00000100:00100000:0.0:1746143664.731123:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.733613:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.747135:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591503488 00000100:00100000:0.0:1746143664.747155:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591503488 00000100:00100000:0.0:1746143664.747180:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3104 00000100:00100000:0.0:1746143664.747186:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:27461:x1830963591503488:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143664.747400:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:27461:x1830963591503488:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 213us (1215us total) trans 8589941878 rc 0/0 00000100:00100000:0.0:1746143664.747405:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3104 00000100:00100000:0.0:1746143664.765767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.765810:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.765839:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.765863:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.765913:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591503744 00000100:00100000:0.0:1746143664.765920:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591503744 00002000:00100000:0.0:1746143664.765955:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8801353be300 x1830963591503744/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:60/0 lens 488/0 e 0 to 0 dl 1746143675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143664.765964:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801353be300 with x1830963591503744 ext(2097152->3145727) 00002000:00010000:0.0:1746143664.765968:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801353be300 00000100:00100000:0.0:1746143664.765981:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591504000 00000100:00100000:0.0:1746143664.765983:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591504000 00002000:00100000:0.0:1746143664.765991:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8801353bea00 x1830963591504000/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:60/0 lens 488/0 e 0 to 0 dl 1746143675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143664.765997:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801353bea00 with x1830963591504000 ext(3145728->4194303) 00002000:00010000:0.0:1746143664.766000:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801353bea00 00000100:00100000:0.0:1746143664.766007:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591504256 00000100:00100000:0.0:1746143664.766009:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591504256 00002000:00100000:0.0:1746143664.766028:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8801353bf800 x1830963591504256/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:60/0 lens 488/0 e 0 to 0 dl 1746143675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143664.766033:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801353bf800 with x1830963591504256 ext(2097152->3145727) 00002000:00010000:0.0:1746143664.766036:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801353bf800 00000100:00100000:0.0:1746143664.766042:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591504512 00000100:00100000:0.0:1746143664.766044:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591504512 00002000:00100000:0.0:1746143664.766052:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8801353bfb80 x1830963591504512/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:60/0 lens 504/0 e 0 to 0 dl 1746143675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143664.766057:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801353bfb80 with x1830963591504512 ext(3145728->4194303) 00002000:00010000:0.0:1746143664.766059:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801353bfb80 00000100:00100000:0.0:1746143664.766068:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2533 00000100:00100000:0.0:1746143664.766074:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801353be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963591503744:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143664.794716:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.794798:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.812055:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.819741:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.819792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.825739:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.829510:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.836868:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.849684:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.851228:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.851626:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.851640:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.851654:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591506560 00000100:00100000:0.0:1746143664.851657:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591506560 00000100:00100000:0.0:1746143664.852278:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7971 00000100:00100000:0.0:1746143664.852285:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801353bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963591506560:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143664.852297:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143664.852308:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800950a9200/0xe984082ccd7212df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209edca expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143664.852345:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091717b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593461248:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143664.852393:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143664.852428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.860523:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.860559:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.860586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.863359:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.876410:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.876495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.884185:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.911678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.929458:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.933369:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591508736 00000100:00100000:0.0:1746143664.933377:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591508736 00002000:00100000:0.0:1746143664.933415:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009b851180 x1830963591508736/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:60/0 lens 488/0 e 0 to 0 dl 1746143675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143664.933425:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b851180 with x1830963591508736 ext(3145728->4194303) 00002000:00010000:0.0:1746143664.933430:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b851180 00000100:00100000:0.0:1746143664.933461:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2543 00000100:00100000:0.0:1746143664.933469:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963591508736:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143664.944068:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963591508480:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14426us (14610us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143664.944078:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2542 00002000:00100000:0.0:1746143664.944086:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880091714a80 x1830963591508480/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:60/0 lens 488/440 e 0 to 0 dl 1746143675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143664.944094:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091714a80 with x1830963591508480 ext(2097152->3145727) 00002000:00010000:0.0:1746143664.944098:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091714a80 00000100:00100000:0.0:1746143664.967345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143664.998673:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.008071:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.008129:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.028768:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.034587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.034619:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.035220:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.044412:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.049592:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.054895:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.058229:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.063126:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.071741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.074482:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.082255:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.087902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.095470:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.109221:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.109273:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.110006:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.116485:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.126159:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.126189:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591513344 00000100:00100000:0.0:1746143665.126195:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591513344 00000100:00100000:0.0:1746143665.126226:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7906 00000100:00100000:0.0:1746143665.126232:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:27480:x1830963591513344:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143665.126248:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143665.126260:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646f800/0xe984082ccd721395 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ee33 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.126417:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646f400/0xe984082ccd72139c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126428:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646f400/0xe984082ccd72139c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126436:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646f400/0xe984082ccd72139c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126448:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646fe00/0xe984082ccd7213a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126461:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646fe00/0xe984082ccd7213a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126467:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646fe00/0xe984082ccd7213a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126557:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7213aa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126579:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7213aa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126585:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7213aa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143665.126594:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143665.126666:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646f400/0xe984082ccd72139c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126673:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646f400/0xe984082ccd72139c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126678:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646f400/0xe984082ccd72139c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126683:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a646f400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143665.126686:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646f400/0xe984082ccd72139c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126692:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646f400/0xe984082ccd72139c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126700:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143665.126703:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143665.126706:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646f400/0xe984082ccd72139c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126711:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646f400/0xe984082ccd72139c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126743:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646fe00/0xe984082ccd7213a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126757:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646fe00/0xe984082ccd7213a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126761:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646fe00/0xe984082ccd7213a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126765:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a646fe00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143665.126767:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646fe00/0xe984082ccd7213a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126771:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646fe00/0xe984082ccd7213a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126778:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093484600) 00010000:00010000:0.0:1746143665.126781:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143665.126783:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646fe00/0xe984082ccd7213a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126787:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646fe00/0xe984082ccd7213a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.126819:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646f800/0xe984082ccd721395 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee33 expref: 250 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.126829:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7213aa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee33 expref: 249 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.126835:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143665.126837:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143665.126839:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c37a00, rc 0) 00000100:00100000:0.0:1746143665.126868:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:27480:x1830963591513344:12345-192.168.202.48@tcp:101:cat.0 Request processed in 635us (709us total) trans 8589941885 rc 0/0 00000100:00100000:0.0:1746143665.126878:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7906 00002000:00010000:0.0:1746143665.129346:0:9527:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime: 1746143661 -> 1746143664 00002000:00010000:0.0:1746143665.129349:0:9527:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143661 -> 1746143664 00002000:00010000:0.0:1746143665.129352:0:9527:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime: 1746143661 -> 1746143664 00000100:00100000:0.0:1746143665.129360:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593463296:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143665.129374:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd721379 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee17 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.129382:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd721379 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee17 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.129389:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095387200, rc 0) 00000100:00100000:0.0:1746143665.129407:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963591512704:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 18079us (19401us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143665.129412:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7979 00000100:00100000:0.0:1746143665.129573:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.139021:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.141692:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.145232:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.145316:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.145338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.145899:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7984 00000100:00100000:0.0:1746143665.145907:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963591513984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143665.145921:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143665.145935:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6c800/0xe984082ccd7213cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ee4f expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143665.145985:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593464192:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143665.146037:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143665.149980:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.150012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.150035:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.150086:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593464192:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143665.150114:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6c800/0xe984082ccd7213cd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee4f expref: 28 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.150125:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6c800/0xe984082ccd7213cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee4f expref: 28 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.150137:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e6c800, rc 0) 00000100:00100000:0.0:1746143665.150184:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963591513984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4278us (4958us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143665.150192:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7984 00000100:00100000:0.0:1746143665.154850:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591514752 00000100:00100000:0.0:1746143665.154857:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591514752 00010000:00010000:0.0:1746143665.154892:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801368d7200/0xe984082ccd72132c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209edfb expref: 20 pid: 25369 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746143665.154921:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3956 00000100:00100000:0.0:1746143665.154928:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963591514752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143665.154938:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143665.154968:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801368d7200/0xe984082ccd72132c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209edfb expref: 20 pid: 25369 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.154978:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801368d7200/0xe984082ccd72132c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209edfb expref: 20 pid: 25369 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.154993:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368d7200/0xe984082ccd72132c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209edfb expref: 20 pid: 25369 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.155005:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.155007:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.155012:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa54800/0xe984082ccd7213b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->1835007) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee3a expref: 14 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.155019:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa54800/0xe984082ccd7213b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->1835007) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee3a expref: 14 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.155042:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa54800/0xe984082ccd7213b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1822720->1835007) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee3a expref: 14 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143665.155050:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593464448:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143665.155129:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143665.155961:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.168342:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.168393:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.176583:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.188923:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.188975:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.201283:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.201343:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.206998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.209646:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e627480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593464576:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143665.209674:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2c00/0xe984082ccd72141a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee6b expref: 12 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.209687:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2c00/0xe984082ccd72141a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee6b expref: 12 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.210316:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e2c00, rc 0) 00000100:00100000:0.0:1746143665.210352:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963591516672:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8866us (9007us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143665.210359:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7987 00000100:00100000:0.0:1746143665.211402:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.220416:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.220473:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.227571:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.227609:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.228700:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2551 00000100:00100000:0.0:1746143665.228708:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963591517440:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143665.253178:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.253230:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.264607:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.264656:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.280862:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.283944:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.285434:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.289839:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.302480:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.304629:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.307020:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.310057:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.313822:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.326525:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.357314:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.357431:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.392554:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.397891:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.398304:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.398334:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.417462:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.417503:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.439837:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.439873:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.443725:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.443768:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.444964:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3963 00000100:00100000:0.0:1746143665.444971:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1962:x1830963591522304:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143665.444978:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143665.444988:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a63de600/0xe984082ccd721188 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ed0d expref: 7 pid: 8497 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746143665.445007:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a63de600/0xe984082ccd721188 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ed0d expref: 7 pid: 8497 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746143665.445018:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a63de600/0xe984082ccd721188 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ed0d expref: 7 pid: 8497 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746143665.445032:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143665.445048:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1962:x1830963591522304:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 79us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.445053:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3963 00000100:00100000:0.0:1746143665.446318:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.454804:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.454844:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.454890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.454932:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591522560 00000100:00100000:0.0:1746143665.454939:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591522560 00010000:00010000:0.0:1746143665.454968:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01e1200/0xe984082ccd7211ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ed3e expref: 14 pid: 4582 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746143665.455007:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3965 00000100:00100000:0.0:1746143665.455014:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963591522560:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143665.455027:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143665.455050:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a01e1200/0xe984082ccd7211ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ed3e expref: 14 pid: 4582 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746143665.455075:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a01e1200/0xe984082ccd7211ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ed3e expref: 14 pid: 4582 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746143665.455094:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01e1200/0xe984082ccd7211ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ed3e expref: 14 pid: 4582 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746143665.455121:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.455123:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.455128:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff800/0xe984082ccd72147c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209eeb1 expref: 31 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.455136:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff800/0xe984082ccd72147c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209eeb1 expref: 31 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.455198:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff800/0xe984082ccd72147c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209eeb1 expref: 31 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143665.455208:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593466752:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143665.455268:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143665.455282:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591522944 00000100:00100000:0.0:1746143665.455284:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591522944 00000100:00100000:0.0:1746143665.455304:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7999 00000100:00100000:0.0:1746143665.455309:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:27480:x1830963591522944:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143665.455316:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143665.455322:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009af09000/0xe984082ccd721498 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209eecd expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.455341:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff800/0xe984082ccd72147c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209eeb1 expref: 33 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.455347:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143665.455348:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143665.455351:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009af09000/0xe984082ccd721498 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209eecd expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.455367:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff800/0xe984082ccd72147c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eeb1 expref: 33 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.455377:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff800/0xe984082ccd72147c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eeb1 expref: 33 pid: 15784 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746143665.455385:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593466880:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143665.455404:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143665.459343:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591523200 00000100:00100000:0.0:1746143665.459349:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591523200 00002000:00100000:0.0:1746143665.459387:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88012f185500 x1830963591523200/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:61/0 lens 488/0 e 0 to 0 dl 1746143676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143665.459396:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185500 with x1830963591523200 ext(1048576->2097151) 00002000:00010000:0.0:1746143665.459401:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185500 00000100:00100000:0.0:1746143665.460228:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2558 00000100:00100000:0.0:1746143665.460235:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963591523200:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143665.468709:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593467136:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143665.468742:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0b800/0xe984082ccd72149f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.469066:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0b800/0xe984082ccd72149f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.469071:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0b800/0xe984082ccd72149f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143665.469086:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143665.469215:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0a600/0xe984082ccd721491 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209eec6 expref: 15 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.470413:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0b800/0xe984082ccd72149f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209eec6 expref: 14 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.470420:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143665.470423:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143665.470425:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0b800, rc 0) 00000100:00100000:0.0:1746143665.471176:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+14:27489:x1830963591522816:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 15937us (16378us total) trans 8589941891 rc 0/0 00000100:00100000:0.0:1746143665.471183:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7911 00000100:00100000:0.0:1746143665.477471:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.477515:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.477557:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591523968 00000100:00100000:0.0:1746143665.477565:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591523968 00002000:00100000:0.0:1746143665.477599:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->2203647) req@ffff8800a63a2d80 x1830963591523968/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:61/0 lens 488/0 e 0 to 0 dl 1746143676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143665.477608:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2d80 with x1830963591523968 ext(2097152->2203647) 00010000:00010000:0.0:1746143665.477623:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff800/0xe984082ccd72147c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eeb1 expref: 32 pid: 15784 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.477636:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff800/0xe984082ccd72147c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eeb1 expref: 32 pid: 15784 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746143665.477642:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a63a2d80 00000100:00100000:0.0:1746143665.477660:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 601 00000100:00100000:0.0:1746143665.477666:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963591523968:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143665.500245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.504097:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.512779:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.524823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.524865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.525300:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963591524736:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11968us (12520us total) trans 0 rc 704512/704512 00000100:00100000:0.0:1746143665.525309:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2559 00002000:00100000:0.0:1746143665.525319:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a63a2300 x1830963591524736/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:61/0 lens 488/440 e 0 to 0 dl 1746143676 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143665.525328:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2300 with x1830963591524736 ext(4194304->4898815) 00002000:00010000:0.0:1746143665.525332:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a2300 00000100:00100000:0.0:1746143665.525353:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591524992 00000100:00100000:0.0:1746143665.525359:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591524992 00002000:00100000:0.0:1746143665.525385:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800930c3b80 x1830963591524992/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:61/0 lens 488/0 e 0 to 0 dl 1746143676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143665.525391:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c3b80 with x1830963591524992 ext(2097152->3145727) 00002000:00010000:0.0:1746143665.525399:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c3b80 00000100:00100000:0.0:1746143665.525417:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591525120 00000100:00100000:0.0:1746143665.525420:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591525120 00002000:00100000:0.0:1746143665.525433:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88013691b480 x1830963591525120/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:61/0 lens 488/0 e 0 to 0 dl 1746143676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143665.525438:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691b480 with x1830963591525120 ext(3145728->4194303) 00002000:00010000:0.0:1746143665.525440:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013691b480 00000100:00100000:0.0:1746143665.525451:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2560 00000100:00100000:0.0:1746143665.525457:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963591524992:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143665.540816:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.554215:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.554760:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.560404:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.565239:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.571689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.577922:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.594228:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.594286:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.598591:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.602795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.602834:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.603272:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3972 00000100:00100000:0.0:1746143665.603279:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963591527296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143665.603287:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143665.603303:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009af09000/0xe984082ccd721498 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eecd expref: 33 pid: 25369 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.603322:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009af09000/0xe984082ccd721498 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eecd expref: 33 pid: 25369 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.603729:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009af09000/0xe984082ccd721498 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eecd expref: 33 pid: 25369 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.603742:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143665.603758:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963591527296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 481us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.603763:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3972 00000100:00100000:0.0:1746143665.604898:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.606960:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.606993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.607023:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.607037:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.607078:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.607099:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591528064 00000100:00100000:0.0:1746143665.607110:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591528064 00000100:00100000:0.0:1746143665.607131:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8005 00000100:00100000:0.0:1746143665.607137:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591527680:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143665.607167:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143665.607176:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0188a00/0xe984082ccd7214ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209eefe expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.607187:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.607189:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.607203:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0188a00/0xe984082ccd7214ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209eefe expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.607212:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0188a00/0xe984082ccd7214ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209eefe expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.607218:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0188a00, rc 0) 00000100:00100000:0.0:1746143665.607240:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963591527680:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 103us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.607248:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8005 00000100:00100000:0.0:1746143665.614006:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.619970:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.620033:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.625412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.629112:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591529216 00000100:00100000:0.0:1746143665.629117:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591529216 00010000:00010000:0.0:1746143665.629161:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72150f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef1a expref: 12 pid: 20509 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746143665.629187:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3975 00000100:00100000:0.0:1746143665.629194:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963591529216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143665.629206:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143665.629211:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72150f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef1a expref: 12 pid: 20509 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.629220:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72150f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef1a expref: 12 pid: 20509 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.629250:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72150f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef1a expref: 12 pid: 20509 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.629271:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143665.629275:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652ac00/0xe984082ccd721524 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.629283:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652ac00/0xe984082ccd721524 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.629288:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652ac00/0xe984082ccd721524 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.629753:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143665.629799:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963591529216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 603us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.629805:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3975 00000100:00100000:0.0:1746143665.633637:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.633688:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.638939:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.642094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.642812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.642866:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.642880:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.642892:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.642912:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.644125:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8016 00000100:00100000:0.0:1746143665.644132:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591530496:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143665.644174:0:8496:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0189600/0xe984082ccd721571 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.644183:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0600/0xe984082ccd7212fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ede6 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.644188:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009074d000/0xe984082ccd7213db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee56 expref: 20 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.644194:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368a7c00/0xe984082ccd72138e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee2c expref: 11 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.644198:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.644199:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.644201:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0189600/0xe984082ccd721571 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.644215:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801368a7c00/0xe984082ccd72138e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee2c expref: 11 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.644221:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801368a7c00/0xe984082ccd72138e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ee2c expref: 11 pid: 15784 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746143665.644228:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593469952:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143665.646916:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e626300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593469184:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143665.648044:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.648075:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591530624 00000100:00100000:0.0:1746143665.648080:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591530624 00010000:00010000:0.0:1746143665.648120:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd721483 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eeb8 expref: 32 pid: 25369 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746143665.648163:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3976 00000100:00100000:0.0:1746143665.648170:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963591530624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143665.648181:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143665.648199:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd721483 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eeb8 expref: 32 pid: 25369 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746143665.648207:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd721483 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eeb8 expref: 32 pid: 25369 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746143665.648223:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd721483 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eeb8 expref: 32 pid: 25369 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746143665.648238:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143665.648268:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963591530624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 98us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.648273:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3976 00000100:00100000:0.0:1746143665.651936:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.652386:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.652953:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.658888:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591530880 00000100:00100000:0.0:1746143665.658893:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591530880 00002000:00100000:0.0:1746143665.658921:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->2457599) req@ffff88008e624a80 x1830963591530880/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:61/0 lens 488/0 e 0 to 0 dl 1746143676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143665.658942:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624a80 with x1830963591530880 ext(2097152->2457599) 00010000:00010000:0.0:1746143665.658949:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800952efe00/0xe984082ccd7214c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eee9 expref: 13 pid: 25369 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.658957:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800952efe00/0xe984082ccd7214c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eee9 expref: 13 pid: 25369 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746143665.658963:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e624a80 00000100:00100000:0.0:1746143665.658974:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591531008 00000100:00100000:0.0:1746143665.658976:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591531008 00002000:00100000:0.0:1746143665.658987:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34e:0x0] (1998848->2097151) req@ffff88008e624e00 x1830963591531008/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:61/0 lens 488/0 e 0 to 0 dl 1746143676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143665.658993:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624e00 with x1830963591531008 ext(1998848->2097151) 00010000:00010000:0.0:1746143665.658997:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a938200/0xe984082ccd7214bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eee2 expref: 14 pid: 25369 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.659004:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a938200/0xe984082ccd7214bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eee2 expref: 14 pid: 25369 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746143665.659009:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e624e00 00000100:00100000:0.0:1746143665.659019:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 602 00000100:00100000:0.0:1746143665.659023:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963591530880:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143665.659375:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 603 00000100:00100000:0.0:1746143665.659380:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963591531008:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143665.667341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.668832:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143665.670872:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801353b8000/0xe984082ccd721563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.670880:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801353b8000/0xe984082ccd721563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.670897:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801353b8000/0xe984082ccd721563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.670904:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801353b8000/0xe984082ccd721563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.670909:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801353b8000/0xe984082ccd721563 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.670915:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801353b8000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143665.670918:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801353b8000/0xe984082ccd721563 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.670925:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801353b8000/0xe984082ccd721563 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.670935:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801353b8000/0xe984082ccd721563 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.670955:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801353b8000/0xe984082ccd721563 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143665.671538:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1965:x1830963591530368:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 28111us (28656us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.671545:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8014 00000100:00100000:0.0:1746143665.673931:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.681601:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3991 00000100:00100000:0.0:1746143665.681611:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e625500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1964:x1830963591533056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143665.681620:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143665.681625:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800930c4000/0xe984082ccd7212b5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eda0 expref: 252 pid: 14762 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.681646:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800930c4000/0xe984082ccd7212b5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209eda0 expref: 252 pid: 14762 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.682009:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143665.682015:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd721578 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.682024:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143665.682202:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e625500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:1964:x1830963591533056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 593us (2444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.682209:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3991 00010000:00010000:0.0:1746143665.683178:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd721578 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143665.683194:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd721578 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000040:00080000:0.0:1746143665.683872:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2085, 88 off174408 00000004:00080000:0.0:1746143665.683882:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744693741319ns, next at 718104255928ns, rc = 0 00000040:00080000:0.0:1746143665.683918:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2055, 88 off171584 00000004:00080000:0.0:1746143665.683922:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744693782762ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143665.683933:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2056, 88 off171672 00000004:00080000:0.0:1746143665.683936:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744693796294ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143665.683943:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2086, 88 off174496 00000004:00080000:0.0:1746143665.683945:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744693805434ns, next at 718104255928ns, rc = 0 00000040:00080000:0.0:1746143665.683951:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2087, 88 off174584 00000004:00080000:0.0:1746143665.683953:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744693813544ns, next at 718104255928ns, rc = 0 00000040:00080000:0.0:1746143665.683959:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2057, 88 off171760 00000004:00080000:0.0:1746143665.683962:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744693821944ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143665.683968:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2058, 88 off171848 00000004:00080000:0.0:1746143665.683970:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744693830697ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143665.683976:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2059, 88 off171936 00000004:00080000:0.0:1746143665.683979:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744693838942ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143665.683985:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2088, 88 off174672 00000004:00080000:0.0:1746143665.683987:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744693847907ns, next at 718104255928ns, rc = 0 00000040:00080000:0.0:1746143665.684015:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2061, 88 off172120 00000004:00080000:0.0:1746143665.684018:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744693878152ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143665.684025:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2089, 88 off174760 00000004:00080000:0.0:1746143665.684027:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744693887452ns, next at 718104255928ns, rc = 0 00000040:00080000:0.0:1746143665.684033:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2062, 88 off172208 00000004:00080000:0.0:1746143665.684039:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744693899694ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143665.684048:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2090, 88 off174848 00000004:00080000:0.0:1746143665.684050:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744693910444ns, next at 718104255928ns, rc = 0 00000040:00080000:0.0:1746143665.684056:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2091, 88 off174936 00000004:00080000:0.0:1746143665.684058:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744693918102ns, next at 718104255928ns, rc = 0 00000040:00080000:0.0:1746143665.684064:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2092, 88 off175024 00000004:00080000:0.0:1746143665.684066:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744693926339ns, next at 718104255928ns, rc = 0 00000040:00080000:0.0:1746143665.684072:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2093, 88 off175112 00000004:00080000:0.0:1746143665.684074:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 744693934227ns, next at 718104255928ns, rc = 0 00000040:00080000:0.0:1746143665.684080:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2063, 88 off172296 00000004:00080000:0.0:1746143665.684082:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 744693942449ns, next at 718087967394ns, rc = 0 00000100:00100000:0.0:1746143665.720498:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591533568 00000100:00100000:0.0:1746143665.720507:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591533568 00000100:00100000:0.0:1746143665.720564:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7917 00000100:00100000:0.0:1746143665.720591:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:27498:x1830963591533568:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143665.720615:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143665.720635:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189600/0xe984082ccd72157f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ef3d expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.720743:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0188c00/0xe984082ccd721586 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.720756:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0188c00/0xe984082ccd721586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.720766:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0188c00/0xe984082ccd721586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.720776:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189800/0xe984082ccd72158d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.720789:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189800/0xe984082ccd72158d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.720794:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189800/0xe984082ccd72158d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00010000:0.0:1746143665.721923:0:21713:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008f0aea00 reply state ffff88009bd12c00 transno 8589941898 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd721578 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143665.721934:0:21713:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746143665.722024:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:27492:x1830963591532800:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 47796us (48098us total) trans 8589941898 rc 0/0 00000100:00100000:0.0:1746143665.722033:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7916 00000001:00080000:0.0:1746143665.722653:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941898 is committed 00000004:00080000:0.0:1746143665.722661:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1410 committed 00000004:00080000:0.0:1746143665.722668:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1439 committed 00000004:00080000:0.0:1746143665.723301:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1438 committed 00000004:00080000:0.0:1746143665.723303:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1437 committed 00000004:00080000:0.0:1746143665.723304:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1436 committed 00000004:00080000:0.0:1746143665.723305:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1409 committed 00000004:00080000:0.0:1746143665.723307:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1435 committed 00000004:00080000:0.0:1746143665.723308:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1408 committed 00000004:00080000:0.0:1746143665.723309:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1434 committed 00000004:00080000:0.0:1746143665.723310:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1407 committed 00000004:00080000:0.0:1746143665.723312:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1406 committed 00000004:00080000:0.0:1746143665.723313:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1405 committed 00000004:00080000:0.0:1746143665.723314:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1433 committed 00000004:00080000:0.0:1746143665.723315:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1432 committed 00000004:00080000:0.0:1746143665.723316:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1404 committed 00000004:00080000:0.0:1746143665.723317:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1403 committed 00000004:00080000:0.0:1746143665.723326:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1431 committed 00000001:00080000:0.0:1746143665.723335:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941891 is committed 00000001:00080000:0.0:1746143665.723341:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941885 is committed 00000001:00080000:0.0:1746143665.723349:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941894 is committed 00000001:00080000:0.0:1746143665.723354:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941892 is committed 00000001:00080000:0.0:1746143665.723371:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941895 is committed 00000001:00080000:0.0:1746143665.723386:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941893 is committed 00000100:00100000:0.0:1746143665.729769:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.729850:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143665.732318:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042800/0xe984082ccd721594 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732325:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042800/0xe984082ccd721594 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143665.732343:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143665.732495:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042800/0xe984082ccd721594 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732502:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042800/0xe984082ccd721594 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732507:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042800/0xe984082ccd721594 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732513:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0042800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143665.732517:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042800/0xe984082ccd721594 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732523:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042800/0xe984082ccd721594 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732531:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143665.732543:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143665.732547:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042800/0xe984082ccd721594 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732551:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042800/0xe984082ccd721594 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732565:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0188c00/0xe984082ccd721586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732570:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0188c00/0xe984082ccd721586 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732575:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0188c00/0xe984082ccd721586 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732579:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0188c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143665.732582:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0188c00/0xe984082ccd721586 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732586:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0188c00/0xe984082ccd721586 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732592:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143665.732594:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143665.732597:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0188c00/0xe984082ccd721586 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732601:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0188c00/0xe984082ccd721586 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732610:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189800/0xe984082ccd72158d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732615:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189800/0xe984082ccd72158d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732623:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189800/0xe984082ccd72158d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732627:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0189800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143665.732629:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189800/0xe984082ccd72158d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732634:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189800/0xe984082ccd72158d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732639:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9dd00) 00010000:00010000:0.0:1746143665.732641:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143665.732642:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189800/0xe984082ccd72158d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732647:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189800/0xe984082ccd72158d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.732684:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189600/0xe984082ccd72157f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef3d expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.732689:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189600/0xe984082ccd72157f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef3d expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.732696:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0189600, rc 0) 00000100:00100000:0.0:1746143665.735304:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:27498:x1830963591533568:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 14719us (14968us total) trans 8589941899 rc 301/301 00000100:00100000:0.0:1746143665.735315:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7917 00000100:00100000:0.0:1746143665.739810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.787313:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.792819:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.792854:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.792874:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.792887:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.792898:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.792934:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.792958:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591534848 00000100:00100000:0.0:1746143665.792967:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591534848 00000100:00100000:0.0:1746143665.793007:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591535104 00000100:00100000:0.0:1746143665.793008:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591535104 00000100:00100000:0.0:1746143665.793020:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591535360 00000100:00100000:0.0:1746143665.793021:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591535360 00000100:00100000:0.0:1746143665.793029:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591534720 00000100:00100000:0.0:1746143665.793031:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591534720 00000100:00100000:0.0:1746143665.793038:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591534976 00000100:00100000:0.0:1746143665.793040:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591534976 00000100:00100000:0.0:1746143665.793047:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591535232 00000100:00100000:0.0:1746143665.793048:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591535232 00000100:00100000:0.0:1746143665.793059:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8034 00000100:00100000:0.0:1746143665.793066:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963591534848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143665.793084:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143665.793110:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0188e00/0xe984082ccd7215cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ef59 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143665.793134:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34a:0x0] initial LVB size: 2097152, mtime: 0x681409b0, atime: 0x681409b0, ctime: 0x681409b0, blocks: 0x821 00010000:00010000:0.0:1746143665.793170:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.793172:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.793180:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0188e00/0xe984082ccd7215cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef59 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.793207:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0188e00/0xe984082ccd7215cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef59 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.793217:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0188e00, rc 0) 00000100:00100000:0.0:1746143665.793258:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963591534848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 192us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.793263:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8034 00000100:00100000:0.0:1746143665.793280:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8035 00000100:00100000:0.0:1746143665.793284:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963591535104:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143665.793290:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143665.793300:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd7215d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ef67 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143665.793313:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409b1, atime: 0x681409b0, ctime: 0x681409b1, blocks: 0x81f 00010000:00010000:0.0:1746143665.793320:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.793321:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.793324:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd7215d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef67 expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.793333:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd7215d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef67 expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.793339:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef3fa00, rc 0) 00000100:00100000:0.0:1746143665.793350:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963591535104:12345-192.168.202.48@tcp:101:cat.0 Request processed in 66us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.793362:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8035 00000100:00100000:0.0:1746143665.793370:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8036 00000100:00100000:0.0:1746143665.793374:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963591535360:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143665.793379:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143665.793385:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801353bbc00/0xe984082ccd7215da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ef75 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143665.793395:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409b0, atime: 0x681409b0, ctime: 0x681409b0, blocks: 0x1029 00010000:00010000:0.0:1746143665.793401:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.793402:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.793405:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801353bbc00/0xe984082ccd7215da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef75 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.793413:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801353bbc00/0xe984082ccd7215da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef75 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.793420:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801353bbc00, rc 0) 00000100:00100000:0.0:1746143665.793431:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963591535360:12345-192.168.202.48@tcp:101:cat.0 Request processed in 57us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.793436:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8036 00000100:00100000:0.0:1746143665.793443:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8037 00000100:00100000:0.0:1746143665.793447:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963591534720:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143665.793452:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143665.793458:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0189600/0xe984082ccd7215e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ef52 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143665.793474:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409b0, atime: 0x681409b0, ctime: 0x681409b0, blocks: 0x7f5 00010000:00010000:0.0:1746143665.793480:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.793481:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.793485:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0189600/0xe984082ccd7215e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef52 expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.793493:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0189600/0xe984082ccd7215e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef52 expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.793499:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0189600, rc 0) 00000100:00100000:0.0:1746143665.793511:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963591534720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 64us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.793515:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8037 00000100:00100000:0.0:1746143665.793524:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8039 00000100:00100000:0.0:1746143665.793528:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963591535232:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143665.793533:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143665.793540:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0189800/0xe984082ccd7215ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ef6e expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143665.793550:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 4897312, mtime: 0x681409b1, atime: 0x681409ae, ctime: 0x681409b1, blocks: 0x15a7 00010000:00010000:0.0:1746143665.793557:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.793558:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.793562:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0189800/0xe984082ccd7215ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef6e expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.793569:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0189800/0xe984082ccd7215ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef6e expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.793581:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0189800, rc 0) 00000100:00100000:0.0:1746143665.793597:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963591535232:12345-192.168.202.48@tcp:101:cat.0 Request processed in 69us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.793601:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8039 00000100:00100000:0.0:1746143665.831018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.831075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.831114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.831132:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.831196:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.832571:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591536128 00000100:00100000:0.0:1746143665.832575:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591536128 00002000:00100000:0.0:1746143665.832595:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8801305c8e00 x1830963591536128/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:61/0 lens 488/0 e 0 to 0 dl 1746143676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143665.832604:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8e00 with x1830963591536128 ext(1048576->2097151) 00002000:00010000:0.0:1746143665.832608:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8e00 00000100:00100000:0.0:1746143665.832620:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591536384 00000100:00100000:0.0:1746143665.832622:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591536384 00002000:00100000:0.0:1746143665.832635:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009445b800 x1830963591536384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:61/0 lens 488/0 e 0 to 0 dl 1746143676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143665.832641:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445b800 with x1830963591536384 ext(1048576->2097151) 00002000:00010000:0.0:1746143665.832644:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009445b800 00000100:00100000:0.0:1746143665.832655:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2565 00000100:00100000:0.0:1746143665.832662:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963591535616:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143665.834078:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2566 00000100:00100000:0.0:1746143665.834110:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963591536128:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143665.854132:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.861929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.861981:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.862008:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.862023:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.862034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.862469:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.862490:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.862811:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591537664 00000100:00100000:0.0:1746143665.862815:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591537664 00000100:00100000:0.0:1746143665.862831:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8041 00000100:00100000:0.0:1746143665.862837:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963591537280:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143665.862845:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143665.862855:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c9fe00/0xe984082ccd72163c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ef98 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.862867:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.862868:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.862875:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c9fe00/0xe984082ccd72163c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef98 expref: 19 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.862887:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131c9fe00/0xe984082ccd72163c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef98 expref: 19 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.862895:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c9fe00, rc 0) 00000100:00100000:0.0:1746143665.863897:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963591537280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1056us (1884us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.863922:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8041 00000100:00100000:0.0:1746143665.863939:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8045 00000100:00100000:0.0:1746143665.863943:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963591537664:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143665.863954:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143665.863962:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c9f400/0xe984082ccd721658 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209efad expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.863974:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.863976:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.863981:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c9f400/0xe984082ccd721658 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efad expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.863989:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131c9f400/0xe984082ccd721658 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efad expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143665.863996:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c9f400, rc 0) 00000100:00100000:0.0:1746143665.864012:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963591537664:12345-192.168.202.48@tcp:101:cat.0 Request processed in 69us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.864017:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8045 00000100:00100000:0.0:1746143665.873131:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.875405:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591538048 00000100:00100000:0.0:1746143665.875411:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591538048 00010000:00010000:0.0:1746143665.875436:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0043600/0xe984082ccd72160b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef7c expref: 10 pid: 14762 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746143665.875466:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3996 00000100:00100000:0.0:1746143665.875471:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963591538048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143665.875489:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143665.875493:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0043600/0xe984082ccd72160b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef7c expref: 10 pid: 14762 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.875502:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0043600/0xe984082ccd72160b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef7c expref: 10 pid: 14762 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.875518:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0043600/0xe984082ccd72160b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef7c expref: 10 pid: 14762 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746143665.875533:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143665.875537:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9a00/0xe984082ccd72162e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143665.875545:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9a00/0xe984082ccd72162e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143665.875551:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9a00/0xe984082ccd72162e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143665.875557:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042600/0xe984082ccd721620 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.875562:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042600/0xe984082ccd721620 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.875566:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042600/0xe984082ccd721620 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.875671:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143665.875695:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963591538048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 224us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.875794:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3996 00010000:00010000:0.0:1746143665.875832:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9a00/0xe984082ccd72162e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143665.875838:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9a00/0xe984082ccd72162e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:0.0:1746143665.875857:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143665.875989:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd721627 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efb4 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.876002:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9a00/0xe984082ccd72162e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efb4 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.876008:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143665.876010:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143665.876012:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d9a00, rc 0) 00000100:00100000:0.0:1746143665.876035:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:27507:x1830963591537920:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 13813us (14053us total) trans 8589941904 rc 0/0 00000100:00100000:0.0:1746143665.876040:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7922 00000100:00100000:0.0:1746143665.888821:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591538432 00000100:00100000:0.0:1746143665.888829:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591538432 00002000:00100000:0.0:1746143665.888876:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009a5aca80 x1830963591538432/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:61/0 lens 488/0 e 0 to 0 dl 1746143676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143665.888886:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5aca80 with x1830963591538432 ext(0->1048575) 00002000:00010000:0.0:1746143665.888892:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a5aca80 00000100:00100000:0.0:1746143665.888921:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591539072 00000100:00100000:0.0:1746143665.888923:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591539072 00002000:00100000:0.0:1746143665.894453:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009a5aed80 x1830963591539072/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:61/0 lens 488/0 e 0 to 0 dl 1746143676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143665.894463:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5aed80 with x1830963591539072 ext(1048576->2097151) 00002000:00010000:0.0:1746143665.894469:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a5aed80 00000100:00100000:0.0:1746143665.894496:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2571 00000100:00100000:0.0:1746143665.894503:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963591539072:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143665.896671:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.896693:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591539328 00000100:00100000:0.0:1746143665.896699:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591539328 00000100:00100000:0.0:1746143665.896741:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7923 00000100:00100000:0.0:1746143665.896747:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:27502:x1830963591539328:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143665.896765:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143665.896784:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c9e400/0xe984082ccd721666 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209efbb expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.896840:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042600/0xe984082ccd721620 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.896847:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c9e400/0xe984082ccd721666 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efbb expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.896864:0:14762:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0042600/0xe984082ccd721620 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143665.896876:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c9e400/0xe984082ccd721666 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efbb expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.896888:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143665.896896:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143665.896900:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c9e400/0xe984082ccd721666 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efbb expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.896907:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c9e400, rc 0) 00000100:00100000:0.0:1746143665.896936:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:27502:x1830963591539328:12345-192.168.202.48@tcp:101:cat.0 Request processed in 190us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143665.896942:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7923 00000100:00100000:0.0:1746143665.917422:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963591538432:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27488us (28684us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143665.917432:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2569 00002000:00100000:0.0:1746143665.917443:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009a5aca80 x1830963591538432/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:61/0 lens 488/440 e 0 to 0 dl 1746143676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143665.917451:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5aca80 with x1830963591538432 ext(0->1048575) 00002000:00010000:0.0:1746143665.917456:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a5aca80 00000100:00100000:0.0:1746143665.931835:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963591538688:12345-192.168.202.48@tcp:3:cat.0 Request processed in 37694us (43065us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143665.931846:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2570 00002000:00100000:0.0:1746143665.931857:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88009a5ad180 x1830963591538688/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:61/0 lens 488/440 e 0 to 0 dl 1746143676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143665.931865:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5ad180 with x1830963591538688 ext(1048576->2097151) 00002000:00010000:0.0:1746143665.931870:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a5ad180 00000001:00080000:0.0:1746143665.958069:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941904 is committed 00000001:00080000:0.0:1746143665.958079:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941899 is committed 00000001:00080000:0.0:1746143665.958084:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941901 is committed 00000001:00080000:0.0:1746143665.958093:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941905 is committed 00000004:00080000:0.0:1746143665.958118:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1418 committed 00000004:00080000:0.0:1746143665.958124:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1448 committed 00000004:00080000:0.0:1746143665.958152:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1447 committed 00000004:00080000:0.0:1746143665.958154:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1446 committed 00000004:00080000:0.0:1746143665.958155:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1445 committed 00000004:00080000:0.0:1746143665.958157:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1417 committed 00000004:00080000:0.0:1746143665.958159:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1444 committed 00000004:00080000:0.0:1746143665.958160:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1416 committed 00000004:00080000:0.0:1746143665.958161:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1443 committed 00000004:00080000:0.0:1746143665.958168:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1415 committed 00000004:00080000:0.0:1746143665.958169:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1414 committed 00000004:00080000:0.0:1746143665.958170:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1413 committed 00000004:00080000:0.0:1746143665.958172:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1442 committed 00000004:00080000:0.0:1746143665.958173:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1441 committed 00000004:00080000:0.0:1746143665.958175:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1412 committed 00000004:00080000:0.0:1746143665.958176:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1411 committed 00000004:00080000:0.0:1746143665.958177:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1440 committed 00000100:00100000:0.0:1746143665.958270:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593474176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143665.958817:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143665.958836:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593474688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143665.958848:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143665.958861:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593475328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143665.958871:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143665.958879:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593475840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143665.958888:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143665.958897:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143665.958901:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593475456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143665.958910:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143665.958925:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593475968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143665.958936:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143665.960070:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e0e00/2, rc 0, transno 17179872159 00000100:00100000:0.0:1746143665.960078:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593475456:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143665.960084:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e0a80/2, rc 0, transno 17179872158 00000100:00100000:0.0:1746143665.960087:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593475968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143665.960092:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e2680/2, rc 0, transno 17179872156 00000100:00100000:0.0:1746143665.960094:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593475328:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143665.960238:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e0700/2, rc 0, transno 17179872157 00000100:00100000:0.0:1746143665.960241:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593475840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143665.960248:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094459880/2, rc 0, transno 21474839449 00000100:00100000:0.0:1746143665.960250:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593474176:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143665.960255:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d3b80/2, rc 0, transno 21474839445 00000100:00100000:0.0:1746143665.960257:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593474688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143665.960267:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593475584 00000100:00100000:0.0:1746143665.960268:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593475584 00000100:00100000:0.0:1746143665.960744:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8062 00000100:00100000:0.0:1746143665.960749:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3292:x1830963593475584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143665.960813:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143665.960815:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143665.960817:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143665.960818:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143665.960820:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143665.960841:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:3292:x1830963593475584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (678us total) trans 17179872163 rc 0/0 00000100:00100000:0.0:1746143665.960852:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8062 00000100:00100000:0.0:1746143665.962956:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.970981:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.984995:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.985050:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143665.991752:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591540352 00000100:00100000:0.0:1746143665.991756:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591540352 00010000:00010000:0.0:1746143665.991771:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd7215d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef67 expref: 35 pid: 25369 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746143665.991825:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3998 00000100:00100000:0.0:1746143665.991835:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963591540352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143665.991842:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143665.991852:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd7215d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef67 expref: 35 pid: 25369 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746143665.991860:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd7215d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef67 expref: 35 pid: 25369 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746143665.992080:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd7215d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef67 expref: 35 pid: 25369 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746143665.992094:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.992096:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143665.992792:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fafba00/0xe984082ccd721674 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efc9 expref: 34 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.993091:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fafba00/0xe984082ccd721674 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efc9 expref: 34 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143665.993127:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fafba00/0xe984082ccd721674 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efc9 expref: 34 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143665.993137:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593476736:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143665.993219:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f32b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143666.004430:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.004467:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.004556:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593476736:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143666.004572:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.004618:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963591540352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12782us (13265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.004626:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3998 00000100:00100000:0.0:1746143666.011476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.023557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.023600:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.027884:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.029358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143666.030671:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143666.033800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.043022:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.046446:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.047350:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591542656 00000100:00100000:0.0:1746143666.047362:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591542656 00000100:00100000:0.0:1746143666.047872:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3119 00000100:00100000:0.0:1746143666.047880:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6309850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:27498:x1830963591542656:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143666.048175:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6309850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:27498:x1830963591542656:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 295us (914us total) trans 8589941906 rc 0/0 00000100:00100000:0.0:1746143666.048183:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3119 00000100:00100000:0.0:1746143666.053070:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.077482:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.084291:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.085315:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.085347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.085363:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591543424 00000100:00100000:0.0:1746143666.085366:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591543424 00000100:00100000:0.0:1746143666.086114:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591543680 00000100:00100000:0.0:1746143666.086117:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591543680 00000100:00100000:0.0:1746143666.086136:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591543936 00000100:00100000:0.0:1746143666.086155:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591543936 00000100:00100000:0.0:1746143666.086167:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8066 00000100:00100000:0.0:1746143666.086172:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963591543424:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143666.086183:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143666.086194:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5549000/0xe984082ccd7216a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209efec expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.086206:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.086207:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.086212:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5549000/0xe984082ccd7216a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efec expref: 8 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.086239:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5549000/0xe984082ccd7216a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efec expref: 8 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.086246:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5549000, rc 0) 00000100:00100000:0.0:1746143666.086267:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591543424:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 95us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.086272:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8066 00000100:00100000:0.0:1746143666.086286:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8067 00000100:00100000:0.0:1746143666.086291:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1964:x1830963591543680:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143666.086297:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143666.086303:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5548400/0xe984082ccd7216ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209effa expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.086312:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.086313:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.086316:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5548400/0xe984082ccd7216ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209effa expref: 7 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.086324:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5548400/0xe984082ccd7216ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209effa expref: 7 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.086329:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5548400, rc 0) 00000100:00100000:0.0:1746143666.086341:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963591543680:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 51us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.086346:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8067 00000100:00100000:0.0:1746143666.086361:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8068 00000100:00100000:0.0:1746143666.086365:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963591543936:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143666.086370:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143666.086376:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd7216b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f008 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.086384:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.086385:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.086389:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd7216b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f008 expref: 8 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.086396:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd7216b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f008 expref: 8 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.086402:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5548200, rc 0) 00000100:00100000:0.0:1746143666.086415:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591543936:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 49us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.086419:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8068 00000100:00100000:0.0:1746143666.088530:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.088555:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.088585:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.088942:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2580 00000100:00100000:0.0:1746143666.088949:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963591544320:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143666.104988:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.105050:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.106605:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963591544320:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17653us (18072us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143666.106625:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2580 00002000:00100000:0.0:1746143666.106635:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800930d1500 x1830963591544320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:62/0 lens 488/440 e 0 to 0 dl 1746143677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143666.106643:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1500 with x1830963591544320 ext(2097152->3145727) 00002000:00010000:0.0:1746143666.106648:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1500 00000100:00100000:0.0:1746143666.121828:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.127685:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.129302:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.134407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.134448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.134517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.142073:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.150838:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.156581:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.156626:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.156666:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.167125:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.167224:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.167248:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591547776 00000100:00100000:0.0:1746143666.167256:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591547776 00000100:00100000:0.0:1746143666.167301:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3120 00000100:00100000:0.0:1746143666.167309:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:27508:x1830963591547776:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1746143666.168497:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:27508:x1830963591547776:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 1188us (1272us total) trans 8589941908 rc 0/0 00000100:00100000:0.0:1746143666.168505:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3120 00000100:00100000:0.0:1746143666.168540:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4006 00000100:00100000:0.0:1746143666.168546:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963591547904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.168553:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.168654:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0188e00/0xe984082ccd7215cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef59 expref: 21 pid: 25369 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.168664:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0188e00/0xe984082ccd7215cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef59 expref: 21 pid: 25369 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.168678:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0188e00/0xe984082ccd7215cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef59 expref: 21 pid: 25369 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.168694:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.168711:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963591547904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 165us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.168716:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4006 00000100:00100000:0.0:1746143666.171156:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.176801:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.201279:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.201314:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.201343:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.201359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.201671:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.202313:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2587 00000100:00100000:0.0:1746143666.202323:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963591549184:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143666.202639:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2590 00000100:00100000:0.0:1746143666.202652:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963591549568:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143666.205745:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.205778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.210174:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.210212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.210234:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591550592 00000100:00100000:0.0:1746143666.210242:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591550592 00000100:00100000:0.0:1746143666.210286:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3121 00000100:00100000:0.0:1746143666.210293:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:27502:x1830963591550592:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1746143666.210567:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:27502:x1830963591550592:12345-192.168.202.48@tcp:35:cat.0 Request processed in 271us (352us total) trans 8589941909 rc 0/0 00000100:00100000:0.0:1746143666.210574:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3121 00000100:00100000:0.0:1746143666.237776:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.237816:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591550848 00000100:00100000:0.0:1746143666.237831:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591550848 00002000:00100000:0.0:1746143666.237878:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1318912->1323007) req@ffff88009bef7100 x1830963591550848/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:62/0 lens 488/0 e 0 to 0 dl 1746143677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143666.237888:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef7100 with x1830963591550848 ext(1318912->1323007) 00002000:00010000:0.0:1746143666.237892:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bef7100 00000100:00100000:0.0:1746143666.237923:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2592 00000100:00100000:0.0:1746143666.237931:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591550848:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143666.238118:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591550848:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 187us (351us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143666.238125:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2592 00002000:00100000:0.0:1746143666.238131:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1318912->1323007) req@ffff88009bef7100 x1830963591550848/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746143677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143666.238167:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef7100 with x1830963591550848 ext(1318912->1323007) 00002000:00010000:0.0:1746143666.238170:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bef7100 00000100:00100000:0.0:1746143666.249545:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.264609:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.289535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.290470:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.303856:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.310783:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.330093:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.330177:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.330211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.330236:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591552256 00000100:00100000:0.0:1746143666.330245:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591552256 00000100:00100000:0.0:1746143666.330284:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591552384 00000100:00100000:0.0:1746143666.330286:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591552384 00000100:00100000:0.0:1746143666.330295:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591552512 00000100:00100000:0.0:1746143666.330297:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591552512 00000100:00100000:0.0:1746143666.330312:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8081 00000100:00100000:0.0:1746143666.330319:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963591552256:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143666.330341:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143666.330359:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d600/0xe984082ccd72177e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f071 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143666.330418:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593479808:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143666.330513:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f32240 going to sleep for 11 seconds 00002000:00010000:0.0:1746143666.332389:0:4581:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime: 1746143665 -> 1746143666 00002000:00010000:0.0:1746143666.332404:0:4581:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143665 -> 1746143666 00002000:00010000:0.0:1746143666.332406:0:4581:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime: 1746143665 -> 1746143666 00000100:00100000:0.0:1746143666.332429:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593479808:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143666.332456:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d600/0xe984082ccd72177e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f071 expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.332472:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d600/0xe984082ccd72177e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f071 expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.332485:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e6d600, rc 0) 00000100:00100000:0.0:1746143666.332523:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963591552256:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2205us (2441us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143666.332528:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8081 00002000:00010000:0.0:1746143666.332630:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime: 1746143664 -> 1746143666 00002000:00010000:0.0:1746143666.332632:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime: 1746143662 -> 1746143666 00002000:00010000:0.0:1746143666.332633:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime: 1746143664 -> 1746143666 00000100:00100000:0.0:1746143666.332641:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593479936:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143666.332657:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd721785 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f078 expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.332665:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd721785 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f078 expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.332671:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c09c00, rc 0) 00000100:00100000:0.0:1746143666.332689:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963591552384:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2238us (2511us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143666.332701:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8082 00000100:00100000:0.0:1746143666.346240:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.347480:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.363082:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.363122:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.363168:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.363214:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591553408 00000100:00100000:0.0:1746143666.363223:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591553408 00000100:00100000:0.0:1746143666.363274:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7933 00000100:00100000:0.0:1746143666.363284:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:27519:x1830963591553408:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143666.363299:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4012 00000100:00100000:0.0:1746143666.363304:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963591553280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.363319:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.363326:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800952ec800/0xe984082ccd7216f2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f01d expref: 11 pid: 20509 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.363336:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800952ec800/0xe984082ccd7216f2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f01d expref: 11 pid: 20509 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.363374:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143666.363382:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd7217af lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143666.363389:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd7217af lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143666.363394:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.363444:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963591553280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 138us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.363449:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4012 00010000:00010000:0.0:1746143666.363483:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143666.363495:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e6d000/0xe984082ccd7217b6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f094 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.363571:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e6da00/0xe984082ccd7217bd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143666.363579:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd7217af lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143666.363583:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e6da00/0xe984082ccd7217bd lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143666.363594:0:14762:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd7217af lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143666.363600:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e6da00/0xe984082ccd7217bd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143666.366198:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.366290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.371611:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.371650:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.371684:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.371708:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.371725:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591553920 00000100:00100000:0.0:1746143666.371728:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591553920 00000100:00100000:0.0:1746143666.371812:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591554048 00000100:00100000:0.0:1746143666.371815:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591554048 00000100:00100000:0.0:1746143666.371843:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8085 00000100:00100000:0.0:1746143666.371848:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963591553920:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143666.371854:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143666.371865:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d600/0xe984082ccd7217e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f0a9 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143666.371916:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593480448:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143666.371991:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f32240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143666.385709:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.387459:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.397668:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.405172:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593480832:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143666.405499:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.405523:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591555328 00000100:00100000:0.0:1746143666.405529:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591555328 00010000:00010000:0.0:1746143666.405575:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800952ed000/0xe984082ccd7216e4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f016 expref: 41 pid: 8496 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.405599:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4015 00000100:00100000:0.0:1746143666.405606:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963591555328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.405620:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.405642:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800952ed000/0xe984082ccd7216e4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f016 expref: 40 pid: 8496 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.405652:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800952ed000/0xe984082ccd7216e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f016 expref: 40 pid: 8496 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.405689:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800952ed000/0xe984082ccd7216e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f016 expref: 40 pid: 8496 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.405706:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.405724:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963591555328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 118us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.405730:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4015 00000100:00100000:0.0:1746143666.405759:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.405771:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591555200 00000100:00100000:0.0:1746143666.405774:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591555200 00010000:00010000:0.0:1746143666.405783:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5548400/0xe984082ccd7216ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209effa expref: 9 pid: 12618 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.405795:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4016 00000100:00100000:0.0:1746143666.405800:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963591555200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.405806:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.405812:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5548400/0xe984082ccd7216ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209effa expref: 9 pid: 12618 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.405819:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5548400/0xe984082ccd7216ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209effa expref: 9 pid: 12618 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.405830:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5548400/0xe984082ccd7216ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209effa expref: 9 pid: 12618 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.405848:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.405865:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963591555200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 64us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.405870:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4016 00000100:00100000:0.0:1746143666.413801:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.417694:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.420944:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.428272:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.450467:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.461131:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.464878:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.464938:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.480646:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.485546:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.488083:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.488114:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.488186:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.488197:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.488207:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.488359:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591558784 00000100:00100000:0.0:1746143666.488363:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591558784 00010000:00010000:0.0:1746143666.488383:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd7217d2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f09b expref: 11 pid: 14762 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746143666.488471:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591558656 00000100:00100000:0.0:1746143666.488473:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591558656 00010000:00010000:0.0:1746143666.488482:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800952ed000/0xe984082ccd721826 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0d3 expref: 13 pid: 14762 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746143666.488503:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591558912 00000100:00100000:0.0:1746143666.488505:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591558912 00010000:00010000:0.0:1746143666.488515:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e6da00/0xe984082ccd7217bd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f094 expref: 249 pid: 14762 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746143666.488527:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4019 00000100:00100000:0.0:1746143666.488532:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963591558784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.488541:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.488546:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd7217d2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f09b expref: 11 pid: 14762 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.488555:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd7217d2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f09b expref: 11 pid: 14762 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.488574:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143666.488579:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ae00/0xe984082ccd721849 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143666.488586:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ae00/0xe984082ccd721849 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143666.488590:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.488627:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963591558784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 93us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.488632:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4019 00000100:00100000:0.0:1746143666.488646:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4020 00000100:00100000:0.0:1746143666.488651:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963591558656:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.488662:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.488666:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800952ed000/0xe984082ccd721826 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0d3 expref: 13 pid: 14762 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.488685:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800952ed000/0xe984082ccd721826 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0d3 expref: 13 pid: 14762 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.488695:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143666.488698:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ae00/0xe984082ccd721849 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143666.488703:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ae00/0xe984082ccd721849 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143666.488707:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.488722:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963591558656:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 71us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.488727:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4020 00000100:00100000:0.0:1746143666.488736:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4021 00000100:00100000:0.0:1746143666.488741:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1965:x1830963591558912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.488747:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.488750:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e6da00/0xe984082ccd7217bd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f094 expref: 249 pid: 14762 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.488757:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e6da00/0xe984082ccd7217bd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f094 expref: 249 pid: 14762 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.488766:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143666.488772:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ae00/0xe984082ccd721849 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143666.488779:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ae00/0xe984082ccd721849 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143666.488785:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ae00/0xe984082ccd721849 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143666.488800:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.488814:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1965:x1830963591558912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 73us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.488819:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4021 00000100:00100000:0.0:1746143666.488860:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.488872:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591559040 00000100:00100000:0.0:1746143666.488875:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591559040 00002000:00100000:0.0:1746143666.488889:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1323007) req@ffff88009cdc3100 x1830963591559040/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:62/0 lens 488/0 e 0 to 0 dl 1746143677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143666.488896:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3100 with x1830963591559040 ext(1048576->1323007) 00010000:00010000:0.0:1746143666.488900:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800952ede00/0xe984082ccd721738 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f05c expref: 23 pid: 8496 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.488909:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800952ede00/0xe984082ccd721738 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1323007) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f05c expref: 23 pid: 8496 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746143666.488914:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc3100 00000100:00100000:0.0:1746143666.488924:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 608 00000100:00100000:0.0:1746143666.488928:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591559040:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143666.510492:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963591558016:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24011us (24478us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143666.510520:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2598 00002000:00100000:0.0:1746143666.510538:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800935a1880 x1830963591558016/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:62/0 lens 488/440 e 0 to 0 dl 1746143677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143666.510549:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a1880 with x1830963591558016 ext(0->1048575) 00002000:00010000:0.0:1746143666.510555:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a1880 00000100:00100000:0.0:1746143666.516996:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.525081:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.525522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.542831:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.575509:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.575873:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.575895:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.575928:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591560320 00000100:00100000:0.0:1746143666.575938:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591560320 00002000:00100000:0.0:1746143666.575991:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009cdc0700 x1830963591560320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:62/0 lens 488/0 e 0 to 0 dl 1746143677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143666.576001:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0700 with x1830963591560320 ext(2097152->3145727) 00002000:00010000:0.0:1746143666.576007:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc0700 00000100:00100000:0.0:1746143666.576034:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591560832 00000100:00100000:0.0:1746143666.576036:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591560832 00002000:00100000:0.0:1746143666.576047:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009cdc1880 x1830963591560832/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:62/0 lens 488/0 e 0 to 0 dl 1746143677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143666.576055:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1880 with x1830963591560832 ext(3145728->4194303) 00002000:00010000:0.0:1746143666.576057:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc1880 00000100:00100000:0.0:1746143666.576070:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2603 00000100:00100000:0.0:1746143666.576086:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1963:x1830963591560320:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143666.622207:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.631794:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.634216:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.643561:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.650251:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.655294:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.655330:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.655364:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.656669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.660224:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591562240 00000100:00100000:0.0:1746143666.660234:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591562240 00000100:00100000:0.0:1746143666.660555:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8097 00000100:00100000:0.0:1746143666.660564:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:27526:x1830963591562240:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143666.660583:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143666.660602:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72189d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f119 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.660628:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801353bbc00/0xe984082ccd7215da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef75 expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.660635:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd7216b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f008 expref: 6 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.660639:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c9f400/0xe984082ccd721658 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efad expref: 24 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.660650:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.660651:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.660654:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72189d lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2674688->3145727] (req 2674688->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f119 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.660678:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131c9f400/0xe984082ccd721658 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209efad expref: 24 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.660686:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131c9f400/0xe984082ccd721658 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209efad expref: 24 pid: 4581 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.660696:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593483264:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143666.661073:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd7216b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f008 expref: 6 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.661081:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd7216b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f008 expref: 6 pid: 12618 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.661088:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593483392:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143666.661123:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801353bbc00/0xe984082ccd7215da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef75 expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.661131:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801353bbc00/0xe984082ccd7215da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef75 expref: 20 pid: 25369 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.661174:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593483520:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143666.681374:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593483264:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143666.681389:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593483392:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143666.682891:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.682950:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.682970:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.682993:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591562624 00000100:00100000:0.0:1746143666.682998:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591562624 00010000:00010000:0.0:1746143666.683028:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd7216b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f008 expref: 7 pid: 12618 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.683046:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591563008 00000100:00100000:0.0:1746143666.683049:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591563008 00010000:00010000:0.0:1746143666.683058:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801353bbc00/0xe984082ccd7215da lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef75 expref: 21 pid: 25369 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.683070:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4027 00000100:00100000:0.0:1746143666.683076:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963591562624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.683088:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.683117:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd7216b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f008 expref: 7 pid: 12618 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.683126:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd7216b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f008 expref: 7 pid: 12618 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.683181:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd7216b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f008 expref: 7 pid: 12618 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.683199:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.683218:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1964:x1830963591562624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 142us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.683223:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4027 00000100:00100000:0.0:1746143666.686628:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.686661:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.700364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.700402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.703299:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.709986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.710005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.710030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.719461:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.721413:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.737772:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.751975:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.752831:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.755556:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.755584:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.773110:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.774351:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.774629:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801353bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963591565952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18921us (19043us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143666.774646:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2612 00002000:00100000:0.0:1746143666.774654:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8801353bdf80 x1830963591565952/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:62/0 lens 488/440 e 0 to 0 dl 1746143677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143666.774662:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801353bdf80 with x1830963591565952 ext(2097152->3145727) 00002000:00010000:0.0:1746143666.774666:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801353bdf80 00000100:00100000:0.0:1746143666.805287:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593484800:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143666.805311:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0a9600/0xe984082ccd721906 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f16d expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.805320:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0a9600/0xe984082ccd721906 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f16d expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.805331:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0a9600, rc 0) 00000100:00100000:0.0:1746143666.805388:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963591567360:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 22826us (22856us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143666.805397:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8108 00000100:00100000:0.0:1746143666.806229:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591566848:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22060us (24391us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143666.806238:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2614 00002000:00100000:0.0:1746143666.806248:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880093501180 x1830963591566848/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:62/0 lens 488/440 e 0 to 0 dl 1746143677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143666.806256:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501180 with x1830963591566848 ext(3145728->4194303) 00002000:00010000:0.0:1746143666.806260:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093501180 00000100:00100000:0.0:1746143666.811103:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.814074:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.814213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.818790:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.823630:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.823708:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.827507:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.827660:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.827686:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591568640 00000100:00100000:0.0:1746143666.827694:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591568640 00000100:00100000:0.0:1746143666.827746:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8111 00000100:00100000:0.0:1746143666.827754:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591568640:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143666.827771:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143666.827790:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0b800/0xe984082ccd72193e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f190 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143666.827846:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593485440:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143666.827913:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f32a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143666.830423:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593485440:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143666.830451:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0b800/0xe984082ccd72193e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f190 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.830463:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0b800/0xe984082ccd72193e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f190 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.830476:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0b800, rc 0) 00000100:00100000:0.0:1746143666.830507:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591568640:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2754us (3010us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143666.830520:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8111 00000100:00100000:0.0:1746143666.840030:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.844564:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591569408 00000100:00100000:0.0:1746143666.844570:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591569408 00000100:00100000:0.0:1746143666.844594:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8114 00000100:00100000:0.0:1746143666.844601:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591569280:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143666.844630:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012da0a600/0xe984082ccd721968 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.844645:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0189600/0xe984082ccd7215e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef52 expref: 40 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.844652:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd7216ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209efe5 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.844658:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090486a00/0xe984082ccd721635 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef8a expref: 20 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.844663:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.844665:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.844667:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0a600/0xe984082ccd721968 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.844688:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090486a00/0xe984082ccd721635 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef8a expref: 20 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.844699:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090486a00/0xe984082ccd721635 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef8a expref: 20 pid: 4582 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.844718:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593485824:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143666.844749:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd7216ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209efe5 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.844757:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd7216ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209efe5 expref: 8 pid: 4581 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.844765:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593485952:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143666.844787:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0189600/0xe984082ccd7215e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef52 expref: 40 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.844795:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0189600/0xe984082ccd7215e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef52 expref: 40 pid: 25369 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.844802:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593486080:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143666.844816:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f32a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143666.847756:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8118 00000100:00100000:0.0:1746143666.847763:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963591569792:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143666.847779:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ae00/0xe984082ccd721984 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.847788:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800952ed200/0xe984082ccd7218ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f14a expref: 20 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.847807:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c25e600/0xe984082ccd7218c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f13c expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.847812:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143666.847813:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143666.847815:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ae00/0xe984082ccd721984 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.847830:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c25e600/0xe984082ccd7218c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f13c expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.847836:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c25e600/0xe984082ccd7218c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f13c expref: 20 pid: 21542 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746143666.847844:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593486720:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143666.847872:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8119 00000100:00100000:0.0:1746143666.847877:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963591569920:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143666.847891:0:8495:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801353bbc00/0xe984082ccd72198b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.847900:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72189d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f119 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.847904:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143666.847905:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143666.847911:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801353bbc00/0xe984082ccd72198b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.847924:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72189d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f119 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.847930:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72189d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2674688->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f119 expref: 22 pid: 8495 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746143666.847937:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593486848:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143666.848912:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800952ed200/0xe984082ccd7218ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f14a expref: 20 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.848920:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800952ed200/0xe984082ccd7218ce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f14a expref: 20 pid: 12618 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746143666.848927:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593487616:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143666.848953:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143666.852329:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.852343:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.852366:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.852378:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.852396:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591570304 00000100:00100000:0.0:1746143666.852402:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591570304 00010000:00010000:0.0:1746143666.852433:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090486a00/0xe984082ccd721635 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ef8a expref: 20 pid: 4582 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.852465:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591570048 00000100:00100000:0.0:1746143666.852467:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591570048 00010000:00010000:0.0:1746143666.852476:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd7216ba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209efe5 expref: 11 pid: 4581 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.852486:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591570176 00000100:00100000:0.0:1746143666.852488:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591570176 00010000:00010000:0.0:1746143666.852496:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9000/0xe984082ccd7218f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f158 expref: 11 pid: 4582 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.852504:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4035 00000100:00100000:0.0:1746143666.852509:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591570048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.852514:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.852519:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd7216ba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209efe5 expref: 11 pid: 4581 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.852528:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd7216ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209efe5 expref: 11 pid: 4581 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.852590:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.852608:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591570048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 98us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.852613:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4035 00000100:00100000:0.0:1746143666.852626:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4036 00000100:00100000:0.0:1746143666.852631:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963591570432:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.852646:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.852660:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d400/0xe984082ccd721834 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0da expref: 23 pid: 8495 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.852669:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d400/0xe984082ccd721834 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0da expref: 23 pid: 8495 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.852680:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.852695:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963591570432:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 64us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.852700:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4036 00000100:00100000:0.0:1746143666.852710:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4037 00000100:00100000:0.0:1746143666.852714:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591570176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.852720:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.852726:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9000/0xe984082ccd7218f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f158 expref: 11 pid: 4582 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.852733:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9000/0xe984082ccd7218f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f158 expref: 11 pid: 4582 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.852742:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.852755:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591570176:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 40us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.852759:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4037 00000100:00100000:0.0:1746143666.852826:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.852836:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591570688 00000100:00100000:0.0:1746143666.852844:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591570688 00010000:00010000:0.0:1746143666.852855:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1c00/0xe984082ccd72185e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0f6 expref: 23 pid: 8495 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746143666.852867:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4038 00000100:00100000:0.0:1746143666.852872:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963591570688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.852879:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.852888:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1c00/0xe984082ccd72185e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0f6 expref: 23 pid: 8495 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.852895:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1c00/0xe984082ccd72185e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0f6 expref: 23 pid: 8495 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.852905:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.852919:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963591570688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.852923:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4038 00000100:00100000:0.0:1746143666.852968:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593486720:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143666.853013:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593486848:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143666.853027:0:8495:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801353bbc00/0xe984082ccd72198b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143666.856314:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593486976:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143666.856335:0:8496:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130a25c00/0xe984082ccd72196f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143666.858732:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591570944 00000100:00100000:0.0:1746143666.858740:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591570944 00010000:00010000:0.0:1746143666.858878:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9200/0xe984082ccd7218f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f15f expref: 10 pid: 4582 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746143666.858909:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591571584 00000100:00100000:0.0:1746143666.858912:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591571584 00010000:00010000:0.0:1746143666.858924:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c800/0xe984082ccd721850 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0ef expref: 20 pid: 8495 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746143666.858936:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591571328 00000100:00100000:0.0:1746143666.858938:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591571328 00010000:00010000:0.0:1746143666.858948:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800952ec600/0xe984082ccd721888 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f104 expref: 17 pid: 21542 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746143666.858956:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591571456 00000100:00100000:0.0:1746143666.858958:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591571456 00010000:00010000:0.0:1746143666.858967:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72180a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0cc expref: 21 pid: 8495 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746143666.858977:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4042 00000100:00100000:0.0:1746143666.858983:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963591570944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.858995:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.859016:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9200/0xe984082ccd7218f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f15f expref: 10 pid: 4582 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.859037:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9200/0xe984082ccd7218f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f15f expref: 10 pid: 4582 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.859056:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9200/0xe984082ccd7218f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f15f expref: 10 pid: 4582 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746143666.859074:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.859121:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963591570944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 138us (2401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.859128:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4042 00000100:00100000:0.0:1746143666.859158:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4043 00000100:00100000:0.0:1746143666.859163:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963591571584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.859171:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.859178:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c800/0xe984082ccd721850 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0ef expref: 21 pid: 8495 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.859185:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c800/0xe984082ccd721850 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0ef expref: 21 pid: 8495 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.859196:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c800/0xe984082ccd721850 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0ef expref: 21 pid: 8495 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.859206:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.859207:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.859211:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941d9200/0xe984082ccd721976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.859224:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941d9200/0xe984082ccd721976 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.859247:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.859264:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963591571584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (2498us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.859270:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4043 00000100:00100000:0.0:1746143666.859281:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4044 00000100:00100000:0.0:1746143666.859286:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963591571328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.859293:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.859305:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800952ec600/0xe984082ccd721888 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f104 expref: 17 pid: 21542 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.859312:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800952ec600/0xe984082ccd721888 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f104 expref: 17 pid: 21542 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.859324:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800952ec600/0xe984082ccd721888 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f104 expref: 17 pid: 21542 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.859332:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.859346:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963591571328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 60us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.859351:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4044 00000100:00100000:0.0:1746143666.859360:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4045 00000100:00100000:0.0:1746143666.859364:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963591571456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143666.859376:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143666.859385:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72180a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0cc expref: 19 pid: 8495 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.859393:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72180a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0cc expref: 19 pid: 8495 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.859402:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72180a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f0cc expref: 19 pid: 8495 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746143666.859411:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.859413:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.859415:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a25c00/0xe984082ccd72196f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.859421:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a25c00/0xe984082ccd72196f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.859434:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143666.859449:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963591571456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 84us (2245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.859455:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4045 00010000:00010000:0.0:1746143666.859506:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130a25c00/0xe984082ccd72196f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.859514:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a25c00/0xe984082ccd72196f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143666.862048:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593487616:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143666.862071:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012da0ae00/0xe984082ccd721984 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.862101:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a25c00/0xe984082ccd72196f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.862107:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130a25c00/0xe984082ccd72196f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.862113:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130a25c00/0xe984082ccd72196f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.862117:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a25c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143666.862120:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a25c00/0xe984082ccd72196f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.862126:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a25c00/0xe984082ccd72196f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.862136:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130a25c00/0xe984082ccd72196f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.862155:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a25c00/0xe984082ccd72196f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143666.862196:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963591569408:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 17427us (17785us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.862201:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8115 00000100:00100000:0.0:1746143666.873634:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.877693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.881007:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.888071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.890729:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.890811:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.891569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.891585:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591574016 00000100:00100000:0.0:1746143666.891588:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591574016 00000100:00100000:0.0:1746143666.892497:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591574144 00000100:00100000:0.0:1746143666.892502:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591574144 00000100:00100000:0.0:1746143666.892526:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8128 00000100:00100000:0.0:1746143666.892531:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963591574016:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143666.892543:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143666.892556:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009518bc00/0xe984082ccd7219ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f1eb expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143666.892575:0:9527:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34b:0x0] initial LVB size: 2097152, mtime: 0x681409b2, atime: 0x681409ae, ctime: 0x681409b2, blocks: 0x821 00010000:00010000:0.0:1746143666.892588:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.892590:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.892595:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009518bc00/0xe984082ccd7219ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f1eb expref: 20 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.892620:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009518bc00/0xe984082ccd7219ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f1eb expref: 20 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.892627:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009518bc00, rc 0) 00000100:00100000:0.0:1746143666.892653:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963591574016:12345-192.168.202.48@tcp:101:cat.0 Request processed in 122us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.892659:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8128 00000100:00100000:0.0:1746143666.892673:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8129 00000100:00100000:0.0:1746143666.892678:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963591574144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143666.892684:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143666.892693:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009518b800/0xe984082ccd7219f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f1f2 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143666.892709:0:9527:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409b2, atime: 0x681409b2, ctime: 0x681409b2, blocks: 0x81f 00010000:00010000:0.0:1746143666.892717:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.892719:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.892722:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009518b800/0xe984082ccd7219f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f1f2 expref: 41 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.892732:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009518b800/0xe984082ccd7219f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f1f2 expref: 41 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.892738:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009518b800, rc 0) 00000100:00100000:0.0:1746143666.892753:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963591574144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 76us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.892766:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8129 00000100:00100000:0.0:1746143666.892828:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.892842:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591574272 00000100:00100000:0.0:1746143666.892845:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591574272 00000100:00100000:0.0:1746143666.892859:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8130 00000100:00100000:0.0:1746143666.892864:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963591574272:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143666.892870:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143666.892878:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009518b000/0xe984082ccd7219fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f1f9 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143666.892890:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 4897312, mtime: 0x681409b2, atime: 0x681409b2, ctime: 0x681409b2, blocks: 0x15a7 00010000:00010000:0.0:1746143666.892898:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.892899:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.892904:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009518b000/0xe984082ccd7219fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f1f9 expref: 42 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.892912:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009518b000/0xe984082ccd7219fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f1f9 expref: 42 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.892919:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009518b000, rc 0) 00000100:00100000:0.0:1746143666.892933:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1963:x1830963591574272:12345-192.168.202.48@tcp:101:cat.0 Request processed in 69us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.892938:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8130 00000100:00100000:0.0:1746143666.892986:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.892998:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591574400 00000100:00100000:0.0:1746143666.893001:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591574400 00000100:00100000:0.0:1746143666.893019:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8131 00000100:00100000:0.0:1746143666.893023:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963591574400:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143666.893030:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143666.893038:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009518b600/0xe984082ccd721a02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f200 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143666.893048:0:9527:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409b2, atime: 0x681409b2, ctime: 0x681409b2, blocks: 0x1029 00010000:00010000:0.0:1746143666.893055:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.893056:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143666.893059:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009518b600/0xe984082ccd721a02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f200 expref: 21 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.893067:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009518b600/0xe984082ccd721a02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f200 expref: 21 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143666.893073:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009518b600, rc 0) 00000100:00100000:0.0:1746143666.893101:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963591574400:12345-192.168.202.48@tcp:101:cat.0 Request processed in 65us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143666.893106:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8131 00000100:00100000:0.0:1746143666.902744:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.902782:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.902807:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.902825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.904951:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.904984:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.905083:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.905185:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.905214:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591575424 00000100:00100000:0.0:1746143666.905220:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591575424 00002000:00100000:0.0:1746143666.905260:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880130fd4380 x1830963591575424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:62/0 lens 488/0 e 0 to 0 dl 1746143677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143666.905270:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4380 with x1830963591575424 ext(0->1048575) 00002000:00010000:0.0:1746143666.905275:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd4380 00000100:00100000:0.0:1746143666.906330:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591575680 00000100:00100000:0.0:1746143666.906336:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591575680 00002000:00100000:0.0:1746143666.906366:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880130fd4a80 x1830963591575680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:62/0 lens 488/0 e 0 to 0 dl 1746143677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143666.906374:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4a80 with x1830963591575680 ext(1048576->2097151) 00002000:00010000:0.0:1746143666.906379:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd4a80 00000100:00100000:0.0:1746143666.909593:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2619 00000100:00100000:0.0:1746143666.909604:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1962:x1830963591576192:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143666.914714:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.925164:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1962:x1830963591575424:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18569us (20189us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143666.925175:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2616 00002000:00100000:0.0:1746143666.925187:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880130fd4380 x1830963591575424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:62/0 lens 488/440 e 0 to 0 dl 1746143677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143666.925196:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4380 with x1830963591575424 ext(0->1048575) 00002000:00010000:0.0:1746143666.925202:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd4380 00000100:00100000:0.0:1746143666.952937:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1962:x1830963591576192:12345-192.168.202.48@tcp:3:cat.0 Request processed in 43334us (47823us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143666.952945:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2619 00002000:00100000:0.0:1746143666.952957:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880130fd6680 x1830963591576192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:62/0 lens 488/440 e 0 to 0 dl 1746143677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143666.952964:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6680 with x1830963591576192 ext(1048576->2097151) 00002000:00010000:0.0:1746143666.952968:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd6680 00000100:00100000:0.0:1746143666.963800:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591576960 00000100:00100000:0.0:1746143666.963811:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591576960 00000100:00100000:0.0:1746143666.963861:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7947 00000100:00100000:0.0:1746143666.963869:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:27542:x1830963591576960:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143666.963889:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143666.963907:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3200/0xe984082ccd721a2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f215 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.964017:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3e00/0xe984082ccd721a33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.964029:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3e00/0xe984082ccd721a33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.964040:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3e00/0xe984082ccd721a33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.964049:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3c00/0xe984082ccd721a3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.964054:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3c00/0xe984082ccd721a3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.964058:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3c00/0xe984082ccd721a3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000001:00080000:0.0:1746143666.968965:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941909 is committed 00000001:00080000:0.0:1746143666.968980:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941908 is committed 00000001:00080000:0.0:1746143666.968988:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941918 is committed 00000001:00080000:0.0:1746143666.968998:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941915 is committed 00000001:00080000:0.0:1746143666.969001:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941912 is committed 00000001:00080000:0.0:1746143666.969006:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941925 is committed 00000001:00080000:0.0:1746143666.969011:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941924 is committed 00000001:00080000:0.0:1746143666.969019:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941923 is committed 00000001:00080000:0.0:1746143666.969030:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941927 is committed 00000004:00080000:0.0:1746143666.969040:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1426 committed 00000004:00080000:0.0:1746143666.969048:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1457 committed 00000004:00080000:0.0:1746143666.969054:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1456 committed 00000004:00080000:0.0:1746143666.969056:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1455 committed 00000004:00080000:0.0:1746143666.969057:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1454 committed 00000004:00080000:0.0:1746143666.969059:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1425 committed 00000004:00080000:0.0:1746143666.969061:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1453 committed 00000004:00080000:0.0:1746143666.969062:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1424 committed 00000004:00080000:0.0:1746143666.969063:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1452 committed 00000004:00080000:0.0:1746143666.969065:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1423 committed 00000004:00080000:0.0:1746143666.969067:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1422 committed 00000004:00080000:0.0:1746143666.969068:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1421 committed 00000004:00080000:0.0:1746143666.969070:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1451 committed 00000004:00080000:0.0:1746143666.969071:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1450 committed 00000004:00080000:0.0:1746143666.969074:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1420 committed 00000004:00080000:0.0:1746143666.969075:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1419 committed 00000004:00080000:0.0:1746143666.969077:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1449 committed 00000001:00080000:0.0:1746143666.969081:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941926 is committed 00010000:00010000:0.0:1746143666.969643:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3000/0xe984082ccd721a48 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.969650:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3000/0xe984082ccd721a48 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.969665:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3000/0xe984082ccd721a48 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143666.971964:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593488896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143666.972485:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593489024 00000100:00100000:0.0:1746143666.972493:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593489024 00000100:00100000:0.0:1746143666.972538:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593489536 00000100:00100000:0.0:1746143666.972539:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593489536 00000100:00100000:0.0:1746143666.972554:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593490048 00000100:00100000:0.0:1746143666.972556:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593490048 00000100:00100000:0.0:1746143666.972564:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593490560 00000100:00100000:0.0:1746143666.972565:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593490560 00000100:00100000:0.0:1746143666.972577:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8132 00000100:00100000:0.0:1746143666.972583:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3295:x1830963593489024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143666.972781:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143666.972784:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143664 -> 1746143664 00002000:00010000:0.0:1746143666.972786:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143664 -> 1746143664 00002000:00010000:0.0:1746143666.972787:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143664 -> 1746143664 00002000:00010000:0.0:1746143666.972789:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2037 -> 2037 00000100:00100000:0.0:1746143666.973747:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3295:x1830963593489024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1162us (3122us total) trans 17179872170 rc 0/0 00000100:00100000:0.0:1746143666.973755:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8132 00000100:00100000:0.0:1746143666.973774:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8133 00000100:00100000:0.0:1746143666.973779:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:3295:x1830963593489536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143666.973893:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143666.973895:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143666 -> 1746143666 00002000:00010000:0.0:1746143666.973897:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143666 -> 1746143666 00002000:00010000:0.0:1746143666.973906:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143666 -> 1746143666 00002000:00010000:0.0:1746143666.973908:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143666.973930:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3295:x1830963593489536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (3266us total) trans 21474839456 rc 0/0 00000100:00100000:0.0:1746143666.973936:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8133 00000100:00100000:0.0:1746143666.973948:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8135 00000100:00100000:0.0:1746143666.973952:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:3295:x1830963593490560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143666.974028:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3295:x1830963593490560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (3295us total) trans 21474839457 rc 0/0 00000100:00100000:0.0:1746143666.974033:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8135 00000100:00100000:0.0:1746143666.974057:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143666.974081:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593489408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143666.974113:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143666.974125:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593489920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143666.974155:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143666.974167:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593490432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143666.974182:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143666.974206:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593488896 00000100:00100000:0.0:1746143666.974210:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593488896 00000100:00100000:0.0:1746143666.974226:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593489408 00000100:00100000:0.0:1746143666.974228:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593489408 00000100:00100000:0.0:1746143666.974237:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593489920 00000100:00100000:0.0:1746143666.974239:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593489920 00000100:00100000:0.0:1746143666.974246:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593490432 00000100:00100000:0.0:1746143666.974248:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593490432 00000100:00100000:0.0:1746143666.974257:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8136 00000100:00100000:0.0:1746143666.974261:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3294:x1830963593488896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143666.975707:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143666.975710:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143666 -> 1746143666 00002000:00010000:0.0:1746143666.975712:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143664 -> 1746143664 00002000:00010000:0.0:1746143666.975714:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143665 -> 1746143665 00002000:00010000:0.0:1746143666.975715:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143666.975736:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3294:x1830963593488896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1473us (1679us total) trans 21474839458 rc 0/0 00000100:00100000:0.0:1746143666.975741:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8136 00000100:00100000:0.0:1746143666.975751:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8139 00000100:00100000:0.0:1746143666.975756:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+63:3294:x1830963593490432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143666.978871:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3294:x1830963593490432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3109us (4681us total) trans 17179872173 rc 0/0 00000100:00100000:0.0:1746143666.978881:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8139 00000100:00100000:0.0:1746143666.978901:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593490688 00000100:00100000:0.0:1746143666.978906:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593490688 00000100:00100000:0.0:1746143666.978923:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8145 00000100:00100000:0.0:1746143666.978928:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3292:x1830963593489664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143666.979011:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143666.979014:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143666.979016:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143666.979018:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143666.979020:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143666.979043:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3292:x1830963593489664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (2523us total) trans 17179872174 rc 0/0 00000100:00100000:0.0:1746143666.979048:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8145 00000100:00100000:0.0:1746143666.979058:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8146 00000100:00100000:0.0:1746143666.979072:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801353bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3292:x1830963593490176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143666.979174:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801353bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3292:x1830963593490176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (2630us total) trans 17179872175 rc 0/0 00000100:00100000:0.0:1746143666.979180:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8146 00000100:00100000:0.0:1746143666.979240:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143666.979284:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000004:00080000:0.0:1746143666.979321:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935a2300/2, rc 0, transno 21474839458 00000100:00100000:0.0:1746143666.979326:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593488896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143666.979338:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f531180/2, rc 0, transno 17179872171 00000100:00100000:0.0:1746143666.979342:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593489408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143666.979349:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f531f80/2, rc 0, transno 17179872172 00000100:00100000:0.0:1746143666.979352:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593489920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143666.979357:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a2a00/2, rc 0, transno 17179872173 00000100:00100000:0.0:1746143666.979359:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593490432:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746143666.981654:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3000/0xe984082ccd721a48 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981663:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3000/0xe984082ccd721a48 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143666.981676:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143666.981736:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3000/0xe984082ccd721a48 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981743:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3000/0xe984082ccd721a48 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981748:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3000/0xe984082ccd721a48 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981762:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f3000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143666.981765:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3000/0xe984082ccd721a48 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981771:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3000/0xe984082ccd721a48 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981781:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143666.981783:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143666.981786:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3000/0xe984082ccd721a48 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981791:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3000/0xe984082ccd721a48 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981805:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3e00/0xe984082ccd721a33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981810:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3e00/0xe984082ccd721a33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981814:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3e00/0xe984082ccd721a33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981818:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f3e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143666.981820:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3e00/0xe984082ccd721a33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981825:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3e00/0xe984082ccd721a33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981831:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143666.981833:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143666.981840:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3e00/0xe984082ccd721a33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981844:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3e00/0xe984082ccd721a33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981852:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3c00/0xe984082ccd721a3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981856:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3c00/0xe984082ccd721a3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981860:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3c00/0xe984082ccd721a3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981864:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f3c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143666.981865:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3c00/0xe984082ccd721a3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981869:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3c00/0xe984082ccd721a3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981875:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74700) 00010000:00010000:0.0:1746143666.981877:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143666.981878:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3c00/0xe984082ccd721a3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981882:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3c00/0xe984082ccd721a3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143666.981917:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3200/0xe984082ccd721a2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f215 expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.981924:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3200/0xe984082ccd721a2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f215 expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143666.981935:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f3200, rc 0) 00000100:00100000:0.0:1746143666.981961:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:27542:x1830963591576960:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 18093us (19892us total) trans 8589941930 rc 301/301 00000100:00100000:0.0:1746143666.981967:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7947 00000100:00100000:0.0:1746143667.008598:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.048849:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.058381:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.068650:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963591578624:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 15952us (16645us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143667.068661:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2621 00002000:00100000:0.0:1746143667.068672:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009a5af100 x1830963591578624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/440 e 0 to 0 dl 1746143678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.068682:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5af100 with x1830963591578624 ext(1048576->2097151) 00002000:00010000:0.0:1746143667.068688:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a5af100 00000100:00100000:0.0:1746143667.104227:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.113487:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.113516:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591579136 00000100:00100000:0.0:1746143667.113525:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591579136 00000100:00100000:0.0:1746143667.113575:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7952 00000100:00100000:0.0:1746143667.113582:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+7:27540:x1830963591579136:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143667.113606:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.113627:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3200/0xe984082ccd721a95 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f238 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.113698:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3200/0xe984082ccd721a95 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f238 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.113710:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3200/0xe984082ccd721a95 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f238 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.113722:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143667.113724:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143667.113728:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800952ed200/0xe984082ccd721a72 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f22a expref: 244 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.113735:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f3200, rc 0) 00000100:00100000:0.0:1746143667.113796:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+8:27540:x1830963591579136:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 210us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.113803:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7952 00000001:00080000:0.0:1746143667.115745:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941930 is committed 00000001:00080000:0.0:1746143667.115759:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941929 is committed 00000001:00080000:0.0:1746143667.115765:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941932 is committed 00000004:00080000:0.0:1746143667.115769:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1434 committed 00000004:00080000:0.0:1746143667.115776:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1466 committed 00000004:00080000:0.0:1746143667.115782:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1465 committed 00000004:00080000:0.0:1746143667.115783:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1464 committed 00000004:00080000:0.0:1746143667.115784:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1463 committed 00000004:00080000:0.0:1746143667.115785:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1433 committed 00000004:00080000:0.0:1746143667.115787:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1462 committed 00000004:00080000:0.0:1746143667.115788:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1432 committed 00000004:00080000:0.0:1746143667.115790:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1461 committed 00000004:00080000:0.0:1746143667.115800:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1431 committed 00000004:00080000:0.0:1746143667.115802:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1430 committed 00000004:00080000:0.0:1746143667.115804:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1429 committed 00000004:00080000:0.0:1746143667.115806:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1460 committed 00000004:00080000:0.0:1746143667.115807:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1459 committed 00000004:00080000:0.0:1746143667.115809:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1428 committed 00000004:00080000:0.0:1746143667.115811:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1427 committed 00000004:00080000:0.0:1746143667.115812:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1458 committed 00000001:00080000:0.0:1746143667.115817:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941931 is committed 00010000:00010000:0.0:1746143667.115944:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53ac00/0xe984082ccd721a6b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f223 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.115953:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143667.115956:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143667.115959:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189600/0xe984082ccd721a8e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x40 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143667.115965:0:20509:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189600/0xe984082ccd721a8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143667.115970:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0189600/0xe984082ccd721a8e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143667.115975:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800952ed200/0xe984082ccd721a72 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f22a expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.115982:0:20509:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800952ed200/0xe984082ccd721a72 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f22a expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.115987:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800952ed200/0xe984082ccd721a72 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f22a expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.116003:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3200/0xe984082ccd721a95 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f238 expref: 6 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.116008:0:20509:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3200/0xe984082ccd721a95 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f238 expref: 6 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.116013:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3200/0xe984082ccd721a95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f238 expref: 6 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.116034:0:20509:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3200/0xe984082ccd721a95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f238 expref: 6 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.116042:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593493248:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143667.116102:0:20509:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800952ed200/0xe984082ccd721a72 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f22a expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.116109:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593493376:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143667.116131:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143667.116348:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8150 00000100:00100000:0.0:1746143667.116352:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+64:3295:x1830963593491712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143667.116511:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143667.116514:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143666 -> 1746143666 00002000:00010000:0.0:1746143667.116516:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143662 -> 1746143662 00002000:00010000:0.0:1746143667.116518:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143666 -> 1746143666 00002000:00010000:0.0:1746143667.116520:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143667.116663:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3295:x1830963593491712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 310us (631us total) trans 21474839464 rc 0/0 00000100:00100000:0.0:1746143667.116669:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8150 00000100:00100000:0.0:1746143667.116683:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8151 00000100:00100000:0.0:1746143667.116687:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:3295:x1830963593492224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143667.116765:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3295:x1830963593492224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (713us total) trans 17179872180 rc 0/0 00000100:00100000:0.0:1746143667.116770:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8151 00000100:00100000:0.0:1746143667.116778:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8152 00000100:00100000:0.0:1746143667.116782:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:3295:x1830963593492736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143667.116860:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3295:x1830963593492736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (775us total) trans 17179872181 rc 0/0 00000100:00100000:0.0:1746143667.116865:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8152 00000100:00100000:0.0:1746143667.116873:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8154 00000100:00100000:0.0:1746143667.116876:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+64:3295:x1830963593492096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143667.116939:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143667.116941:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143667.116943:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143667.116945:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143667.116946:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143667.117136:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3295:x1830963593492096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 258us (961us total) trans 21474839465 rc 0/0 00000100:00100000:0.0:1746143667.117157:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8154 00000100:00100000:0.0:1746143667.117169:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8156 00000100:00100000:0.0:1746143667.117173:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+64:3295:x1830963593493120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143667.117256:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3295:x1830963593493120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1038us total) trans 21474839466 rc 0/0 00000100:00100000:0.0:1746143667.117261:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8156 00000100:00100000:0.0:1746143667.117898:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593491328 00000100:00100000:0.0:1746143667.117903:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593491328 00000100:00100000:0.0:1746143667.117918:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593492352 00000100:00100000:0.0:1746143667.117919:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593492352 00000100:00100000:0.0:1746143667.117925:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593491456 00000100:00100000:0.0:1746143667.117927:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593491456 00000100:00100000:0.0:1746143667.117932:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593492480 00000100:00100000:0.0:1746143667.117933:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593492480 00000100:00100000:0.0:1746143667.117940:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8157 00000100:00100000:0.0:1746143667.117944:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3292:x1830963593491328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143667.118023:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143667.118026:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143666 -> 1746143666 00002000:00010000:0.0:1746143667.118028:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143664 -> 1746143664 00002000:00010000:0.0:1746143667.118030:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143665 -> 1746143665 00002000:00010000:0.0:1746143667.118032:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143667.118165:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+70:3292:x1830963593491328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (470us total) trans 21474839468 rc 0/0 00000100:00100000:0.0:1746143667.118171:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8157 00000100:00100000:0.0:1746143667.118181:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8160 00000100:00100000:0.0:1746143667.118186:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3292:x1830963593492864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143667.118259:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3292:x1830963593492864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (451us total) trans 17179872184 rc 0/0 00000100:00100000:0.0:1746143667.118263:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8160 00000100:00100000:0.0:1746143667.118271:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8162 00000100:00100000:0.0:1746143667.118281:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3292:x1830963593491968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143667.118348:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143667.118350:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143666 -> 1746143666 00002000:00010000:0.0:1746143667.118351:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143666 -> 1746143666 00002000:00010000:0.0:1746143667.118353:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143666 -> 1746143666 00002000:00010000:0.0:1746143667.118355:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143667.118510:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+70:3292:x1830963593491968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 229us (651us total) trans 21474839470 rc 0/0 00000100:00100000:0.0:1746143667.118514:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8162 00000100:00100000:0.0:1746143667.118727:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143667.118735:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593493504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143667.118754:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143667.118958:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e63ed80/2, rc 0, transno 17179872187 00000100:00100000:0.0:1746143667.118962:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593493504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143667.119007:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593493248:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143667.119039:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593493376:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143667.119072:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800952efe00/0xe984082ccd721a64 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f223 expref: 243 pid: 20509 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746143667.119545:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53ac00/0xe984082ccd721a6b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f223 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.119575:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d53ac00, rc 0) 00000100:00100000:0.0:1746143667.119604:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:27542:x1830963591578368:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 66404us (70770us total) trans 8589941932 rc 0/0 00000100:00100000:0.0:1746143667.119618:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7949 00000100:00100000:0.0:1746143667.119637:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591579520 00000100:00100000:0.0:1746143667.119640:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591579520 00000100:00100000:0.0:1746143667.119655:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591579648 00000100:00100000:0.0:1746143667.119656:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591579648 00000100:00100000:0.0:1746143667.119667:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3133 00000100:00100000:0.0:1746143667.119672:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+9:27540:x1830963591579520:12345-192.168.202.48@tcp:49:multiop.0 00000100:00100000:0.0:1746143667.119718:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+9:27540:x1830963591579520:12345-192.168.202.48@tcp:49:multiop.0 Request processed in 46us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.119724:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3133 00000100:00100000:0.0:1746143667.119732:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3134 00000100:00100000:0.0:1746143667.119737:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:27537:x1830963591579648:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:0.0:1746143667.119767:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:27537:x1830963591579648:12345-192.168.202.48@tcp:49:cat.0 Request processed in 31us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.119772:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3134 00000100:00100000:0.0:1746143667.122532:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.124462:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.126786:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.128314:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.128822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.129271:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.129283:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.129296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.129308:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.130304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.132465:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.132482:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591581312 00000100:00100000:0.0:1746143667.132485:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591581312 00002000:00100000:0.0:1746143667.132513:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1613824->1617919) req@ffff88009a92ed80 x1830963591581312/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:63/0 lens 488/0 e 0 to 0 dl 1746143678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.132521:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a92ed80 with x1830963591581312 ext(1613824->1617919) 00002000:00010000:0.0:1746143667.132525:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a92ed80 00000100:00100000:0.0:1746143667.132537:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2622 00000100:00100000:0.0:1746143667.132542:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1962:x1830963591581312:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143667.132681:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1962:x1830963591581312:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 138us (219us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143667.132686:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2622 00002000:00100000:0.0:1746143667.132691:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1613824->1617919) req@ffff88009a92ed80 x1830963591581312/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746143678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.132697:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a92ed80 with x1830963591581312 ext(1613824->1617919) 00002000:00010000:0.0:1746143667.132700:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a92ed80 00000100:00100000:0.0:1746143667.132715:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591581568 00000100:00100000:0.0:1746143667.132718:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591581568 00000100:00100000:0.0:1746143667.132743:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8175 00000100:00100000:0.0:1746143667.132748:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963591581568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.132755:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.132764:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136489e00/0xe984082ccd721b05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f28c expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.132776:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.132784:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.132788:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136489e00/0xe984082ccd721b05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f28c expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.132798:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136489e00/0xe984082ccd721b05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f28c expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.132804:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136489e00, rc 0) 00000100:00100000:0.0:1746143667.132821:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963591581568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 73us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.132826:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8175 00000100:00100000:0.0:1746143667.134485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.134516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.134558:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.134588:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.140028:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.144053:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591582592 00000100:00100000:0.0:1746143667.144059:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591582592 00002000:00100000:0.0:1746143667.144103:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2228224->2232319) req@ffff8800949f3800 x1830963591582592/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/0 e 0 to 0 dl 1746143678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.144112:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3800 with x1830963591582592 ext(2228224->2232319) 00002000:00010000:0.0:1746143667.144117:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f3800 00000100:00100000:0.0:1746143667.144136:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2624 00000100:00100000:0.0:1746143667.144163:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963591582592:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143667.144739:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963591582592:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 576us (1353us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143667.144756:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2624 00002000:00100000:0.0:1746143667.144761:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2228224->2232319) req@ffff8800949f3800 x1830963591582592/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746143678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.144768:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3800 with x1830963591582592 ext(2228224->2232319) 00002000:00010000:0.0:1746143667.144771:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f3800 00000100:00100000:0.0:1746143667.147810:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.150229:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.150754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.151521:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.151542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.151564:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.152203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.152218:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591583616 00000100:00100000:0.0:1746143667.152220:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591583616 00002000:00100000:0.0:1746143667.152235:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009a92ea00 x1830963591583616/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:63/0 lens 488/0 e 0 to 0 dl 1746143678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.152242:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a92ea00 with x1830963591583616 ext(0->1048575) 00002000:00010000:0.0:1746143667.152245:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a92ea00 00000100:00100000:0.0:1746143667.153654:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2625 00000100:00100000:0.0:1746143667.153662:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963591583360:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143667.153808:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963591583360:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 147us (2288us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143667.153813:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2625 00002000:00100000:0.0:1746143667.153819:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2682880->2686975) req@ffff88009a92fb80 x1830963591583360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746143678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.153834:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a92fb80 with x1830963591583360 ext(2682880->2686975) 00002000:00010000:0.0:1746143667.153839:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a92fb80 00000100:00100000:0.0:1746143667.153850:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2626 00000100:00100000:0.0:1746143667.153855:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963591583616:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143667.155229:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2628 00000100:00100000:0.0:1746143667.155235:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1962:x1830963591583872:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143667.166769:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.170011:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591585280 00000100:00100000:0.0:1746143667.170016:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591585280 00000100:00100000:0.0:1746143667.170053:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3135 00000100:00100000:0.0:1746143667.170059:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:27542:x1830963591585280:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143667.170262:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:27542:x1830963591585280:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 203us (1347us total) trans 8589941935 rc 0/0 00000100:00100000:0.0:1746143667.171925:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3135 00000100:00100000:0.0:1746143667.173049:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963591583616:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19189us (21501us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143667.173059:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2626 00002000:00100000:0.0:1746143667.173079:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009a92ea00 x1830963591583616/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:63/0 lens 488/440 e 0 to 0 dl 1746143678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.173096:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a92ea00 with x1830963591583616 ext(0->1048575) 00002000:00010000:0.0:1746143667.173102:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a92ea00 00000100:00100000:0.0:1746143667.185979:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1962:x1830963591583872:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30741us (34411us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143667.185996:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2628 00002000:00100000:0.0:1746143667.186012:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88009c3fbb80 x1830963591583872/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:63/0 lens 488/440 e 0 to 0 dl 1746143678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.186020:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830963591583872 ext(1048576->2097151) 00002000:00010000:0.0:1746143667.186026:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fbb80 00000100:00100000:0.0:1746143667.186260:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591585664 00000100:00100000:0.0:1746143667.186266:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591585664 00010000:00010000:0.0:1746143667.186293:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136489e00/0xe984082ccd721b05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f28c expref: 21 pid: 8497 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746143667.186328:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4062 00000100:00100000:0.0:1746143667.186334:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963591585664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143667.186346:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143667.186367:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136489e00/0xe984082ccd721b05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f28c expref: 21 pid: 8497 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746143667.186378:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136489e00/0xe984082ccd721b05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f28c expref: 21 pid: 8497 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746143667.186398:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136489e00/0xe984082ccd721b05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f28c expref: 21 pid: 8497 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746143667.186421:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.186423:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.186432:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c6ce00/0xe984082ccd721b28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2a8 expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.186450:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c6ce00/0xe984082ccd721b28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2a8 expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.186488:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130c6ce00/0xe984082ccd721b28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2a8 expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.186501:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593494912:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143667.186560:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143667.192037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.192132:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.192192:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.196916:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.200495:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.226669:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963591587456:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19881us (22314us total) trans 0 rc 770048/770048 00000100:00100000:0.0:1746143667.226681:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2635 00002000:00100000:0.0:1746143667.226697:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1327104->2097151) req@ffff8800930dd880 x1830963591587456/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:63/0 lens 488/440 e 0 to 0 dl 1746143678 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.226706:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd880 with x1830963591587456 ext(1327104->2097151) 00002000:00010000:0.0:1746143667.226712:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dd880 00000100:00100000:0.0:1746143667.227541:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.227580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.232007:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.244183:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.244244:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.251467:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.260695:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.260729:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.260750:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591588608 00000100:00100000:0.0:1746143667.260759:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591588608 00000100:00100000:0.0:1746143667.260794:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591588864 00000100:00100000:0.0:1746143667.260796:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591588864 00000100:00100000:0.0:1746143667.260823:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8182 00000100:00100000:0.0:1746143667.260830:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963591588608:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.260848:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.260864:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd9fa00/0xe984082ccd721b59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f2cb expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.260920:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593495424:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143667.260995:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143667.261013:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8183 00000100:00100000:0.0:1746143667.261018:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963591588864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.261025:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.261031:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd9ec00/0xe984082ccd721b60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f2d9 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.261056:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593495552:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143667.261077:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51396c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143667.261120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.263331:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591588736 00000100:00100000:0.0:1746143667.263340:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591588736 00000100:00100000:0.0:1746143667.263387:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8184 00000100:00100000:0.0:1746143667.263394:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1964:x1830963591588736:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.263409:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.263422:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd9f400/0xe984082ccd721b67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f2d2 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.263467:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593495680:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143667.263540:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139540 going to sleep for 11 seconds 00002000:00010000:0.0:1746143667.266687:0:8496:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143666 -> 1746143667 00000100:00100000:0.0:1746143667.266711:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593495680:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143667.266742:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd9f400/0xe984082ccd721b67 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2d2 expref: 42 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.266754:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd9f400/0xe984082ccd721b67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2d2 expref: 42 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.266778:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd9f400, rc 0) 00000100:00100000:0.0:1746143667.266821:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1964:x1830963591588736:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3426us (5700us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143667.266828:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8184 00000100:00100000:0.0:1746143667.275926:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.275971:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.276012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.277617:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.289707:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.290370:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.290404:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.290434:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.301569:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.316053:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963591589760:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25046us (26344us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143667.316066:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2638 00002000:00100000:0.0:1746143667.316079:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012b7cea00 x1830963591589760/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:63/0 lens 488/440 e 0 to 0 dl 1746143678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.316097:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cea00 with x1830963591589760 ext(2097152->3145727) 00002000:00010000:0.0:1746143667.316103:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cea00 00000100:00100000:0.0:1746143667.339592:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.365698:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.404919:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.410689:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.421299:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.425503:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.428522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.440369:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.444439:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.444469:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.444508:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.444523:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591592448 00000100:00100000:0.0:1746143667.444531:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591592448 00000100:00100000:0.0:1746143667.444556:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7959 00000100:00100000:0.0:1746143667.444562:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:27558:x1830963591592448:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143667.444578:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.444595:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9ee00/0xe984082ccd721bc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f30a expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.444685:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e600/0xe984082ccd721bd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444697:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e600/0xe984082ccd721bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444706:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e600/0xe984082ccd721bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444717:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e800/0xe984082ccd721bd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444722:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e800/0xe984082ccd721bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444727:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e800/0xe984082ccd721bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444822:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9ea00/0xe984082ccd721be5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444829:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9ea00/0xe984082ccd721be5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444835:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9ea00/0xe984082ccd721be5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143667.444843:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143667.444916:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e600/0xe984082ccd721bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444932:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e600/0xe984082ccd721bd0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444941:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e600/0xe984082ccd721bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444947:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd9e600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143667.444950:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e600/0xe984082ccd721bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444957:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e600/0xe984082ccd721bd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444967:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143667.444970:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143667.444974:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e600/0xe984082ccd721bd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444979:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e600/0xe984082ccd721bd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444992:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e800/0xe984082ccd721bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.444996:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e800/0xe984082ccd721bd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.445001:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e800/0xe984082ccd721bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.445004:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd9e800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143667.445006:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e800/0xe984082ccd721bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.445009:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e800/0xe984082ccd721bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.445021:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009066dd00) 00010000:00010000:0.0:1746143667.445023:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143667.445025:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e800/0xe984082ccd721bd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.445029:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9e800/0xe984082ccd721bd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143667.445059:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9ee00/0xe984082ccd721bc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f30a expref: 13 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.445069:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9ea00/0xe984082ccd721be5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f30a expref: 12 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.445074:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143667.445075:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143667.445077:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd9ea00, rc 0) 00000100:00100000:0.0:1746143667.445110:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:27558:x1830963591592448:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 547us (679us total) trans 8589941942 rc 0/0 00000100:00100000:0.0:1746143667.445115:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7959 00000100:00100000:0.0:1746143667.470023:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.470504:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.470528:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591592960 00000100:00100000:0.0:1746143667.470536:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591592960 00010000:00010000:0.0:1746143667.470570:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd721b7c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2ee expref: 24 pid: 8495 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746143667.470594:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591593088 00000100:00100000:0.0:1746143667.470599:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591593088 00010000:00010000:0.0:1746143667.470609:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941d8400/0xe984082ccd721b52 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2c4 expref: 25 pid: 4582 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746143667.470621:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4067 00000100:00100000:0.0:1746143667.470627:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963591592960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143667.470640:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143667.470659:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd721b7c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2ee expref: 24 pid: 8495 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746143667.470668:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd721b7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2ee expref: 24 pid: 8495 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746143667.470693:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143667.470727:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963591592960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.470733:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4067 00000100:00100000:0.0:1746143667.470746:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4068 00000100:00100000:0.0:1746143667.470750:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963591593088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143667.470754:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143667.470759:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941d8400/0xe984082ccd721b52 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2c4 expref: 25 pid: 4582 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746143667.470766:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941d8400/0xe984082ccd721b52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2c4 expref: 25 pid: 4582 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746143667.470774:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.470780:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.470786:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fb2de00/0xe984082ccd721bf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f31f expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.470793:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fb2de00/0xe984082ccd721bf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f31f expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.470819:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fb2de00/0xe984082ccd721bf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f31f expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.470829:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593497216:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143667.470872:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139540 going to sleep for 11 seconds 00010000:00010000:0.0:1746143667.471869:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd721b7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2ee expref: 23 pid: 8495 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746143667.471884:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593496960:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.471892:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941d8400/0xe984082ccd721b52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2c4 expref: 25 pid: 4582 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746143667.471899:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593497088:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.471921:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fb2de00/0xe984082ccd721bf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f31f expref: 22 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.471928:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fb2de00, rc 0) 00000100:00100000:0.0:1746143667.471949:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:27552:x1830963591592832:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 14785us (15205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.471962:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8191 00000100:00100000:0.0:1746143667.476269:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.476333:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.476436:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591593344 00000100:00100000:0.0:1746143667.476446:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591593344 00002000:00100000:0.0:1746143667.476496:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88012b7cf100 x1830963591593344/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/0 e 0 to 0 dl 1746143678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.476506:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cf100 with x1830963591593344 ext(0->1048575) 00002000:00010000:0.0:1746143667.476511:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7cf100 00000100:00100000:0.0:1746143667.476527:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591593600 00000100:00100000:0.0:1746143667.476529:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591593600 00002000:00100000:0.0:1746143667.476541:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a5d82300 x1830963591593600/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/0 e 0 to 0 dl 1746143678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.476547:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82300 with x1830963591593600 ext(1048576->2097151) 00002000:00010000:0.0:1746143667.476549:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d82300 00000100:00100000:0.0:1746143667.476560:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2643 00000100:00100000:0.0:1746143667.476567:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963591593344:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143667.481448:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593497216:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143667.481470:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143667.481501:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963591593088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10749us (10996us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.481512:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4068 00000100:00100000:0.0:1746143667.487675:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591593856 00000100:00100000:0.0:1746143667.487685:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591593856 00002000:00100000:0.0:1746143667.487729:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3256320->3260415) req@ffff8800930df480 x1830963591593856/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/0 e 0 to 0 dl 1746143678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.487744:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df480 with x1830963591593856 ext(3256320->3260415) 00002000:00010000:0.0:1746143667.487750:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930df480 00000100:00100000:0.0:1746143667.487769:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2645 00000100:00100000:0.0:1746143667.487776:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963591593856:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143667.487941:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963591593856:12345-192.168.202.48@tcp:3:cat.0 Request processed in 165us (334us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143667.487947:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2645 00002000:00100000:0.0:1746143667.487952:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3256320->3260415) req@ffff8800930df480 x1830963591593856/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746143678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.487958:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df480 with x1830963591593856 ext(3256320->3260415) 00002000:00010000:0.0:1746143667.487961:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930df480 00010000:00010000:0.0:1746143667.514765:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143667.524704:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.524737:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591594112 00000100:00100000:0.0:1746143667.524747:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591594112 00000100:00100000:0.0:1746143667.524794:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3140 00000100:00100000:0.0:1746143667.524803:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:27552:x1830963591594112:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143667.525070:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:27552:x1830963591594112:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 268us (376us total) trans 8589941943 rc 0/0 00000100:00100000:0.0:1746143667.525077:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3140 00000100:00100000:0.0:1746143667.564408:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591594368 00000100:00100000:0.0:1746143667.564415:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591594368 00002000:00100000:0.0:1746143667.564451:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1613824->2097151) req@ffff880093806300 x1830963591594368/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:63/0 lens 488/0 e 0 to 0 dl 1746143678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.564473:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806300 with x1830963591594368 ext(1613824->2097151) 00010000:00010000:0.0:1746143667.564480:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9c00/0xe984082ccd721ac6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f24d expref: 24 pid: 4582 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746143667.564491:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9c00/0xe984082ccd721ac6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f24d expref: 24 pid: 4582 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746143667.564497:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093806300 00000100:00100000:0.0:1746143667.564525:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 615 00000100:00100000:0.0:1746143667.564532:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591594368:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143667.589948:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591594496 00000100:00100000:0.0:1746143667.589959:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591594496 00010000:00010000:0.0:1746143667.589997:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9c00/0xe984082ccd721ac6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f24d expref: 26 pid: 4582 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746143667.590063:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4069 00000100:00100000:0.0:1746143667.590071:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963591594496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143667.590093:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143667.590115:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9c00/0xe984082ccd721ac6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f24d expref: 26 pid: 4582 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746143667.590128:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9c00/0xe984082ccd721ac6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f24d expref: 26 pid: 4582 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746143667.590362:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9c00/0xe984082ccd721ac6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f24d expref: 26 pid: 4582 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746143667.590383:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.590385:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.590393:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801373de600/0xe984082ccd721bfa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f326 expref: 22 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.590402:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801373de600/0xe984082ccd721bfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f326 expref: 22 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.603893:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.627061:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.627388:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.629700:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.638813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.648793:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.662068:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591596288 00000100:00100000:0.0:1746143667.662079:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591596288 00000100:00100000:0.0:1746143667.662156:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7961 00000100:00100000:0.0:1746143667.662164:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:27565:x1830963591596288:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143667.662189:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.662208:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c200/0xe984082ccd721c32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f350 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.662306:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0xe984082ccd721c39 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143667.662321:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c400/0xe984082ccd721b98 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2f5 expref: 250 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.662338:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9ea00/0xe984082ccd721be5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f30a expref: 13 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.662352:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0xe984082ccd721c39 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143667.662384:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9ea00/0xe984082ccd721be5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f30a expref: 13 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.662397:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd9ea00/0xe984082ccd721be5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f30a expref: 13 pid: 20509 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746143667.662410:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593498112:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.662506:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c400/0xe984082ccd721b98 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2f5 expref: 250 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.662514:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c400/0xe984082ccd721b98 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2f5 expref: 250 pid: 14764 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746143667.664236:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593498240:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.664530:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51396c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143667.668881:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.668939:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.668955:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.668985:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.669298:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591597184 00000100:00100000:0.0:1746143667.669301:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591597184 00002000:00100000:0.0:1746143667.669336:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3604480->4194303) req@ffff880095098e00 x1830963591597184/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/0 e 0 to 0 dl 1746143678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.669346:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098e00 with x1830963591597184 ext(3604480->4194303) 00010000:00010000:0.0:1746143667.669353:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009133d600/0xe984082ccd721ba6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2fc expref: 44 pid: 4581 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746143667.669364:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009133d600/0xe984082ccd721ba6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f2fc expref: 44 pid: 4581 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746143667.669371:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095098e00 00000100:00100000:0.0:1746143667.669383:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 617 00000100:00100000:0.0:1746143667.669389:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1965:x1830963591597184:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143667.670644:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593498112:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.670655:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d82d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593498240:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.670672:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0xe984082ccd721c39 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:0.0:1746143667.694501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.694529:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591597696 00000100:00100000:0.0:1746143667.694536:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591597696 00000100:00100000:0.0:1746143667.694571:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8200 00000100:00100000:0.0:1746143667.694578:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:27559:x1830963591597696:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.694592:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.694607:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd721c5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f36c expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.694642:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143667.694647:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800952eda00/0xe984082ccd721c40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2764800->3145727] (req 2764800->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f357 expref: 23 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.694652:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143667.694655:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd721c5c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f36c expref: 45 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.694684:0:8496:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800952eda00/0xe984082ccd721c40 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2764800->3145727] (req 2764800->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f357 expref: 23 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.694694:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd721c5c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f36c expref: 45 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.694727:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7eac00, rc 0) 00000100:00100000:0.0:1746143667.694760:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:27559:x1830963591597696:12345-192.168.202.48@tcp:101:cat.0 Request processed in 182us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.694765:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8200 00000100:00100000:0.0:1746143667.712979:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.715795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.715816:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591598592 00000100:00100000:0.0:1746143667.715820:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591598592 00000100:00100000:0.0:1746143667.715844:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8201 00000100:00100000:0.0:1746143667.715849:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+22:27563:x1830963591598592:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.715860:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.715871:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948cf800/0xe984082ccd721c63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f373 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.715896:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143667.715901:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948cf800/0xe984082ccd721c63 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f373 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.715910:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948cf800/0xe984082ccd721c63 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f373 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.715918:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948cf800, rc 0) 00000100:00100000:0.0:1746143667.715945:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+23:27563:x1830963591598592:12345-192.168.202.48@tcp:101:cat.0 Request processed in 95us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.715950:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8201 00000100:00100000:0.0:1746143667.727345:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591598848 00000100:00100000:0.0:1746143667.727349:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591598848 00000100:00100000:0.0:1746143667.727369:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8202 00000100:00100000:0.0:1746143667.727374:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:27558:x1830963591598848:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143667.727382:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.727393:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bc1bc00/0xe984082ccd721c6a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f37a expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.727410:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fb2de00/0xe984082ccd721bf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f31f expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.727416:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143667.727418:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143667.727420:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc1bc00/0xe984082ccd721c6a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->2629631] (req 2097152->2629631) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f37a expref: 10 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.727451:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fb2de00/0xe984082ccd721bf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f31f expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.727459:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fb2de00/0xe984082ccd721bf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f31f expref: 16 pid: 4582 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746143667.727469:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593499264:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.727504:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143667.731697:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.731719:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.731752:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009509a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593499264:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.731772:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bc1bc00/0xe984082ccd721c6a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->2629631] (req 2097152->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f37a expref: 10 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.731786:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc1bc00, rc 0) 00000100:00100000:0.0:1746143667.731816:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:27558:x1830963591598848:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4442us (5056us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.731823:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8202 00000100:00100000:0.0:1746143667.731849:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591599360 00000100:00100000:0.0:1746143667.731853:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591599360 00002000:00100000:0.0:1746143667.731873:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3260415) req@ffff880095098700 x1830963591599360/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/0 e 0 to 0 dl 1746143678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.731880:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098700 with x1830963591599360 ext(3145728->3260415) 00010000:00010000:0.0:1746143667.731885:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fb2de00/0xe984082ccd721bf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f31f expref: 17 pid: 4582 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746143667.731898:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fb2de00/0xe984082ccd721bf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f31f expref: 17 pid: 4582 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746143667.731904:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095098700 00000100:00100000:0.0:1746143667.731914:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591599616 00000100:00100000:0.0:1746143667.731917:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591599616 00002000:00100000:0.0:1746143667.731927:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34a:0x0] (1757184->1761279) req@ffff88009509b800 x1830963591599616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/0 e 0 to 0 dl 1746143678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.731932:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509b800 with x1830963591599616 ext(1757184->1761279) 00002000:00010000:0.0:1746143667.731936:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009509b800 00000100:00100000:0.0:1746143667.731945:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 620 00000100:00100000:0.0:1746143667.731950:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963591599360:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143667.732093:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2651 00000100:00100000:0.0:1746143667.732099:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963591599616:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143667.732189:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963591599616:12345-192.168.202.48@tcp:3:cat.0 Request processed in 90us (469us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143667.732195:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2651 00002000:00100000:0.0:1746143667.732199:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1757184->1761279) req@ffff88009509b800 x1830963591599616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746143678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.732205:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509b800 with x1830963591599616 ext(1757184->1761279) 00002000:00010000:0.0:1746143667.732207:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009509b800 00000100:00100000:0.0:1746143667.759129:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2654 00000100:00100000:0.0:1746143667.759155:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1963:x1830963591600384:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143667.762513:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.788011:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.805667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.805701:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.805766:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.805784:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591601792 00000100:00100000:0.0:1746143667.805786:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591601792 00000100:00100000:0.0:1746143667.805805:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8203 00000100:00100000:0.0:1746143667.805810:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:27559:x1830963591601792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.805820:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.805832:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5643800/0xe984082ccd721c71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f381 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.805850:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bc1bc00/0xe984082ccd721c6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f37a expref: 12 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.805856:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143667.805857:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143667.805860:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5643800/0xe984082ccd721c71 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f381 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.805880:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bc1bc00/0xe984082ccd721c6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f37a expref: 12 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.805889:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bc1bc00/0xe984082ccd721c6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f37a expref: 12 pid: 8495 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746143667.805916:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593499776:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.805974:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51396c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143667.815302:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.815404:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.830092:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591602304 00000100:00100000:0.0:1746143667.830099:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591602304 00000100:00100000:0.0:1746143667.830136:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3142 00000100:00100000:0.0:1746143667.830164:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fd67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:7696:x1830963591602304:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143667.830323:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fd67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:7696:x1830963591602304:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 159us (493us total) trans 8589941947 rc 0/0 00000100:00100000:0.0:1746143667.832238:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3142 00000100:00100000:0.0:1746143667.840271:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.840309:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.845399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.851450:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591603200 00000100:00100000:0.0:1746143667.851453:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591603200 00000100:00100000:0.0:1746143667.851469:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591603328 00000100:00100000:0.0:1746143667.851471:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591603328 00000100:00100000:0.0:1746143667.851485:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8205 00000100:00100000:0.0:1746143667.851491:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963591602816:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143667.851504:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.851515:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a63ff800/0xe984082ccd721c9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f396 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.851546:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593500288:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143667.851597:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143667.851613:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8206 00000100:00100000:0.0:1746143667.851618:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963591602944:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143667.851624:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.851630:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a63ff600/0xe984082ccd721ca2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f39d expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.851639:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.851640:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.851645:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63ff600/0xe984082ccd721ca2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f39d expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.851656:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a63ff600/0xe984082ccd721ca2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f39d expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.851664:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63ff600, rc 0) 00000100:00100000:0.0:1746143667.851679:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963591602944:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 61us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.851684:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8206 00000100:00100000:0.0:1746143667.851694:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8207 00000100:00100000:0.0:1746143667.851698:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963591603072:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143667.851703:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.851710:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a63ffc00/0xe984082ccd721ca9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f3a4 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.851718:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.851723:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.851727:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63ffc00/0xe984082ccd721ca9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3a4 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.851735:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a63ffc00/0xe984082ccd721ca9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3a4 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.851741:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63ffc00, rc 0) 00000100:00100000:0.0:1746143667.851752:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963591603072:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 54us (2027us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.851757:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8207 00000100:00100000:0.0:1746143667.851764:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8208 00000100:00100000:0.0:1746143667.851768:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963591603200:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143667.851772:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.851776:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a63ff400/0xe984082ccd721cb0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f3ab expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.851782:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.851783:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.851786:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63ff400/0xe984082ccd721cb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3ab expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.851793:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a63ff400/0xe984082ccd721cb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3ab expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.851798:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63ff400, rc 0) 00000100:00100000:0.0:1746143667.851805:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963591603200:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 38us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.851815:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8208 00000100:00100000:0.0:1746143667.851823:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8209 00000100:00100000:0.0:1746143667.851826:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963591603328:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143667.851830:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.851834:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a63fec00/0xe984082ccd721cb7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f3b2 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.851841:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.851842:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.851845:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63fec00/0xe984082ccd721cb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3b2 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.851852:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a63fec00/0xe984082ccd721cb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3b2 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.851856:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63fec00, rc 0) 00000100:00100000:0.0:1746143667.851865:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963591603328:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 38us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.851868:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8209 00000100:00100000:0.0:1746143667.854752:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.866677:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591603840 00000100:00100000:0.0:1746143667.866683:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591603840 00002000:00100000:0.0:1746143667.866712:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880093804e00 x1830963591603840/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/0 e 0 to 0 dl 1746143678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.866720:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804e00 with x1830963591603840 ext(2097152->3145727) 00002000:00010000:0.0:1746143667.866724:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093804e00 00000100:00100000:0.0:1746143667.867365:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2659 00000100:00100000:0.0:1746143667.867371:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963591603840:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143667.882524:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591604864 00000100:00100000:0.0:1746143667.882533:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591604864 00000100:00100000:0.0:1746143667.882587:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8210 00000100:00100000:0.0:1746143667.882594:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963591604864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.882608:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.882622:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5643600/0xe984082ccd721cd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f3c0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.882668:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593500544:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143667.882727:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143667.894229:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.912168:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591606016 00000100:00100000:0.0:1746143667.912172:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591606016 00000100:00100000:0.0:1746143667.912190:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591606144 00000100:00100000:0.0:1746143667.912191:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591606144 00000100:00100000:0.0:1746143667.912204:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8214 00000100:00100000:0.0:1746143667.912209:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591605888:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143667.912225:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cd8dc00/0xe984082ccd721d04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912234:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd721c2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f349 expref: 21 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912240:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a63ffc00/0xe984082ccd721ca9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3a4 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.912259:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c6ce00/0xe984082ccd721c47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f35e expref: 11 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912264:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.912266:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.912268:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd8dc00/0xe984082ccd721d04 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912283:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c6ce00/0xe984082ccd721c47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f35e expref: 11 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912290:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c6ce00/0xe984082ccd721c47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f35e expref: 11 pid: 8495 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746143667.912297:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593501568:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.912334:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a63ffc00/0xe984082ccd721ca9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3a4 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.912342:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a63ffc00/0xe984082ccd721ca9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3a4 expref: 11 pid: 25369 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746143667.912348:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593501696:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.912367:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd721c2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f349 expref: 21 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912383:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd721c2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f349 expref: 21 pid: 8496 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746143667.912389:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593501824:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.912403:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143667.912416:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8215 00000100:00100000:0.0:1746143667.912421:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591606016:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143667.912435:0:8497:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cd8c600/0xe984082ccd721d0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912444:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd721c5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f36c expref: 21 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912450:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a63ff400/0xe984082ccd721cb0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3ab expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.912455:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948cf800/0xe984082ccd721c63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f373 expref: 11 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912460:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.912462:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.912464:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd8c600/0xe984082ccd721d0b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912477:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948cf800/0xe984082ccd721c63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f373 expref: 11 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912488:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948cf800/0xe984082ccd721c63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f373 expref: 11 pid: 4582 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746143667.912495:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593501952:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.912520:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a63ff400/0xe984082ccd721cb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3ab expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.912526:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a63ff400/0xe984082ccd721cb0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3ab expref: 11 pid: 25369 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746143667.912532:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593502080:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.912550:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd721c5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f36c expref: 21 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912557:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd721c5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f36c expref: 21 pid: 8496 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746143667.912563:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593502208:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.912575:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143667.912588:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8216 00000100:00100000:0.0:1746143667.912594:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963591606144:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143667.912608:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a24800/0xe984082ccd721d12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912624:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5643800/0xe984082ccd721c71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f381 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912630:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a63fec00/0xe984082ccd721cb7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3b2 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.912637:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b30200/0xe984082ccd721c94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f38f expref: 11 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912642:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.912643:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.912644:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a24800/0xe984082ccd721d12 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912658:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093b30200/0xe984082ccd721c94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f38f expref: 11 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912664:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093b30200/0xe984082ccd721c94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f38f expref: 11 pid: 8495 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746143667.912671:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593502336:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.912693:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a63fec00/0xe984082ccd721cb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3b2 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.912699:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a63fec00/0xe984082ccd721cb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3b2 expref: 10 pid: 25369 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746143667.912715:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593502464:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.912739:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5643800/0xe984082ccd721c71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f381 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.912746:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5643800/0xe984082ccd721c71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f381 expref: 18 pid: 8495 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746143667.912752:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593502592:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.912764:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51396c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143667.913779:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.915373:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.933198:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.934438:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593501568:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.934446:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593501696:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.934452:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593501824:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.934471:0:4582:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cd8dc00/0xe984082ccd721d04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.934489:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593501952:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.934495:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593502080:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.934501:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593502208:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.934526:0:8497:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cd8c600/0xe984082ccd721d0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.934545:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593501184:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.934552:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593501312:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.934558:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593501440:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.934571:0:8495:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721cfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.934604:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593502336:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.934628:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593502464:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143667.935108:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593502592:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143667.935122:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130a24800/0xe984082ccd721d12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.936596:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.936631:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.936649:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.936675:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.936925:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.936950:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.936963:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143667.937672:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.937694:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.937712:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.937717:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721cfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.937848:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721cfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.937854:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b144200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143667.937857:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721cfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.937863:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721cfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.937872:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721cfd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.937878:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721cfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.937976:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963591605760:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 26122us (26195us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.937987:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8213 00000100:00100000:0.0:1746143667.938022:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.938173:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.938189:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.938240:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143667.938250:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cd8dc00/0xe984082ccd721d04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.938256:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd8dc00/0xe984082ccd721d04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.938268:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cd8dc00/0xe984082ccd721d04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.938274:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd8dc00/0xe984082ccd721d04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.938280:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cd8dc00/0xe984082ccd721d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.938284:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd8dc00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143667.938287:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cd8dc00/0xe984082ccd721d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.938293:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cd8dc00/0xe984082ccd721d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.938309:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cd8dc00/0xe984082ccd721d04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.938314:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd8dc00/0xe984082ccd721d04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.938341:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963591605888:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 26131us (26541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.938346:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8214 00000100:00100000:0.0:1746143667.938411:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4096 00000100:00100000:0.0:1746143667.938416:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963591609088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143667.938422:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143667.938429:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a63fec00/0xe984082ccd721cb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3b2 expref: 9 pid: 25369 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746143667.938437:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a63fec00/0xe984082ccd721cb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3b2 expref: 9 pid: 25369 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746143667.938447:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a63fec00/0xe984082ccd721cb7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3b2 expref: 9 pid: 25369 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746143667.938454:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.938455:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.938458:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a24800/0xe984082ccd721d12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.938472:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a24800/0xe984082ccd721d12 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.938485:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143667.938500:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591609088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 84us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.938505:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4096 00000100:00100000:0.0:1746143667.939802:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963591606400:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25393us (26026us total) trans 0 rc 704512/704512 00000100:00100000:0.0:1746143667.939808:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 622 00002000:00100000:0.0:1746143667.939815:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094459500 x1830963591606400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:63/0 lens 488/440 e 0 to 0 dl 1746143678 ref 1 fl Complete:H/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143667.939822:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459500 with x1830963591606400 ext(4194304->4898815) 00010000:00010000:0.0:1746143667.939827:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd721c5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f36c expref: 20 pid: 8496 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746143667.939835:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd721c5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f36c expref: 20 pid: 8496 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746143667.940097:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094459500 00000100:00100000:0.0:1746143667.944923:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.946246:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8221 00000100:00100000:0.0:1746143667.946253:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963591609472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.946259:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.946278:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801369eb600/0xe984082ccd721d58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f3f1 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.946295:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.946751:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.946758:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801369eb600/0xe984082ccd721d58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3f1 expref: 21 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.946772:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801369eb600/0xe984082ccd721d58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3f1 expref: 21 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.946781:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369eb600, rc 0) 00000100:00100000:0.0:1746143667.946814:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963591609472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 560us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.946820:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8221 00000100:00100000:0.0:1746143667.946834:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591609984 00000100:00100000:0.0:1746143667.946838:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591609984 00000100:00100000:0.0:1746143667.946851:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591609856 00000100:00100000:0.0:1746143667.946853:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591609856 00000100:00100000:0.0:1746143667.946863:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591610112 00000100:00100000:0.0:1746143667.946865:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591610112 00000100:00100000:0.0:1746143667.946876:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8223 00000100:00100000:0.0:1746143667.946881:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963591609728:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.946890:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.946901:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd721d66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f3ff expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143667.946922:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34b:0x0] initial LVB size: 2097152, mtime: 0x681409b2, atime: 0x681409b2, ctime: 0x681409b2, blocks: 0x81d 00010000:00010000:0.0:1746143667.946933:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.946942:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.946948:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd721d66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3ff expref: 24 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.946960:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd721d66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3ff expref: 24 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.946968:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948cf800, rc 0) 00000100:00100000:0.0:1746143667.946992:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963591609728:12345-192.168.202.48@tcp:101:cat.0 Request processed in 110us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.946998:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8223 00000100:00100000:0.0:1746143667.947015:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8224 00000100:00100000:0.0:1746143667.947021:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963591609984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.947028:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.947037:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd721d6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f40d expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.947047:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.947055:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd721d6d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f40d expref: 23 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.947064:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd721d6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f40d expref: 23 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.947079:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b144200, rc 0) 00000100:00100000:0.0:1746143667.947114:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963591609984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 92us (495us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143667.947129:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8224 00000100:00100000:0.0:1746143667.947171:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8225 00000100:00100000:0.0:1746143667.947179:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963591609856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.947187:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.947197:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b145200/0xe984082ccd721d74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f406 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143667.947211:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409b3, atime: 0x681409b2, ctime: 0x681409b2, blocks: 0x81d 00010000:00010000:0.0:1746143667.947222:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.947223:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.947229:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b145200/0xe984082ccd721d74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f406 expref: 22 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.947238:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b145200/0xe984082ccd721d74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f406 expref: 22 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.947245:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b145200, rc 0) 00000100:00100000:0.0:1746143667.947269:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963591609856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 90us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.947274:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8225 00000100:00100000:0.0:1746143667.947289:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8226 00000100:00100000:0.0:1746143667.947295:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963591610112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.947302:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.947311:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b145600/0xe984082ccd721d7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f414 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143667.947333:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409b3, atime: 0x681409b3, ctime: 0x681409b3, blocks: 0x1029 00010000:00010000:0.0:1746143667.947344:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.947345:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.947351:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b145600/0xe984082ccd721d7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f414 expref: 24 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.947360:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b145600/0xe984082ccd721d7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f414 expref: 24 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.947367:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b145600, rc 0) 00000100:00100000:0.0:1746143667.947390:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963591610112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 94us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.947395:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8226 00000100:00100000:0.0:1746143667.955256:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143667.955563:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cd8c600/0xe984082ccd721d0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.955571:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd8c600/0xe984082ccd721d0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.955592:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cd8c600/0xe984082ccd721d0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.955599:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd8c600/0xe984082ccd721d0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.955618:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cd8c600/0xe984082ccd721d0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.955624:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd8c600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143667.955627:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cd8c600/0xe984082ccd721d0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.955634:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cd8c600/0xe984082ccd721d0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.955642:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.955644:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.955648:0:8497:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b31800/0xe984082ccd721d51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3ea expref: 8 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.955654:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b31800/0xe984082ccd721d51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3ea expref: 8 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.955660:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.955661:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.955663:0:8497:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095178c00/0xe984082ccd721d82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f41b expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.955668:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095178c00/0xe984082ccd721d82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f41b expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.955690:0:8497:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095178c00/0xe984082ccd721d82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f41b expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.955706:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593503104:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143667.956364:0:8497:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093b31800/0xe984082ccd721d51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f3ea expref: 8 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.956372:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593503232:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143667.956391:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143667.960578:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593503104:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143667.960591:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593503232:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143667.960613:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cd8c600/0xe984082ccd721d0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.960621:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd8c600/0xe984082ccd721d0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143667.961540:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1963:x1830963591606016:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 49119us (49495us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.961545:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8215 00000100:00100000:0.0:1746143667.961976:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8232 00000100:00100000:0.0:1746143667.961980:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963591611008:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143667.961986:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143667.961991:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd721da5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f43e expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143667.962013:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.962057:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143667.962061:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd721da5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f43e expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.962070:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd721da5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f43e expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143667.962076:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b145000, rc 0) 00000100:00100000:0.0:1746143667.962098:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963591611008:12345-192.168.202.48@tcp:101:cat.0 Request processed in 118us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143667.962102:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8232 00000100:00100000:0.0:1746143667.966446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.969368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.974714:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.992397:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143667.994686:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.126019:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593503360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143668.126105:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143668.129529:0:3292:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839471 gen 2 00000004:00080000:0.0:1746143668.129536:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd6a00, transno 21474839400 00000004:00080000:0.0:1746143668.129547:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd5880, transno 21474839401 00000004:00080000:0.0:1746143668.129550:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd5c00, transno 21474839402 00000004:00080000:0.0:1746143668.129552:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd6300, transno 21474839403 00000004:00080000:0.0:1746143668.129555:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd4000, transno 21474839404 00000004:00080000:0.0:1746143668.129557:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd4700, transno 21474839405 00000004:00080000:0.0:1746143668.129573:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd7480, transno 21474839406 00000004:00080000:0.0:1746143668.129576:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd7800, transno 21474839407 00000004:00080000:0.0:1746143668.129578:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c3100, transno 21474839408 00000004:00080000:0.0:1746143668.129580:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c0700, transno 21474839409 00000004:00080000:0.0:1746143668.129582:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c0e00, transno 21474839410 00000004:00080000:0.0:1746143668.129584:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c3480, transno 21474839411 00000004:00080000:0.0:1746143668.129586:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c1500, transno 21474839412 00000004:00080000:0.0:1746143668.129588:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c2a00, transno 21474839413 00000004:00080000:0.0:1746143668.129590:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c10700, transno 21474839414 00000004:00080000:0.0:1746143668.129592:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c1880, transno 21474839415 00000004:00080000:0.0:1746143668.129594:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c20700, transno 21474839417 00000004:00080000:0.0:1746143668.129596:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ee680, transno 21474839418 00000004:00080000:0.0:1746143668.129598:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c21f80, transno 21474839419 00000004:00080000:0.0:1746143668.129600:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305c8000, transno 21474839420 00000004:00080000:0.0:1746143668.129602:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094304700, transno 21474839421 00000004:00080000:0.0:1746143668.129604:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ece00, transno 21474839422 00000004:00080000:0.0:1746143668.129606:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094306680, transno 21474839423 00000004:00080000:0.0:1746143668.129607:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1eea00, transno 21474839424 00000004:00080000:0.0:1746143668.129610:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136918380, transno 21474839425 00000004:00080000:0.0:1746143668.129612:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ee300, transno 21474839426 00000004:00080000:0.0:1746143668.129614:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136919500, transno 21474839427 00000004:00080000:0.0:1746143668.129616:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136918a80, transno 21474839428 00000004:00080000:0.0:1746143668.129618:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013691bb80, transno 21474839429 00000004:00080000:0.0:1746143668.129620:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136919180, transno 21474839430 00000004:00080000:0.0:1746143668.129622:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013691a680, transno 21474839431 00000004:00080000:0.0:1746143668.129623:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136919880, transno 21474839432 00000004:00080000:0.0:1746143668.129625:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ae680, transno 21474839437 00000004:00080000:0.0:1746143668.129627:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ace00, transno 21474839438 00000004:00080000:0.0:1746143668.129629:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ad180, transno 21474839439 00000004:00080000:0.0:1746143668.129630:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0aed80, transno 21474839440 00000004:00080000:0.0:1746143668.129637:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ad880, transno 21474839441 00000004:00080000:0.0:1746143668.129639:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0aca80, transno 21474839442 00000004:00080000:0.0:1746143668.129641:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0afb80, transno 21474839443 00000004:00080000:0.0:1746143668.129642:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ad500, transno 21474839444 00000004:00080000:0.0:1746143668.129645:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d3b80, transno 21474839445 00000004:00080000:0.0:1746143668.129647:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094458000, transno 21474839446 00000004:00080000:0.0:1746143668.129649:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009445bb80, transno 21474839447 00000004:00080000:0.0:1746143668.129650:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d0380, transno 21474839448 00000004:00080000:0.0:1746143668.129652:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094459880, transno 21474839449 00000004:00080000:0.0:1746143668.129654:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d0000, transno 21474839450 00000004:00080000:0.0:1746143668.129655:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009445aa00, transno 21474839451 00000004:00080000:0.0:1746143668.129657:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d2300, transno 21474839452 00000004:00080000:0.0:1746143668.129660:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef7b80, transno 21474839456 00000004:00080000:0.0:1746143668.129662:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef5f80, transno 21474839457 00000004:00080000:0.0:1746143668.129664:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a2300, transno 21474839458 00000004:00080000:0.0:1746143668.129665:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef4e00, transno 21474839459 00000004:00080000:0.0:1746143668.129668:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef5880, transno 21474839460 00000004:00080000:0.0:1746143668.129669:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef4700, transno 21474839461 00000004:00080000:0.0:1746143668.129671:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef6a00, transno 21474839462 00000004:00080000:0.0:1746143668.129673:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a2680, transno 21474839463 00000004:00080000:0.0:1746143668.129675:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd7b80, transno 21474839464 00000004:00080000:0.0:1746143668.129677:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef7800, transno 21474839465 00000004:00080000:0.0:1746143668.129679:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe0e00, transno 21474839466 00000004:00080000:0.0:1746143668.129681:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef6300, transno 21474839467 00000004:00080000:0.0:1746143668.129683:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5ac380, transno 21474839468 00000004:00080000:0.0:1746143668.129685:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef4380, transno 21474839469 00000004:00080000:0.0:1746143668.129687:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd6d80, transno 21474839470 00000004:00080000:0.0:1746143668.129689:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe0380, transno 21474839471 00000100:00100000:0.0:1746143668.129700:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593503360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143668.139565:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.142643:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1830963593503872:0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.142686:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143668.142711:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143668.142717:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1830963593504000:0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.142736:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143668.142783:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593503872 00000100:00100000:0.0:1746143668.142788:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593503872 00000100:00100000:0.0:1746143668.142825:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593504000 00000100:00100000:0.0:1746143668.142828:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593504000 00000100:00100000:0.0:1746143668.142849:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1746143668.142856:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830963593503872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.142897:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830963593503872:12345-0@lo:400:kworker.0 Request processed in 41us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.142903:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1746143668.142918:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1746143668.142923:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830963593504000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.142947:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830963593504000:12345-0@lo:400:kworker.0 Request processed in 24us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.142952:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1746143668.142982:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1830963593504000:0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.142991:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1830963593503872:0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.143030:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b20e2be-dc58-49ff-81b7-9c0574412294:3293:1830963593503744:0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.143057:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143668.143099:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830963593504256:0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.143135:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143668.143177:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143668.143184:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593504128:0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.143205:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143668.143228:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593504256 00000100:00100000:0.0:1746143668.143231:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593504256 00000100:00100000:0.0:1746143668.143249:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1746143668.143254:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963593504256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.143285:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963593504256:12345-0@lo:400:kworker.0 Request processed in 30us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.143290:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1746143668.143314:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830963593504256:0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.143412:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593503488:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143668.143421:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593503616:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143668.143441:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b31600/0xe984082ccd721dcf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [188416->1048575] (req 188416->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f44c expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.143455:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b31600, rc 0) 00000100:00100000:0.0:1746143668.143483:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:27573:x1830963591612672:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2868us (3927us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.143489:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8233 00000100:00100000:0.0:1746143668.143601:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593504128 00000100:00100000:0.0:1746143668.143604:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593504128 00000100:00100000:0.0:1746143668.143624:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1746143668.143629:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1830963593504128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.143672:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1830963593504128:12345-0@lo:400:kworker.0 Request processed in 42us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.143677:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1746143668.143697:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872187 gen 2 00000004:00080000:0.0:1746143668.143702:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094305500, transno 17179872102 00000004:00080000:0.0:1746143668.143710:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a1180, transno 17179872103 00000004:00080000:0.0:1746143668.143712:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094304a80, transno 17179872104 00000004:00080000:0.0:1746143668.143715:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a0a80, transno 17179872105 00000004:00080000:0.0:1746143668.143717:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094304e00, transno 17179872106 00000004:00080000:0.0:1746143668.143719:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094306d80, transno 17179872107 00000004:00080000:0.0:1746143668.143721:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094307800, transno 17179872108 00000004:00080000:0.0:1746143668.143722:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094305c00, transno 17179872109 00000004:00080000:0.0:1746143668.143724:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c2680, transno 17179872110 00000004:00080000:0.0:1746143668.143726:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c0a80, transno 17179872111 00000004:00080000:0.0:1746143668.143728:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c2300, transno 17179872112 00000004:00080000:0.0:1746143668.143730:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c0000, transno 17179872113 00000004:00080000:0.0:1746143668.143732:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c3800, transno 17179872114 00000004:00080000:0.0:1746143668.143733:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c0380, transno 17179872115 00000004:00080000:0.0:1746143668.143735:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c1180, transno 17179872116 00000004:00080000:0.0:1746143668.143737:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c1f80, transno 17179872117 00000004:00080000:0.0:1746143668.143739:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090765500, transno 17179872118 00000004:00080000:0.0:1746143668.143741:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930c1c00, transno 17179872119 00000004:00080000:0.0:1746143668.143743:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63d500, transno 17179872122 00000004:00080000:0.0:1746143668.143745:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63f480, transno 17179872123 00000004:00080000:0.0:1746143668.143747:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63ca80, transno 17179872124 00000004:00080000:0.0:1746143668.143749:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63d180, transno 17179872125 00000004:00080000:0.0:1746143668.143750:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63d880, transno 17179872126 00000004:00080000:0.0:1746143668.143752:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63f800, transno 17179872127 00000004:00080000:0.0:1746143668.143759:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090765180, transno 17179872128 00000004:00080000:0.0:1746143668.143761:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63c700, transno 17179872129 00000004:00080000:0.0:1746143668.143764:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63ea00, transno 17179872130 00000004:00080000:0.0:1746143668.143766:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f02a00, transno 17179872132 00000004:00080000:0.0:1746143668.143767:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f00a80, transno 17179872133 00000004:00080000:0.0:1746143668.143769:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f01880, transno 17179872134 00000004:00080000:0.0:1746143668.143771:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f00e00, transno 17179872135 00000004:00080000:0.0:1746143668.143773:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093502680, transno 17179872136 00000004:00080000:0.0:1746143668.143775:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f02d80, transno 17179872137 00000004:00080000:0.0:1746143668.143777:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f00000, transno 17179872138 00000004:00080000:0.0:1746143668.143779:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f01c00, transno 17179872139 00000004:00080000:0.0:1746143668.143781:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f01f80, transno 17179872140 00000004:00080000:0.0:1746143668.143783:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f184380, transno 17179872147 00000004:00080000:0.0:1746143668.143784:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f187480, transno 17179872148 00000004:00080000:0.0:1746143668.143786:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f184e00, transno 17179872149 00000004:00080000:0.0:1746143668.143788:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f184a80, transno 17179872150 00000004:00080000:0.0:1746143668.143790:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f185180, transno 17179872151 00000004:00080000:0.0:1746143668.143792:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f186d80, transno 17179872152 00000004:00080000:0.0:1746143668.143794:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f186300, transno 17179872153 00000004:00080000:0.0:1746143668.143796:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe0700, transno 17179872154 00000004:00080000:0.0:1746143668.143798:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c10380, transno 17179872155 00000004:00080000:0.0:1746143668.143801:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e2680, transno 17179872156 00000004:00080000:0.0:1746143668.143802:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e0700, transno 17179872157 00000004:00080000:0.0:1746143668.143804:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e0a80, transno 17179872158 00000004:00080000:0.0:1746143668.143806:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e0e00, transno 17179872159 00000004:00080000:0.0:1746143668.143807:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f02300, transno 17179872160 00000004:00080000:0.0:1746143668.143809:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e3b80, transno 17179872161 00000004:00080000:0.0:1746143668.143811:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e3480, transno 17179872162 00000004:00080000:0.0:1746143668.143812:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e1180, transno 17179872163 00000004:00080000:0.0:1746143668.143814:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093502300, transno 17179872164 00000004:00080000:0.0:1746143668.143820:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dc000, transno 17179872170 00000004:00080000:0.0:1746143668.143823:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f531180, transno 17179872171 00000004:00080000:0.0:1746143668.143825:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f531f80, transno 17179872172 00000004:00080000:0.0:1746143668.143827:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a2a00, transno 17179872173 00000004:00080000:0.0:1746143668.143828:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f532d80, transno 17179872174 00000004:00080000:0.0:1746143668.143830:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a3480, transno 17179872175 00000004:00080000:0.0:1746143668.143832:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a3800, transno 17179872176 00000004:00080000:0.0:1746143668.143834:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f533100, transno 17179872177 00000004:00080000:0.0:1746143668.143836:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a0a80, transno 17179872178 00000004:00080000:0.0:1746143668.143838:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c20a80, transno 17179872179 00000004:00080000:0.0:1746143668.143840:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63fb80, transno 17179872180 00000004:00080000:0.0:1746143668.143842:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63df80, transno 17179872181 00000004:00080000:0.0:1746143668.143844:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c20e00, transno 17179872182 00000004:00080000:0.0:1746143668.143845:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c22a00, transno 17179872183 00000004:00080000:0.0:1746143668.143847:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63e680, transno 17179872184 00000004:00080000:0.0:1746143668.143849:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c23b80, transno 17179872185 00000004:00080000:0.0:1746143668.143850:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63c000, transno 17179872186 00000004:00080000:0.0:1746143668.143852:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63ed80, transno 17179872187 00000100:00100000:0.0:1746143668.143857:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593504128:0@lo:400:kworker.0 00000004:00080000:0.0:1746143668.144309:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 72 done 00000100:00100000:0.0:1746143668.144415:0:14758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593503744 00000100:00100000:0.0:1746143668.144419:0:14758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593503744 00000100:00100000:0.0:1746143668.144441:0:14758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1746143668.144447:0:14758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3293:x1830963593503744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.144477:0:14758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3293:x1830963593503744:12345-0@lo:400:kworker.0 Request processed in 30us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.144482:0:14758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1746143668.144507:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b20e2be-dc58-49ff-81b7-9c0574412294:3293:1830963593503744:0@lo:400:kworker.0 00000100:00100000:0.0:1746143668.146122:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.146356:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.156231:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.158066:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593504768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143668.158106:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143668.158572:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593504768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143668.160612:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.164797:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593504896:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143668.164807:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593505152:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143668.164830:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009af08400/0xe984082ccd721ddd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1048576->1085439] (req 1048576->1085439) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f45a expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.164843:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af08400, rc 0) 00000100:00100000:0.0:1746143668.164901:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:27573:x1830963591613696:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3178us (3332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.164907:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8235 00000100:00100000:0.0:1746143668.166882:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.173022:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591614592 00000100:00100000:0.0:1746143668.173027:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591614592 00000100:00100000:0.0:1746143668.173063:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8236 00000100:00100000:0.0:1746143668.173068:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+12:27571:x1830963591614592:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143668.173088:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143668.173103:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721de4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f461 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.173161:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b145600/0xe984082ccd721d7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f414 expref: 20 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.173168:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b30c00/0xe984082ccd721d9e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f437 expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.173174:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.173175:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.173179:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721de4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->3936255] (req 3145728->3936255) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f461 expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.173202:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093b30c00/0xe984082ccd721d9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f437 expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.173212:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093b30c00/0xe984082ccd721d9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f437 expref: 13 pid: 8495 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746143668.173222:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593505408:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143668.173294:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b145600/0xe984082ccd721d7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f414 expref: 20 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.173302:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b145600/0xe984082ccd721d7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f414 expref: 20 pid: 4582 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746143668.173309:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593505536:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143668.173331:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143668.177133:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593505408:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143668.177168:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593505536:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143668.177198:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721de4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->3936255] (req 3145728->3936255) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f461 expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.177212:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b144200, rc 0) 00000100:00100000:0.0:1746143668.177248:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:27571:x1830963591614592:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4179us (4301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.177256:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8236 00000100:00100000:0.0:1746143668.177760:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591615104 00000100:00100000:0.0:1746143668.177763:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591615104 00010000:00010000:0.0:1746143668.177776:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093b30c00/0xe984082ccd721d9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f437 expref: 13 pid: 8495 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746143668.177790:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591614976 00000100:00100000:0.0:1746143668.177792:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591614976 00010000:00010000:0.0:1746143668.177799:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b145600/0xe984082ccd721d7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f414 expref: 21 pid: 4582 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746143668.177986:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4105 00000100:00100000:0.0:1746143668.177992:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963591615104:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143668.178000:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143668.178016:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093b30c00/0xe984082ccd721d9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f437 expref: 13 pid: 8495 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746143668.178037:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093b30c00/0xe984082ccd721d9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f437 expref: 13 pid: 8495 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746143668.178054:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b30c00/0xe984082ccd721d9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f437 expref: 13 pid: 8495 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746143668.178066:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143668.178095:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963591615104:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 103us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.178101:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4105 00000100:00100000:0.0:1746143668.178113:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4106 00000100:00100000:0.0:1746143668.178117:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963591614976:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143668.178123:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143668.178130:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b145600/0xe984082ccd721d7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f414 expref: 21 pid: 4582 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746143668.178137:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b145600/0xe984082ccd721d7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f414 expref: 21 pid: 4582 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746143668.178166:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b145600/0xe984082ccd721d7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f414 expref: 21 pid: 4582 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746143668.178173:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.178175:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.178180:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721de4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f461 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.178192:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721de4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f461 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.178214:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd721de4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f461 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143668.178223:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593505664:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143668.178265:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139f00 going to sleep for 11 seconds 00000100:00080000:0.0:1746143668.178277:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143668.186475:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.189858:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.227901:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.229464:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.234589:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.234702:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593505792:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143668.234729:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955dbe00/0xe984082ccd721deb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f468 expref: 22 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.234741:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955dbe00/0xe984082ccd721deb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f468 expref: 22 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.234752:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955dbe00, rc 0) 00000100:00100000:0.0:1746143668.234787:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963591615744:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4583us (6895us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143668.234794:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8237 00000100:00100000:0.0:1746143668.243474:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.258542:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:0.0:1746143668.258652:0:21542:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime: 1746143664 -> 1746143667 00002000:00010000:0.0:1746143668.258656:0:21542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime: 1746143664 -> 1746143667 00002000:00010000:0.0:1746143668.258658:0:21542:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime: 1746143664 -> 1746143667 00000100:00100000:0.0:1746143668.258671:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593506048:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143668.258698:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xe984082ccd721e1c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f47d expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.258710:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xe984082ccd721e1c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f47d expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.258722:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af08c00, rc 0) 00000100:00100000:0.0:1746143668.258746:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963591617536:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7287us (7352us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143668.258754:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8239 00000100:00100000:0.0:1746143668.258774:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591617664 00000100:00100000:0.0:1746143668.258778:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591617664 00000100:00100000:0.0:1746143668.258799:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8240 00000100:00100000:0.0:1746143668.258805:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963591617664:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143668.258815:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143668.258827:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800955dbe00/0xe984082ccd721e23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f484 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143668.258861:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593506176:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143668.258906:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143668.271824:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.285179:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.294953:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.297315:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.298247:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591618048 00000100:00100000:0.0:1746143668.298251:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591618048 00000100:00100000:0.0:1746143668.298269:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8243 00000100:00100000:0.0:1746143668.298275:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963591618048:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143668.298281:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143668.298288:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955db600/0xe984082ccd721e38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f492 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143668.298310:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593506560:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143668.298334:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143668.300249:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:0.0:1746143668.304704:0:8496:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime: 1746143667 -> 1746143668 00000100:00100000:0.0:1746143668.304721:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593506560:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143668.304744:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955db600/0xe984082ccd721e38 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f492 expref: 24 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.304761:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955db600/0xe984082ccd721e38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f492 expref: 24 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.304772:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955db600, rc 0) 00000100:00100000:0.0:1746143668.304813:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963591618048:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6537us (7675us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143668.304820:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8243 00000100:00100000:0.0:1746143668.306227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.309384:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.310566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.317451:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.317483:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.318769:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591619456 00000100:00100000:0.0:1746143668.318773:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591619456 00002000:00100000:0.0:1746143668.318793:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88012fc12680 x1830963591619456/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:64/0 lens 488/0 e 0 to 0 dl 1746143679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143668.318800:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12680 with x1830963591619456 ext(0->1048575) 00002000:00010000:0.0:1746143668.318803:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc12680 00000100:00100000:0.0:1746143668.318814:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2673 00000100:00100000:0.0:1746143668.318818:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963591619456:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143668.325376:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591619584 00000100:00100000:0.0:1746143668.325381:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591619584 00010000:00010000:0.0:1746143668.325399:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095178800/0xe984082ccd721dd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f453 expref: 14 pid: 4581 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746143668.325433:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4110 00000100:00100000:0.0:1746143668.325439:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963591619584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143668.325448:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143668.325472:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095178800/0xe984082ccd721dd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f453 expref: 14 pid: 4581 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746143668.325482:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095178800/0xe984082ccd721dd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f453 expref: 14 pid: 4581 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746143668.325509:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095178800/0xe984082ccd721dd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f453 expref: 14 pid: 4581 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746143668.325526:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.325528:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.325533:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095179a00/0xe984082ccd721e46 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4a7 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.325540:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095179a00/0xe984082ccd721e46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4a7 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.325562:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095179a00/0xe984082ccd721e46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4a7 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143668.326113:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593507456:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143668.326185:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143668.332130:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963591619456:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13308us (13462us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143668.332160:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2673 00002000:00100000:0.0:1746143668.332171:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88012fc12680 x1830963591619456/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:64/0 lens 488/440 e 0 to 0 dl 1746143679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143668.332178:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12680 with x1830963591619456 ext(0->1048575) 00002000:00010000:0.0:1746143668.332182:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc12680 00000100:00100000:0.0:1746143668.333856:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.333900:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.342992:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.343620:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.343638:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591620224 00000100:00100000:0.0:1746143668.343645:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591620224 00000100:00100000:0.0:1746143668.343674:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591620352 00000100:00100000:0.0:1746143668.343675:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591620352 00000100:00100000:0.0:1746143668.343687:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8246 00000100:00100000:0.0:1746143668.343693:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:27585:x1830963591620224:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143668.343707:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143668.343719:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800955dbe00/0xe984082ccd721e7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f4bc expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.343743:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009af08400/0xe984082ccd721ddd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1085439) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f45a expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.343751:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143668.343752:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143668.343755:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800955dbe00/0xe984082ccd721e7e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4bc expref: 13 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.343779:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009af08400/0xe984082ccd721ddd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1085439) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f45a expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.343790:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009af08400/0xe984082ccd721ddd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1085439) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f45a expref: 19 pid: 4581 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746143668.343800:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593507584:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143668.343868:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143668.343898:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8247 00000100:00100000:0.0:1746143668.343903:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1963:x1830963591620352:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143668.343911:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143668.343920:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c37400/0xe984082ccd721e85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f4c3 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.343930:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.343932:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.343937:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c37400/0xe984082ccd721e85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4c3 expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.343948:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c37400/0xe984082ccd721e85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4c3 expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.343956:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c37400, rc 0) 00000100:00100000:0.0:1746143668.343973:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963591620352:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 70us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.343978:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8247 00000100:00100000:0.0:1746143668.344006:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.344016:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591620608 00000100:00100000:0.0:1746143668.344019:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591620608 00000100:00100000:0.0:1746143668.344035:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8248 00000100:00100000:0.0:1746143668.344039:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1963:x1830963591620608:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143668.344044:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143668.344050:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800955db400/0xe984082ccd721e8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f4d1 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.344058:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.344063:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.344067:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800955db400/0xe984082ccd721e8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4d1 expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.344084:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800955db400/0xe984082ccd721e8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4d1 expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.344091:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955db400, rc 0) 00000100:00100000:0.0:1746143668.344104:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963591620608:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 65us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.344108:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8248 00000100:00100000:0.0:1746143668.344167:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.344177:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591620864 00000100:00100000:0.0:1746143668.344179:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591620864 00000100:00100000:0.0:1746143668.344193:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8249 00000100:00100000:0.0:1746143668.344197:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963591620864:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143668.344203:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143668.344208:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f12de00/0xe984082ccd721e93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f4df expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.344219:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.344220:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.344223:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f12de00/0xe984082ccd721e93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4df expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.344330:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f12de00/0xe984082ccd721e93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4df expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.344345:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12de00, rc 0) 00000100:00100000:0.0:1746143668.344357:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963591620864:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 160us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.344361:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8249 00000100:00100000:0.0:1746143668.344387:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.344401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.344407:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591620480 00000100:00100000:0.0:1746143668.344409:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591620480 00000100:00100000:0.0:1746143668.344417:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591620736 00000100:00100000:0.0:1746143668.344418:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591620736 00000100:00100000:0.0:1746143668.344425:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8250 00000100:00100000:0.0:1746143668.344429:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963591620480:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143668.344433:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143668.344438:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12ca00/0xe984082ccd721e9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f4ca expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143668.344456:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593507712:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143668.344480:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143668.344509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.344519:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591620992 00000100:00100000:0.0:1746143668.344521:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591620992 00000100:00100000:0.0:1746143668.344533:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8251 00000100:00100000:0.0:1746143668.344537:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963591620736:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143668.344541:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143668.344548:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd721ea1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f4d8 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.344560:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.344561:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.344565:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd721ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4d8 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.344572:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd721ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4d8 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.344578:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61cc800, rc 0) 00000100:00100000:0.0:1746143668.344588:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963591620736:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 52us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.344592:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8251 00000100:00100000:0.0:1746143668.344600:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8252 00000100:00100000:0.0:1746143668.344603:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963591620992:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143668.344607:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143668.344611:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a61cde00/0xe984082ccd721ea8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f4e6 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143668.344627:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593507840:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143668.344639:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e1840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143668.347342:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593507584:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143668.347364:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800955dbe00/0xe984082ccd721e7e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4bc expref: 13 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.348287:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955dbe00, rc 0) 00000100:00100000:0.0:1746143668.349279:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:27585:x1830963591620224:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5581us (6290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.349287:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8246 00000100:00100000:0.0:1746143668.350781:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593507840:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143668.350797:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a61cde00/0xe984082ccd721ea8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4e6 expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.350806:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a61cde00/0xe984082ccd721ea8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4e6 expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.351512:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61cde00, rc 0) 00000100:00100000:0.0:1746143668.351898:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963591620992:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 7291us (7386us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143668.351904:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8252 00000100:00100000:0.0:1746143668.354241:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.356480:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.357546:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.363790:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591622016 00000100:00100000:0.0:1746143668.363797:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591622016 00000100:00100000:0.0:1746143668.363832:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7972 00000100:00100000:0.0:1746143668.363838:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:27590:x1830963591622016:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143668.363857:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143668.363871:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c200/0xe984082ccd721ec4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f4fb expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.363955:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0xe984082ccd721ecb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.363970:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0xe984082ccd721ecb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.363979:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0xe984082ccd721ecb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.363989:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0xe984082ccd721ed2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.363994:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0xe984082ccd721ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.363998:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0xe984082ccd721ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364094:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0xe984082ccd721ed9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364101:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0xe984082ccd721ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364106:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0xe984082ccd721ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:0.0:1746143668.364113:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143668.364198:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0xe984082ccd721ecb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364204:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0xe984082ccd721ecb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364208:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0xe984082ccd721ecb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364219:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12c400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143668.364222:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0xe984082ccd721ecb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364227:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0xe984082ccd721ecb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364236:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143668.364238:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143668.364241:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0xe984082ccd721ecb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364245:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0xe984082ccd721ecb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364263:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0xe984082ccd721ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364268:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0xe984082ccd721ed2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364272:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0xe984082ccd721ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364276:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12cc00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143668.364278:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0xe984082ccd721ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364283:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0xe984082ccd721ed2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364288:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800933c0e00) 00010000:00010000:0.0:1746143668.364290:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143668.364297:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0xe984082ccd721ed2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364301:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0xe984082ccd721ed2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143668.364330:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c200/0xe984082ccd721ec4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4fb expref: 21 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.364340:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0xe984082ccd721ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4fb expref: 20 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.364346:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143668.364348:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143668.364350:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d600, rc 0) 00000100:00100000:0.0:1746143668.364383:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:27590:x1830963591622016:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 545us (695us total) trans 8589941959 rc 0/0 00000100:00100000:0.0:1746143668.364389:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7972 00000100:00100000:0.0:1746143668.365246:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.374650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.382018:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.382049:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.382103:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.431204:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.441919:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.441958:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.458609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.458642:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.458665:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591624832 00000100:00100000:0.0:1746143668.458680:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591624832 00002000:00100000:0.0:1746143668.458715:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88012e1e3b80 x1830963591624832/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:64/0 lens 488/0 e 0 to 0 dl 1746143679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143668.458724:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e3b80 with x1830963591624832 ext(2097152->3145727) 00002000:00010000:0.0:1746143668.458728:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e3b80 00000100:00100000:0.0:1746143668.463458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.463638:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.465848:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.483324:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.496975:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.499086:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.499119:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.508713:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.510306:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.510343:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.522766:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.522789:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.522829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.525194:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.526656:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.526727:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.532375:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.533030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.534557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.536038:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.542692:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591629568 00000100:00100000:0.0:1746143668.542700:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591629568 00002000:00100000:0.0:1746143668.542737:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880094c0ed80 x1830963591629568/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:64/0 lens 488/0 e 0 to 0 dl 1746143679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143668.542755:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ed80 with x1830963591629568 ext(2097152->3145727) 00002000:00010000:0.0:1746143668.542759:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0ed80 00000100:00100000:0.0:1746143668.542776:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2689 00000100:00100000:0.0:1746143668.542783:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963591629568:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143668.569237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.573290:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.573314:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591630080 00000100:00100000:0.0:1746143668.573319:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591630080 00000100:00100000:0.0:1746143668.573429:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8267 00000100:00100000:0.0:1746143668.573437:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+15:27590:x1830963591630080:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143668.573451:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143668.573464:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6171e00/0xe984082ccd721f57 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f564 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.573485:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5793200/0xe984082ccd721f1f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f52c expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.573492:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.573493:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143668.573496:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6171e00/0xe984082ccd721f57 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->3198975] (req 3145728->3198975) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f564 expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.573516:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5793200/0xe984082ccd721f1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f52c expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.573526:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5793200/0xe984082ccd721f1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f52c expref: 16 pid: 6929 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746143668.573545:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593510016:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143668.577883:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.580909:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e1840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143668.580923:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593510016:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143668.580943:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6171e00/0xe984082ccd721f57 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->3198975] (req 3145728->3198975) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f564 expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143668.580956:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6171e00, rc 0) 00000100:00100000:0.0:1746143668.580979:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+16:27590:x1830963591630080:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7542us (7696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.580986:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8267 00000100:00100000:0.0:1746143668.589010:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.593560:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.593633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.595593:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.617255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.626535:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.626596:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.750284:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.772988:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.778941:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.793069:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.793793:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.794180:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.800997:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593510912:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143668.801018:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143668.801566:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963591633024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5265us (7383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.801575:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4126 00000100:00100000:0.0:1746143668.803554:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.805034:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.806311:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.808102:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.808194:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.810296:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.810312:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.810340:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.810373:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.810581:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591633920 00000100:00100000:0.0:1746143668.810585:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591633920 00010000:00010000:0.0:1746143668.810598:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd721ea1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4d8 expref: 7 pid: 25369 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746143668.810613:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591634048 00000100:00100000:0.0:1746143668.810615:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591634048 00010000:00010000:0.0:1746143668.810621:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b145200/0xe984082ccd721d74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f406 expref: 29 pid: 4582 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746143668.810630:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591634432 00000100:00100000:0.0:1746143668.810632:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591634432 00010000:00010000:0.0:1746143668.810637:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009af09400/0xe984082ccd721d90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f430 expref: 15 pid: 15784 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746143668.810660:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4127 00000100:00100000:0.0:1746143668.810665:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963591633920:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143668.810672:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143668.810683:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd721ea1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4d8 expref: 7 pid: 25369 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746143668.810691:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd721ea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4d8 expref: 7 pid: 25369 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746143668.810709:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd721ea1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4d8 expref: 7 pid: 25369 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746143668.810720:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143668.811686:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1964:x1830963591633920:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1019us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143668.811692:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4127 00000100:00100000:0.0:1746143668.817357:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.821286:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.821329:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.822678:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.823967:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:0.0:1746143668.827629:0:25369:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143667 -> 1746143668 00002000:00010000:0.0:1746143668.827635:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143666 -> 1746143668 00002000:00010000:0.0:1746143668.827636:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143666 -> 1746143668 00000100:00100000:0.0:1746143668.827654:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593511936:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143668.827688:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009af09400/0xe984082ccd721fce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5a3 expref: 14 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.827701:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009af09400/0xe984082ccd721fce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5a3 expref: 14 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143668.827724:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af09400, rc 0) 00000100:00100000:0.0:1746143668.829001:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963591635200:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6217us (6324us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143668.829007:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8274 00000100:00100000:0.0:1746143668.830474:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.834955:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.840102:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.848514:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.855393:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2701 00000100:00100000:0.0:1746143668.855404:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963591637120:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143668.876504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.880201:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.885932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.891491:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.891849:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.921091:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.921186:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.922040:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2705 00000100:00100000:0.0:1746143668.922047:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963591638656:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143668.932268:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.946624:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.953863:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.973657:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.988328:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.988368:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143668.988412:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.025838:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.061446:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143669.063685:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143669.068406:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.077329:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.082982:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.083016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.092600:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.097087:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.163587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.173779:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.182276:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.185355:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.196195:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.200339:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.206081:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.206112:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.206174:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.206220:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593514368:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143669.206241:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b5d200/0xe984082ccd722037 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5f0 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.206264:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b5d200, rc 0) 00000100:00100000:0.0:1746143669.206298:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:27619:x1830963591642880:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5828us (5966us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143669.206305:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8283 00000100:00100000:0.0:1746143669.211137:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.217894:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.218485:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.218501:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591643776 00000100:00100000:0.0:1746143669.218503:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591643776 00010000:00010000:0.0:1746143669.218517:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2a00/0xe984082ccd72201b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1404928->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5d4 expref: 29 pid: 6929 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746143669.218532:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4141 00000100:00100000:0.0:1746143669.218536:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963591643776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143669.218543:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143669.218554:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2a00/0xe984082ccd72201b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1404928->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5d4 expref: 29 pid: 6929 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.218563:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2a00/0xe984082ccd72201b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1404928->1437695) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5d4 expref: 29 pid: 6929 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.218579:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2a00/0xe984082ccd72201b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1404928->1437695) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5d4 expref: 29 pid: 6929 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.218608:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143669.218619:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143669.218625:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b5d200/0xe984082ccd722037 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5f0 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.218633:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b5d200/0xe984082ccd722037 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5f0 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.218659:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093b5d200/0xe984082ccd722037 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5f0 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143669.218668:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593514624:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143669.218716:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e1840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143669.224219:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.268460:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.268497:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.268522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.268558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.268585:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591644288 00000100:00100000:0.0:1746143669.268593:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591644288 00002000:00100000:0.0:1746143669.268628:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800935a3800 x1830963591644288/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:65/0 lens 488/0 e 0 to 0 dl 1746143680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143669.268638:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3800 with x1830963591644288 ext(2097152->3145727) 00002000:00010000:0.0:1746143669.268643:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a3800 00000100:00100000:0.0:1746143669.268670:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591644544 00000100:00100000:0.0:1746143669.268673:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591644544 00002000:00100000:0.0:1746143669.268683:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800935a1f80 x1830963591644544/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:65/0 lens 488/0 e 0 to 0 dl 1746143680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143669.268701:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a1f80 with x1830963591644544 ext(3145728->4194303) 00002000:00010000:0.0:1746143669.268703:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a1f80 00000100:00100000:0.0:1746143669.268713:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591644800 00000100:00100000:0.0:1746143669.268715:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591644800 00002000:00100000:0.0:1746143669.268726:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800935a2a00 x1830963591644800/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:65/0 lens 488/0 e 0 to 0 dl 1746143680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143669.268731:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a2a00 with x1830963591644800 ext(2097152->3145727) 00002000:00010000:0.0:1746143669.268734:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a2a00 00000100:00100000:0.0:1746143669.268740:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591645056 00000100:00100000:0.0:1746143669.268742:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591645056 00002000:00100000:0.0:1746143669.268751:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3723263) req@ffff8800935a3b80 x1830963591645056/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:65/0 lens 488/0 e 0 to 0 dl 1746143680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143669.268757:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3b80 with x1830963591645056 ext(3145728->3723263) 00002000:00010000:0.0:1746143669.268758:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a3b80 00000100:00100000:0.0:1746143669.268768:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2716 00000100:00100000:0.0:1746143669.268774:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963591644288:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143669.314365:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.322581:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591645696 00000100:00100000:0.0:1746143669.322589:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591645696 00000100:00100000:0.0:1746143669.322623:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591645824 00000100:00100000:0.0:1746143669.322625:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591645824 00000100:00100000:0.0:1746143669.323018:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591645952 00000100:00100000:0.0:1746143669.323021:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591645952 00000100:00100000:0.0:1746143669.323249:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8286 00000100:00100000:0.0:1746143669.323256:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963591645952:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143669.323274:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143669.323283:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6170e00/0xe984082ccd72206f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f60c expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143669.323309:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593514880:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143669.323894:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143669.346418:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.346455:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:0.0:1746143669.366444:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143668 -> 1746143669 00000100:00100000:0.0:1746143669.366459:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593514880:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143669.366482:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6170e00/0xe984082ccd72206f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f60c expref: 25 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143669.366493:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6170e00/0xe984082ccd72206f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f60c expref: 25 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143669.366504:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6170e00, rc 0) 00000100:00100000:0.0:1746143669.366525:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963591645952:12345-192.168.202.48@tcp:101:cat.0 Request processed in 43270us (44252us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143669.366530:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8286 00000100:00100000:0.0:1746143669.368826:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.373216:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.375435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.375487:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.381001:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593515136:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143669.381034:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f4d7e00/0xe984082ccd7220a0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f621 expref: 20 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143669.381046:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f4d7e00/0xe984082ccd7220a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f621 expref: 20 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143669.381057:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d7e00, rc 0) 00000100:00100000:0.0:1746143669.381098:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963591647232:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5522us (5609us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143669.381105:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8288 00000100:00100000:0.0:1746143669.383635:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.388042:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.396998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.405701:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.414531:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.421187:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.434518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.448993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.451415:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.451443:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.451479:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.469612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.477940:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.477956:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143669.481189:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143669.484952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.491241:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591650688 00000100:00100000:0.0:1746143669.491252:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591650688 00002000:00100000:0.0:1746143669.491273:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1531904->1535999) req@ffff8800930c1500 x1830963591650688/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:65/0 lens 488/0 e 0 to 0 dl 1746143680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143669.491280:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c1500 with x1830963591650688 ext(1531904->1535999) 00002000:00010000:0.0:1746143669.491283:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930c1500 00000100:00100000:0.0:1746143669.491294:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2729 00000100:00100000:0.0:1746143669.491297:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963591650688:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143669.491418:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963591650688:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 119us (419us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143669.491424:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2729 00002000:00100000:0.0:1746143669.491428:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1531904->1535999) req@ffff8800930c1500 x1830963591650688/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746143680 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143669.491435:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c1500 with x1830963591650688 ext(1531904->1535999) 00002000:00010000:0.0:1746143669.491437:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930c1500 00000100:00100000:0.0:1746143669.502108:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.511237:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.512822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.514097:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.520518:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.526380:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.540376:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.546984:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.547273:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.549135:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.576381:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.591259:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.620834:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.653923:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.653963:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.654043:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.654099:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591653376 00000100:00100000:0.0:1746143669.654106:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591653376 00002000:00100000:0.0:1746143669.654171:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880130fd5c00 x1830963591653376/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:65/0 lens 488/0 e 0 to 0 dl 1746143680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143669.654180:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5c00 with x1830963591653376 ext(3145728->4194303) 00002000:00010000:0.0:1746143669.654185:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd5c00 00000100:00100000:0.0:1746143669.654199:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591653248 00000100:00100000:0.0:1746143669.654201:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591653248 00002000:00100000:0.0:1746143669.654213:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880130fd6300 x1830963591653248/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:65/0 lens 488/0 e 0 to 0 dl 1746143680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143669.654219:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6300 with x1830963591653248 ext(2097152->3145727) 00002000:00010000:0.0:1746143669.654222:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd6300 00000100:00100000:0.0:1746143669.654232:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591653760 00000100:00100000:0.0:1746143669.654235:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591653760 00002000:00100000:0.0:1746143669.654249:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880130fd4000 x1830963591653760/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:65/0 lens 488/0 e 0 to 0 dl 1746143680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143669.654254:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4000 with x1830963591653760 ext(3145728->4194303) 00002000:00010000:0.0:1746143669.654257:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd4000 00000100:00100000:0.0:1746143669.654271:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2733 00000100:00100000:0.0:1746143669.654279:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963591653376:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143669.655447:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2734 00000100:00100000:0.0:1746143669.655465:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963591653248:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143669.689673:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.699811:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.699889:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.703733:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.710976:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.715966:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.721254:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.724024:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.724347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.729861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.730059:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.730925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.731429:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.732783:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.739475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.739750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.749079:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.754972:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.755032:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.756503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.758367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.758487:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.760103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.761381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.766435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.771761:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.775992:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.783711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.788592:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.810282:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.819579:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.819614:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.819637:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.819663:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.823744:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2742 00000100:00100000:0.0:1746143669.823773:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963591659520:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143669.862680:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.865321:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.869641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.880856:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.888396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.901771:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143669.902120:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143669.904764:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.904940:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.908671:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591661696 00000100:00100000:0.0:1746143669.908677:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591661696 00010000:00010000:0.0:1746143669.908702:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd722006 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5cd expref: 268 pid: 14762 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746143669.908728:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4154 00000100:00100000:0.0:1746143669.908734:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:1965:x1830963591661696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143669.908743:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143669.908754:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd722006 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5cd expref: 268 pid: 14762 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.908762:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd722006 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5cd expref: 268 pid: 14762 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.908778:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd722006 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5cd expref: 268 pid: 14762 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.908797:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143669.908801:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0171000/0xe984082ccd7221b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143669.908808:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0171000/0xe984082ccd7221b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143669.908812:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0171000/0xe984082ccd7221b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143669.908816:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143669.908849:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:1965:x1830963591661696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 115us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143669.908855:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4154 00000100:00100000:0.0:1746143669.909326:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.915222:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143669.916125:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143669.917470:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.917521:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.917542:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.917555:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.917588:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.925501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.930030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.936407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.946239:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.946266:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.947492:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.947513:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591663488 00000100:00100000:0.0:1746143669.947520:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591663488 00000100:00100000:0.0:1746143669.947547:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591663744 00000100:00100000:0.0:1746143669.947549:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591663744 00000100:00100000:0.0:1746143669.947558:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591664000 00000100:00100000:0.0:1746143669.947559:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591664000 00000100:00100000:0.0:1746143669.947581:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8320 00000100:00100000:0.0:1746143669.947588:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963591663488:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143669.947622:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c70b000/0xe984082ccd722213 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947637:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd721fc7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f59c expref: 31 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947645:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0621a00/0xe984082ccd7221b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f6ec expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143669.947651:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b145200/0xe984082ccd721fd5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5aa expref: 19 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947656:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143669.947669:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143669.947672:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c70b000/0xe984082ccd722213 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947700:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b145200/0xe984082ccd721fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5aa expref: 19 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947711:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b145200/0xe984082ccd721fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5aa expref: 19 pid: 25369 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746143669.947723:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f893100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593519488:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143669.947788:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0621a00/0xe984082ccd7221b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f6ec expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143669.947795:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0621a00/0xe984082ccd7221b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f6ec expref: 9 pid: 25369 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746143669.947802:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f893480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593519744:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143669.947819:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd721fc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f59c expref: 31 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947825:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd721fc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f59c expref: 31 pid: 6929 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746143669.947831:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f893800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593519872:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143669.947843:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e1840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143669.947859:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8322 00000100:00100000:0.0:1746143669.947868:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963591664000:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143669.947881:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c70a200/0xe984082ccd722221 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947890:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0c00/0xe984082ccd72212c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->4476927] (req 4194304->4476927) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f691 expref: 31 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947896:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f199200/0xe984082ccd722179 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f6c2 expref: 31 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947901:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0a00/0xe984082ccd722125 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4476928->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f68a expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947906:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f198600/0xe984082ccd722187 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4476928->18446744073709551615] (req 4476928->4898815) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f6d0 expref: 31 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947910:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 4 00010000:00010000:0.0:1746143669.947911:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 4 00010000:00010000:0.0:1746143669.947913:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c70a200/0xe984082ccd722221 lrc: 7/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947923:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f198600/0xe984082ccd722187 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4476928->18446744073709551615] (req 4476928->4898815) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f6d0 expref: 31 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947929:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f198600/0xe984082ccd722187 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4476928->18446744073709551615] (req 4476928->4898815) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f6d0 expref: 31 pid: 8497 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746143669.947943:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f893b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593520128:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143669.947962:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0a00/0xe984082ccd722125 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4476928->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f68a expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947968:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0a00/0xe984082ccd722125 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4476928->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f68a expref: 19 pid: 6929 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746143669.947974:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593520256:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143669.947987:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f199200/0xe984082ccd722179 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f6c2 expref: 31 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.947992:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f199200/0xe984082ccd722179 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f6c2 expref: 31 pid: 8497 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746143669.947998:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593520384:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143669.948011:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0c00/0xe984082ccd72212c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->4476927] (req 4194304->4476927) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f691 expref: 31 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.948017:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0c00/0xe984082ccd72212c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->4476927] (req 4194304->4476927) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f691 expref: 31 pid: 6929 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746143669.948023:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593520512:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143669.948030:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143669.948051:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.948104:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.948134:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.956643:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.956663:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591664512 00000100:00100000:0.0:1746143669.956668:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591664512 00010000:00010000:0.0:1746143669.956693:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b145200/0xe984082ccd721fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5aa expref: 20 pid: 25369 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746143669.956726:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4157 00000100:00100000:0.0:1746143669.956732:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963591664512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143669.956743:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143669.956761:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b145200/0xe984082ccd721fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5aa expref: 20 pid: 25369 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.956770:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b145200/0xe984082ccd721fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5aa expref: 20 pid: 25369 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.959668:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b145200/0xe984082ccd721fd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5aa expref: 20 pid: 25369 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.959691:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143669.959751:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963591664512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3018us (3107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143669.959760:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4157 00000100:00100000:0.0:1746143669.959832:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.959850:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591664640 00000100:00100000:0.0:1746143669.959858:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591664640 00010000:00010000:0.0:1746143669.959875:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0a00/0xe984082ccd722125 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4476928->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f68a expref: 19 pid: 6929 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746143669.959890:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4158 00000100:00100000:0.0:1746143669.959895:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963591664640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143669.959905:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143669.959920:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0a00/0xe984082ccd722125 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [4476928->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f68a expref: 19 pid: 6929 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.959929:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0a00/0xe984082ccd722125 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [4476928->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f68a expref: 19 pid: 6929 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.959943:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0a00/0xe984082ccd722125 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [4476928->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f68a expref: 19 pid: 6929 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.959951:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143669.959965:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963591664640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 69us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143669.959970:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4158 00000100:00100000:0.0:1746143669.960083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.960132:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593521024:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143669.960176:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593521152:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143669.960207:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593521408:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143669.960228:0:8495:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0171600/0xe984082ccd72222f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143669.960254:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.960262:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591664896 00000100:00100000:0.0:1746143669.960264:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591664896 00010000:00010000:0.0:1746143669.960274:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f198600/0xe984082ccd722187 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4476928->18446744073709551615] (req 4476928->4898815) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f6d0 expref: 32 pid: 8497 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746143669.960286:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4159 00000100:00100000:0.0:1746143669.960291:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963591664896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143669.960296:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143669.960303:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f198600/0xe984082ccd722187 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4476928->18446744073709551615] (req 4476928->4898815) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f6d0 expref: 32 pid: 8497 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.960311:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f198600/0xe984082ccd722187 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4476928->18446744073709551615] (req 4476928->4898815) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f6d0 expref: 32 pid: 8497 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.960321:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f198600/0xe984082ccd722187 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4476928->18446744073709551615] (req 4476928->4898815) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f6d0 expref: 32 pid: 8497 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.960329:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143669.960344:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963591664896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 53us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143669.960349:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4159 00000100:00100000:0.0:1746143669.960371:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.960418:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.960429:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591665024 00000100:00100000:0.0:1746143669.960434:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591665024 00010000:00010000:0.0:1746143669.960445:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cdb4a00/0xe984082ccd721f18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f525 expref: 27 pid: 8495 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746143669.960455:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4161 00000100:00100000:0.0:1746143669.960460:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963591665024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143669.960465:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143669.960473:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cdb4a00/0xe984082ccd721f18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f525 expref: 27 pid: 8495 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746143669.960480:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cdb4a00/0xe984082ccd721f18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f525 expref: 27 pid: 8495 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746143669.960491:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cdb4a00/0xe984082ccd721f18 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f525 expref: 27 pid: 8495 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746143669.960499:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143669.960513:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963591665024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 53us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143669.960517:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4161 00000100:00100000:0.0:1746143669.961627:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.961640:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591665792 00000100:00100000:0.0:1746143669.961643:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591665792 00010000:00010000:0.0:1746143669.961655:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800955dbe00/0xe984082ccd721e7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4bc expref: 21 pid: 8496 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746143669.967956:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.967981:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.968003:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.968015:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.968025:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.968039:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.968053:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.968083:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591665664 00000100:00100000:0.0:1746143669.968090:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591665664 00002000:00100000:0.0:1746143669.968123:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3584000->4194303) req@ffff88008fe35880 x1830963591665664/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:65/0 lens 488/0 e 0 to 0 dl 1746143680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143669.968132:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe35880 with x1830963591665664 ext(3584000->4194303) 00010000:00010000:0.0:1746143669.968157:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1e00/0xe984082ccd722110 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3584000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f675 expref: 26 pid: 8496 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746143669.968167:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1e00/0xe984082ccd722110 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3584000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f675 expref: 26 pid: 8496 timeout: 848 lvb_type: 0 00002000:00010000:0.0:1746143669.968172:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008fe35880 00000100:00100000:0.0:1746143669.968188:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 644 00000100:00100000:0.0:1746143669.968194:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963591665664:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143669.968708:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.968755:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143669.971608:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a0171600/0xe984082ccd72222f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.971616:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0171600/0xe984082ccd72222f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.971640:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0171600/0xe984082ccd72222f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.971646:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0171600/0xe984082ccd72222f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.971652:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0171600/0xe984082ccd72222f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.971657:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0171600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143669.971659:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0171600/0xe984082ccd72222f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.971665:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0171600/0xe984082ccd72222f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.971673:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0171600/0xe984082ccd72222f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143669.971679:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0171600/0xe984082ccd72222f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143669.974711:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963591663872:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 26215us (26598us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143669.974721:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8324 00000100:00100000:0.0:1746143669.975960:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.985082:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143669.991995:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.000475:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.000882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.002248:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.002268:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591666816 00000100:00100000:0.0:1746143670.002273:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591666816 00010000:00010000:0.0:1746143670.002306:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800949b6400/0xe984082ccd722053 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5f7 expref: 267 pid: 14762 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746143670.002343:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4173 00000100:00100000:0.0:1746143670.002349:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:1964:x1830963591666816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143670.002360:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143670.002364:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800949b6400/0xe984082ccd722053 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5f7 expref: 267 pid: 14762 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746143670.002373:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800949b6400/0xe984082ccd722053 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5f7 expref: 267 pid: 14762 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746143670.002390:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800949b6400/0xe984082ccd722053 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f5f7 expref: 267 pid: 14762 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746143670.002404:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143670.002408:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088a800/0xe984082ccd72223d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143670.002415:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143670.002443:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:1964:x1830963591666816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 95us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143670.002463:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4173 00000100:00080000:0.0:1746143670.002479:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143670.002494:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.002503:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591666944 00000100:00100000:0.0:1746143670.002505:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591666944 00010000:00010000:0.0:1746143670.002512:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0xe984082ccd721ed9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4fb expref: 25 pid: 14764 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746143670.002522:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4174 00000100:00100000:0.0:1746143670.002526:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963591666944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143670.002531:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143670.002533:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0xe984082ccd721ed9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4fb expref: 25 pid: 14764 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746143670.002540:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0xe984082ccd721ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4fb expref: 25 pid: 14764 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746143670.002548:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0xe984082ccd721ed9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f4fb expref: 25 pid: 14764 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746143670.002556:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143670.002558:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088a800/0xe984082ccd72223d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143670.002563:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143670.002575:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591666944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 48us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143670.002579:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4174 00000100:00100000:0.0:1746143670.002688:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.002695:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591667712 00000100:00100000:0.0:1746143670.002697:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591667712 00010000:00010000:0.0:1746143670.002705:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800952ed200/0xe984082ccd721a72 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f22a expref: 266 pid: 21713 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746143670.002716:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4175 00000100:00100000:0.0:1746143670.002719:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:1963:x1830963591667712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143670.002724:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143670.002727:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800952ed200/0xe984082ccd721a72 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f22a expref: 266 pid: 21713 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746143670.002733:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800952ed200/0xe984082ccd721a72 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f22a expref: 266 pid: 21713 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746143670.002741:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143670.002743:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088a800/0xe984082ccd72223d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143670.002747:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143670.002758:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:1963:x1830963591667712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143670.002763:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4175 00000100:00100000:0.0:1746143670.002797:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.002804:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591667584 00000100:00100000:0.0:1746143670.002806:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591667584 00010000:00010000:0.0:1746143670.002812:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3200/0xe984082ccd721a95 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f238 expref: 24 pid: 21713 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746143670.002830:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4176 00000100:00100000:0.0:1746143670.002834:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1963:x1830963591667584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143670.002838:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143670.002840:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3200/0xe984082ccd721a95 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f238 expref: 24 pid: 21713 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746143670.002847:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7f3200/0xe984082ccd721a95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f238 expref: 24 pid: 21713 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746143670.002854:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143670.002856:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088a800/0xe984082ccd72223d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143670.002860:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143670.002869:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1963:x1830963591667584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 35us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143670.002873:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4176 00000100:00100000:0.0:1746143670.002923:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.002930:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591667840 00000100:00100000:0.0:1746143670.002932:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591667840 00010000:00010000:0.0:1746143670.002939:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53ac00/0xe984082ccd721a6b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f223 expref: 266 pid: 20509 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746143670.002949:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4177 00000100:00100000:0.0:1746143670.002952:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:1964:x1830963591667840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143670.002956:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143670.002962:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53ac00/0xe984082ccd721a6b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f223 expref: 266 pid: 20509 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746143670.002967:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53ac00/0xe984082ccd721a6b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f223 expref: 266 pid: 20509 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746143670.002974:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143670.002977:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088a800/0xe984082ccd72223d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143670.002980:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143670.002990:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:1964:x1830963591667840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 37us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143670.002994:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4177 00000100:00100000:0.0:1746143670.010837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.010875:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.015987:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.016009:0:14761:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591668224 00000100:00100000:0.0:1746143670.016014:0:14761:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591668224 00000100:00100000:0.0:1746143670.016042:0:14761:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 163 00000100:00100000:0.0:1746143670.016048:0:14761:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1962:x1830963591668224:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1746143670.016102:0:14761:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1962:x1830963591668224:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143670.016108:0:14761:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 163 00000001:00080000:0.0:1746143670.040994:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941959 is committed 00000001:00080000:0.0:1746143670.041005:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941947 is committed 00000001:00080000:0.0:1746143670.041018:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941984 is committed 00000004:00080000:0.0:1746143670.041021:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1442 committed 00000004:00080000:0.0:1746143670.041033:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1475 committed 00000004:00080000:0.0:1746143670.041038:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1474 committed 00000004:00080000:0.0:1746143670.041040:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1473 committed 00000004:00080000:0.0:1746143670.041041:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1472 committed 00000004:00080000:0.0:1746143670.041043:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1441 committed 00000004:00080000:0.0:1746143670.041044:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1471 committed 00000004:00080000:0.0:1746143670.041045:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1440 committed 00000004:00080000:0.0:1746143670.041046:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1470 committed 00000004:00080000:0.0:1746143670.041048:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1439 committed 00000004:00080000:0.0:1746143670.041049:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1438 committed 00000004:00080000:0.0:1746143670.041050:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1437 committed 00000004:00080000:0.0:1746143670.041051:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1469 committed 00000004:00080000:0.0:1746143670.041052:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1468 committed 00000004:00080000:0.0:1746143670.041053:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1436 committed 00000004:00080000:0.0:1746143670.041054:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1435 committed 00000004:00080000:0.0:1746143670.041056:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1467 committed 00000001:00080000:0.0:1746143670.041059:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941983 is committed 00000001:00080000:0.0:1746143670.041072:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941982 is committed 00000100:00100000:0.0:1746143670.041304:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593522816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.041357:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143670.041398:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593523328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.041413:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143670.041428:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143670.041432:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593522432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.041444:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143670.041453:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593522944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.041465:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143670.041478:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593522688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.041499:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143670.041510:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593523200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.041521:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143670.041532:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143670.041536:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593522560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.041549:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143670.041559:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593523072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.041570:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143670.041588:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593522816 00000100:00100000:0.0:1746143670.041594:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593522816 00000100:00100000:0.0:1746143670.041624:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593523328 00000100:00100000:0.0:1746143670.041626:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593523328 00000100:00100000:0.0:1746143670.041635:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593522432 00000100:00100000:0.0:1746143670.041636:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593522432 00000100:00100000:0.0:1746143670.041644:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593522944 00000100:00100000:0.0:1746143670.041645:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593522944 00000100:00100000:0.0:1746143670.041651:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593522688 00000100:00100000:0.0:1746143670.041652:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593522688 00000100:00100000:0.0:1746143670.041658:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593523200 00000100:00100000:0.0:1746143670.041659:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593523200 00000100:00100000:0.0:1746143670.041665:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593522560 00000100:00100000:0.0:1746143670.041667:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593522560 00000100:00100000:0.0:1746143670.041673:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593523072 00000100:00100000:0.0:1746143670.041674:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593523072 00000100:00100000:0.0:1746143670.041682:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8326 00000100:00100000:0.0:1746143670.041688:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593522816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143670.041833:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143670.041836:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143670.041838:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143670.041843:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143670.041845:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143670.041871:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593522816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 183us (513us total) trans 17179872201 rc 0/0 00000100:00100000:0.0:1746143670.041878:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8326 00000100:00100000:0.0:1746143670.041891:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8327 00000100:00100000:0.0:1746143670.041895:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593523328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.041971:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593523328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (557us total) trans 17179872202 rc 0/0 00000100:00100000:0.0:1746143670.041976:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8327 00000100:00100000:0.0:1746143670.041984:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8328 00000100:00100000:0.0:1746143670.041987:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593522432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.042059:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593522432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (613us total) trans 17179872203 rc 0/0 00000100:00100000:0.0:1746143670.042076:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8328 00000100:00100000:0.0:1746143670.042085:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8329 00000100:00100000:0.0:1746143670.042090:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593522944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.042187:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593522944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (720us total) trans 17179872204 rc 0/0 00000100:00100000:0.0:1746143670.042192:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8329 00000100:00100000:0.0:1746143670.042201:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8330 00000100:00100000:0.0:1746143670.042204:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963593522688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.042276:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593522688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (776us total) trans 17179872205 rc 0/0 00000100:00100000:0.0:1746143670.042281:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8330 00000100:00100000:0.0:1746143670.042294:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8331 00000100:00100000:0.0:1746143670.042298:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963593523200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.042380:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593523200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (858us total) trans 17179872206 rc 0/0 00000100:00100000:0.0:1746143670.042384:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8331 00000100:00100000:0.0:1746143670.042393:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8332 00000100:00100000:0.0:1746143670.042396:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963593522560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.042459:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593522560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (909us total) trans 17179872207 rc 0/0 00000100:00100000:0.0:1746143670.042464:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8332 00000100:00100000:0.0:1746143670.042471:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8333 00000100:00100000:0.0:1746143670.042475:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963593523072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.042541:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593523072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (970us total) trans 17179872208 rc 0/0 00000100:00100000:0.0:1746143670.042545:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8333 00000100:00080000:0.0:1746143670.042566:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746143670.042596:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe37480/2, rc 0, transno 17179872207 00000100:00100000:0.0:1746143670.042604:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593522560:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143670.042611:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe34000/2, rc 0, transno 17179872208 00000100:00100000:0.0:1746143670.042613:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593523072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143670.042619:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe37800/2, rc 0, transno 17179872205 00000100:00100000:0.0:1746143670.042621:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593522688:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143670.042626:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe34700/2, rc 0, transno 17179872206 00000100:00100000:0.0:1746143670.042628:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593523200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143670.042665:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe37100/2, rc 0, transno 17179872203 00000100:00100000:0.0:1746143670.042667:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593522432:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143670.042672:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe36d80/2, rc 0, transno 17179872204 00000100:00100000:0.0:1746143670.042674:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593522944:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143670.042679:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe37b80/2, rc 0, transno 17179872201 00000100:00100000:0.0:1746143670.042682:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593522816:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143670.042687:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe34a80/2, rc 0, transno 17179872202 00000100:00100000:0.0:1746143670.042689:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593523328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.042693:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143670.042697:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593523456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.042714:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143670.042745:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593523456 00000100:00100000:0.0:1746143670.042749:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593523456 00000100:00100000:0.0:1746143670.042764:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8334 00000100:00100000:0.0:1746143670.042768:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593523456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143670.042842:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3294:x1830963593523456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (127us total) trans 17179872209 rc 0/0 00000100:00100000:0.0:1746143670.042847:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8334 00000004:00080000:0.0:1746143670.042864:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e63fb80/2, rc 0, transno 17179872209 00000100:00100000:0.0:1746143670.042867:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593523456:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746143670.047973:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143670.057196:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591668352 00000100:00100000:0.0:1746143670.057203:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591668352 00000100:00100000:0.0:1746143670.057240:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7987 00000100:00100000:0.0:1746143670.057246:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:27647:x1830963591668352:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143670.057270:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143670.057285:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17a00/0xe984082ccd722244 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f72b expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143670.057328:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17a00/0xe984082ccd722244 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f72b expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143670.057339:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17a00/0xe984082ccd722244 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f72b expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143670.057351:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143670.057354:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143670.057356:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd17a00, rc 0) 00000100:00100000:0.0:1746143670.057388:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:27647:x1830963591668352:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 143us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143670.057394:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7987 00000100:00100000:0.0:1746143670.061197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.067962:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.068108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.073320:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.074287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.074328:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143670.074346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.092669:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.092712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.092742:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.092767:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.092780:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.092810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.092822:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.092846:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.092871:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591669504 00000100:00100000:0.0:1746143671.092878:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591669504 00000100:00100000:0.0:1746143671.092927:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591669760 00000100:00100000:0.0:1746143671.092930:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591669760 00000100:00100000:0.0:1746143671.092945:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591670016 00000100:00100000:0.0:1746143671.092947:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591670016 00000100:00100000:0.0:1746143671.092957:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591670272 00000100:00100000:0.0:1746143671.092959:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591670272 00000100:00100000:0.0:1746143671.092966:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591670528 00000100:00100000:0.0:1746143671.092967:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591670528 00000100:00100000:0.0:1746143671.092974:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591670784 00000100:00100000:0.0:1746143671.092975:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591670784 00000100:00100000:0.0:1746143671.092982:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591671040 00000100:00100000:0.0:1746143671.092983:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591671040 00000100:00100000:0.0:1746143671.092991:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591671296 00000100:00100000:0.0:1746143671.092993:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591671296 00000100:00100000:0.0:1746143671.093003:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2747 00000100:00100000:0.0:1746143671.093010:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963591669504:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143671.093037:0:26144:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a084ca00/0xe984082ccd722283 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.093049:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.093062:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.093067:0:26144:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a084ca00/0xe984082ccd722283 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.093079:0:26144:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a084ca00/0xe984082ccd722283 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143671.094234:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2748 00000100:00100000:0.0:1746143671.094241:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963591669760:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143671.094258:0:26145:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a084c600/0xe984082ccd72228a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.094266:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.094267:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.094270:0:26145:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a084c600/0xe984082ccd72228a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.094280:0:26145:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a084c600/0xe984082ccd72228a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746143671.095370:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143671.095374:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746143671.146026:0:8501:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ff6d200/0xe984082ccd722298 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.146037:0:8501:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff6d200/0xe984082ccd722298 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.146043:0:8501:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ff6d200/0xe984082ccd722298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.146049:0:8501:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff6d200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143671.146060:0:8501:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ff6d200/0xe984082ccd722298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.146079:0:8501:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ff6d200/0xe984082ccd722298 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.146090:0:8501:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ff6d200/0xe984082ccd722298 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.146095:0:8501:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff6d200/0xe984082ccd722298 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143671.146181:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1963:x1830963591670272:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 49594us (53411us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143671.146189:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2750 00000100:00100000:0.0:1746143671.176768:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143671.177232:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143671.179480:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591671680 00000100:00100000:0.0:1746143671.179486:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591671680 00000100:00100000:0.0:1746143671.179559:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3161 00000100:00100000:0.0:1746143671.179567:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:27647:x1830963591671680:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:0.0:1746143671.180834:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:27647:x1830963591671680:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 1264us (1437us total) trans 8589941985 rc 0/0 00000100:00100000:0.0:1746143671.180843:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3161 00000100:00100000:0.0:1746143671.182217:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.205518:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.209627:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.209651:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591672448 00000100:00100000:0.0:1746143671.209663:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591672448 00000100:00100000:0.0:1746143671.209712:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7990 00000100:00100000:0.0:1746143671.209719:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+6:27661:x1830963591672448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143671.209735:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.209747:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084d400/0xe984082ccd7222de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f76a expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.209820:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084d800/0xe984082ccd7222e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.209830:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084d800/0xe984082ccd7222e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.209839:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084d800/0xe984082ccd7222e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.209848:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084da00/0xe984082ccd7222ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.209853:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084da00/0xe984082ccd7222ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.209858:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084da00/0xe984082ccd7222ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.209932:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084dc00/0xe984082ccd7222f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.209939:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084dc00/0xe984082ccd7222f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.209944:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084dc00/0xe984082ccd7222f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:0.0:1746143671.209958:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143671.210013:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084d800/0xe984082ccd7222e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210018:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084d800/0xe984082ccd7222e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210023:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084d800/0xe984082ccd7222e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210028:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a084d800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143671.210031:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084d800/0xe984082ccd7222e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210036:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084d800/0xe984082ccd7222e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210044:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143671.210046:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143671.210049:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084d800/0xe984082ccd7222e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210065:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084d800/0xe984082ccd7222e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210078:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084da00/0xe984082ccd7222ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210083:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084da00/0xe984082ccd7222ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210087:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084da00/0xe984082ccd7222ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210098:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a084da00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143671.210100:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084da00/0xe984082ccd7222ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210105:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084da00/0xe984082ccd7222ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210111:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093484600) 00010000:00010000:0.0:1746143671.210112:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143671.210115:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084da00/0xe984082ccd7222ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210119:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084da00/0xe984082ccd7222ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143671.210176:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084d400/0xe984082ccd7222de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f76a expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.210186:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084dc00/0xe984082ccd7222f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f76a expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.210191:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143671.210193:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143671.210195:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a084dc00, rc 0) 00000100:00100000:0.0:1746143671.210224:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+8:27661:x1830963591672448:12345-192.168.202.48@tcp:101:cat.0 Request processed in 505us (603us total) trans 8589941988 rc 0/0 00000100:00100000:0.0:1746143671.210229:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7990 00000100:00080000:0.0:1746143671.210245:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143671.217304:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.217839:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.218396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143671.220467:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143671.220471:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143671.220487:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.220507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.220519:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591673216 00000100:00100000:0.0:1746143671.220522:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591673216 00000100:00100000:0.0:1746143671.220539:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8351 00000100:00100000:0.0:1746143671.220544:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963591673344:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143671.220551:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.220558:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a084d400/0xe984082ccd72230f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f794 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.220569:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.220571:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.220575:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a084d400/0xe984082ccd72230f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f794 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.220584:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a084d400/0xe984082ccd72230f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f794 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.220591:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a084d400, rc 0) 00000100:00100000:0.0:1746143671.220609:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963591673344:12345-192.168.202.48@tcp:101:cat.0 Request processed in 64us (2213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143671.220614:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8351 00000100:00100000:0.0:1746143671.220660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.220675:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591673472 00000100:00100000:0.0:1746143671.220685:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591673472 00000100:00100000:0.0:1746143671.220702:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8354 00000100:00100000:0.0:1746143671.220706:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963591673472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143671.220712:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.220718:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a084d800/0xe984082ccd722324 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f79b expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.220727:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.220728:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.220732:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a084d800/0xe984082ccd722324 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f79b expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.220741:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a084d800/0xe984082ccd722324 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f79b expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.220747:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a084d800, rc 0) 00000100:00100000:0.0:1746143671.220763:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963591673472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 57us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143671.220768:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8354 00000100:00100000:0.0:1746143671.221212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.222396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.232476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.232528:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.232545:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591674112 00000100:00100000:0.0:1746143671.232548:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591674112 00000100:00100000:0.0:1746143671.235039:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.235075:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.235099:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.235118:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591674368 00000100:00100000:0.0:1746143671.235123:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591674368 00000100:00100000:0.0:1746143671.235161:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591674496 00000100:00100000:0.0:1746143671.235164:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591674496 00000100:00100000:0.0:1746143671.235184:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591674624 00000100:00100000:0.0:1746143671.235186:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591674624 00000100:00100000:0.0:1746143671.235198:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8357 00000100:00100000:0.0:1746143671.235203:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963591674368:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143671.235213:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.235223:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a084da00/0xe984082ccd72235c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f7b7 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.235238:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.235240:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.235246:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a084da00/0xe984082ccd72235c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7b7 expref: 28 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.235257:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a084da00/0xe984082ccd72235c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7b7 expref: 28 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.235264:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a084da00, rc 0) 00000100:00100000:0.0:1746143671.235289:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963591674368:12345-192.168.202.48@tcp:101:cat.0 Request processed in 85us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143671.235294:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8357 00000100:00100000:0.0:1746143671.235305:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8358 00000100:00100000:0.0:1746143671.235309:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963591674496:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143671.235315:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.235322:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f7be expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.235337:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.235338:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.235342:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7be expref: 32 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.235351:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7be expref: 32 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.235358:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a084c800, rc 0) 00000100:00100000:0.0:1746143671.235373:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963591674496:12345-192.168.202.48@tcp:101:cat.0 Request processed in 63us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143671.235378:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8358 00000100:00100000:0.0:1746143671.235387:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8359 00000100:00100000:0.0:1746143671.235392:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963591674624:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143671.235397:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.235402:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a084de00/0xe984082ccd72236a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f7c5 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.235410:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.235412:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.235415:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a084de00/0xe984082ccd72236a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7c5 expref: 32 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.235423:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a084de00/0xe984082ccd72236a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7c5 expref: 32 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.235438:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a084de00, rc 0) 00000100:00100000:0.0:1746143671.235450:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963591674624:12345-192.168.202.48@tcp:101:cat.0 Request processed in 58us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143671.235455:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8359 00000100:00100000:0.0:1746143671.235477:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.235487:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591674752 00000100:00100000:0.0:1746143671.235489:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591674752 00000100:00100000:0.0:1746143671.235501:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8360 00000100:00100000:0.0:1746143671.235505:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963591674752:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143671.235510:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.235516:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a084c200/0xe984082ccd722371 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f7cc expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.235525:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.235526:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.235530:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a084c200/0xe984082ccd722371 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7cc expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.235537:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a084c200/0xe984082ccd722371 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7cc expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.235544:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a084c200, rc 0) 00000100:00100000:0.0:1746143671.235556:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963591674752:12345-192.168.202.48@tcp:101:cat.0 Request processed in 51us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143671.235560:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8360 00000100:00100000:0.0:1746143671.235608:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.235682:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591674240 00000100:00100000:0.0:1746143671.235685:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591674240 00002000:00100000:0.0:1746143671.235706:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880094c10700 x1830963591674240/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:67/0 lens 488/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.235714:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10700 with x1830963591674240 ext(0->1048575) 00002000:00010000:0.0:1746143671.235717:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10700 00000100:00100000:0.0:1746143671.235727:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2755 00000100:00100000:0.0:1746143671.235732:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963591674240:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143671.245121:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.245288:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.245918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.245939:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.245952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.245974:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143671.249148:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70b000/0xe984082ccd722347 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143671.249155:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70b000/0xe984082ccd722347 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143671.249169:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143671.249277:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70a200/0xe984082ccd722340 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7a2 expref: 10 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.249293:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70b000/0xe984082ccd722347 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7a2 expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.249299:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143671.249312:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143671.249314:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c70b000, rc 0) 00000100:00100000:0.0:1746143671.249651:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+9:27659:x1830963591673728:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 27191us (27253us total) trans 8589941990 rc 0/0 00000100:00100000:0.0:1746143671.249657:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7992 00000100:00100000:0.0:1746143671.262840:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591676160 00000100:00100000:0.0:1746143671.262847:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591676160 00000100:00100000:0.0:1746143671.262885:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7993 00000100:00100000:0.0:1746143671.262891:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:27658:x1830963591676160:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143671.262911:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.262914:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143671.262935:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521200/0xe984082ccd722332 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f771 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.262951:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143671.262955:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143671.262979:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6a00/0xe984082ccd72237f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f7d3 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.263018:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6c00/0xe984082ccd722386 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143671.263027:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17a00/0xe984082ccd722244 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f72b expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.263034:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6c00/0xe984082ccd722386 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143671.263067:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17a00/0xe984082ccd722244 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f72b expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.263083:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17a00/0xe984082ccd722244 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f72b expref: 8 pid: 14762 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746143671.263094:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593524992:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143671.263182:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143671.271612:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591676288 00000100:00100000:0.0:1746143671.271619:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591676288 00000100:00100000:0.0:1746143671.271672:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7994 00000100:00100000:0.0:1746143671.271678:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:27662:x1830963591676288:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143671.271694:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.271708:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d7400/0xe984082ccd72238d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f7da expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.271751:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6c00/0xe984082ccd722386 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143671.271758:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d7400/0xe984082ccd72238d lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7da expref: 245 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.271772:0:14762:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6c00/0xe984082ccd722386 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143671.271781:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d7400/0xe984082ccd72238d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7da expref: 245 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.271790:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143671.271792:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143671.271802:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6c00/0xe984082ccd722386 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143671.271809:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7d7400, rc 0) 00000100:00100000:0.0:1746143671.271863:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:27662:x1830963591676288:12345-192.168.202.48@tcp:101:cat.0 Request processed in 185us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143671.271869:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7994 00000100:00100000:0.0:1746143671.272209:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963591674240:12345-192.168.202.48@tcp:3:cat.0 Request processed in 36476us (36600us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143671.272216:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2755 00002000:00100000:0.0:1746143671.272223:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880094c10700 x1830963591674240/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:67/0 lens 488/440 e 0 to 0 dl 1746143682 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.272233:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10700 with x1830963591674240 ext(0->1048575) 00002000:00010000:0.0:1746143671.272237:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10700 00000100:00100000:0.0:1746143671.276260:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.284110:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963591675648:12345-192.168.202.48@tcp:3:cat.0 Request processed in 34080us (38151us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143671.284120:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2757 00002000:00100000:0.0:1746143671.284130:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88008f0ad500 x1830963591675648/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:67/0 lens 488/440 e 0 to 0 dl 1746143682 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.284155:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad500 with x1830963591675648 ext(1048576->2097151) 00002000:00010000:0.0:1746143671.284161:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ad500 00000100:00100000:0.0:1746143671.297089:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591676544 00000100:00100000:0.0:1746143671.297098:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591676544 00000100:00100000:0.0:1746143671.300097:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7995 00000100:00100000:0.0:1746143671.300112:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:27661:x1830963591676544:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143671.300176:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.300198:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6400/0xe984082ccd722394 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f7e1 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.300254:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6400/0xe984082ccd722394 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7e1 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.300265:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6400/0xe984082ccd722394 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7e1 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.300278:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143671.300280:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143671.300284:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d7400/0xe984082ccd72238d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7da expref: 245 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.300290:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7d6400, rc 0) 00000100:00100000:0.0:1746143671.300351:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:27661:x1830963591676544:12345-192.168.202.48@tcp:101:cat.0 Request processed in 244us (4185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143671.300357:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7995 00010000:00010000:0.0:1746143671.337108:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6c00/0xe984082ccd722386 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7d3 expref: 246 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.337116:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143671.337118:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143671.337120:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088a600/0xe984082ccd7223b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x40 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.337126:0:20509:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088a600/0xe984082ccd7223b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.337172:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088a600/0xe984082ccd7223b0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.337178:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d7400/0xe984082ccd72238d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7da expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.337184:0:20509:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d7400/0xe984082ccd72238d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7da expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.337190:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d7400/0xe984082ccd72238d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7da expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.337196:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6400/0xe984082ccd722394 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7e1 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.337201:0:20509:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6400/0xe984082ccd722394 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7e1 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.337206:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6400/0xe984082ccd722394 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7e1 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.337230:0:20509:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d6400/0xe984082ccd722394 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7e1 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143671.337240:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593525248:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143671.337304:0:20509:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7d7400/0xe984082ccd72238d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7da expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143671.337321:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593525376:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143671.337349:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b000 going to sleep for 11 seconds 00000001:00080000:0.0:1746143671.337362:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941990 is committed 00000001:00080000:0.0:1746143671.337372:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941985 is committed 00000001:00080000:0.0:1746143671.337376:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941986 is committed 00000001:00080000:0.0:1746143671.337380:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589941991 is committed 00000004:00080000:0.0:1746143671.337383:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1450 committed 00000004:00080000:0.0:1746143671.337389:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1484 committed 00000004:00080000:0.0:1746143671.337393:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1483 committed 00000004:00080000:0.0:1746143671.337394:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1482 committed 00000004:00080000:0.0:1746143671.337396:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1481 committed 00000004:00080000:0.0:1746143671.337397:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1449 committed 00000004:00080000:0.0:1746143671.337399:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1480 committed 00000004:00080000:0.0:1746143671.337401:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1448 committed 00000004:00080000:0.0:1746143671.337402:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1479 committed 00000004:00080000:0.0:1746143671.337403:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1447 committed 00000004:00080000:0.0:1746143671.337405:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1446 committed 00000004:00080000:0.0:1746143671.337406:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1445 committed 00000004:00080000:0.0:1746143671.337407:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1478 committed 00000004:00080000:0.0:1746143671.337409:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1477 committed 00000004:00080000:0.0:1746143671.337410:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1444 committed 00000004:00080000:0.0:1746143671.337412:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1443 committed 00000004:00080000:0.0:1746143671.337413:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1476 committed 00000100:00100000:0.0:1746143671.337493:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593525632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143671.337518:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143671.337534:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593526144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143671.337547:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143671.337569:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143671.337574:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593525504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143671.337589:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143671.337600:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593526016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143671.337612:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143671.337626:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593525760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143671.337640:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143671.337651:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593526272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143671.337663:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143671.337673:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143671.337677:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593525888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143671.337689:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143671.337699:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593526400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143671.337719:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143671.337742:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593525632 00000100:00100000:0.0:1746143671.337745:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593525632 00000100:00100000:0.0:1746143671.337764:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593526144 00000100:00100000:0.0:1746143671.337766:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593526144 00000100:00100000:0.0:1746143671.337775:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593525504 00000100:00100000:0.0:1746143671.337776:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593525504 00000100:00100000:0.0:1746143671.337784:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593526016 00000100:00100000:0.0:1746143671.337786:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593526016 00000100:00100000:0.0:1746143671.337792:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593525760 00000100:00100000:0.0:1746143671.337794:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593525760 00000100:00100000:0.0:1746143671.337799:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593526272 00000100:00100000:0.0:1746143671.337801:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593526272 00000100:00100000:0.0:1746143671.337806:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593525888 00000100:00100000:0.0:1746143671.337807:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593525888 00000100:00100000:0.0:1746143671.337812:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593526400 00000100:00100000:0.0:1746143671.337817:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593526400 00000100:00100000:0.0:1746143671.337832:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8361 00000100:00100000:0.0:1746143671.337836:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3293:x1830963593525632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143671.337993:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143671.337996:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143669 -> 1746143669 00002000:00010000:0.0:1746143671.337998:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143669 -> 1746143669 00002000:00010000:0.0:1746143671.338000:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143669 -> 1746143669 00002000:00010000:0.0:1746143671.338001:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746143671.338024:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963593525632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (506us total) trans 21474839494 rc 0/0 00000100:00100000:0.0:1746143671.338030:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8361 00000100:00100000:0.0:1746143671.338041:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8362 00000100:00100000:0.0:1746143671.338045:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3293:x1830963593526144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143671.338159:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963593526144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (589us total) trans 21474839495 rc 0/0 00000100:00100000:0.0:1746143671.338166:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8362 00000100:00100000:0.0:1746143671.338179:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8363 00000100:00100000:0.0:1746143671.338183:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3293:x1830963593525504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143671.338248:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143671.338250:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143667 -> 1746143667 00002000:00010000:0.0:1746143671.338252:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143668 -> 1746143668 00002000:00010000:0.0:1746143671.338254:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143667 -> 1746143667 00002000:00010000:0.0:1746143671.338255:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143671.338273:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963593525504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (683us total) trans 21474839496 rc 0/0 00000100:00100000:0.0:1746143671.338284:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8363 00000100:00100000:0.0:1746143671.338295:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8364 00000100:00100000:0.0:1746143671.338299:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3293:x1830963593526016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143671.338367:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:0.0:1746143671.338369:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:0.0:1746143671.338371:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143671.338372:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:0.0:1746143671.338374:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:0.0:1746143671.338392:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963593526016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (779us total) trans 21474839497 rc 0/0 00000100:00100000:0.0:1746143671.338397:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8364 00000100:00100000:0.0:1746143671.338406:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8365 00000100:00100000:0.0:1746143671.338410:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963593525760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143671.338472:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143671.338475:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143669 -> 1746143669 00002000:00010000:0.0:1746143671.338476:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143669 -> 1746143669 00002000:00010000:0.0:1746143671.338477:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143669 -> 1746143669 00002000:00010000:0.0:1746143671.338479:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143671.338501:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593525760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (860us total) trans 21474839498 rc 0/0 00000100:00100000:0.0:1746143671.338506:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8365 00000100:00100000:0.0:1746143671.338601:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8366 00000100:00100000:0.0:1746143671.338606:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963593526272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143671.338678:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593526272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (1013us total) trans 21474839499 rc 0/0 00000100:00100000:0.0:1746143671.338687:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8366 00000100:00100000:0.0:1746143671.338698:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8367 00000100:00100000:0.0:1746143671.338702:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963593525888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143671.338761:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143671.338762:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143671.338764:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143671.338766:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143671.338767:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143671.338786:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593525888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (1095us total) trans 21474839500 rc 0/0 00000100:00100000:0.0:1746143671.338790:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8367 00000100:00100000:0.0:1746143671.338799:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8368 00000100:00100000:0.0:1746143671.338803:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963593526400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143671.338861:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593526400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (1142us total) trans 21474839501 rc 0/0 00000100:00100000:0.0:1746143671.338865:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8368 00000004:00080000:0.0:1746143671.338899:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131e9ca80/2, rc 0, transno 21474839500 00000100:00100000:0.0:1746143671.338903:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593525888:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143671.338908:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131e9dc00/2, rc 0, transno 21474839501 00000100:00100000:0.0:1746143671.338910:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593526400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143671.338915:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7c1880/2, rc 0, transno 21474839498 00000100:00100000:0.0:1746143671.338917:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593525760:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143671.338921:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131e9c380/2, rc 0, transno 21474839499 00000100:00100000:0.0:1746143671.338923:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593526272:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143671.338938:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7c2a00/2, rc 0, transno 21474839496 00000100:00100000:0.0:1746143671.338940:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593525504:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143671.338944:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131e9f100/2, rc 0, transno 21474839497 00000100:00100000:0.0:1746143671.338946:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593526016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143671.338951:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7c3800/2, rc 0, transno 21474839494 00000100:00100000:0.0:1746143671.338952:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593525632:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143671.338956:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131e9d180/2, rc 0, transno 21474839495 00000100:00100000:0.0:1746143671.338958:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593526144:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143671.338968:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088a600/0xe984082ccd7223b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.338973:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088a600/0xe984082ccd7223b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:0.0:1746143671.338999:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:0.0:1746143671.339002:0:14764:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143671.339012:0:14764:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088a600/0xe984082ccd7223b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339020:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088a600/0xe984082ccd7223b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339027:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088b800/0xe984082ccd7223a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339031:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088b800/0xe984082ccd7223a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339036:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088b800/0xe984082ccd7223a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339047:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a088b800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143671.339062:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088b800/0xe984082ccd7223a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339067:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088b800/0xe984082ccd7223a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339076:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143671.339078:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143671.339081:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088b800/0xe984082ccd7223a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339085:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088b800/0xe984082ccd7223a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339094:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088ba00/0xe984082ccd7223a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339097:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088ba00/0xe984082ccd7223a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339101:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088ba00/0xe984082ccd7223a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339105:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a088ba00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143671.339107:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088ba00/0xe984082ccd7223a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339110:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088ba00/0xe984082ccd7223a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339114:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800939cdb00) 00010000:00010000:0.0:1746143671.339116:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143671.339121:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088ba00/0xe984082ccd7223a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339125:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088ba00/0xe984082ccd7223a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143671.339161:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088b200/0xe984082ccd72239b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7e8 expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.339169:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a088a600/0xe984082ccd7223b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7e8 expref: 7 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.339174:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143671.339176:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746143671.339177:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a088a600, rc 0) 00000100:00100000:0.0:1746143671.339201:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:27663:x1830963591676672:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 13707us (13838us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143671.339206:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7996 00000100:00100000:0.0:1746143671.347022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.347681:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.349796:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.353224:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.364656:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.365316:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.365408:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591677824 00000100:00100000:0.0:1746143671.365411:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591677824 00000100:00100000:0.0:1746143671.365432:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8378 00000100:00100000:0.0:1746143671.365436:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:27658:x1830963591677824:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143671.365447:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.365466:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd7223d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f7fd expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.365481:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b5d200/0xe984082ccd722275 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f74e expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.365488:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7be expref: 33 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.365494:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b7f2800/0xe984082ccd72231d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f78d expref: 19 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.365499:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.365500:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.365503:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd7223d3 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1474560->1957887] (req 1474560->1957887) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7fd expref: 33 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.365521:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b7f2800/0xe984082ccd72231d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f78d expref: 19 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.365531:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b7f2800/0xe984082ccd72231d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f78d expref: 19 pid: 4581 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746143671.365541:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593527808:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143671.365589:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7be expref: 33 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.365604:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7be expref: 33 pid: 8496 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746143671.365707:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593527936:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143671.365785:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093b5d200/0xe984082ccd722275 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f74e expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.365792:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093b5d200/0xe984082ccd722275 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f74e expref: 8 pid: 4582 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746143671.365799:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593528064:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143671.365813:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143671.375014:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.375548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.375625:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.375648:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.375677:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.375699:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591678208 00000100:00100000:0.0:1746143671.375704:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591678208 00002000:00100000:0.0:1746143671.375734:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800a0362680 x1830963591678208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:67/0 lens 488/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.375742:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0362680 with x1830963591678208 ext(0->1048575) 00002000:00010000:0.0:1746143671.375746:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0362680 00000100:00100000:0.0:1746143671.375769:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591678464 00000100:00100000:0.0:1746143671.375773:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591678464 00002000:00100000:0.0:1746143671.375789:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a0362a00 x1830963591678464/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:67/0 lens 488/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.375811:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0362a00 with x1830963591678464 ext(1048576->2097151) 00002000:00010000:0.0:1746143671.375814:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0362a00 00000100:00100000:0.0:1746143671.375827:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591678720 00000100:00100000:0.0:1746143671.375830:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591678720 00002000:00100000:0.0:1746143671.375846:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a0362d80 x1830963591678720/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:67/0 lens 488/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.375851:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0362d80 with x1830963591678720 ext(1048576->2097151) 00002000:00010000:0.0:1746143671.375854:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0362d80 00000100:00100000:0.0:1746143671.375864:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591678976 00000100:00100000:0.0:1746143671.375867:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591678976 00002000:00100000:0.0:1746143671.375879:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff8800a0363100 x1830963591678976/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:67/0 lens 488/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.375885:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0363100 with x1830963591678976 ext(1048576->2097151) 00010000:00010000:0.0:1746143671.375891:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7be expref: 35 pid: 8496 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746143671.375900:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7be expref: 35 pid: 8496 timeout: 850 lvb_type: 1 00002000:00010000:0.0:1746143671.375905:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0363100 00000100:00100000:0.0:1746143671.375921:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 645 00000100:00100000:0.0:1746143671.375926:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963591678976:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143671.377098:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2761 00000100:00100000:0.0:1746143671.377105:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963591678720:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143671.394430:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.400000:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963591678976:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24070us (24320us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143671.400009:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 645 00002000:00100000:0.0:1746143671.400018:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff8800a0363100 x1830963591678976/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:67/0 lens 488/440 e 0 to 0 dl 1746143682 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.400027:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0363100 with x1830963591678976 ext(1048576->2097151) 00010000:00010000:0.0:1746143671.400035:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7be expref: 35 pid: 8496 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746143671.400045:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7be expref: 35 pid: 8496 timeout: 850 lvb_type: 1 00002000:00010000:0.0:1746143671.400061:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0363100 00000100:00100000:0.0:1746143671.415732:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.415748:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.415777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.416110:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963591678720:12345-192.168.202.48@tcp:3:cat.0 Request processed in 39004us (40460us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143671.416118:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2761 00002000:00100000:0.0:1746143671.416125:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a0362d80 x1830963591678720/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:67/0 lens 488/440 e 0 to 0 dl 1746143682 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.416133:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0362d80 with x1830963591678720 ext(1048576->2097151) 00002000:00010000:0.0:1746143671.416162:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0362d80 00000100:00100000:0.0:1746143671.416186:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4190 00000100:00100000:0.0:1746143671.416197:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0363b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963591679872:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143671.416203:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143671.418474:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a084d800/0xe984082ccd722324 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f79b expref: 27 pid: 25369 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746143671.418485:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a084d800/0xe984082ccd722324 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f79b expref: 27 pid: 25369 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746143671.418503:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a084d800/0xe984082ccd722324 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f79b expref: 27 pid: 25369 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746143671.418520:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143671.418549:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0363b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963591679872:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2353us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143671.418556:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4190 00000100:00100000:0.0:1746143671.418611:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.418627:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591680256 00000100:00100000:0.0:1746143671.418631:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591680256 00010000:00010000:0.0:1746143671.418647:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7be expref: 35 pid: 8496 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746143671.418825:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4192 00000100:00100000:0.0:1746143671.418832:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591680256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143671.418841:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143671.418855:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7be expref: 35 pid: 8496 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746143671.418872:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7be expref: 35 pid: 8496 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746143671.418884:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a084c800/0xe984082ccd722363 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7be expref: 35 pid: 8496 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746143671.418893:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.418895:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.418901:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd7223d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1957887) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7fd expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.418908:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd7223d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1957887) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7fd expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.418933:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd7223d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1957887) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7fd expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143671.418943:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593528704:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143671.418983:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143671.425891:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.425918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.425945:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.425969:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.425989:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591680896 00000100:00100000:0.0:1746143671.425994:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591680896 00000100:00100000:0.0:1746143671.426018:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591681024 00000100:00100000:0.0:1746143671.426029:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591681024 00000100:00100000:0.0:1746143671.426044:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8380 00000100:00100000:0.0:1746143671.426060:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963591680896:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143671.426072:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.426085:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff6da00/0xe984082ccd7223ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f812 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143671.426124:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593528960:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143671.426208:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143671.426224:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8381 00000100:00100000:0.0:1746143671.426229:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963591681024:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143671.426235:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.426243:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff6c400/0xe984082ccd7223f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f819 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143671.426264:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593529088:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143671.426765:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b240 going to sleep for 11 seconds 00002000:00010000:0.0:1746143671.434851:0:6929:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143668 -> 1746143671 00002000:00010000:0.0:1746143671.434855:0:6929:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143668 -> 1746143671 00002000:00010000:0.0:1746143671.434857:0:6929:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143668 -> 1746143671 00000100:00100000:0.0:1746143671.434873:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593528960:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143671.434905:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff6da00/0xe984082ccd7223ef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f812 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.434916:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff6da00/0xe984082ccd7223ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f812 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.434944:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff6da00, rc 0) 00000100:00100000:0.0:1746143671.434980:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963591680896:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 8930us (9033us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143671.434988:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8380 00000100:00100000:0.0:1746143671.443688:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.446432:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.447289:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.447322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.451493:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.451534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.451578:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.454286:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.454301:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591682688 00000100:00100000:0.0:1746143671.454305:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591682688 00002000:00100000:0.0:1746143671.454328:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3325952->3330047) req@ffff8800936cdc00 x1830963591682688/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:67/0 lens 488/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.454336:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936cdc00 with x1830963591682688 ext(3325952->3330047) 00002000:00010000:0.0:1746143671.454340:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936cdc00 00000100:00100000:0.0:1746143671.454906:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2767 00000100:00100000:0.0:1746143671.454913:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963591682688:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143671.455487:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963591682688:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 574us (1203us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143671.455493:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2767 00002000:00100000:0.0:1746143671.455499:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3325952->3330047) req@ffff8800936cdc00 x1830963591682688/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746143682 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.455517:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936cdc00 with x1830963591682688 ext(3325952->3330047) 00002000:00010000:0.0:1746143671.455520:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936cdc00 00000100:00100000:0.0:1746143671.455935:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591682944 00000100:00100000:0.0:1746143671.455939:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591682944 00002000:00100000:0.0:1746143671.455952:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1474559) req@ffff8800930c1f80 x1830963591682944/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:67/0 lens 488/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.455959:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c1f80 with x1830963591682944 ext(1048576->1474559) 00010000:00010000:0.0:1746143671.455965:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd7223d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7fd expref: 31 pid: 9527 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746143671.455976:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd7223d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7fd expref: 31 pid: 9527 timeout: 850 lvb_type: 0 00002000:00010000:0.0:1746143671.455982:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930c1f80 00000100:00100000:0.0:1746143671.455991:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591683328 00000100:00100000:0.0:1746143671.455993:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591683328 00002000:00100000:0.0:1746143671.456002:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1474560->1957887) req@ffff88008f7c2d80 x1830963591683328/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:67/0 lens 488/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.456008:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c2d80 with x1830963591683328 ext(1474560->1957887) 00010000:00010000:0.0:1746143671.456012:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd7223d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7fd expref: 32 pid: 9527 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746143671.456020:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd7223d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7fd expref: 32 pid: 9527 timeout: 850 lvb_type: 0 00002000:00010000:0.0:1746143671.456034:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7c2d80 00000100:00100000:0.0:1746143671.456045:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 646 00000100:00100000:0.0:1746143671.456060:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963591682944:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143671.461786:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591683968 00000100:00100000:0.0:1746143671.461795:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591683968 00000100:00100000:0.0:1746143671.461841:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3168 00000100:00100000:0.0:1746143671.461848:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+7:27659:x1830963591683968:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143671.462009:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+8:27659:x1830963591683968:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 161us (447us total) trans 8589941995 rc 0/0 00000100:00100000:0.0:1746143671.462015:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3168 00000100:00100000:0.0:1746143671.487697:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.498309:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.498348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.498374:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.498389:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591684352 00000100:00100000:0.0:1746143671.498392:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591684352 00000100:00100000:0.0:1746143671.498415:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8385 00000100:00100000:0.0:1746143671.498420:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591684352:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143671.498436:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.498449:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff6c800/0xe984082ccd722420 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f835 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143671.498485:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593529856:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143671.498566:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.498584:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143671.498593:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591684608 00000100:00100000:0.0:1746143671.498595:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591684608 00000100:00100000:0.0:1746143671.498611:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8386 00000100:00100000:0.0:1746143671.498615:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963591684608:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143671.498622:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143671.498630:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff6c000/0xe984082ccd722427 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f843 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143671.498753:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593530112:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143671.498786:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b300 going to sleep for 11 seconds 00010000:00010000:0.0:1746143671.501614:0:6929:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff88008e63c700 x1830963593529856) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd7223d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1474560->1957887) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7fd expref: 37 pid: 9527 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746143671.501631:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd7223d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1474560->1957887) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7fd expref: 37 pid: 9527 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746143671.501646:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593529856:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143671.501670:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff6c800/0xe984082ccd722420 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f835 expref: 36 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.501680:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff6c800/0xe984082ccd722420 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f835 expref: 36 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.501687:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff6c800, rc 0) 00000100:00100000:0.0:1746143671.501709:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591684352:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3289us (3334us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143671.501723:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8385 00000100:00100000:0.0:1746143671.501978:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593530112:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143671.501993:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff6c000/0xe984082ccd722427 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f843 expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.502001:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff6c000/0xe984082ccd722427 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f843 expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143671.502008:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff6c000, rc 0) 00000100:00100000:0.0:1746143671.502026:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963591684608:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3410us (3461us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143671.502031:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8386 00000100:00100000:0.0:1746143671.507266:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.515419:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.522354:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.528984:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.537514:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.540339:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.540383:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.540403:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591686016 00000100:00100000:0.0:1746143671.540408:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591686016 00002000:00100000:0.0:1746143671.540438:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880090764a80 x1830963591686016/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:67/0 lens 488/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.540447:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764a80 with x1830963591686016 ext(2097152->3145727) 00002000:00010000:0.0:1746143671.540452:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090764a80 00000100:00100000:0.0:1746143671.540476:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591686272 00000100:00100000:0.0:1746143671.540479:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591686272 00002000:00100000:0.0:1746143671.540490:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880090767b80 x1830963591686272/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:67/0 lens 488/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.540495:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767b80 with x1830963591686272 ext(3145728->4194303) 00002000:00010000:0.0:1746143671.540498:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090767b80 00000100:00100000:0.0:1746143671.540507:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2771 00000100:00100000:0.0:1746143671.540510:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591686272:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143671.542579:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.542615:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.542631:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591686528 00000100:00100000:0.0:1746143671.542634:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591686528 00002000:00100000:0.0:1746143671.542656:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3629055) req@ffff88009a5ac380 x1830963591686528/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:67/0 lens 504/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.542664:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5ac380 with x1830963591686528 ext(2097152->3629055) 00002000:00010000:0.0:1746143671.542668:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a5ac380 00000100:00100000:0.0:1746143671.542679:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591686656 00000100:00100000:0.0:1746143671.542681:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591686656 00002000:00100000:0.0:1746143671.542689:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3629056->4194303) req@ffff88009a5ae300 x1830963591686656/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:67/0 lens 488/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.542695:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5ae300 with x1830963591686656 ext(3629056->4194303) 00002000:00010000:0.0:1746143671.542697:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a5ae300 00000100:00100000:0.0:1746143671.542706:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2772 00000100:00100000:0.0:1746143671.542711:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591686528:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143671.558616:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.566205:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.581040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.592668:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.592712:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.606915:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.606959:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.607002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.625780:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.660014:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.663761:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.692934:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.712298:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.721996:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.791879:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.800057:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.800109:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.800127:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.800167:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591690624 00000100:00100000:0.0:1746143671.800173:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591690624 00010000:00010000:0.0:1746143671.800197:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c70a000/0xe984082ccd722355 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7b0 expref: 30 pid: 21542 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746143671.800212:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591690496 00000100:00100000:0.0:1746143671.800214:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591690496 00010000:00010000:0.0:1746143671.800220:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012baff000/0xe984082ccd722316 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f77f expref: 25 pid: 15784 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746143671.800228:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591690752 00000100:00100000:0.0:1746143671.800230:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591690752 00010000:00010000:0.0:1746143671.800239:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d53ac00/0xe984082ccd722267 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f740 expref: 8 pid: 4582 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746143671.800249:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4199 00000100:00100000:0.0:1746143671.800254:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0400000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963591690624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143671.800262:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143671.802519:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c70a000/0xe984082ccd722355 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7b0 expref: 30 pid: 21542 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746143671.802538:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c70a000/0xe984082ccd722355 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7b0 expref: 30 pid: 21542 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746143671.802553:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c70a000/0xe984082ccd722355 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f7b0 expref: 30 pid: 21542 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746143671.802810:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.802812:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143671.802819:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab28c00/0xe984082ccd722497 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1855487) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f87b expref: 29 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143671.802826:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab28c00/0xe984082ccd722497 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1855487) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f87b expref: 29 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143671.815797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.819761:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.829407:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.829453:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.837741:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591691648 00000100:00100000:0.0:1746143671.837755:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591691648 00002000:00100000:0.0:1746143671.837790:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3690496->3694591) req@ffff880094307800 x1830963591691648/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:67/0 lens 488/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.837799:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307800 with x1830963591691648 ext(3690496->3694591) 00002000:00010000:0.0:1746143671.837803:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307800 00000100:00100000:0.0:1746143671.837816:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591691904 00000100:00100000:0.0:1746143671.837818:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591691904 00002000:00100000:0.0:1746143671.837827:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1851392->1855487) req@ffff880094304700 x1830963591691904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:67/0 lens 488/0 e 0 to 0 dl 1746143682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.837834:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304700 with x1830963591691904 ext(1851392->1855487) 00002000:00010000:0.0:1746143671.837836:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304700 00000100:00100000:0.0:1746143671.837846:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2783 00000100:00100000:0.0:1746143671.837851:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963591691904:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143671.837958:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963591691904:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 105us (299us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143671.837964:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2783 00002000:00100000:0.0:1746143671.837968:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1851392->1855487) req@ffff880094304700 x1830963591691904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746143682 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143671.837975:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304700 with x1830963591691904 ext(1851392->1855487) 00002000:00010000:0.0:1746143671.837977:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304700 00000100:00100000:0.0:1746143671.848575:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.848909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.858384:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.860655:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.868628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.874310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.900245:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.904922:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.918550:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.939627:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.951020:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.968356:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.981497:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.981591:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f890000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593532672:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143671.981608:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143671.981656:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0403800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963591694080:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 13114us (13305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143671.981666:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4206 00000100:00100000:0.0:1746143671.997658:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143671.998461:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.000075:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.002187:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.005030:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591695360 00000100:00100000:0.0:1746143672.005035:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591695360 00010000:00010000:0.0:1746143672.005157:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0824e00/0xe984082ccd722489 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f874 expref: 251 pid: 20509 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746143672.005184:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591695488 00000100:00100000:0.0:1746143672.005187:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591695488 00010000:00010000:0.0:1746143672.005196:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0825600/0xe984082ccd722466 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f86d expref: 14 pid: 20509 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746143672.037374:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.037430:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.051621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.072058:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.086080:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.086477:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.086501:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591697408 00000100:00100000:0.0:1746143672.086503:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591697408 00002000:00100000:0.0:1746143672.086516:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3264512->4194303) req@ffff88008f8ed500 x1830963591697408/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:68/0 lens 488/0 e 0 to 0 dl 1746143683 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143672.086521:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f8ed500 with x1830963591697408 ext(3264512->4194303) 00002000:00010000:0.0:1746143672.086524:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f8ed500 00000100:00100000:0.0:1746143672.086532:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2792 00000100:00100000:0.0:1746143672.086536:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f8ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1963:x1830963591697408:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143672.104615:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.109966:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.118564:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.119865:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.127179:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.139908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.140591:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.142101:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.143411:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.150089:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.150195:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.154368:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.154391:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591699840 00000100:00100000:0.0:1746143672.154396:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591699840 00002000:00100000:0.0:1746143672.154426:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4116480->4194303) req@ffff88008f8efb80 x1830963591699840/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:68/0 lens 488/0 e 0 to 0 dl 1746143683 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143672.154440:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f8efb80 with x1830963591699840 ext(4116480->4194303) 00010000:00010000:0.0:1746143672.154448:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa43600/0xe984082ccd72255b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4116480->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f8f9 expref: 25 pid: 4582 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746143672.154459:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa43600/0xe984082ccd72255b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4116480->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f8f9 expref: 25 pid: 4582 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746143672.154465:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f8efb80 00000100:00100000:0.0:1746143672.154496:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 655 00000100:00100000:0.0:1746143672.154502:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963591699840:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143672.154672:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.160319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.163260:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.170436:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.174333:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.175890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.184815:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.184914:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.185627:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.186295:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2797 00000100:00100000:0.0:1746143672.186301:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963591701504:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143672.191240:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591701760 00000100:00100000:0.0:1746143672.191245:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591701760 00000100:00100000:0.0:1746143672.191270:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8412 00000100:00100000:0.0:1746143672.191276:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1962:x1830963591701760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143672.191295:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143672.191308:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8c00/0xe984082ccd722585 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f923 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143672.191347:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593535232:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143672.191402:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143672.202741:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593535232:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143672.202768:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8c00/0xe984082ccd722585 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f923 expref: 28 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143672.202780:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b8c00/0xe984082ccd722585 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f923 expref: 28 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143672.202807:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a04b8c00, rc 0) 00000100:00100000:0.0:1746143672.202833:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1962:x1830963591701760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 11556us (12849us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143672.202839:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8412 00000100:00100000:0.0:1746143672.202992:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963591701504:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16691us (18078us total) trans 0 rc 614400/614400 00000100:00100000:0.0:1746143672.202998:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2797 00002000:00100000:0.0:1746143672.203003:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3502080->4116479) req@ffff88009445b480 x1830963591701504/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:68/0 lens 488/440 e 0 to 0 dl 1746143683 ref 1 fl Complete:/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143672.203009:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445b480 with x1830963591701504 ext(3502080->4116479) 00002000:00010000:0.0:1746143672.203012:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009445b480 00000100:00100000:0.0:1746143672.204319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.207534:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.207688:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.210040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.216505:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.233422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.244388:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.277319:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.284817:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.295359:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.300452:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.326980:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.347568:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.351893:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.376587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.387094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.389806:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.394190:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.399796:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.402641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.412522:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.419412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.461633:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.461669:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.507626:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.507661:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.509431:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.527315:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.527394:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.528722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.538381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.538397:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.538417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.556990:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.558201:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.566466:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.567217:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591710080 00000100:00100000:0.0:1746143672.567223:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591710080 00002000:00100000:0.0:1746143672.567253:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a06a5f80 x1830963591710080/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:68/0 lens 488/0 e 0 to 0 dl 1746143683 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143672.567263:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a5f80 with x1830963591710080 ext(2097152->3145727) 00002000:00010000:0.0:1746143672.567267:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a06a5f80 00000100:00100000:0.0:1746143672.567280:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2807 00000100:00100000:0.0:1746143672.567285:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1962:x1830963591710080:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143672.568403:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.569058:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.569634:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.569662:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.569683:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591710464 00000100:00100000:0.0:1746143672.569688:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591710464 00002000:00100000:0.0:1746143672.569714:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a06a6300 x1830963591710464/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:68/0 lens 488/0 e 0 to 0 dl 1746143683 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143672.569723:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a6300 with x1830963591710464 ext(3145728->4194303) 00002000:00010000:0.0:1746143672.569728:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a06a6300 00000100:00100000:0.0:1746143672.569741:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591710592 00000100:00100000:0.0:1746143672.569748:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591710592 00002000:00100000:0.0:1746143672.569760:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34c:0x0] (634880->638975) req@ffff8800a06a6680 x1830963591710592/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:68/0 lens 488/0 e 0 to 0 dl 1746143683 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143672.569767:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a6680 with x1830963591710592 ext(634880->638975) 00002000:00010000:0.0:1746143672.569770:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a06a6680 00000100:00100000:0.0:1746143672.569780:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591710848 00000100:00100000:0.0:1746143672.569782:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591710848 00002000:00100000:0.0:1746143672.569792:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a06a6a00 x1830963591710848/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:68/0 lens 488/0 e 0 to 0 dl 1746143683 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143672.569798:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a6a00 with x1830963591710848 ext(2097152->3145727) 00002000:00010000:0.0:1746143672.569801:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a06a6a00 00000100:00100000:0.0:1746143672.569808:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591711104 00000100:00100000:0.0:1746143672.569810:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591711104 00002000:00100000:0.0:1746143672.569816:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800a06a6d80 x1830963591711104/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:68/0 lens 488/0 e 0 to 0 dl 1746143683 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143672.569822:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a6d80 with x1830963591711104 ext(3145728->4194303) 00002000:00010000:0.0:1746143672.569824:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a06a6d80 00000100:00100000:0.0:1746143672.569831:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2808 00000100:00100000:0.0:1746143672.569836:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1962:x1830963591710464:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143672.570863:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2809 00000100:00100000:0.0:1746143672.570870:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963591710592:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143672.570945:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963591710592:12345-192.168.202.48@tcp:3:cat.0 Request processed in 76us (1888us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143672.570951:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2809 00002000:00100000:0.0:1746143672.570956:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (634880->638975) req@ffff8800a06a6680 x1830963591710592/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746143683 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143672.570968:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a6680 with x1830963591710592 ext(634880->638975) 00002000:00010000:0.0:1746143672.570971:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a06a6680 00000100:00100000:0.0:1746143672.570984:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2810 00000100:00100000:0.0:1746143672.570989:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1962:x1830963591710848:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143672.572167:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2811 00000100:00100000:0.0:1746143672.572174:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1962:x1830963591711104:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143672.578116:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.578159:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591711232 00000100:00100000:0.0:1746143672.578167:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591711232 00000100:00100000:0.0:1746143672.578208:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 489 00000100:00100000:0.0:1746143672.578215:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963591711232:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143672.578226:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143672.578246:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28a00/0xe984082ccd72267a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f993 expref: 22 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143672.578261:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143672.578265:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143672.578316:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963591711232:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143672.578322:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 489 00000100:00100000:0.0:1746143672.604372:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1962:x1830963591710080:12345-192.168.202.48@tcp:3:cat.0 Request processed in 37077us (37903us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143672.604381:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2807 00002000:00100000:0.0:1746143672.604395:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a06a5f80 x1830963591710080/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:68/0 lens 488/440 e 0 to 0 dl 1746143683 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143672.604403:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a5f80 with x1830963591710080 ext(2097152->3145727) 00002000:00010000:0.0:1746143672.606031:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a06a5f80 00000100:00100000:0.0:1746143672.624708:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963591710848:12345-192.168.202.48@tcp:3:cat.0 Request processed in 53710us (55066us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143672.624719:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2810 00002000:00100000:0.0:1746143672.624729:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a06a6a00 x1830963591710848/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:68/0 lens 488/440 e 0 to 0 dl 1746143683 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143672.624737:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a6a00 with x1830963591710848 ext(2097152->3145727) 00002000:00010000:0.0:1746143672.624742:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a06a6a00 00000100:00100000:0.0:1746143672.649883:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:0.0:1746143672.664004:0:8496:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime: 1746143668 -> 1746143672 00002000:00010000:0.0:1746143672.664010:0:8496:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime: 1746143668 -> 1746143672 00002000:00010000:0.0:1746143672.664012:0:8496:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime: 1746143668 -> 1746143672 00000100:00100000:0.0:1746143672.664030:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f892a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593537280:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143672.664067:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd722688 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f99a expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143672.664081:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd722688 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f99a expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143672.664096:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336a600, rc 0) 00000100:00100000:0.0:1746143672.664132:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1965:x1830963591711616:12345-192.168.202.48@tcp:101:cat.0 Request processed in 13538us (14257us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143672.664162:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8424 00000100:00100000:0.0:1746143672.670268:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.670292:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591711744 00000100:00100000:0.0:1746143672.670299:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591711744 00000100:00100000:0.0:1746143672.670335:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8425 00000100:00100000:0.0:1746143672.670343:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1965:x1830963591711744:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143672.670358:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143672.670372:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c25b200/0xe984082ccd72268f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f9a1 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143672.670415:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593537408:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143672.670478:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143672.674537:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593537408:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143672.674565:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c25b200/0xe984082ccd72268f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9a1 expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143672.674577:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c25b200/0xe984082ccd72268f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9a1 expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143672.674586:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c25b200, rc 0) 00000100:00100000:0.0:1746143672.674619:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1965:x1830963591711744:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4276us (4357us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143672.674626:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8425 00000100:00100000:0.0:1746143672.688453:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.688482:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591711872 00000100:00100000:0.0:1746143672.688493:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591711872 00000100:00100000:0.0:1746143672.688527:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8426 00000100:00100000:0.0:1746143672.688534:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1962:x1830963591711872:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143672.688550:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143672.688564:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c25be00/0xe984082ccd722696 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f9a8 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143672.688610:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593537536:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143672.688676:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143672.691977:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593537536:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143672.692004:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c25be00/0xe984082ccd722696 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9a8 expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143672.692015:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c25be00/0xe984082ccd722696 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9a8 expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143672.692026:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c25be00, rc 0) 00000100:00100000:0.0:1746143672.692082:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1962:x1830963591711872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3546us (3633us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143672.692090:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8426 00000100:00100000:0.0:1746143672.735319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.735406:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.735446:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591712128 00000100:00100000:0.0:1746143672.735451:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591712128 00010000:00010000:0.0:1746143672.735471:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a004d200/0xe984082ccd72244a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f866 expref: 36 pid: 8496 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746143672.735495:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591712256 00000100:00100000:0.0:1746143672.735497:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591712256 00010000:00010000:0.0:1746143672.735505:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0170800/0xe984082ccd722404 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f82e expref: 29 pid: 4582 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746143672.735517:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4222 00000100:00100000:0.0:1746143672.735522:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963591712128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143672.735531:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143672.735545:0:11106:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:0.0:1746143672.735550:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a004d200/0xe984082ccd72244a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f866 expref: 36 pid: 8496 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746143672.735558:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a004d200/0xe984082ccd72244a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f866 expref: 36 pid: 8496 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746143672.735574:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a004d200/0xe984082ccd72244a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f866 expref: 36 pid: 8496 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746143672.735595:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143672.736394:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963591712128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 868us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143672.736400:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4222 00000100:00100000:0.0:1746143672.736426:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4223 00000100:00100000:0.0:1746143672.736430:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1965:x1830963591712256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143672.736443:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143672.736452:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0170800/0xe984082ccd722404 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f82e expref: 29 pid: 4582 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746143672.736459:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0170800/0xe984082ccd722404 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f82e expref: 29 pid: 4582 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746143672.736470:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0170800/0xe984082ccd722404 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f82e expref: 29 pid: 4582 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746143672.736478:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143672.736480:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143672.736484:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0a8000/0xe984082ccd72269d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9af expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143672.736492:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0a8000/0xe984082ccd72269d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9af expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143672.736513:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0a8000/0xe984082ccd72269d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9af expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143672.736522:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593537920:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143672.736566:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143672.739868:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593537920:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143672.739887:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143672.739920:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1965:x1830963591712256:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3488us (4512us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143672.739933:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4223 00000100:00100000:0.0:1746143672.759345:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.759367:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591712896 00000100:00100000:0.0:1746143672.759373:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591712896 00000100:00100000:0.0:1746143672.759405:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8012 00000100:00100000:0.0:1746143672.759411:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:27709:x1830963591712896:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143672.759427:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143672.759441:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012caac600/0xe984082ccd7226ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209f9bd expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143672.759523:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caad400/0xe984082ccd7226b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759534:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012caad400/0xe984082ccd7226b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759543:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012caad400/0xe984082ccd7226b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759553:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caac000/0xe984082ccd7226b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759558:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012caac000/0xe984082ccd7226b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759562:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012caac000/0xe984082ccd7226b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759645:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caacc00/0xe984082ccd7226c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759653:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012caacc00/0xe984082ccd7226c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759666:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012caacc00/0xe984082ccd7226c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143672.759673:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143672.759736:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caad400/0xe984082ccd7226b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759741:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012caad400/0xe984082ccd7226b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759745:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012caad400/0xe984082ccd7226b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759749:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012caad400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143672.759752:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012caad400/0xe984082ccd7226b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759756:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012caad400/0xe984082ccd7226b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759763:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143672.759765:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143672.759767:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012caad400/0xe984082ccd7226b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759771:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012caad400/0xe984082ccd7226b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759791:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caac000/0xe984082ccd7226b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759795:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012caac000/0xe984082ccd7226b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759806:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012caac000/0xe984082ccd7226b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759809:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012caac000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143672.759811:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012caac000/0xe984082ccd7226b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759815:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012caac000/0xe984082ccd7226b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759820:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5ab00) 00010000:00010000:0.0:1746143672.759822:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143672.759824:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012caac000/0xe984082ccd7226b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759828:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012caac000/0xe984082ccd7226b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143672.759857:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012caac600/0xe984082ccd7226ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9bd expref: 258 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143672.759867:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012caacc00/0xe984082ccd7226c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9bd expref: 257 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143672.759872:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143672.759874:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143672.759875:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caacc00, rc 0) 00000100:00100000:0.0:1746143672.759913:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:27709:x1830963591712896:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 501us (572us total) trans 8589942016 rc 0/0 00000100:00100000:0.0:1746143672.759918:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8012 00000100:00100000:0.0:1746143672.766984:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.767010:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.767077:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.768300:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 490 00000100:00100000:0.0:1746143672.768307:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:1964:x1830963591713280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143672.768316:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143672.768329:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012caacc00/0xe984082ccd7226c0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9bd expref: 257 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143672.768371:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143672.768374:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143672.768406:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:1964:x1830963591713280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 99us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143672.768412:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 490 00000001:00080000:0.0:1746143672.789085:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872209 is committed 00000001:00080000:0.0:1746143672.789113:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872223 is committed 00000001:00080000:0.0:1746143672.789121:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872221 is committed 00000001:00080000:0.0:1746143672.789126:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872218 is committed 00000001:00080000:0.0:1746143672.789182:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872222 is committed 00000001:00080000:0.0:1746143672.789209:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872224 is committed 00000100:00100000:0.0:1746143672.793823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.803271:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.809967:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.825858:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.826713:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.829935:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.829999:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.836046:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.837942:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.837990:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.846797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.847423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.851339:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.851880:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.852267:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.854203:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.854257:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.854905:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.855493:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.855927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.858924:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.860677:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.864249:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.864562:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.869069:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591718272 00000100:00100000:0.0:1746143672.869076:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591718272 00010000:00010000:0.0:1746143672.869103:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0a8000/0xe984082ccd72269d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9af expref: 11 pid: 8496 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746143672.869125:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4230 00000100:00100000:0.0:1746143672.869132:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963591718272:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143672.869162:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143672.869181:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f0a8000/0xe984082ccd72269d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9af expref: 11 pid: 8496 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746143672.869199:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f0a8000/0xe984082ccd72269d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9af expref: 11 pid: 8496 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746143672.869217:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0a8000/0xe984082ccd72269d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f9af expref: 11 pid: 8496 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746143672.869233:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143672.869235:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143672.869240:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf000/0xe984082ccd722745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa03 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143672.869246:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf000/0xe984082ccd722745 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa03 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143672.869273:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf000/0xe984082ccd722745 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa03 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143672.869284:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a55880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593539840:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143672.869346:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143672.887373:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.896478:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591719168 00000100:00100000:0.0:1746143672.896484:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591719168 00002000:00100000:0.0:1746143672.897082:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1572864->2097151) req@ffff88008f890380 x1830963591719168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:68/0 lens 488/0 e 0 to 0 dl 1746143683 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143672.897090:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f890380 with x1830963591719168 ext(1572864->2097151) 00002000:00010000:0.0:1746143672.897101:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f890380 00000100:00100000:0.0:1746143672.897124:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2819 00000100:00100000:0.0:1746143672.897371:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963591719168:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143672.913501:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.917442:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.917841:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.923952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.934116:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.943465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.944794:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.944821:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.959696:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.970579:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.970662:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.973987:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.975906:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.983851:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143672.998721:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143673.016451:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143673.025011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.025073:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143673.060722:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143673.066817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.115085:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.120535:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.121574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.147214:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.147300:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.147329:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591724032 00000100:00100000:0.0:1746143673.147336:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591724032 00000100:00100000:0.0:1746143673.147387:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 495 00000100:00100000:0.0:1746143673.147394:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+263:1963:x1830963591724032:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143673.147404:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143673.147423:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f198e00/0xe984082ccd7227df lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa50 expref: 263 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143673.147441:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143673.147444:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143673.147474:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:1963:x1830963591724032:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 81us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143673.147479:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 495 00000100:00100000:0.0:1746143673.149289:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593541248:0@lo:400:kworker.0 00000100:00100000:0.0:1746143673.149327:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143673.149368:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143673.149372:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1830963593541120:0@lo:400:kworker.0 00000100:00100000:0.0:1746143673.149392:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143673.149800:0:14758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593540864 00000100:00100000:0.0:1746143673.149803:0:14758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593540864 00000100:00100000:0.0:1746143673.149823:0:14758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1746143673.149827:0:14758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3294:x1830963593540864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143673.149853:0:14758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3294:x1830963593540864:12345-0@lo:400:kworker.0 Request processed in 25us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143673.149858:0:14758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1746143673.150126:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1746143673.150131:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830963593541376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143673.150184:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830963593541376:12345-0@lo:400:kworker.0 Request processed in 48us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143673.150190:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1746143673.150200:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1746143673.150204:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830963593540992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143673.150224:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830963593540992:12345-0@lo:400:kworker.0 Request processed in 19us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143673.150227:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1746143673.150495:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1830963593541120:0@lo:400:kworker.0 00000004:00080000:0.0:1746143673.151563:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 16 done 00000100:00100000:0.0:1746143673.159743:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.165607:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.188624:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963591724800:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18072us (23015us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143673.188633:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2828 00002000:00100000:0.0:1746143673.188643:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88012b4a2d80 x1830963591724800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:69/0 lens 488/440 e 0 to 0 dl 1746143684 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143673.188652:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4a2d80 with x1830963591724800 ext(1048576->2097151) 00002000:00010000:0.0:1746143673.188657:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4a2d80 00000100:00100000:0.0:1746143673.200339:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.209367:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.210803:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.261679:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.270117:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.277674:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.281295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.281665:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.289705:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143673.292481:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143673.304355:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591726848 00000100:00100000:0.0:1746143673.304361:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591726848 00010000:00010000:0.0:1746143673.304386:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00f8000/0xe984082ccd7225a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f93f expref: 19 pid: 9527 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746143673.304414:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4237 00000100:00100000:0.0:1746143673.304420:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963591726848:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143673.304429:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143673.304444:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00f8000/0xe984082ccd7225a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f93f expref: 19 pid: 9527 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746143673.304454:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00f8000/0xe984082ccd7225a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f93f expref: 19 pid: 9527 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746143673.304469:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00f8000/0xe984082ccd7225a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f93f expref: 19 pid: 9527 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746143673.304484:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143673.305876:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963591726848:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1454us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143673.305886:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4237 00000100:00100000:0.0:1746143673.305917:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591726976 00000100:00100000:0.0:1746143673.305920:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591726976 00010000:00010000:0.0:1746143673.305933:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d53d400/0xe984082ccd72261f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f969 expref: 10 pid: 4581 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746143673.306222:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4238 00000100:00100000:0.0:1746143673.306228:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0363b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963591726976:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143673.306236:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143673.306246:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d53d400/0xe984082ccd72261f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f969 expref: 10 pid: 4581 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746143673.306254:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d53d400/0xe984082ccd72261f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f969 expref: 10 pid: 4581 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746143673.306264:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d53d400/0xe984082ccd72261f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f969 expref: 10 pid: 4581 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746143673.306273:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143673.306275:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143673.306280:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f199e00/0xe984082ccd72281e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa6c expref: 9 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143673.306287:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f199e00/0xe984082ccd72281e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa6c expref: 9 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143673.306310:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f199e00/0xe984082ccd72281e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2572287) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa6c expref: 9 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143673.306327:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593542528:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143673.307192:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143673.313621:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593542528:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143673.313634:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143673.313651:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0363b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963591726976:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7423us (8334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143673.313656:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4238 00000100:00100000:0.0:1746143673.318261:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591727616 00000100:00100000:0.0:1746143673.318266:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591727616 00000100:00100000:0.0:1746143673.319060:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3185 00000100:00100000:0.0:1746143673.319066:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+27:27721:x1830963591727616:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143673.319282:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+28:27721:x1830963591727616:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 216us (1226us total) trans 8589942030 rc 0/0 00000100:00100000:0.0:1746143673.319287:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3185 00000100:00100000:0.0:1746143673.324828:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.344513:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.348371:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.366899:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.366936:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.366964:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.370893:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.374373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.384024:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.394749:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.397246:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.397332:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591729792 00000100:00100000:0.0:1746143673.397336:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591729792 00000100:00100000:0.0:1746143673.397360:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 498 00000100:00100000:0.0:1746143673.397365:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0402a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1962:x1830963591729792:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143673.397372:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143673.397391:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd722864 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa81 expref: 31 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143673.397407:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143673.397411:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143673.397428:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0402a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1962:x1830963591729792:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 63us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143673.397434:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 498 00000100:00100000:0.0:1746143673.403191:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.403225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.403253:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.403282:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.435809:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.441880:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.447773:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.461818:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.477966:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.497041:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.500451:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591731968 00000100:00100000:0.0:1746143673.500456:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591731968 00000100:00100000:0.0:1746143673.500500:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 499 00000100:00100000:0.0:1746143673.500506:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1962:x1830963591731968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143673.500525:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143673.500539:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009331ea00/0xe984082ccd7228b1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fab2 expref: 32 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143673.500554:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143673.500557:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143673.500584:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1962:x1830963591731968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143673.500590:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 499 00000100:00100000:0.0:1746143673.503660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.503709:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.505722:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.505740:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591732608 00000100:00100000:0.0:1746143673.505743:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591732608 00000100:00100000:0.0:1746143673.505773:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8455 00000100:00100000:0.0:1746143673.505779:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+10:27740:x1830963591732608:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143673.505788:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143673.505800:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd7228e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fac0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143673.505820:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a63fe800/0xe984082ccd722825 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa73 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143673.505827:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143673.505828:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143673.505831:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd7228e2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fac0 expref: 11 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143673.505867:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a63fe800/0xe984082ccd722825 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa73 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143673.505877:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a63fe800/0xe984082ccd722825 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3555327) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa73 expref: 19 pid: 4581 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746143673.505888:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593543424:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143673.505950:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143673.507467:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593543424:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143673.507483:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd7228e2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fac0 expref: 11 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143673.507494:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009808a800, rc 0) 00000100:00100000:0.0:1746143673.507517:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+11:27740:x1830963591732608:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1738us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143673.507523:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8455 00000100:00100000:0.0:1746143673.517351:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.517392:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.517434:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.535775:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.536565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.536600:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.544424:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.544460:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591733888 00000100:00100000:0.0:1746143673.544472:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591733888 00002000:00100000:0.0:1746143673.544503:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009cdc1500 x1830963591733888/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:69/0 lens 488/0 e 0 to 0 dl 1746143684 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143673.544511:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1500 with x1830963591733888 ext(2097152->3145727) 00002000:00010000:0.0:1746143673.544514:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc1500 00000100:00100000:0.0:1746143673.544531:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2837 00000100:00100000:0.0:1746143673.544537:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963591733888:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143673.545923:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.581363:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.589741:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.589796:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.591465:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2840 00000100:00100000:0.0:1746143673.593732:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963591734784:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143673.608066:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.616187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.623566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.623658:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.627745:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.628098:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.631752:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.654681:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.670828:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.675335:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.682786:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.687308:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.695293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.695357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.714223:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.723410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.730271:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.730830:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.746844:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.747913:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.774836:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.774886:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.780903:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.780944:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.783535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.788220:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.788343:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.789547:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.794288:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.795848:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.800072:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.800195:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.834617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.848395:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591741696 00000100:00100000:0.0:1746143673.848401:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591741696 00010000:00010000:0.0:1746143673.848418:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63dfe00/0xe984082ccd72291a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209faf8 expref: 14 pid: 8496 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746143673.848445:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4250 00000100:00100000:0.0:1746143673.848451:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f891500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963591741696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143673.848458:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143673.848487:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a63dfe00/0xe984082ccd72291a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209faf8 expref: 14 pid: 8496 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746143673.848496:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a63dfe00/0xe984082ccd72291a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209faf8 expref: 14 pid: 8496 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746143673.848512:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a63dfe00/0xe984082ccd72291a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2883583) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209faf8 expref: 14 pid: 8496 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746143673.848542:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143673.848544:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143673.848549:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bcae000/0xe984082ccd7229b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2990080->3055615) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fb3e expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143673.848557:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bcae000/0xe984082ccd7229b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2990080->3055615) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fb3e expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143673.848583:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bcae000/0xe984082ccd7229b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2990080->3055615) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fb3e expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143673.848593:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bcae000/0xe984082ccd7229b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2990080->3055615) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fb3e expref: 21 pid: 4581 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746143673.848604:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593545600:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143673.849997:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143673.852964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.862461:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.868874:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143673.872589:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095386600/0xe984082ccd7229c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fb53 expref: 12 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143673.872606:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593545728:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143673.872713:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd7229c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fb4c expref: 23 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143673.872721:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593545856:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143673.872737:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143673.880319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.880373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.898555:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.901641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.908370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.925058:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.935360:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.935412:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.951960:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.952723:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.968888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143673.970761:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963591743744:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35113us (35407us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143673.970767:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2849 00002000:00100000:0.0:1746143673.970774:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880094306d80 x1830963591743744/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:69/0 lens 488/440 e 0 to 0 dl 1746143684 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143673.970783:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306d80 with x1830963591743744 ext(3145728->4194303) 00002000:00010000:0.0:1746143673.970796:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094306d80 00000100:00100000:0.0:1746143673.998174:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.004463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.005934:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591745152 00000100:00100000:0.0:1746143674.005946:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591745152 00002000:00100000:0.0:1746143674.005984:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009bef7b80 x1830963591745152/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:70/0 lens 488/0 e 0 to 0 dl 1746143685 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143674.005994:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef7b80 with x1830963591745152 ext(4194304->4898815) 00002000:00010000:0.0:1746143674.006004:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef7b80 00000100:00100000:0.0:1746143674.006042:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2853 00000100:00100000:0.0:1746143674.006049:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963591745152:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143674.072591:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.081750:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.082949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.085661:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.085695:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591746048 00000100:00100000:0.0:1746143674.085701:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591746048 00000100:00100000:0.0:1746143674.089219:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.089765:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.089786:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.089823:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591746432 00000100:00100000:0.0:1746143674.089826:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591746432 00000100:00100000:0.0:1746143674.089847:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3193 00000100:00100000:0.0:1746143674.089851:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+274:27765:x1830963591746432:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143674.089975:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+273:27765:x1830963591746432:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 122us (209us total) trans 8589942047 rc 0/0 00000100:00100000:0.0:1746143674.089992:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3193 00000100:00100000:0.0:1746143674.095332:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.097260:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.097295:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.104973:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591747200 00000100:00100000:0.0:1746143674.104983:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591747200 00002000:00100000:0.0:1746143674.105022:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3817472->3821567) req@ffff88008f893b80 x1830963591747200/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:70/0 lens 488/0 e 0 to 0 dl 1746143685 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143674.105040:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f893b80 with x1830963591747200 ext(3817472->3821567) 00002000:00010000:0.0:1746143674.105045:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f893b80 00000100:00100000:0.0:1746143674.105063:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2855 00000100:00100000:0.0:1746143674.105070:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963591747200:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143674.107518:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963591747200:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 2447us (5850us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143674.107524:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2855 00002000:00100000:0.0:1746143674.107529:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3817472->3821567) req@ffff88008f893b80 x1830963591747200/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746143685 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143674.107536:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f893b80 with x1830963591747200 ext(3817472->3821567) 00002000:00010000:0.0:1746143674.107539:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f893b80 00000100:00100000:0.0:1746143674.111702:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.111787:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.130579:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.135212:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.135290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.139789:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.156777:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.174219:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.178184:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.178228:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.186817:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.186863:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.243688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.250316:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.252240:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143674.252785:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095386200/0xe984082ccd722a7f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252791:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095386200/0xe984082ccd722a7f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:0.0:1746143674.252818:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:0.0:1746143674.252822:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143674.252833:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095386200/0xe984082ccd722a7f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252841:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095386200/0xe984082ccd722a7f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252849:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095387600/0xe984082ccd722a71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252854:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095387600/0xe984082ccd722a71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252859:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095387600/0xe984082ccd722a71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252875:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095387600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143674.252878:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095387600/0xe984082ccd722a71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252884:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095387600/0xe984082ccd722a71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252892:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143674.252894:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143674.252897:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095387600/0xe984082ccd722a71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252901:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095387600/0xe984082ccd722a71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252923:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095387200/0xe984082ccd722a78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252928:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095387200/0xe984082ccd722a78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252933:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095387200/0xe984082ccd722a78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252937:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095387200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143674.252939:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095387200/0xe984082ccd722a78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252943:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095387200/0xe984082ccd722a78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252948:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800939cde00) 00010000:00010000:0.0:1746143674.252950:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143674.252955:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095387200/0xe984082ccd722a78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252958:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095387200/0xe984082ccd722a78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.252982:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095386600/0xe984082ccd722a6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fba0 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.252991:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095386200/0xe984082ccd722a7f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fba0 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.252996:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143674.252997:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143674.252999:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095386200, rc 0) 00000100:00100000:0.0:1746143674.253917:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:27772:x1830963591750272:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 6859us (10234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.253923:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8029 00000100:00100000:0.0:1746143674.257445:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.257480:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143674.258288:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143674.258291:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143674.264685:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.270584:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.273389:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143674.274071:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095387c00/0xe984082ccd722acc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.274078:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095387c00/0xe984082ccd722acc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:0.0:1746143674.274120:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:0.0:1746143674.274124:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143674.274136:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095387c00/0xe984082ccd722acc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143674.274197:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3b200/0xe984082ccd722ac5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbd8 expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.274211:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095387c00/0xe984082ccd722acc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbd8 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.274217:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74800) 00010000:00010000:0.0:1746143674.274219:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143674.274221:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095387c00, rc 0) 00000100:00100000:0.0:1746143674.274247:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:27772:x1830963591751936:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3409us (3668us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.274253:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8031 00000100:00100000:0.0:1746143674.276518:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.282126:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.286263:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591752960 00000100:00100000:0.0:1746143674.286267:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591752960 00000100:00100000:0.0:1746143674.286707:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8492 00000100:00100000:0.0:1746143674.286712:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591752960:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143674.286726:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a716600/0xe984082ccd722b0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.286735:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b145a00/0xe984082ccd722761 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa1f expref: 19 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.286753:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd722aa2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbbc expref: 11 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143674.286759:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b51fd600/0xe984082ccd722776 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa34 expref: 29 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143674.286764:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.286765:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.286767:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a716600/0xe984082ccd722b0b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.286781:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b51fd600/0xe984082ccd722776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa34 expref: 29 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143674.286790:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b51fd600/0xe984082ccd722776 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa34 expref: 29 pid: 4581 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746143674.286797:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593549312:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143674.286817:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd722aa2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbbc expref: 11 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143674.286824:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd722aa2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbbc expref: 11 pid: 6929 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746143674.286831:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593549440:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143674.286851:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b145a00/0xe984082ccd722761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa1f expref: 19 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.286859:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b145a00/0xe984082ccd722761 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa1f expref: 19 pid: 8496 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.286866:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593549568:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143674.286874:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143674.286989:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591753216 00000100:00100000:0.0:1746143674.286991:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591753216 00000100:00100000:0.0:1746143674.287362:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8493 00000100:00100000:0.0:1746143674.287367:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963591753216:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143674.287382:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3b200/0xe984082ccd722b12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.287391:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5a00/0xe984082ccd722a2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fb7d expref: 12 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.287396:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143674.287397:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143674.287399:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3b200/0xe984082ccd722b12 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.287414:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5a00/0xe984082ccd722a2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fb7d expref: 12 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.287421:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5a00/0xe984082ccd722a2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fb7d expref: 12 pid: 8496 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.287433:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593549696:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143674.287449:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143674.292424:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593549696:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143674.292436:0:15784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3b200/0xe984082ccd722b12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143674.295865:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.295891:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.295910:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.302849:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.302889:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.302915:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.302926:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.302947:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.302967:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591753472 00000100:00100000:0.0:1746143674.302973:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591753472 00010000:00010000:0.0:1746143674.302997:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6dfc00/0xe984082ccd722a8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbae expref: 10 pid: 4581 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746143674.303016:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591753344 00000100:00100000:0.0:1746143674.303017:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591753344 00010000:00010000:0.0:1746143674.303038:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6de000/0xe984082ccd722a86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fba7 expref: 12 pid: 4581 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746143674.303048:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591754112 00000100:00100000:0.0:1746143674.303062:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591754112 00010000:00010000:0.0:1746143674.303073:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9600/0xe984082ccd72275a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa18 expref: 13 pid: 8496 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.303080:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591754496 00000100:00100000:0.0:1746143674.303082:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591754496 00010000:00010000:0.0:1746143674.303091:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa43200/0xe984082ccd722562 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f900 expref: 20 pid: 8497 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.303099:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4265 00000100:00100000:0.0:1746143674.303105:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963591753472:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.303116:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.303134:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d6dfc00/0xe984082ccd722a8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbae expref: 10 pid: 4581 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.303172:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d6dfc00/0xe984082ccd722a8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbae expref: 10 pid: 4581 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.303189:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6dfc00/0xe984082ccd722a8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbae expref: 10 pid: 4581 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.303204:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.303235:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963591753472:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 130us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.303241:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4265 00000100:00100000:0.0:1746143674.303283:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4266 00000100:00100000:0.0:1746143674.303288:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963591753344:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.303302:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.303313:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d6de000/0xe984082ccd722a86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fba7 expref: 12 pid: 4581 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.303322:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d6de000/0xe984082ccd722a86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fba7 expref: 12 pid: 4581 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.303333:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6de000/0xe984082ccd722a86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fba7 expref: 12 pid: 4581 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.303342:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.303355:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591753344:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 67us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.303360:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4266 00000100:00100000:0.0:1746143674.303371:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4267 00000100:00100000:0.0:1746143674.303375:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963591754112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.303380:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.303388:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9600/0xe984082ccd72275a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa18 expref: 13 pid: 8496 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.303396:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9600/0xe984082ccd72275a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa18 expref: 13 pid: 8496 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.303407:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0a9600/0xe984082ccd72275a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fa18 expref: 13 pid: 8496 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.303423:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.303425:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.303430:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd722afd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.303437:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd722afd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.303454:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.303468:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963591754112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 92us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.303472:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4267 00000100:00100000:0.0:1746143674.303483:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4268 00000100:00100000:0.0:1746143674.303487:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963591754496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.303491:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.303499:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa43200/0xe984082ccd722562 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f900 expref: 20 pid: 8497 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.303506:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa43200/0xe984082ccd722562 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f900 expref: 20 pid: 8497 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.303516:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa43200/0xe984082ccd722562 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f900 expref: 20 pid: 8497 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.303522:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.303538:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963591754496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.303542:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4268 00000100:00100000:0.0:1746143674.303585:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.303594:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591754368 00000100:00100000:0.0:1746143674.303596:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591754368 00010000:00010000:0.0:1746143674.303605:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab29c00/0xe984082ccd7224f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f8b3 expref: 21 pid: 4582 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746143674.303613:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4269 00000100:00100000:0.0:1746143674.303617:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963591754368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.303623:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.303629:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab29c00/0xe984082ccd7224f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f8b3 expref: 21 pid: 4582 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.303635:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab29c00/0xe984082ccd7224f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f8b3 expref: 21 pid: 4582 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.303644:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab29c00/0xe984082ccd7224f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f8b3 expref: 21 pid: 4582 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.303651:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.303661:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963591754368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 44us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.303665:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4269 00000100:00100000:0.0:1746143674.303703:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.303711:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591755008 00000100:00100000:0.0:1746143674.303717:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591755008 00010000:00010000:0.0:1746143674.303727:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63dfc00/0xe984082ccd722983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fb29 expref: 29 pid: 8496 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.303737:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4270 00000100:00100000:0.0:1746143674.303740:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963591755008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.303744:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.303750:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a63dfc00/0xe984082ccd722983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fb29 expref: 29 pid: 8496 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.303756:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a63dfc00/0xe984082ccd722983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fb29 expref: 29 pid: 8496 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.303767:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a63dfc00/0xe984082ccd722983 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fb29 expref: 29 pid: 8496 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.303773:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.303785:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963591755008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 44us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.303789:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4270 00000100:00100000:0.0:1746143674.303815:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.303822:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591755264 00000100:00100000:0.0:1746143674.303825:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591755264 00010000:00010000:0.0:1746143674.303832:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a004de00/0xe984082ccd7224c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f89e expref: 12 pid: 4582 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.303840:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4271 00000100:00100000:0.0:1746143674.303843:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963591755264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.303848:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.303854:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a004de00/0xe984082ccd7224c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f89e expref: 12 pid: 4582 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.303861:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a004de00/0xe984082ccd7224c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f89e expref: 12 pid: 4582 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.303869:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a004de00/0xe984082ccd7224c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209f89e expref: 12 pid: 4582 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.303876:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.303877:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.303879:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4c00/0xe984082ccd722af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.303885:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4c00/0xe984082ccd722af6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.303895:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.303905:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963591755264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 61us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.303910:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4271 00000100:00100000:0.0:1746143674.303938:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.303947:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591753984 00000100:00100000:0.0:1746143674.303949:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591753984 00010000:00010000:0.0:1746143674.303957:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd722aa2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbbc expref: 11 pid: 6929 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746143674.303971:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4272 00000100:00100000:0.0:1746143674.303975:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963591753984:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.303980:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.303987:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd722aa2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbbc expref: 11 pid: 6929 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.303994:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd722aa2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbbc expref: 11 pid: 6929 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.304003:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd722aa2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbbc expref: 11 pid: 6929 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.304011:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.304034:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963591753984:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 58us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.304039:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4272 00000100:00100000:0.0:1746143674.304119:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.304131:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591754752 00000100:00100000:0.0:1746143674.304134:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591754752 00010000:00010000:0.0:1746143674.304161:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd722a9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbc3 expref: 10 pid: 6929 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746143674.304172:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4273 00000100:00100000:0.0:1746143674.304175:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963591754752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.304182:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.304189:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd722a9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbc3 expref: 10 pid: 6929 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.304195:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd722a9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbc3 expref: 10 pid: 6929 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.304205:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd722a9b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbc3 expref: 10 pid: 6929 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746143674.304212:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.304226:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963591754752:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 50us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.304231:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4273 00010000:00010000:0.0:1746143674.321501:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095387600/0xe984082ccd722aef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321508:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095387600/0xe984082ccd722aef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321521:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095387600/0xe984082ccd722aef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321525:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095387600/0xe984082ccd722aef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321531:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095387600/0xe984082ccd722aef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321536:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095387600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143674.321538:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095387600/0xe984082ccd722aef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321543:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095387600/0xe984082ccd722aef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321552:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095387600/0xe984082ccd722aef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321557:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095387600/0xe984082ccd722aef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143674.321591:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963591752576:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 35353us (35483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.321597:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8488 00010000:00010000:0.0:1746143674.321617:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d521400/0xe984082ccd722b04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321623:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d521400/0xe984082ccd722b04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321636:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d521400/0xe984082ccd722b04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321642:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d521400/0xe984082ccd722b04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321648:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d521400/0xe984082ccd722b04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321653:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d521400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143674.321655:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d521400/0xe984082ccd722b04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321661:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d521400/0xe984082ccd722b04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321669:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d521400/0xe984082ccd722b04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.321675:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d521400/0xe984082ccd722b04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143674.321706:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1965:x1830963591753088:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 35066us (35098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.321711:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8491 00000100:00100000:0.0:1746143674.326991:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.330474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.335540:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.335568:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.336367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.339178:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.340338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143674.340715:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a9600/0xe984082ccd722b19 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143674.340720:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a9600/0xe984082ccd722b19 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000040:00080000:0.0:1746143674.341242:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2139, 88 off179160 00000004:00080000:0.0:1746143674.341249:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753351108879ns, next at 718104255928ns, rc = 0 00000040:00080000:0.0:1746143674.341271:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2104, 88 off175904 00000004:00080000:0.0:1746143674.341275:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753351135712ns, next at 718087967394ns, rc = 0 00000001:00080000:0.0:1746143674.368478:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942056 is committed 00000004:00080000:0.0:1746143674.368488:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1458 committed 00000004:00080000:0.0:1746143674.368502:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1493 committed 00000004:00080000:0.0:1746143674.368506:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1492 committed 00000004:00080000:0.0:1746143674.368507:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1491 committed 00000004:00080000:0.0:1746143674.368509:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1490 committed 00000004:00080000:0.0:1746143674.368510:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1457 committed 00000004:00080000:0.0:1746143674.368512:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1489 committed 00000004:00080000:0.0:1746143674.368513:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1456 committed 00000004:00080000:0.0:1746143674.368514:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1488 committed 00000004:00080000:0.0:1746143674.368516:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1455 committed 00000004:00080000:0.0:1746143674.368517:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1454 committed 00000004:00080000:0.0:1746143674.368519:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1453 committed 00000004:00080000:0.0:1746143674.368520:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1487 committed 00000004:00080000:0.0:1746143674.368522:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1486 committed 00000004:00080000:0.0:1746143674.368523:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1452 committed 00000004:00080000:0.0:1746143674.368524:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1451 committed 00000004:00080000:0.0:1746143674.368527:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1485 committed 00000001:00080000:0.0:1746143674.368532:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942047 is committed 00000001:00080000:0.0:1746143674.368537:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942030 is committed 00000001:00080000:0.0:1746143674.368587:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942055 is committed 00000001:00080000:0.0:1746143674.368591:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942054 is committed 00000100:00100000:0.0:1746143674.371056:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593553408 00000100:00100000:0.0:1746143674.371060:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593553408 00000100:00100000:0.0:1746143674.371076:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8510 00000100:00100000:0.0:1746143674.371080:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593553408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143674.374715:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963593553408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3632us (3695us total) trans 17179872243 rc 0/0 00000100:00100000:0.0:1746143674.374723:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8510 00000100:00100000:0.0:1746143674.378947:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.383265:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591757696 00000100:00100000:0.0:1746143674.383270:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591757696 00000100:00100000:0.0:1746143674.383584:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591757824 00000100:00100000:0.0:1746143674.383587:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591757824 00000100:00100000:0.0:1746143674.383662:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8511 00000100:00100000:0.0:1746143674.383669:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1964:x1830963591757696:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143674.383682:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143674.383695:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5400/0xe984082ccd722b35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fbfb expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143674.383713:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409b8, atime: 0x681409b8, ctime: 0x681409b8, blocks: 0x7f5 00010000:00010000:0.0:1746143674.383726:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.383727:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.383734:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5400/0xe984082ccd722b35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbfb expref: 7 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143674.383745:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5400/0xe984082ccd722b35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fbfb expref: 7 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143674.383757:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f5400, rc 0) 00000100:00100000:0.0:1746143674.383788:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963591757696:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 120us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.384642:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8511 00000100:00100000:0.0:1746143674.385084:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.385111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.385156:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.385477:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.399524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.399563:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.399590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.399617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.399632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.399645:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.399715:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.399736:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2861 00000100:00100000:0.0:1746143674.399744:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963591758592:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143674.399770:0:8502:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f8f4000/0xe984082ccd722b5f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.399780:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.399782:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.399785:0:8502:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8f4000/0xe984082ccd722b5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.399796:0:8502:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f8f4000/0xe984082ccd722b5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143674.400920:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2864 00000100:00100000:0.0:1746143674.400926:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963591759104:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143674.400941:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4600/0xe984082ccd722b74 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.400948:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.400949:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.400952:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4600/0xe984082ccd722b74 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.400961:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4600/0xe984082ccd722b74 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143674.408132:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591760128 00000100:00100000:0.0:1746143674.408153:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591760128 00000100:00100000:0.0:1746143674.408194:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2868 00000100:00100000:0.0:1746143674.408200:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1964:x1830963591760128:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143674.408227:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800942b3400/0xe984082ccd722b90 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.408238:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.408239:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.408244:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942b3400/0xe984082ccd722b90 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.408255:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942b3400/0xe984082ccd722b90 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143674.487893:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.501334:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.510109:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.513947:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.527848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.531303:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.541591:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.547357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.554676:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.564411:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.566788:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.572858:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.575562:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.614554:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593556480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143674.614581:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143674.614605:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593556992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143674.614619:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143674.614631:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143674.614635:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593556352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143674.614647:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143674.614655:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593556864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143674.614666:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143674.616079:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bef4e00/2, rc 0, transno 17179872249 00000100:00100000:0.0:1746143674.616087:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593556352:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143674.616095:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bef6a00/2, rc 0, transno 17179872250 00000100:00100000:0.0:1746143674.616098:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593556864:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143674.616103:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bef7800/2, rc 0, transno 17179872247 00000100:00100000:0.0:1746143674.616105:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593556480:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143674.616109:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f891880/2, rc 0, transno 17179872248 00000100:00100000:0.0:1746143674.616112:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593556992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143674.619234:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.620107:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593556608 00000100:00100000:0.0:1746143674.620113:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593556608 00000100:00100000:0.0:1746143674.620161:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593557120 00000100:00100000:0.0:1746143674.620163:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593557120 00000100:00100000:0.0:1746143674.620179:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8541 00000100:00100000:0.0:1746143674.620185:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963593556608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143674.620329:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143674.620331:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143674.620333:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143674.620335:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143674.620336:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143674.620360:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963593556608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (1682us total) trans 17179872251 rc 0/0 00000100:00100000:0.0:1746143674.620365:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8541 00000100:00100000:0.0:1746143674.620384:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8542 00000100:00100000:0.0:1746143674.620388:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963593557120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143674.620448:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963593557120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (536us total) trans 17179872252 rc 0/0 00000100:00100000:0.0:1746143674.620455:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8542 00000100:00100000:0.0:1746143674.630125:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.661260:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.672591:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.676942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.678054:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.678125:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591764352 00000100:00100000:0.0:1746143674.678129:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591764352 00000100:00100000:0.0:1746143674.678179:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8546 00000100:00100000:0.0:1746143674.678187:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:27783:x1830963591764352:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143674.678197:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143674.678209:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094cfae00/0xe984082ccd722c31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fc6b expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.678232:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0170000/0xe984082ccd722b9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc25 expref: 11 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.678239:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143674.678241:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143674.678244:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094cfae00/0xe984082ccd722c31 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc6b expref: 28 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.678273:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0170000/0xe984082ccd722b9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc25 expref: 11 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.678285:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0170000/0xe984082ccd722b9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc25 expref: 11 pid: 15784 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.678302:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593557376:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143674.678385:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b240 going to sleep for 11 seconds 00010000:00010000:0.0:1746143674.685218:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0170000/0xe984082ccd722b9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc25 expref: 12 pid: 15784 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.685242:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593557376:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143674.685262:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094cfae00/0xe984082ccd722c31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc6b expref: 28 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.685269:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cfae00, rc 0) 00000100:00100000:0.0:1746143674.685287:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:27783:x1830963591764352:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7102us (7234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.685293:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8546 00000100:00100000:0.0:1746143674.697334:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.697420:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.697457:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591764864 00000100:00100000:0.0:1746143674.697465:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591764864 00002000:00100000:0.0:1746143674.697500:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800a63a0380 x1830963591764864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:70/0 lens 488/0 e 0 to 0 dl 1746143685 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143674.697508:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a0380 with x1830963591764864 ext(0->1048575) 00002000:00010000:0.0:1746143674.697513:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a0380 00000100:00100000:0.0:1746143674.697541:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591765120 00000100:00100000:0.0:1746143674.697543:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591765120 00002000:00100000:0.0:1746143674.697553:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800a63a1180 x1830963591765120/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:70/0 lens 488/0 e 0 to 0 dl 1746143685 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143674.697559:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a1180 with x1830963591765120 ext(0->1048575) 00002000:00010000:0.0:1746143674.697562:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a1180 00000100:00100000:0.0:1746143674.697573:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2869 00000100:00100000:0.0:1746143674.697579:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963591764864:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143674.699555:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2870 00000100:00100000:0.0:1746143674.699564:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963591765120:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143674.709301:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.714961:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963591764864:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17379us (17629us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143674.714970:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2869 00002000:00100000:0.0:1746143674.714979:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800a63a0380 x1830963591764864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:70/0 lens 488/440 e 0 to 0 dl 1746143685 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143674.714987:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a0380 with x1830963591764864 ext(0->1048575) 00002000:00010000:0.0:1746143674.714992:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a0380 00000100:00100000:0.0:1746143674.722477:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591765504 00000100:00100000:0.0:1746143674.722489:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591765504 00010000:00010000:0.0:1746143674.722529:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd722beb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc56 expref: 10 pid: 16090 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.722583:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4296 00000100:00100000:0.0:1746143674.722590:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963591765504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.722602:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.722607:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd722beb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc56 expref: 10 pid: 16090 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.722625:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd722beb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc56 expref: 10 pid: 16090 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.722966:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd722beb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc56 expref: 10 pid: 16090 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.722984:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143674.722988:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800951aa200/0xe984082ccd722c46 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143674.722995:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800951aa200/0xe984082ccd722c46 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143674.723001:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800951aa200/0xe984082ccd722c46 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143674.723031:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.723064:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963591765504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 474us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.723070:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4296 00000100:00100000:0.0:1746143674.734862:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.753810:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.753846:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.753938:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f892d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593558016:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143674.753957:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2211200/0xe984082ccd722c54 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc80 expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.753969:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2211200, rc 0) 00000100:00100000:0.0:1746143674.759903:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:27784:x1830963591765760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8636us (25046us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.759909:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8548 00000100:00100000:0.0:1746143674.760447:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591766144 00000100:00100000:0.0:1746143674.760454:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591766144 00010000:00010000:0.0:1746143674.760481:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0171000/0xe984082ccd722ba5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc2c expref: 12 pid: 15784 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.760513:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4297 00000100:00100000:0.0:1746143674.760520:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963591766144:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.760532:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.760551:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0171000/0xe984082ccd722ba5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc2c expref: 12 pid: 15784 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.760562:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0171000/0xe984082ccd722ba5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc2c expref: 12 pid: 15784 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.760580:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0171000/0xe984082ccd722ba5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc2c expref: 12 pid: 15784 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.760607:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.760609:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.760614:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2211200/0xe984082ccd722c54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc80 expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.760620:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2211200/0xe984082ccd722c54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc80 expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.760631:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.760632:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.760634:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd722c5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc87 expref: 20 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.760639:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd722c5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc87 expref: 20 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.760666:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd722c5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc87 expref: 20 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143674.760676:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593558144:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143674.765063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.765092:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.769628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.769688:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.771211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.771224:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.771238:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591767168 00000100:00100000:0.0:1746143674.771241:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591767168 00010000:00010000:0.0:1746143674.771260:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210800/0xe984082ccd722c69 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc9c expref: 246 pid: 16090 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.771276:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591767424 00000100:00100000:0.0:1746143674.771278:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591767424 00010000:00010000:0.0:1746143674.771286:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5e00/0xe984082ccd722bcf lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc4f expref: 8 pid: 20509 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.771301:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4298 00000100:00100000:0.0:1746143674.771306:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:1965:x1830963591767168:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.771314:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.771318:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210800/0xe984082ccd722c69 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc9c expref: 246 pid: 16090 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.771326:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210800/0xe984082ccd722c69 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc9c expref: 246 pid: 16090 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.771342:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143674.771347:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0xe984082ccd722c77 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143674.771353:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0xe984082ccd722c77 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143674.771357:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.771391:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:1965:x1830963591767168:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.771396:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4298 00000100:00100000:0.0:1746143674.771417:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4299 00000100:00100000:0.0:1746143674.771422:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963591767424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.771430:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.771433:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5e00/0xe984082ccd722bcf lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc4f expref: 8 pid: 20509 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.771443:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5e00/0xe984082ccd722bcf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc4f expref: 8 pid: 20509 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.771451:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143674.771454:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0xe984082ccd722c77 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143674.771459:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0xe984082ccd722c77 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143674.771462:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.771473:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963591767424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.771478:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4299 00000100:00100000:0.0:1746143674.787462:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963591766784:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17201us (17841us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143674.787472:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2871 00002000:00100000:0.0:1746143674.787480:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008f530000 x1830963591766784/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:70/0 lens 488/440 e 0 to 0 dl 1746143685 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143674.787489:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f530000 with x1830963591766784 ext(1048576->2097151) 00002000:00010000:0.0:1746143674.787493:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f530000 00000100:00100000:0.0:1746143674.797469:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.797514:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.797548:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591767680 00000100:00100000:0.0:1746143674.797557:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591767680 00000100:00100000:0.0:1746143674.797603:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8045 00000100:00100000:0.0:1746143674.797611:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+8:27781:x1830963591767680:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143674.797639:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143674.797661:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173a00/0xe984082ccd722c7e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fcaa expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.797716:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0xe984082ccd722c77 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143674.798050:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173a00/0xe984082ccd722c7e lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcaa expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.798063:0:20509:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0xe984082ccd722c77 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143674.798076:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173a00/0xe984082ccd722c7e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcaa expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.798089:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143674.798091:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143674.798095:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173a00/0xe984082ccd722c7e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcaa expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.798101:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c173a00, rc 0) 00000100:00100000:0.0:1746143674.798125:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+9:27781:x1830963591767680:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 515us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.798131:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8045 00000100:00100000:0.0:1746143674.801601:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.804628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.806016:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143674.822591:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0xe984082ccd722c77 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc95 expref: 247 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.822607:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143674.822610:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143674.822614:0:14763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173a00/0xe984082ccd722c7e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcaa expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.822625:0:14763:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173a00/0xe984082ccd722c7e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcaa expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.822632:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173a00/0xe984082ccd722c7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcaa expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.822639:0:14763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd722c93 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcb8 expref: 247 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.822645:0:14763:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd722c93 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcb8 expref: 247 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.822651:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd722c93 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcb8 expref: 247 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.822695:0:14763:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd722c93 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcb8 expref: 247 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143674.822709:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593559040:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143674.822811:0:14763:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173a00/0xe984082ccd722c7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcaa expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143674.822823:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593559168:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143674.822842:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143674.823570:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593559936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143674.823587:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143674.823598:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593560448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143674.823609:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143674.823619:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593560960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143674.823629:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143674.824496:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593560320 00000100:00100000:0.0:1746143674.824500:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593560320 00000100:00100000:0.0:1746143674.824531:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593560832 00000100:00100000:0.0:1746143674.824533:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593560832 00000100:00100000:0.0:1746143674.824542:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593559936 00000100:00100000:0.0:1746143674.824543:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593559936 00000100:00100000:0.0:1746143674.824549:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593560448 00000100:00100000:0.0:1746143674.824551:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593560448 00000100:00100000:0.0:1746143674.824561:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8552 00000100:00100000:0.0:1746143674.824568:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3294:x1830963593559296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143674.824622:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8554 00000100:00100000:0.0:1746143674.824627:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3294:x1830963593560320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143674.825215:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143674.825218:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143673 -> 1746143673 00002000:00010000:0.0:1746143674.825220:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143673 -> 1746143673 00002000:00010000:0.0:1746143674.825222:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143674 -> 1746143674 00002000:00010000:0.0:1746143674.825223:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2037 -> 2037 00000100:00100000:0.0:1746143674.825240:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3294:x1830963593560320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 614us (1702us total) trans 17179872258 rc 0/0 00000100:00100000:0.0:1746143674.825247:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8554 00000100:00100000:0.0:1746143674.825256:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8559 00000100:00100000:0.0:1746143674.825260:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3294:x1830963593559808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143674.825331:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:0.0:1746143674.825333:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:0.0:1746143674.825335:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143674.825336:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:0.0:1746143674.825338:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:0.0:1746143674.825355:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3294:x1830963593559808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (1844us total) trans 21474839534 rc 0/0 00000100:00100000:0.0:1746143674.825360:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8559 00000100:00100000:0.0:1746143674.825391:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593561344 00000100:00100000:0.0:1746143674.825394:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593561344 00000100:00100000:0.0:1746143674.826908:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8568 00000100:00100000:0.0:1746143674.826914:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3295:x1830963593561344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143674.827168:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3295:x1830963593561344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 255us (1795us total) trans 17179872264 rc 0/0 00000100:00100000:0.0:1746143674.827173:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8568 00000100:00100000:0.0:1746143674.827228:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593559040:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143674.827236:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593559168:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143674.827269:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd722c70 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc95 expref: 244 pid: 14763 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746143674.827285:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0xe984082ccd722c77 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc95 expref: 243 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.827312:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c173600, rc 0) 00000100:00100000:0.0:1746143674.827345:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:27785:x1830963591766400:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 62134us (62293us total) trans 8589942064 rc 0/0 00000100:00100000:0.0:1746143674.827351:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8043 00000100:00100000:0.0:1746143674.828569:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591768448 00000100:00100000:0.0:1746143674.828573:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591768448 00000100:00100000:0.0:1746143674.828596:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8047 00000100:00100000:0.0:1746143674.828601:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+7:27784:x1830963591768448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143674.828611:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143674.828623:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c5200/0xe984082ccd722c9a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fcbf expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.828717:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c5200/0xe984082ccd722c9a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcbf expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.828731:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c5200/0xe984082ccd722c9a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcbf expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.828745:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143674.828747:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143674.828750:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9c5200, rc 0) 00000100:00100000:0.0:1746143674.828771:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+8:27784:x1830963591768448:12345-192.168.202.48@tcp:101:cat.0 Request processed in 170us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.828776:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8047 00000100:00100000:0.0:1746143674.829710:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.831808:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.834213:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.838639:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.838780:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.838801:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591769216 00000100:00100000:0.0:1746143674.838804:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591769216 00010000:00010000:0.0:1746143674.838826:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0xe984082ccd722bb3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc3a expref: 11 pid: 15784 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.838846:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4302 00000100:00100000:0.0:1746143674.838850:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963591769216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.838859:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.840191:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0xe984082ccd722bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc3a expref: 11 pid: 15784 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.840204:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0xe984082ccd722bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc3a expref: 11 pid: 15784 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.840226:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e7d6c00/0xe984082ccd722bb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc3a expref: 11 pid: 15784 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.840240:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.840243:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.840249:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5400/0xe984082ccd722ca1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcc6 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.840256:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5400/0xe984082ccd722ca1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcc6 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.840293:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5400/0xe984082ccd722ca1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcc6 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143674.840305:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593561600:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143674.840368:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143674.848727:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593561600:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143674.848749:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.848770:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963591769216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9919us (9990us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.848778:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4302 00000100:00100000:0.0:1746143674.853508:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.862011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.862436:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.866501:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591770624 00000100:00100000:0.0:1746143674.866508:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591770624 00002000:00100000:0.0:1746143674.866547:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2547712->2551807) req@ffff880094304a80 x1830963591770624/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:70/0 lens 488/0 e 0 to 0 dl 1746143685 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143674.866555:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304a80 with x1830963591770624 ext(2547712->2551807) 00002000:00010000:0.0:1746143674.866561:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094304a80 00000100:00100000:0.0:1746143674.867608:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2877 00000100:00100000:0.0:1746143674.867614:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963591770624:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143674.867779:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963591770624:12345-192.168.202.48@tcp:3:cat.0 Request processed in 164us (2191us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143674.867788:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2877 00002000:00100000:0.0:1746143674.867794:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2547712->2551807) req@ffff880094304a80 x1830963591770624/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746143685 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143674.867801:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304a80 with x1830963591770624 ext(2547712->2551807) 00002000:00010000:0.0:1746143674.867804:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094304a80 00000100:00100000:0.0:1746143674.869806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.874120:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.877665:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.877729:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.883346:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8574 00000100:00100000:0.0:1746143674.883357:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963591771520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143674.883375:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143674.883392:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009331ec00/0xe984082ccd722ccb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fce9 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143674.883441:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593562624:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143674.884623:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00002000:00010000:0.0:1746143674.887492:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime: 1746143673 -> 1746143674 00002000:00010000:0.0:1746143674.887495:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143673 -> 1746143674 00000100:00100000:0.0:1746143674.887508:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593562496:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143674.887528:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd722cc4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcf7 expref: 15 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143674.887540:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd722cc4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcf7 expref: 15 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143674.887553:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a717400, rc 0) 00000100:00100000:0.0:1746143674.887590:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963591771776:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4229us (4376us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143674.887597:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8575 00000100:00100000:0.0:1746143674.890732:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.894540:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591772160 00000100:00100000:0.0:1746143674.894549:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591772160 00010000:00010000:0.0:1746143674.894583:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5400/0xe984082ccd722ca1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcc6 expref: 20 pid: 8497 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746143674.894632:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4305 00000100:00100000:0.0:1746143674.894640:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963591772160:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143674.894654:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143674.894677:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5400/0xe984082ccd722ca1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcc6 expref: 20 pid: 8497 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.894689:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5400/0xe984082ccd722ca1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcc6 expref: 20 pid: 8497 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.894711:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5400/0xe984082ccd722ca1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcc6 expref: 20 pid: 8497 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746143674.894739:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.894741:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143674.894749:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b5d800/0xe984082ccd722cb6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcdb expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.894758:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b5d800/0xe984082ccd722cb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcdb expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143674.894792:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093b5d800/0xe984082ccd722cb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcdb expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143674.894804:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593562880:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143674.895066:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143674.896009:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.898839:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593562880:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143674.898859:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.898886:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963591772160:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4246us (4422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.898895:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4305 00000100:00100000:0.0:1746143674.900822:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.901668:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.909553:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.915705:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593563136:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143674.915726:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.915784:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963591772800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5316us (6240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.915796:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4306 00000100:00100000:0.0:1746143674.917236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.922355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.931621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.938071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.943583:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.944404:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.947433:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593563648:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143674.947454:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143674.947498:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963591773824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3757us (3921us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143674.947509:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4308 00000100:00100000:0.0:1746143674.956572:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.956606:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.956641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.970406:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.978197:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.978712:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.983310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.983346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.984203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143674.984242:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.003403:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143675.007068:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143675.018537:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143675.019096:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143675.025164:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.033728:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.104251:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.129696:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.138134:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.140116:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.148235:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.148279:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.156934:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.158695:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.158988:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.159043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.159067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.174395:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593564032:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143675.174419:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143675.174471:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963591778944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 14393us (15401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.174481:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4310 00000100:00100000:0.0:1746143675.194396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.212341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.227880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.257769:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.262565:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591780736 00000100:00100000:0.0:1746143675.262574:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591780736 00010000:00010000:0.0:1746143675.262610:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093b5ca00/0xe984082ccd722d6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2113536->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd3d expref: 27 pid: 21542 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746143675.262649:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4311 00000100:00100000:0.0:1746143675.262657:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963591780736:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143675.262673:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143675.262696:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093b5ca00/0xe984082ccd722d6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2113536->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd3d expref: 27 pid: 21542 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.262711:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093b5ca00/0xe984082ccd722d6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2113536->2338815) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd3d expref: 27 pid: 21542 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.262733:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b5ca00/0xe984082ccd722d6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2113536->2338815) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd3d expref: 27 pid: 21542 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.262761:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.262763:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.262770:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a717a00/0xe984082ccd722d73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd44 expref: 14 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.262778:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a717a00/0xe984082ccd722d73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd44 expref: 14 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.262809:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a717a00/0xe984082ccd722d73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd44 expref: 14 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143675.262821:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593564416:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143675.262891:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143675.264055:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.284629:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.284672:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.284700:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.284732:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.284772:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.284811:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591782016 00000100:00100000:0.0:1746143675.284819:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591782016 00000100:00100000:0.0:1746143675.284861:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 509 00000100:00100000:0.0:1746143675.284868:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1964:x1830963591782016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143675.284881:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143675.284900:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca3b200/0xe984082ccd722dab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd52 expref: 249 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.284926:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143675.284930:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70a400/0xe984082ccd722d8f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143675.284938:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70a400/0xe984082ccd722d8f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143675.284942:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70a400/0xe984082ccd722d8f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143675.284947:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143675.284982:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1964:x1830963591782016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 114us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.284989:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 509 00000100:00100000:0.0:1746143675.285171:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591781504 00000100:00100000:0.0:1746143675.285175:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591781504 00002000:00100000:0.0:1746143675.285199:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880136919500 x1830963591781504/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143675.285207:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919500 with x1830963591781504 ext(2097152->3145727) 00002000:00010000:0.0:1746143675.285212:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136919500 00000100:00100000:0.0:1746143675.285232:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591781888 00000100:00100000:0.0:1746143675.285234:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591781888 00002000:00100000:0.0:1746143675.285246:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880136918a80 x1830963591781888/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143675.285252:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136918a80 with x1830963591781888 ext(3145728->4194303) 00002000:00010000:0.0:1746143675.285254:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136918a80 00000100:00100000:0.0:1746143675.287809:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2897 00000100:00100000:0.0:1746143675.287821:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963591781888:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143675.305745:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591782144 00000100:00100000:0.0:1746143675.305755:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591782144 00010000:00010000:0.0:1746143675.305787:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800951aa200/0xe984082ccd722c46 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc79 expref: 249 pid: 20509 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746143675.305898:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4312 00000100:00100000:0.0:1746143675.305905:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1965:x1830963591782144:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143675.305916:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143675.305923:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800951aa200/0xe984082ccd722c46 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc79 expref: 249 pid: 20509 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.305932:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800951aa200/0xe984082ccd722c46 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc79 expref: 249 pid: 20509 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.305949:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800951aa200/0xe984082ccd722c46 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc79 expref: 249 pid: 20509 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.305977:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143675.305981:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70a400/0xe984082ccd722d8f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143675.305993:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70a400/0xe984082ccd722d8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143675.305998:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70a400/0xe984082ccd722d8f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143675.306026:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143675.306058:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1965:x1830963591782144:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 154us (4971us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.306064:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4312 00000100:00100000:0.0:1746143675.321213:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.321295:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.337413:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.337449:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.337486:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.337514:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591783168 00000100:00100000:0.0:1746143675.337523:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591783168 00000100:00100000:0.0:1746143675.337578:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591783424 00000100:00100000:0.0:1746143675.337580:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591783424 00000100:00100000:0.0:1746143675.337594:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591783680 00000100:00100000:0.0:1746143675.337595:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591783680 00000100:00100000:0.0:1746143675.337608:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8587 00000100:00100000:0.0:1746143675.337615:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963591783168:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143675.337633:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143675.337653:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a2210800/0xe984082ccd722dc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fd67 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.337678:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.339085:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.339093:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2210800/0xe984082ccd722dc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd67 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.339104:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a2210800/0xe984082ccd722dc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd67 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.339112:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2210800, rc 0) 00000100:00100000:0.0:1746143675.339159:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591783168:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1544us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.339165:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8587 00000100:00100000:0.0:1746143675.339178:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591783296 00000100:00100000:0.0:1746143675.339180:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591783296 00000100:00100000:0.0:1746143675.339196:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591783552 00000100:00100000:0.0:1746143675.339197:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591783552 00000100:00100000:0.0:1746143675.339208:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591783808 00000100:00100000:0.0:1746143675.339210:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591783808 00000100:00100000:0.0:1746143675.339220:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8590 00000100:00100000:0.0:1746143675.339225:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591783296:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143675.339232:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143675.339239:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd722ddc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fd6e expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.339250:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.339252:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.339256:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd722ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd6e expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.339265:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd722ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd6e expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.339276:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2210a00, rc 0) 00000100:00100000:0.0:1746143675.339292:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963591783296:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 67us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.339296:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8590 00000100:00100000:0.0:1746143675.339308:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8591 00000100:00100000:0.0:1746143675.339312:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591783552:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143675.339319:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143675.339325:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a2210400/0xe984082ccd722de3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fd7c expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.339333:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.339334:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.339337:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2210400/0xe984082ccd722de3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd7c expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.339343:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a2210400/0xe984082ccd722de3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd7c expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.339350:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2210400, rc 0) 00000100:00100000:0.0:1746143675.339363:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963591783552:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 50us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.339366:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8591 00000100:00100000:0.0:1746143675.339376:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8592 00000100:00100000:0.0:1746143675.339379:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591783808:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143675.339387:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143675.339391:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd722dea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fd8a expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143675.339413:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593564928:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143675.339447:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143675.344883:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.344928:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591784320 00000100:00100000:0.0:1746143675.344937:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591784320 00002000:00100000:0.0:1746143675.344985:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3506176->3510271) req@ffff88008e63f480 x1830963591784320/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143675.344995:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63f480 with x1830963591784320 ext(3506176->3510271) 00002000:00010000:0.0:1746143675.345001:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e63f480 00000100:00100000:0.0:1746143675.345036:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2900 00000100:00100000:0.0:1746143675.345044:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963591784320:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143675.345672:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963591784320:12345-192.168.202.48@tcp:3:cat.0 Request processed in 626us (796us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143675.345679:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2900 00002000:00100000:0.0:1746143675.345685:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3506176->3510271) req@ffff88008e63f480 x1830963591784320/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/4536 e 0 to 0 dl 1746143686 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143675.345693:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63f480 with x1830963591784320 ext(3506176->3510271) 00002000:00010000:0.0:1746143675.345696:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e63f480 00000100:00100000:0.0:1746143675.351293:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.361054:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.361198:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.361268:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.361292:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591784960 00000100:00100000:0.0:1746143675.361301:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591784960 00002000:00100000:0.0:1746143675.361346:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3506176->4194303) req@ffff8801305c8380 x1830963591784960/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143675.361355:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8380 with x1830963591784960 ext(3506176->4194303) 00010000:00010000:0.0:1746143675.361365:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210e00/0xe984082ccd722dc0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd60 expref: 15 pid: 21542 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.361379:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a2210e00/0xe984082ccd722dc0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd60 expref: 15 pid: 21542 timeout: 854 lvb_type: 0 00002000:00010000:0.0:1746143675.361385:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305c8380 00000100:00100000:0.0:1746143675.361404:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 684 00000100:00100000:0.0:1746143675.361411:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963591784960:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143675.375157:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.375192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.375205:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.375220:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.375312:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.375336:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591785088 00000100:00100000:0.0:1746143675.375346:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591785088 00010000:00010000:0.0:1746143675.375386:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b5ce00/0xe984082ccd722cd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2551808->18446744073709551615] (req 2551808->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcfe expref: 24 pid: 12618 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746143675.375409:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591785344 00000100:00100000:0.0:1746143675.375411:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591785344 00010000:00010000:0.0:1746143675.375420:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b5c800/0xe984082ccd722cfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd21 expref: 25 pid: 12618 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746143675.375428:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591785216 00000100:00100000:0.0:1746143675.375429:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591785216 00010000:00010000:0.0:1746143675.375437:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca3b000/0xe984082ccd722dd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd83 expref: 12 pid: 8497 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746143675.375444:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591785472 00000100:00100000:0.0:1746143675.375446:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591785472 00010000:00010000:0.0:1746143675.375455:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70a400/0xe984082ccd722d8f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd4b expref: 9 pid: 14762 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746143675.375462:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591785600 00000100:00100000:0.0:1746143675.375464:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591785600 00010000:00010000:0.0:1746143675.375472:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b5dc00/0xe984082ccd722ce0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd05 expref: 32 pid: 12618 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746143675.375484:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4315 00000100:00100000:0.0:1746143675.375491:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963591785088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143675.375505:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143675.375527:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b5ce00/0xe984082ccd722cd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2551808->18446744073709551615] (req 2551808->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcfe expref: 25 pid: 12618 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.375538:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b5ce00/0xe984082ccd722cd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2551808->18446744073709551615] (req 2551808->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcfe expref: 25 pid: 12618 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.375561:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b5ce00/0xe984082ccd722cd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2551808->18446744073709551615] (req 2551808->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcfe expref: 25 pid: 12618 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.375595:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143675.375636:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591785088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 146us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.375644:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4315 00000100:00100000:0.0:1746143675.375670:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4316 00000100:00100000:0.0:1746143675.375674:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591785344:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143675.375680:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143675.375687:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b5c800/0xe984082ccd722cfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd21 expref: 23 pid: 12618 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.375695:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b5c800/0xe984082ccd722cfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd21 expref: 23 pid: 12618 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.375705:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b5c800/0xe984082ccd722cfc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd21 expref: 23 pid: 12618 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.375713:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143675.375725:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963591785344:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.375730:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4316 00000100:00100000:0.0:1746143675.375740:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4317 00000100:00100000:0.0:1746143675.375744:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963591785216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143675.375750:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143675.375755:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca3b000/0xe984082ccd722dd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd83 expref: 12 pid: 8497 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.375763:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca3b000/0xe984082ccd722dd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd83 expref: 12 pid: 8497 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.375773:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca3b000/0xe984082ccd722dd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd83 expref: 12 pid: 8497 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.375780:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143675.375791:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963591785216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.375796:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4317 00000100:00100000:0.0:1746143675.375804:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4318 00000100:00100000:0.0:1746143675.375808:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963591785472:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143675.375815:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143675.375820:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70a400/0xe984082ccd722d8f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd4b expref: 9 pid: 14762 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.375827:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70a400/0xe984082ccd722d8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd4b expref: 9 pid: 14762 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.375838:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70a400/0xe984082ccd722d8f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd4b expref: 9 pid: 14762 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.375848:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143675.375853:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0825200/0xe984082ccd722e06 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143675.375865:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0825200/0xe984082ccd722e06 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143675.375871:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0825200/0xe984082ccd722e06 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143675.375893:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143675.375905:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591785472:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 96us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.375909:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4318 00000100:00100000:0.0:1746143675.382948:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591785856 00000100:00100000:0.0:1746143675.382955:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591785856 00002000:00100000:0.0:1746143675.382997:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4476928->4481023) req@ffff880093806a00 x1830963591785856/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143675.383006:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806a00 with x1830963591785856 ext(4476928->4481023) 00002000:00010000:0.0:1746143675.383010:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093806a00 00000100:00100000:0.0:1746143675.383048:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2901 00000100:00100000:0.0:1746143675.383057:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963591785856:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143675.383233:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963591785856:12345-192.168.202.48@tcp:3:cat.0 Request processed in 177us (779us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143675.383239:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2901 00002000:00100000:0.0:1746143675.383245:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4476928->4481023) req@ffff880093806a00 x1830963591785856/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/4536 e 0 to 0 dl 1746143686 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143675.383252:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806a00 with x1830963591785856 ext(4476928->4481023) 00002000:00010000:0.0:1746143675.383255:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093806a00 00000100:00100000:0.0:1746143675.384981:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.386222:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.389177:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143675.394215:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd722e1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143675.394231:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd722e1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:0.0:1746143675.394286:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:0.0:1746143675.394290:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143675.394310:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd722e1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143675.394351:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5200/0xe984082ccd722e14 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fda6 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.394386:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd722e1b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fda6 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.394395:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143675.394398:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143675.394401:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f4400, rc 0) 00000100:00100000:0.0:1746143675.394463:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:27800:x1830963591785984:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 9360us (9480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.394472:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8054 00000100:00100000:0.0:1746143675.396549:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.408294:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8596 00000100:00100000:0.0:1746143675.408304:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591787008:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143675.408313:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143675.408331:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a088b200/0xe984082ccd722e29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fdb4 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.408353:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.408355:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.408363:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a088b200/0xe984082ccd722e29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdb4 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.408378:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a088b200/0xe984082ccd722e29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdb4 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.408387:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a088b200, rc 0) 00000100:00100000:0.0:1746143675.408433:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963591787008:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 131us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.408439:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8596 00000100:00100000:0.0:1746143675.418488:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.418718:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.423765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.433401:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.433430:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.433453:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.433473:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591787776 00000100:00100000:0.0:1746143675.433482:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591787776 00000100:00100000:0.0:1746143675.433519:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591787648 00000100:00100000:0.0:1746143675.433520:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591787648 00000100:00100000:0.0:1746143675.433530:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591787904 00000100:00100000:0.0:1746143675.433532:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591787904 00000100:00100000:0.0:1746143675.433544:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8598 00000100:00100000:0.0:1746143675.433551:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1965:x1830963591787776:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143675.433596:0:12618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a088b000/0xe984082ccd722e4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.433615:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2211200/0xe984082ccd722c54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc80 expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.433624:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd722ddc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd6e expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.433631:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd722c5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc87 expref: 26 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.433637:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.433638:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.433641:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a088b000/0xe984082ccd722e4c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.433669:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd722c5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc87 expref: 26 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.433680:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd722c5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc87 expref: 26 pid: 8496 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746143675.433692:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593566464:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143675.433768:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd722ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd6e expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.433780:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd722ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd6e expref: 13 pid: 8495 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746143675.433787:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593566592:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143675.433809:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2211200/0xe984082ccd722c54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc80 expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.433816:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a2211200/0xe984082ccd722c54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc80 expref: 15 pid: 8497 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746143675.433824:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593566848:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143675.433837:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143675.433855:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8600 00000100:00100000:0.0:1746143675.433859:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963591787904:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143675.433873:0:6929:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093b5c800/0xe984082ccd722e5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.433883:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa42a00/0xe984082ccd722c85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fca3 expref: 26 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.433890:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca3ba00/0xe984082ccd722dce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd75 expref: 13 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.433896:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd722c8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcb1 expref: 15 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.433902:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.433903:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.433905:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093b5c800/0xe984082ccd722e5a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.433917:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd722c8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcb1 expref: 15 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.433924:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd722c8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcb1 expref: 15 pid: 8496 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746143675.433931:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593567232:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143675.435284:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca3ba00/0xe984082ccd722dce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd75 expref: 13 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.435293:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca3ba00/0xe984082ccd722dce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd75 expref: 13 pid: 8497 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746143675.435303:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593567872:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143675.435320:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa42a00/0xe984082ccd722c85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fca3 expref: 26 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.435328:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa42a00/0xe984082ccd722c85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fca3 expref: 26 pid: 8496 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746143675.435341:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593568000:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143675.435358:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143675.443113:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593567232:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143675.443155:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593567872:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143675.443178:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593568000:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143675.443205:0:6929:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093b5c800/0xe984082ccd722e5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143675.446080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.446114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.446135:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.447082:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591789184 00000100:00100000:0.0:1746143675.447085:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591789184 00010000:00010000:0.0:1746143675.447100:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094cfae00/0xe984082ccd722c31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc6b expref: 32 pid: 8497 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746143675.447112:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591789440 00000100:00100000:0.0:1746143675.447115:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591789440 00010000:00010000:0.0:1746143675.447121:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2210400/0xe984082ccd722de3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd7c expref: 13 pid: 8495 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746143675.447132:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4325 00000100:00100000:0.0:1746143675.447136:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963591789184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143675.447166:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143675.447175:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094cfae00/0xe984082ccd722c31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc6b expref: 32 pid: 8497 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.447183:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094cfae00/0xe984082ccd722c31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc6b expref: 32 pid: 8497 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.447196:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094cfae00/0xe984082ccd722c31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc6b expref: 32 pid: 8497 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.447209:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143675.447228:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963591789184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 91us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.447233:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4325 00000100:00100000:0.0:1746143675.447289:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4326 00000100:00100000:0.0:1746143675.447294:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963591789440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143675.447300:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143675.447307:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a2210400/0xe984082ccd722de3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd7c expref: 13 pid: 8495 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.447313:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a2210400/0xe984082ccd722de3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd7c expref: 13 pid: 8495 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.447322:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a2210400/0xe984082ccd722de3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd7c expref: 13 pid: 8495 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.447330:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143675.447343:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963591789440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 50us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.447349:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4326 00000100:00100000:0.0:1746143675.451042:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.451771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.451800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.451815:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.451832:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.451865:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143675.452856:0:6929:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093b5c800/0xe984082ccd722e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.452864:0:6929:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093b5c800/0xe984082ccd722e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.452879:0:6929:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093b5c800/0xe984082ccd722e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.452885:0:6929:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093b5c800/0xe984082ccd722e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.452890:0:6929:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093b5c800/0xe984082ccd722e5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.452895:0:6929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093b5c800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143675.452897:0:6929:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093b5c800/0xe984082ccd722e5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.452902:0:6929:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093b5c800/0xe984082ccd722e5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.452912:0:6929:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093b5c800/0xe984082ccd722e5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.452918:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b5c800/0xe984082ccd722e5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143675.452949:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963591787904:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 19089us (19494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.452953:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8600 00000100:00100000:0.0:1746143675.455194:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.455228:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.455255:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.455284:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143675.455397:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a088b200/0xe984082ccd722e29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdb4 expref: 11 pid: 12618 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746143675.455424:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591790336 00000100:00100000:1.0:1746143675.455427:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591790336 00010000:00010000:1.0:1746143675.455438:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53be00/0xe984082ccd722e37 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdc2 expref: 10 pid: 14762 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746143675.455450:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591790208 00000100:00100000:1.0:1746143675.455451:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591790208 00010000:00010000:1.0:1746143675.455459:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd722df1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd91 expref: 25 pid: 8495 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746143675.455467:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591790464 00000100:00100000:1.0:1746143675.455468:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591790464 00010000:00010000:1.0:1746143675.455477:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b5d800/0xe984082ccd722cb6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcdb expref: 31 pid: 8497 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746143675.455488:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4333 00000100:00100000:1.0:1746143675.455494:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963591790080:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143675.455506:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143675.455525:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a088b200/0xe984082ccd722e29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdb4 expref: 11 pid: 12618 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746143675.455534:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a088b200/0xe984082ccd722e29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdb4 expref: 11 pid: 12618 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746143675.455552:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a088b200/0xe984082ccd722e29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdb4 expref: 11 pid: 12618 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746143675.455572:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143675.455609:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963591790080:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 114us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.455615:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4333 00000100:00100000:1.0:1746143675.455627:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4334 00000100:00100000:1.0:1746143675.455632:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963591790336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143675.455640:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143675.455644:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53be00/0xe984082ccd722e37 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdc2 expref: 10 pid: 14762 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.455652:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53be00/0xe984082ccd722e37 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdc2 expref: 10 pid: 14762 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.455667:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53be00/0xe984082ccd722e37 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdc2 expref: 10 pid: 14762 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.455684:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143675.455690:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800900a3c00/0xe984082ccd722e8b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143675.455699:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800900a3c00/0xe984082ccd722e8b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143675.455705:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800900a3c00/0xe984082ccd722e8b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143675.455722:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143675.455737:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963591790336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 105us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.455742:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4334 00000100:00100000:1.0:1746143675.455752:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4335 00000100:00100000:1.0:1746143675.455755:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963591790208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143675.455761:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143675.455769:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd722df1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd91 expref: 25 pid: 8495 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.455775:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd722df1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd91 expref: 25 pid: 8495 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.455786:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd722df1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fd91 expref: 25 pid: 8495 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.455795:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.455797:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.455800:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c9fe00/0xe984082ccd722e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.455807:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c9fe00/0xe984082ccd722e6f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.455819:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143675.455832:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963591790208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 75us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.455836:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4335 00000100:00100000:1.0:1746143675.455846:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4336 00000100:00100000:1.0:1746143675.455850:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963591790464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143675.455856:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143675.455869:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b5d800/0xe984082ccd722cb6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcdb expref: 31 pid: 8497 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.455878:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b5d800/0xe984082ccd722cb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcdb expref: 31 pid: 8497 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.455889:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b5d800/0xe984082ccd722cb6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcdb expref: 31 pid: 8497 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.455898:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.455899:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.455902:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c9e800/0xe984082ccd722e61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.455908:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c9e800/0xe984082ccd722e61 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.455920:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143675.455933:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963591790464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 83us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.455938:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4336 00010000:00010000:1.0:1746143675.455955:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c9e800/0xe984082ccd722e61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.455962:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c9e800/0xe984082ccd722e61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.455979:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c9e800/0xe984082ccd722e61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.455986:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c9e800/0xe984082ccd722e61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.455993:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c9e800/0xe984082ccd722e61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.455998:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131c9e800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143675.456001:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c9e800/0xe984082ccd722e61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.456008:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c9e800/0xe984082ccd722e61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.456028:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c9e800/0xe984082ccd722e61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.456034:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c9e800/0xe984082ccd722e61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143675.456071:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963591788032:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 21263us (21314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.456078:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8601 00000100:00100000:0.0:1746143675.461973:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.486280:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.488767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.492416:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.509158:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.512949:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.512984:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.513008:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.513042:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.513060:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591792000 00000100:00100000:0.0:1746143675.513067:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591792000 00000100:00100000:0.0:1746143675.513099:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591792128 00000100:00100000:0.0:1746143675.513101:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591792128 00000100:00100000:0.0:1746143675.513113:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591792256 00000100:00100000:0.0:1746143675.513115:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591792256 00000100:00100000:0.0:1746143675.513126:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591792384 00000100:00100000:0.0:1746143675.513127:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591792384 00000100:00100000:0.0:1746143675.513157:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8605 00000100:00100000:0.0:1746143675.513165:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963591792000:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143675.513180:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143675.513200:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c711a00/0xe984082ccd722ea0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fdd7 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143675.513224:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409b9, atime: 0x681409b9, ctime: 0x681409ba, blocks: 0x7f5 00010000:00010000:0.0:1746143675.513242:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.513244:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.513253:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c711a00/0xe984082ccd722ea0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdd7 expref: 31 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.513268:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c711a00/0xe984082ccd722ea0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdd7 expref: 31 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.513278:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c711a00, rc 0) 00000100:00100000:0.0:1746143675.513305:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963591792000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 141us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.513311:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8605 00000100:00100000:0.0:1746143675.513334:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8606 00000100:00100000:0.0:1746143675.513339:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963591792128:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143675.513346:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143675.513357:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c711200/0xe984082ccd722ea7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fdde expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143675.513371:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34a:0x0] initial LVB size: 2097152, mtime: 0x681409b9, atime: 0x681409b9, ctime: 0x681409ba, blocks: 0x821 00010000:00010000:0.0:1746143675.513379:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.513380:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.513383:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c711200/0xe984082ccd722ea7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdde expref: 27 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.513392:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c711200/0xe984082ccd722ea7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdde expref: 27 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.513398:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c711200, rc 0) 00000100:00100000:0.0:1746143675.513412:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963591792128:12345-192.168.202.48@tcp:101:cat.0 Request processed in 73us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.513416:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8606 00000100:00100000:0.0:1746143675.513426:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8607 00000100:00100000:0.0:1746143675.513430:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963591792256:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143675.513435:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143675.513441:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c710e00/0xe984082ccd722eae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fde5 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143675.513450:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34b:0x0] initial LVB size: 2097152, mtime: 0x681409b9, atime: 0x681409b9, ctime: 0x681409ba, blocks: 0x81f 00010000:00010000:0.0:1746143675.513457:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.513458:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.513461:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c710e00/0xe984082ccd722eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fde5 expref: 27 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.513473:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c710e00/0xe984082ccd722eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fde5 expref: 27 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.513480:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c710e00, rc 0) 00000100:00100000:0.0:1746143675.513493:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963591792256:12345-192.168.202.48@tcp:101:cat.0 Request processed in 63us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.513497:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8607 00000100:00100000:0.0:1746143675.513505:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8608 00000100:00100000:0.0:1746143675.513510:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963591792384:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143675.513515:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143675.513521:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c711600/0xe984082ccd722eb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fdec expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143675.513530:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409ba, atime: 0x681409b9, ctime: 0x681409ba, blocks: 0x821 00010000:00010000:0.0:1746143675.513538:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.513539:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.513542:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c711600/0xe984082ccd722eb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdec expref: 31 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.513550:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c711600/0xe984082ccd722eb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdec expref: 31 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.513556:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c711600, rc 0) 00000100:00100000:0.0:1746143675.513568:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963591792384:12345-192.168.202.48@tcp:101:cat.0 Request processed in 59us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.513576:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8608 00000100:00100000:0.0:1746143675.513617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.513630:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591792512 00000100:00100000:0.0:1746143675.513633:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591792512 00000100:00100000:0.0:1746143675.513646:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8609 00000100:00100000:0.0:1746143675.513650:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963591792512:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143675.513655:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143675.513663:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c711c00/0xe984082ccd722ebc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fdf3 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143675.513674:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 4897312, mtime: 0x681409bb, atime: 0x681409ba, ctime: 0x681409bb, blocks: 0x15a7 00010000:00010000:0.0:1746143675.513681:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.513682:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.513687:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c711c00/0xe984082ccd722ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdf3 expref: 32 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.513695:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c711c00/0xe984082ccd722ebc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdf3 expref: 32 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.513702:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c711c00, rc 0) 00000100:00100000:0.0:1746143675.513715:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963591792512:12345-192.168.202.48@tcp:101:cat.0 Request processed in 64us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.513719:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8609 00000100:00100000:0.0:1746143675.517526:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.517580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.522756:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591793280 00000100:00100000:1.0:1746143675.522766:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591793280 00000100:00100000:1.0:1746143675.522820:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8058 00000100:00100000:1.0:1746143675.522828:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+14:27808:x1830963591793280:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143675.522852:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143675.522872:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcf600/0xe984082ccd722ec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fdfa expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.522978:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcf000/0xe984082ccd722eca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.522991:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcf000/0xe984082ccd722eca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523002:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcf000/0xe984082ccd722eca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523027:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa42a00/0xe984082ccd722ed1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523033:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa42a00/0xe984082ccd722ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523039:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa42a00/0xe984082ccd722ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523180:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfae00/0xe984082ccd722ed8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523189:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfae00/0xe984082ccd722ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523195:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfae00/0xe984082ccd722ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143675.523207:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143675.523291:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcf000/0xe984082ccd722eca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523298:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcf000/0xe984082ccd722eca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523304:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcf000/0xe984082ccd722eca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523310:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bbcf000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143675.523314:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcf000/0xe984082ccd722eca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523320:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcf000/0xe984082ccd722eca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523330:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143675.523333:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143675.523336:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcf000/0xe984082ccd722eca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523341:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcf000/0xe984082ccd722eca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523356:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa42a00/0xe984082ccd722ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523360:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa42a00/0xe984082ccd722ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523365:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa42a00/0xe984082ccd722ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523372:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa42a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143675.523374:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa42a00/0xe984082ccd722ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523378:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa42a00/0xe984082ccd722ed1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523383:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74100) 00010000:00010000:1.0:1746143675.523385:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143675.523387:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa42a00/0xe984082ccd722ed1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523391:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa42a00/0xe984082ccd722ed1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.523423:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbcf600/0xe984082ccd722ec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdfa expref: 17 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.523434:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfae00/0xe984082ccd722ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdfa expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.523439:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143675.523441:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143675.523443:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cfae00, rc 0) 00000100:00100000:1.0:1746143675.523485:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+16:27808:x1830963591793280:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 657us (814us total) trans 8589942081 rc 0/0 00000100:00100000:1.0:1746143675.523491:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8058 00000100:00100000:1.0:1746143675.540728:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.563594:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.570779:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.572434:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.572534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.572551:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591794048 00000100:00100000:1.0:1746143675.572554:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591794048 00000100:00100000:1.0:1746143675.572574:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591794176 00000100:00100000:1.0:1746143675.572576:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591794176 00000100:00100000:1.0:1746143675.572589:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8611 00000100:00100000:1.0:1746143675.572594:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963591794048:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143675.572603:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143675.572614:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf600/0xe984082ccd722f02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe0f expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.572626:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.572627:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.572632:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf600/0xe984082ccd722f02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe0f expref: 16 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143675.572642:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf600/0xe984082ccd722f02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe0f expref: 16 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143675.572649:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcf600, rc 0) 00000100:00100000:1.0:1746143675.572668:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963591794048:12345-192.168.202.48@tcp:101:cat.0 Request processed in 74us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.572673:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8611 00000100:00100000:1.0:1746143675.572684:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8612 00000100:00100000:1.0:1746143675.572688:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963591794176:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143675.572694:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143675.572700:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbcea00/0xe984082ccd722f09 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe16 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.572714:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.572715:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.572719:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcea00/0xe984082ccd722f09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe16 expref: 16 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143675.572728:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcea00/0xe984082ccd722f09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe16 expref: 16 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143675.572734:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcea00, rc 0) 00000100:00100000:1.0:1746143675.572749:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963591794176:12345-192.168.202.48@tcp:101:cat.0 Request processed in 60us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.572754:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8612 00000100:00100000:1.0:1746143675.572794:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.572807:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591794304 00000100:00100000:1.0:1746143675.572810:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591794304 00000100:00100000:1.0:1746143675.572824:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8613 00000100:00100000:1.0:1746143675.572828:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963591794304:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143675.572834:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143675.572841:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bbcf000/0xe984082ccd722f10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe1d expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.572851:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.572852:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.572857:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bbcf000/0xe984082ccd722f10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe1d expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143675.572866:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bbcf000/0xe984082ccd722f10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe1d expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143675.572873:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcf000, rc 0) 00000100:00100000:1.0:1746143675.572888:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591794304:12345-192.168.202.48@tcp:101:cat.0 Request processed in 59us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.572893:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8613 00000100:00100000:0.0:1746143675.576107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.576173:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.576771:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.577473:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8615 00000100:00100000:1.0:1746143675.577487:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8616 00000100:00100000:1.0:1746143675.577493:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:27806:x1830963591794688:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143675.577501:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143675.577512:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe32 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.577535:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c710e00/0xe984082ccd722eae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fde5 expref: 28 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143675.577543:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcea00/0xe984082ccd722f09 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe16 expref: 16 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143675.577550:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.577552:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.577555:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1236992->1953791] (req 1236992->1953791) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.577586:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbcea00/0xe984082ccd722f09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe16 expref: 16 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143675.577602:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcea00/0xe984082ccd722f09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe16 expref: 16 pid: 12618 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746143675.577614:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593568640:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143675.577705:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c710e00/0xe984082ccd722eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fde5 expref: 28 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143675.577713:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c710e00/0xe984082ccd722eae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fde5 expref: 28 pid: 6929 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746143675.577721:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593568768:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143675.577738:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143675.578135:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963591794560:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143675.578157:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143675.578165:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c711000/0xe984082ccd722f25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe2b expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.578179:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.578180:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.578186:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c711000/0xe984082ccd722f25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe2b expref: 17 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.578200:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c711000/0xe984082ccd722f25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe2b expref: 17 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143675.578210:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c711000, rc 0) 00000100:00100000:0.0:1746143675.578233:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963591794560:12345-192.168.202.48@tcp:101:cat.0 Request processed in 754us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.578239:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8615 00000100:00100000:0.0:1746143675.583807:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.583848:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.583870:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591794816 00000100:00100000:0.0:1746143675.583878:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591794816 00010000:00010000:0.0:1746143675.583914:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcea00/0xe984082ccd722f09 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe16 expref: 17 pid: 12618 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746143675.584244:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591794944 00000100:00100000:0.0:1746143675.584247:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591794944 00010000:00010000:0.0:1746143675.584260:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c710e00/0xe984082ccd722eae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fde5 expref: 29 pid: 6929 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746143675.584331:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593568640:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143675.584340:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593568768:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143675.584366:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1236992->1953791] (req 1236992->1953791) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.584380:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcf400, rc 0) 00000100:00100000:1.0:1746143675.584420:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:27806:x1830963591794688:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6927us (7649us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.584428:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8616 00000100:00100000:0.0:1746143675.584739:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4339 00000100:00100000:0.0:1746143675.584747:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963591794816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143675.584758:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143675.584780:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bbcea00/0xe984082ccd722f09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe16 expref: 17 pid: 12618 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.584791:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bbcea00/0xe984082ccd722f09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe16 expref: 17 pid: 12618 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.584812:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcea00/0xe984082ccd722f09 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe16 expref: 17 pid: 12618 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.584831:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143675.584846:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963591794816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.584851:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4339 00000100:00100000:0.0:1746143675.584898:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4340 00000100:00100000:0.0:1746143675.584902:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963591794944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143675.584908:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143675.584914:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c710e00/0xe984082ccd722eae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fde5 expref: 28 pid: 6929 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.584923:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c710e00/0xe984082ccd722eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fde5 expref: 28 pid: 6929 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.584934:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c710e00/0xe984082ccd722eae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fde5 expref: 28 pid: 6929 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.584941:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.584943:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.584949:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1953791) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.584957:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1953791) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.584981:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1953791) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143675.584991:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593568896:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143675.585040:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143675.590153:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.590192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.590251:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.590279:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591795200 00000100:00100000:1.0:1746143675.590287:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591795200 00002000:00100000:1.0:1746143675.590331:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880093804700 x1830963591795200/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.590341:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804700 with x1830963591795200 ext(0->1048575) 00002000:00010000:1.0:1746143675.590347:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093804700 00000100:00100000:1.0:1746143675.590373:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591795456 00000100:00100000:1.0:1746143675.590375:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591795456 00002000:00100000:1.0:1746143675.590389:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093804380 x1830963591795456/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.590396:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804380 with x1830963591795456 ext(1048576->2097151) 00002000:00010000:1.0:1746143675.590399:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093804380 00000100:00100000:1.0:1746143675.590407:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591795712 00000100:00100000:1.0:1746143675.590408:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591795712 00002000:00100000:1.0:1746143675.590418:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1236992->1241087) req@ffff880093805c00 x1830963591795712/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.590424:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805c00 with x1830963591795712 ext(1236992->1241087) 00002000:00010000:1.0:1746143675.590426:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093805c00 00000100:00100000:1.0:1746143675.590439:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2905 00000100:00100000:1.0:1746143675.590445:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963591795200:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143675.591821:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2906 00000100:00100000:1.0:1746143675.591829:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963591795456:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143675.594797:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593568896:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143675.594821:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143675.594859:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963591794944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9954us (11009us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.594870:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4340 00000100:00100000:1.0:1746143675.594966:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2907 00000100:00100000:1.0:1746143675.594975:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963591795712:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143675.595126:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963591795712:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 152us (4874us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143675.595132:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2907 00002000:00100000:1.0:1746143675.595159:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1236992->1241087) req@ffff880093805c00 x1830963591795712/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:71/0 lens 488/4536 e 0 to 0 dl 1746143686 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.595169:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805c00 with x1830963591795712 ext(1236992->1241087) 00002000:00010000:1.0:1746143675.595174:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093805c00 00000100:00100000:1.0:1746143675.614403:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963591795200:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23941us (24259us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143675.614418:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2905 00002000:00100000:1.0:1746143675.614434:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880093804700 x1830963591795200/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/440 e 0 to 0 dl 1746143686 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.614444:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804700 with x1830963591795200 ext(0->1048575) 00002000:00010000:1.0:1746143675.614451:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093804700 00000100:00100000:1.0:1746143675.615803:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963591795456:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23969us (25604us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143675.615810:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2906 00002000:00100000:1.0:1746143675.615816:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093804380 x1830963591795456/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/440 e 0 to 0 dl 1746143686 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.615829:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804380 with x1830963591795456 ext(1048576->2097151) 00002000:00010000:1.0:1746143675.615833:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093804380 00000100:00100000:0.0:1746143675.629074:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.629133:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.629645:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591795840 00000100:00100000:1.0:1746143675.629649:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591795840 00000100:00100000:1.0:1746143675.629686:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8617 00000100:00100000:1.0:1746143675.629692:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:27812:x1830963591795840:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143675.629701:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143675.629718:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800951aa200/0xe984082ccd722f2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe39 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.629743:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1953791) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 26 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.629751:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143675.629753:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143675.629756:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800951aa200/0xe984082ccd722f2c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe39 expref: 17 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.629790:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1953791) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 26 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.629801:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1953791) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 26 pid: 12618 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746143675.629811:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593569024:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143675.629883:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143675.635615:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.635654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.635679:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591796352 00000100:00100000:0.0:1746143675.635688:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591796352 00002000:00100000:0.0:1746143675.635735:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1236992->1953791) req@ffff8800930d0000 x1830963591796352/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143675.635744:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0000 with x1830963591796352 ext(1236992->1953791) 00010000:00010000:0.0:1746143675.635754:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 27 pid: 12618 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746143675.635766:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 27 pid: 12618 timeout: 854 lvb_type: 0 00002000:00010000:0.0:1746143675.635772:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d0000 00000100:00100000:0.0:1746143675.635801:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 687 00000100:00100000:0.0:1746143675.635808:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963591796352:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143675.637056:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593569024:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143675.637082:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800951aa200/0xe984082ccd722f2c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe39 expref: 17 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.637098:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800951aa200, rc 0) 00000100:00100000:1.0:1746143675.637117:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+17:27812:x1830963591795840:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7426us (8056us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.637124:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8617 00000100:00100000:0.0:1746143675.678180:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.678225:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591796864 00000100:00100000:0.0:1746143675.678234:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591796864 00000100:00100000:0.0:1746143675.682449:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:27819:x1830963591796864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143675.682485:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143675.682507:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095178e00/0xe984082ccd722f33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe40 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.682622:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095178600/0xe984082ccd722f3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682634:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095178600/0xe984082ccd722f3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682646:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095178600/0xe984082ccd722f3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682662:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717000/0xe984082ccd722f41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682668:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717000/0xe984082ccd722f41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682673:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717000/0xe984082ccd722f41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682776:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716400/0xe984082ccd722f48 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682785:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716400/0xe984082ccd722f48 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682791:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716400/0xe984082ccd722f48 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143675.682798:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143675.682885:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095178600/0xe984082ccd722f3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682891:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095178600/0xe984082ccd722f3a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682897:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095178600/0xe984082ccd722f3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682902:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095178600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143675.682906:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095178600/0xe984082ccd722f3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682912:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095178600/0xe984082ccd722f3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682923:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143675.682926:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143675.682930:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095178600/0xe984082ccd722f3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682934:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095178600/0xe984082ccd722f3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682972:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717000/0xe984082ccd722f41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682977:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717000/0xe984082ccd722f41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682982:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717000/0xe984082ccd722f41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682986:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a717000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143675.682988:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717000/0xe984082ccd722f41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682993:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717000/0xe984082ccd722f41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.682998:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5056700) 00010000:00010000:0.0:1746143675.683000:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143675.683002:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717000/0xe984082ccd722f41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.683006:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717000/0xe984082ccd722f41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.683051:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095178e00/0xe984082ccd722f33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe40 expref: 254 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.683064:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716400/0xe984082ccd722f48 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe40 expref: 253 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.683072:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143675.683074:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143675.683076:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a716400, rc 0) 00000100:00100000:0.0:1746143675.686567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.686652:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591796992 00000100:00100000:1.0:1746143675.686661:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591796992 00010000:00010000:1.0:1746143675.686696:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 29 pid: 12618 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746143675.686719:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4341 00000100:00100000:1.0:1746143675.686725:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963591796992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143675.686739:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143675.686758:0:7151:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143673 -> 1746143675 00002000:00010000:1.0:1746143675.686760:0:7151:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143674 -> 1746143675 00010000:00010000:1.0:1746143675.686765:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 29 pid: 12618 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.686777:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1953791) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 29 pid: 12618 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.686796:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf400/0xe984082ccd722f1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1953791) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe32 expref: 29 pid: 12618 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.686829:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.686831:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.686839:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800951aa200/0xe984082ccd722f2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe39 expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.686847:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800951aa200/0xe984082ccd722f2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe39 expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.686882:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800951aa200/0xe984082ccd722f2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe39 expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143675.686894:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593569152:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143675.686976:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143675.688062:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593569152:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143675.688076:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143675.688104:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963591796992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1378us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.688112:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4341 00000100:00100000:0.0:1746143675.688213:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.688253:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591797120 00000100:00100000:1.0:1746143675.688257:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591797120 00000100:00100000:1.0:1746143675.688296:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8618 00000100:00100000:1.0:1746143675.688302:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963591797120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143675.688319:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143675.688332:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbcee00/0xe984082ccd722f56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe47 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.688353:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.688355:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.688361:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcee00/0xe984082ccd722f56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe47 expref: 29 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143675.688374:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcee00/0xe984082ccd722f56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe47 expref: 29 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143675.688383:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcee00, rc 0) 00000100:00100000:1.0:1746143675.688401:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963591797120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 99us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.688407:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8618 00000100:00100000:0.0:1746143675.696291:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.696373:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591797632 00000100:00100000:1.0:1746143675.696382:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591797632 00002000:00100000:1.0:1746143675.696430:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008e63ed80 x1830963591797632/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.696440:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63ed80 with x1830963591797632 ext(1048576->2097151) 00002000:00010000:1.0:1746143675.696445:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e63ed80 00000100:00100000:1.0:1746143675.696456:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2909 00000100:00100000:1.0:1746143675.696460:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963591797632:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143675.704717:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.704742:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.704769:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.704793:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.706286:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2912 00000100:00100000:0.0:1746143675.706295:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963591798144:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143675.706575:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2913 00000100:00100000:1.0:1746143675.706583:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963591798528:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143675.721102:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.721158:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.721182:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591798912 00000100:00100000:0.0:1746143675.721191:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591798912 00010000:00010000:0.0:1746143675.721235:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0189800/0xe984082ccd722f17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe24 expref: 28 pid: 8497 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746143675.721263:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591799040 00000100:00100000:0.0:1746143675.721265:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591799040 00010000:00010000:0.0:1746143675.721276:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c711c00/0xe984082ccd722ebc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdf3 expref: 36 pid: 15784 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746143675.721298:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4342 00000100:00100000:0.0:1746143675.721305:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1965:x1830963591798912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143675.721320:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143675.721344:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0189800/0xe984082ccd722f17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe24 expref: 28 pid: 8497 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.721356:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0189800/0xe984082ccd722f17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe24 expref: 28 pid: 8497 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.721378:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0189800/0xe984082ccd722f17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe24 expref: 28 pid: 8497 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.721398:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143675.721442:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963591798912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 137us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.721449:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4342 00000100:00100000:0.0:1746143675.721477:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4343 00000100:00100000:0.0:1746143675.721481:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963591799040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143675.721487:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143675.721495:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c711c00/0xe984082ccd722ebc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdf3 expref: 36 pid: 15784 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.721503:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c711c00/0xe984082ccd722ebc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdf3 expref: 36 pid: 15784 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746143675.721520:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.721523:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143675.721530:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800939c5800/0xe984082ccd722f5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2289664->3133439) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe4e expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.721539:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800939c5800/0xe984082ccd722f5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2289664->3133439) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe4e expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.721572:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800939c5800/0xe984082ccd722f5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2289664->3133439) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe4e expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143675.721586:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593569536:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143675.721644:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143675.722103:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963591797632:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25640us (26180us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143675.722109:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2909 00002000:00100000:0.0:1746143675.722118:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008e63ed80 x1830963591797632/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/440 e 0 to 0 dl 1746143686 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143675.722127:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63ed80 with x1830963591797632 ext(1048576->2097151) 00002000:00010000:0.0:1746143675.722131:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e63ed80 00000100:00100000:1.0:1746143675.738136:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.738176:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591799296 00000100:00100000:1.0:1746143675.738186:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591799296 00002000:00100000:1.0:1746143675.738230:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2289664->2293759) req@ffff880093805f80 x1830963591799296/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.738240:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805f80 with x1830963591799296 ext(2289664->2293759) 00002000:00010000:1.0:1746143675.738245:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093805f80 00000100:00100000:1.0:1746143675.738263:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2915 00000100:00100000:1.0:1746143675.738269:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591799296:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143675.738410:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591799296:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 139us (283us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143675.738418:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2915 00002000:00100000:1.0:1746143675.738422:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2289664->2293759) req@ffff880093805f80 x1830963591799296/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/4536 e 0 to 0 dl 1746143686 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.738429:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805f80 with x1830963591799296 ext(2289664->2293759) 00002000:00010000:1.0:1746143675.738432:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093805f80 00000100:00100000:0.0:1746143675.738442:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593569536:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143675.738463:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143675.748154:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963591798144:12345-192.168.202.48@tcp:3:cat.0 Request processed in 41834us (43384us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143675.748172:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2912 00002000:00100000:0.0:1746143675.748186:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88009bfe3b80 x1830963591798144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:71/0 lens 488/440 e 0 to 0 dl 1746143686 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143675.748196:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3b80 with x1830963591798144 ext(1048576->2097151) 00002000:00010000:0.0:1746143675.748201:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe3b80 00000100:00100000:0.0:1746143675.787315:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.787355:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.787384:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.787425:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.787446:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591799680 00000100:00100000:1.0:1746143675.787456:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591799680 00002000:00100000:1.0:1746143675.787505:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3149823) req@ffff88012fc10380 x1830963591799680/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 504/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.787516:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10380 with x1830963591799680 ext(2097152->3149823) 00002000:00010000:1.0:1746143675.787521:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc10380 00000100:00100000:1.0:1746143675.787537:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591800192 00000100:00100000:1.0:1746143675.787539:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591800192 00002000:00100000:1.0:1746143675.787552:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88012fc13800 x1830963591800192/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.787558:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13800 with x1830963591800192 ext(3145728->4194303) 00002000:00010000:1.0:1746143675.787561:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc13800 00000100:00100000:1.0:1746143675.787572:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2916 00000100:00100000:1.0:1746143675.787578:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963591799680:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143675.788810:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2919 00000100:00100000:1.0:1746143675.788817:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963591800064:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143675.800525:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.809779:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963591799680:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22200us (22474us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143675.809788:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2916 00002000:00100000:1.0:1746143675.809797:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3149823) req@ffff88012fc10380 x1830963591799680/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 504/440 e 0 to 0 dl 1746143686 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.809805:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10380 with x1830963591799680 ext(2097152->3149823) 00010000:00010000:1.0:1746143675.809812:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800939c5800/0xe984082ccd722f5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe4e expref: 26 pid: 8497 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.809825:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800939c5800/0xe984082ccd722f5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->3133439) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe4e expref: 26 pid: 8497 timeout: 854 lvb_type: 0 00002000:00010000:1.0:1746143675.809831:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fc10380 00000100:00100000:1.0:1746143675.820258:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963591800064:12345-192.168.202.48@tcp:3:cat.0 Request processed in 31429us (32820us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143675.820270:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2919 00002000:00100000:1.0:1746143675.820282:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012fc13480 x1830963591800064/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:71/0 lens 488/440 e 0 to 0 dl 1746143686 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.820291:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13480 with x1830963591800064 ext(2097152->3145727) 00002000:00010000:1.0:1746143675.820299:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc13480 00000100:00100000:0.0:1746143675.832643:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.834672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.836398:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.837196:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591801088 00000100:00100000:0.0:1746143675.837205:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591801088 00000100:00100000:0.0:1746143675.837441:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8621 00000100:00100000:0.0:1746143675.837448:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:27812:x1830963591801088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143675.837461:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143675.837477:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a716600/0xe984082ccd722f6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe5c expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.837505:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143675.837507:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143675.837510:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a716600/0xe984082ccd722f6b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe5c expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.837526:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a716600/0xe984082ccd722f6b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe5c expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.837535:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a716600, rc 0) 00000100:00100000:0.0:1746143675.837583:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:27812:x1830963591801088:12345-192.168.202.48@tcp:101:cat.0 Request processed in 136us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143675.837588:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8621 00000100:00100000:0.0:1746143675.870004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.878491:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.878607:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591801472 00000100:00100000:1.0:1746143675.878615:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591801472 00000100:00100000:1.0:1746143675.878664:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8061 00000100:00100000:1.0:1746143675.878671:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:27823:x1830963591801472:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143675.878696:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143675.878715:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff9200/0xe984082ccd722f72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe63 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.878818:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff9400/0xe984082ccd722f79 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.878833:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfae00/0xe984082ccd722ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdfa expref: 18 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.878840:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716400/0xe984082ccd722f48 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe40 expref: 254 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.878846:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff9400/0xe984082ccd722f79 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.878874:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716400/0xe984082ccd722f48 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe40 expref: 254 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.878886:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716400/0xe984082ccd722f48 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe40 expref: 254 pid: 14763 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746143675.878897:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593570048:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143675.880406:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfae00/0xe984082ccd722ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdfa expref: 18 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.880418:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfae00/0xe984082ccd722ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdfa expref: 18 pid: 14763 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746143675.880429:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593570176:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143675.882124:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143675.884166:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.884199:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.884228:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.884305:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591802240 00000100:00100000:1.0:1746143675.884318:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591802240 00002000:00100000:1.0:1746143675.884367:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88012fc13b80 x1830963591802240/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.884377:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13b80 with x1830963591802240 ext(3145728->4194303) 00002000:00010000:1.0:1746143675.884382:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc13b80 00000100:00100000:1.0:1746143675.884399:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591802496 00000100:00100000:1.0:1746143675.884402:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591802496 00002000:00100000:1.0:1746143675.884415:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012fc10a80 x1830963591802496/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.884422:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10a80 with x1830963591802496 ext(2097152->3145727) 00002000:00010000:1.0:1746143675.884425:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10a80 00000100:00100000:1.0:1746143675.884448:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2921 00000100:00100000:1.0:1746143675.884456:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963591802240:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143675.886876:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4346 00000100:00100000:1.0:1746143675.886881:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963591802752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143675.886887:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143675.886893:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfae00/0xe984082ccd722ed8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdfa expref: 19 pid: 14763 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.886912:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfae00/0xe984082ccd722ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdfa expref: 19 pid: 14763 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.886964:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143675.886966:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143675.886992:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963591802752:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 110us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.886999:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4346 00010000:00010000:0.0:1746143675.888236:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716400/0xe984082ccd722f48 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe40 expref: 254 pid: 14763 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746143675.888281:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593570048:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143675.888297:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfae00/0xe984082ccd722ed8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdfa expref: 18 pid: 14763 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746143675.888308:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593570176:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143675.888324:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff9400/0xe984082ccd722f79 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.888332:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff9400/0xe984082ccd722f79 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143675.888341:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff9400/0xe984082ccd722f79 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143675.888362:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143675.888512:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff9200/0xe984082ccd722f72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe63 expref: 255 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.888525:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff9400/0xe984082ccd722f79 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe63 expref: 254 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143675.888532:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143675.888535:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143675.888537:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff9400, rc 0) 00000100:00100000:0.0:1746143675.888561:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:27823:x1830963591801472:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 9890us (10070us total) trans 8589942087 rc 0/0 00000100:00100000:0.0:1746143675.888567:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8061 00000100:00100000:0.0:1746143675.902376:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.903584:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591802240:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19123us (19446us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143675.903593:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2921 00002000:00100000:1.0:1746143675.903599:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88012fc13b80 x1830963591802240/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:71/0 lens 488/440 e 0 to 0 dl 1746143686 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.903608:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13b80 with x1830963591802240 ext(3145728->4194303) 00002000:00010000:1.0:1746143675.903614:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc13b80 00000100:00100000:0.0:1746143675.920596:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.953439:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.958949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.965207:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.965505:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591803776 00000100:00100000:1.0:1746143675.965514:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591803776 00010000:00010000:1.0:1746143675.965551:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c711000/0xe984082ccd722f25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe2b expref: 17 pid: 21542 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746143675.965622:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4347 00000100:00100000:1.0:1746143675.965631:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963591803776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143675.965645:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143675.965671:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c711000/0xe984082ccd722f25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe2b expref: 17 pid: 21542 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746143675.965683:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c711000/0xe984082ccd722f25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe2b expref: 17 pid: 21542 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746143675.965706:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c711000/0xe984082ccd722f25 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe2b expref: 17 pid: 21542 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746143675.966224:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143675.966271:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963591803776:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 641us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.966278:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4347 00000100:00100000:0.0:1746143675.967182:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.967256:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591803904 00000100:00100000:1.0:1746143675.967261:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591803904 00010000:00010000:1.0:1746143675.967282:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0188c00/0xe984082ccd722e99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdd0 expref: 30 pid: 21542 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746143675.967314:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4348 00000100:00100000:1.0:1746143675.967319:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963591803904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143675.967329:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143675.967346:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0188c00/0xe984082ccd722e99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdd0 expref: 30 pid: 21542 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.967356:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0188c00/0xe984082ccd722e99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdd0 expref: 30 pid: 21542 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.967373:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0188c00/0xe984082ccd722e99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdd0 expref: 30 pid: 21542 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.967386:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.967388:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.967395:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f79fc00/0xe984082ccd722f87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe6a expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.967403:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f79fc00/0xe984082ccd722f87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe6a expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.967435:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f79fc00/0xe984082ccd722f87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe6a expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143675.967447:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593570560:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143675.967521:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143675.967654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.967766:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591804160 00000100:00100000:1.0:1746143675.967770:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591804160 00000100:00100000:1.0:1746143675.967797:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8062 00000100:00100000:1.0:1746143675.967802:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+18:27826:x1830963591804160:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143675.967820:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143675.967834:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dd400/0xe984082ccd722f8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe71 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.967933:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dd200/0xe984082ccd722f95 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.967945:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dd200/0xe984082ccd722f95 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143675.967958:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dd200/0xe984082ccd722f95 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143675.967967:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143675.968095:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dd400/0xe984082ccd722f8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe71 expref: 21 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.968108:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dd200/0xe984082ccd722f95 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe71 expref: 20 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.968115:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143675.968118:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143675.968120:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a07dd200, rc 0) 00000100:00100000:1.0:1746143675.968172:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+20:27826:x1830963591804160:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 369us (518us total) trans 8589942089 rc 0/0 00000100:00100000:1.0:1746143675.968179:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8062 00000100:00100000:1.0:1746143675.972539:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593570560:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143675.972563:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143675.972624:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963591803904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5303us (5444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.972636:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4348 00000100:00100000:0.0:1746143675.974262:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.977590:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143675.984421:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.984569:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591804672 00000100:00100000:1.0:1746143675.984576:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591804672 00010000:00010000:1.0:1746143675.984711:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a716600/0xe984082ccd722f6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe5c expref: 26 pid: 8497 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746143675.984753:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4349 00000100:00100000:1.0:1746143675.984762:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963591804672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143675.984777:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143675.985057:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a716600/0xe984082ccd722f6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe5c expref: 26 pid: 8497 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.985069:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a716600/0xe984082ccd722f6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe5c expref: 26 pid: 8497 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.985091:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a716600/0xe984082ccd722f6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe5c expref: 26 pid: 8497 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.985107:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143675.985132:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963591804672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 372us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.985155:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4349 00000100:00100000:0.0:1746143675.985287:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.985421:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591804800 00000100:00100000:1.0:1746143675.985425:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591804800 00010000:00010000:1.0:1746143675.985437:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba23600/0xe984082ccd722f64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe55 expref: 33 pid: 8497 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746143675.985463:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4350 00000100:00100000:1.0:1746143675.985468:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963591804800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143675.985476:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143675.985483:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ba23600/0xe984082ccd722f64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe55 expref: 33 pid: 8497 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.985497:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ba23600/0xe984082ccd722f64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe55 expref: 33 pid: 8497 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.985508:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ba23600/0xe984082ccd722f64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe55 expref: 33 pid: 8497 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746143675.985517:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.985519:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143675.985526:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009519ac00/0xe984082ccd722fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4632575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe78 expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.985535:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009519ac00/0xe984082ccd722fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4632575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe78 expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143675.985565:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009519ac00/0xe984082ccd722fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4632575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe78 expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143675.985577:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593570944:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143675.985631:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143675.989055:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593570944:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143675.989077:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143675.989135:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963591804800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3665us (3846us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143675.989213:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4350 00000100:00100000:0.0:1746143675.993475:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143675.993600:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591805056 00000100:00100000:1.0:1746143675.993612:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591805056 00002000:00100000:1.0:1746143675.993662:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4628480->4632575) req@ffff8800930d1500 x1830963591805056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:71/0 lens 488/0 e 0 to 0 dl 1746143686 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143675.993673:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1500 with x1830963591805056 ext(4628480->4632575) 00002000:00010000:1.0:1746143675.993679:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d1500 00000100:00100000:0.0:1746143676.066583:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.066625:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.067567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.067871:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591805440 00000100:00100000:1.0:1746143676.067875:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591805440 00000100:00100000:1.0:1746143676.067906:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8626 00000100:00100000:1.0:1746143676.067911:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963591805440:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.067917:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.067924:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a07dd600/0xe984082ccd722fb8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe8d expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143676.068654:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593571456:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143676.068768:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143676.071275:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.071353:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:1.0:1746143676.071786:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143674 -> 1746143675 00000100:00100000:1.0:1746143676.071802:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593571456:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143676.071819:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a07dd600/0xe984082ccd722fb8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe8d expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.071828:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a07dd600/0xe984082ccd722fb8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe8d expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.071841:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a07dd600, rc 0) 00000100:00100000:1.0:1746143676.071877:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963591805440:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3964us (4308us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143676.071886:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8626 00000100:00100000:0.0:1746143676.090581:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.091075:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591805952 00000100:00100000:1.0:1746143676.091082:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591805952 00002000:00100000:1.0:1746143676.091120:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1925120->1929215) req@ffff88009bfe3800 x1830963591805952/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.091129:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3800 with x1830963591805952 ext(1925120->1929215) 00002000:00010000:1.0:1746143676.091134:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe3800 00000100:00100000:1.0:1746143676.091175:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2928 00000100:00100000:1.0:1746143676.091181:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963591805952:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143676.091343:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963591805952:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 162us (763us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143676.091349:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2928 00002000:00100000:1.0:1746143676.091354:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1925120->1929215) req@ffff88009bfe3800 x1830963591805952/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.091361:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3800 with x1830963591805952 ext(1925120->1929215) 00002000:00010000:1.0:1746143676.091363:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe3800 00000100:00100000:0.0:1746143676.094268:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.094358:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.096995:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591806080 00000100:00100000:1.0:1746143676.097013:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591806080 00000100:00100000:1.0:1746143676.097057:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8627 00000100:00100000:1.0:1746143676.097063:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+25:27826:x1830963591806080:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:0.0:1746143676.097664:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143676.097671:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.097692:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a07dd600/0xe984082ccd722fbf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe94 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.097728:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c711600/0xe984082ccd722eb5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdec expref: 31 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.097735:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcf000/0xe984082ccd722f10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe1d expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.097741:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.097743:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.097746:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a07dd600/0xe984082ccd722fbf lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->1589247] (req 1048576->1589247) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe94 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.097776:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bbcf000/0xe984082ccd722f10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe1d expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.097788:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bbcf000/0xe984082ccd722f10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe1d expref: 26 pid: 25369 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746143676.097800:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593571712:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143676.097886:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c711600/0xe984082ccd722eb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdec expref: 31 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.097894:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c711600/0xe984082ccd722eb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdec expref: 31 pid: 6929 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746143676.097901:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593571840:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143676.097920:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143676.097937:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591806592 00000100:00100000:1.0:1746143676.097940:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591806592 00000100:00100000:1.0:1746143676.097993:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8063 00000100:00100000:1.0:1746143676.097999:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:27834:x1830963591806592:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.098024:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.098037:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dd400/0xe984082ccd722fc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fe9b expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.098131:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dde00/0xe984082ccd722fcd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098155:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dde00/0xe984082ccd722fcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098166:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dde00/0xe984082ccd722fcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098177:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd722fd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098182:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd722fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098186:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd722fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098282:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc800/0xe984082ccd722fdb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098288:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc800/0xe984082ccd722fdb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098296:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc800/0xe984082ccd722fdb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143676.098303:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143676.098381:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dde00/0xe984082ccd722fcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098387:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dde00/0xe984082ccd722fcd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098392:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dde00/0xe984082ccd722fcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098397:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a07dde00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143676.098400:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dde00/0xe984082ccd722fcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098406:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dde00/0xe984082ccd722fcd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098415:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143676.098418:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143676.098421:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dde00/0xe984082ccd722fcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098425:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dde00/0xe984082ccd722fcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098437:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd722fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098441:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd722fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098448:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd722fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098452:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a07dca00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143676.098453:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd722fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098456:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd722fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098460:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74a00) 00010000:00010000:1.0:1746143676.098462:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143676.098464:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd722fd4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098468:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd722fd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.098498:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dd400/0xe984082ccd722fc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe9b expref: 258 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.098506:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc800/0xe984082ccd722fdb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe9b expref: 257 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.098512:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143676.098513:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143676.098515:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a07dc800, rc 0) 00000100:00100000:1.0:1746143676.098544:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:27834:x1830963591806592:12345-192.168.202.48@tcp:101:cat.0 Request processed in 544us (880us total) trans 8589942090 rc 0/0 00000100:00100000:1.0:1746143676.098549:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8063 00000100:00100000:0.0:1746143676.111725:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.111772:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.111835:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.111873:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143676.115432:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcf000/0xe984082ccd722f10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe1d expref: 26 pid: 25369 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746143676.115465:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593571712:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143676.115478:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c711600/0xe984082ccd722eb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdec expref: 32 pid: 6929 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746143676.115485:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593571840:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143676.115510:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a07dd600/0xe984082ccd722fbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe94 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.115522:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a07dd600, rc 0) 00000100:00100000:1.0:1746143676.115580:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+25:27826:x1830963591806080:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 18516us (21321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143676.115588:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8627 00000100:00100000:0.0:1746143676.135454:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.137860:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.140287:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.150262:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.150313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.159640:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.170397:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.170605:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.188949:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591809024 00000100:00100000:1.0:1746143676.188954:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591809024 00000100:00100000:1.0:1746143676.188990:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591809280 00000100:00100000:1.0:1746143676.188992:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591809280 00000100:00100000:1.0:1746143676.189018:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8630 00000100:00100000:1.0:1746143676.189023:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963591809024:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.189038:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.189053:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e61e200/0xe984082ccd72301a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209feb7 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.189072:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.189075:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.189082:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e61e200/0xe984082ccd72301a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209feb7 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.189098:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e61e200/0xe984082ccd72301a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209feb7 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.189108:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e61e200, rc 0) 00000100:00100000:1.0:1746143676.189134:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963591809024:12345-192.168.202.48@tcp:101:cat.0 Request processed in 111us (2224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143676.189152:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8630 00000100:00100000:1.0:1746143676.189165:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8631 00000100:00100000:1.0:1746143676.189170:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963591809280:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.189176:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.189182:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e61e600/0xe984082ccd723021 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fec5 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143676.189222:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593572480:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143676.189274:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143676.190717:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591809408 00000100:00100000:0.0:1746143676.190722:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591809408 00000100:00100000:0.0:1746143676.190754:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8633 00000100:00100000:0.0:1746143676.190760:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:27836:x1830963591809408:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143676.190769:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143676.190778:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009331ec00/0xe984082ccd72302f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fecc expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143676.190796:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c711200/0xe984082ccd722ea7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdde expref: 32 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143676.190803:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf600/0xe984082ccd722f02 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe0f expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143676.190809:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143676.190810:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143676.190813:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009331ec00/0xe984082ccd72302f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1474560->1523711] (req 1474560->1523711) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fecc expref: 32 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143676.190833:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf600/0xe984082ccd722f02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe0f expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143676.190843:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf600/0xe984082ccd722f02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe0f expref: 19 pid: 12618 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746143676.190852:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593572736:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143676.190899:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c711200/0xe984082ccd722ea7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdde expref: 32 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143676.190907:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c711200/0xe984082ccd722ea7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdde expref: 32 pid: 6929 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746143676.190914:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593572864:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143676.190928:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143676.194956:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593572480:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143676.194990:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e61e600/0xe984082ccd723021 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fec5 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.195012:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e61e600/0xe984082ccd723021 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fec5 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.195035:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e61e600, rc 0) 00000100:00100000:1.0:1746143676.195084:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963591809280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5912us (8146us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143676.195093:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8631 00010000:00010000:0.0:1746143676.196284:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcf600/0xe984082ccd722f02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe0f expref: 18 pid: 12618 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746143676.196299:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593572736:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143676.196310:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c711200/0xe984082ccd722ea7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fdde expref: 30 pid: 6929 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746143676.196318:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f185180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593572864:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143676.196335:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009331ec00/0xe984082ccd72302f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1523711) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fecc expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143676.196344:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009331ec00, rc 0) 00000100:00100000:0.0:1746143676.196363:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:27836:x1830963591809408:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5604us (5889us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143676.196370:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8633 00000100:00100000:0.0:1746143676.202765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.206729:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.206777:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.209843:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.211379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.211451:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.211466:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591810432 00000100:00100000:1.0:1746143676.211469:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591810432 00002000:00100000:1.0:1746143676.211487:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4632575) req@ffff880093805880 x1830963591810432/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.211494:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805880 with x1830963591810432 ext(4194304->4632575) 00010000:00010000:1.0:1746143676.211499:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009519ac00/0xe984082ccd722fa3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4632575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe78 expref: 32 pid: 12618 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.211507:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009519ac00/0xe984082ccd722fa3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4632575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe78 expref: 32 pid: 12618 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746143676.211513:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093805880 00000100:00100000:1.0:1746143676.211522:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591810688 00000100:00100000:1.0:1746143676.211523:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591810688 00002000:00100000:1.0:1746143676.211533:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34a:0x0] (1519616->1523711) req@ffff880093806d80 x1830963591810688/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.211540:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806d80 with x1830963591810688 ext(1519616->1523711) 00002000:00010000:1.0:1746143676.211544:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093806d80 00000100:00100000:1.0:1746143676.211553:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 691 00000100:00100000:1.0:1746143676.211557:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963591810432:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143676.221776:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963591810432:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 10207us (10386us total) trans 17179872271 rc 0/0 00000100:00100000:1.0:1746143676.221789:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 691 00002000:00100000:1.0:1746143676.221798:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4632575) req@ffff880093805880 x1830963591810432/t17179872271(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/448 e 0 to 0 dl 1746143687 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.221807:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805880 with x1830963591810432 ext(4194304->4632575) 00010000:00010000:1.0:1746143676.221817:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009519ac00/0xe984082ccd722fa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4632575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe78 expref: 34 pid: 12618 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.221827:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009519ac00/0xe984082ccd722fa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4632575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe78 expref: 34 pid: 12618 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746143676.221833:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093805880 00000100:00100000:0.0:1746143676.225988:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.226200:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.226449:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4359 00000100:00100000:0.0:1746143676.226454:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591810944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143676.226463:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143676.226485:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009519ac00/0xe984082ccd722fa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4632575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe78 expref: 34 pid: 12618 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746143676.226501:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009519ac00/0xe984082ccd722fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4632575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe78 expref: 34 pid: 12618 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746143676.226523:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009519ac00/0xe984082ccd722fa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4632575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fe78 expref: 34 pid: 12618 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746143676.226541:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143676.226543:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143676.226550:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f79fa00/0xe984082ccd72303d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209feda expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143676.226558:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79fa00/0xe984082ccd72303d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209feda expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143676.226588:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f79fa00/0xe984082ccd72303d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209feda expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143676.226600:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593573376:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143676.226995:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143676.231039:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.231306:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.232336:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591811456 00000100:00100000:1.0:1746143676.232341:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591811456 00002000:00100000:1.0:1746143676.232363:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88012f187480 x1830963591811456/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.232370:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187480 with x1830963591811456 ext(1048576->2097151) 00002000:00010000:1.0:1746143676.232374:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f187480 00000100:00100000:1.0:1746143676.232388:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2935 00000100:00100000:1.0:1746143676.232395:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1962:x1830963591811200:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143676.247501:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1962:x1830963591811200:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15094us (16461us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143676.247691:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2935 00002000:00100000:1.0:1746143676.247706:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88012f187b80 x1830963591811200/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/440 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.247716:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187b80 with x1830963591811200 ext(2097152->3145727) 00002000:00010000:1.0:1746143676.247722:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f187b80 00000100:00100000:0.0:1746143676.251688:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.259959:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.263947:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.267741:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.268512:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591812096 00000100:00100000:1.0:1746143676.268520:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591812096 00000100:00100000:0.0:1746143676.282256:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.299290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.300896:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591812480 00000100:00100000:1.0:1746143676.300907:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591812480 00000100:00100000:1.0:1746143676.301031:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8638 00000100:00100000:1.0:1746143676.301040:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:27834:x1830963591812480:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.301062:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.301082:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a008b400/0xe984082ccd723052 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209feef expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.301107:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.301109:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.301118:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a008b400/0xe984082ccd723052 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209feef expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.301134:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a008b400/0xe984082ccd723052 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209feef expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.301177:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a008b400, rc 0) 00000100:00100000:1.0:1746143676.301230:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:27834:x1830963591812480:12345-192.168.202.48@tcp:101:cat.0 Request processed in 191us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143676.301236:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8638 00000100:00100000:0.0:1746143676.303295:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.303372:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.303400:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.305234:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2940 00000100:00100000:1.0:1746143676.305242:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963591813120:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143676.323920:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591813376 00000100:00100000:1.0:1746143676.323930:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591813376 00002000:00100000:1.0:1746143676.323974:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88013691b480 x1830963591813376/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.323983:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691b480 with x1830963591813376 ext(2097152->3145727) 00002000:00010000:1.0:1746143676.323988:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013691b480 00000100:00100000:0.0:1746143676.324349:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963591812608:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20720us (21062us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143676.324357:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2938 00002000:00100000:0.0:1746143676.324364:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012e1e0380 x1830963591812608/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/440 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143676.324371:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0380 with x1830963591812608 ext(2097152->3145727) 00002000:00010000:0.0:1746143676.324374:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e1e0380 00000100:00100000:0.0:1746143676.324392:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2942 00000100:00100000:0.0:1746143676.324397:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963591813632:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143676.324603:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2943 00000100:00100000:1.0:1746143676.324608:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963591813376:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143676.354384:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963591813120:12345-192.168.202.48@tcp:3:cat.0 Request processed in 49132us (50971us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143676.354396:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2940 00002000:00100000:1.0:1746143676.354408:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88012e1e1c00 x1830963591813120/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/440 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.354416:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e1c00 with x1830963591813120 ext(3145728->4194303) 00002000:00010000:1.0:1746143676.354423:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e1e1c00 00000100:00100000:0.0:1746143676.364523:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.364608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.364902:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591814144 00000100:00100000:1.0:1746143676.364912:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591814144 00000100:00100000:1.0:1746143676.364970:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591814016 00000100:00100000:1.0:1746143676.364973:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591814016 00000100:00100000:1.0:1746143676.364992:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8639 00000100:00100000:1.0:1746143676.365000:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963591814144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.365030:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.365049:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c591200/0xe984082ccd723059 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fefd expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.365072:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.365074:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.365083:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c591200/0xe984082ccd723059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fefd expref: 28 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.365099:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c591200/0xe984082ccd723059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fefd expref: 28 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.365110:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c591200, rc 0) 00000100:00100000:1.0:1746143676.365190:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1964:x1830963591814144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 189us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143676.365197:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8639 00000100:00100000:1.0:1746143676.365211:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8640 00000100:00100000:1.0:1746143676.365215:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963591814016:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.365223:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.365232:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c591c00/0xe984082ccd723060 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209fef6 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143676.365274:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593573888:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143676.365340:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143676.365651:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963591813376:12345-192.168.202.48@tcp:3:cat.0 Request processed in 41041us (41807us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143676.365660:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2943 00002000:00100000:1.0:1746143676.365669:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88013691b480 x1830963591813376/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/440 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.365678:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691b480 with x1830963591813376 ext(2097152->3145727) 00002000:00010000:1.0:1746143676.365682:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013691b480 00002000:00010000:1.0:1746143676.374247:0:25369:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime: 1746143673 -> 1746143675 00002000:00010000:1.0:1746143676.374388:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143673 -> 1746143676 00002000:00010000:1.0:1746143676.374390:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime: 1746143674 -> 1746143675 00000100:00100000:1.0:1746143676.374417:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593573888:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143676.374452:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c591c00/0xe984082ccd723060 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fef6 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.374467:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c591c00/0xe984082ccd723060 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fef6 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.374493:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c591c00, rc 0) 00000100:00100000:1.0:1746143676.374544:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963591814016:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9326us (9933us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143676.374553:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8640 00000100:00100000:0.0:1746143676.382878:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.391409:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.392028:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591814656 00000100:00100000:1.0:1746143676.392038:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591814656 00002000:00100000:1.0:1746143676.392085:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88012e1e0700 x1830963591814656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.392094:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0700 with x1830963591814656 ext(4194304->4898815) 00002000:00010000:1.0:1746143676.392101:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e0700 00000100:00100000:1.0:1746143676.392129:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2945 00000100:00100000:1.0:1746143676.392136:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963591814656:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143676.397671:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591814784 00000100:00100000:1.0:1746143676.397680:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591814784 00000100:00100000:1.0:1746143676.397734:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8641 00000100:00100000:1.0:1746143676.397743:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963591814784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.397765:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.397783:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c590000/0xe984082ccd723067 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ff04 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143676.397839:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593574016:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143676.397921:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143676.405428:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593574016:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143676.405460:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c590000/0xe984082ccd723067 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff04 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.405475:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c590000/0xe984082ccd723067 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff04 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.405489:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c590000, rc 0) 00000100:00100000:1.0:1746143676.405544:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963591814784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7801us (8301us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143676.405552:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8641 00000100:00100000:1.0:1746143676.406428:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963591814656:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14290us (15026us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143676.406436:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2945 00002000:00100000:1.0:1746143676.406446:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88012e1e0700 x1830963591814656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/440 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.406455:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0700 with x1830963591814656 ext(4194304->4898815) 00002000:00010000:1.0:1746143676.406460:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e0700 00000100:00100000:0.0:1746143676.412853:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.413274:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.413308:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591815168 00000100:00100000:1.0:1746143676.413317:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591815168 00000100:00100000:1.0:1746143676.413370:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8642 00000100:00100000:1.0:1746143676.413377:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963591815168:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.413395:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.413412:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c591a00/0xe984082ccd72306e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ff0b expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143676.413464:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593574144:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143676.413535:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143676.415178:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593574144:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143676.415205:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c591a00/0xe984082ccd72306e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff0b expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.415217:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c591a00/0xe984082ccd72306e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff0b expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.415235:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c591a00, rc 0) 00000100:00100000:1.0:1746143676.415495:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963591815168:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2116us (2219us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143676.415503:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8642 00000100:00100000:0.0:1746143676.436554:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.440240:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.440307:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.443448:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.443534:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591815936 00000100:00100000:1.0:1746143676.443543:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591815936 00000100:00100000:1.0:1746143676.443590:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8643 00000100:00100000:1.0:1746143676.443598:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:27843:x1830963591815936:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143676.443615:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.443632:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c590200/0xe984082ccd723098 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ff19 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.443660:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f79fa00/0xe984082ccd72303d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209feda expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.443670:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e62f800/0xe984082ccd72304b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fee8 expref: 35 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.443676:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.443677:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.443680:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c590200/0xe984082ccd723098 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff19 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.443707:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e62f800/0xe984082ccd72304b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fee8 expref: 35 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.443717:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e62f800/0xe984082ccd72304b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fee8 expref: 35 pid: 8497 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746143676.443728:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593574272:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143676.443816:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f79fa00/0xe984082ccd72303d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209feda expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.443824:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f79fa00/0xe984082ccd72303d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209feda expref: 27 pid: 8497 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746143676.443832:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593574400:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143676.443852:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143676.447045:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593574272:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143676.447056:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593574400:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143676.447085:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c590200/0xe984082ccd723098 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3022848->3039231] (req 3022848->3039231) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff19 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.447103:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c590200, rc 0) 00000100:00100000:1.0:1746143676.447166:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:27843:x1830963591815936:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3568us (3727us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143676.447175:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8643 00000100:00100000:0.0:1746143676.452123:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.453494:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.460801:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.461044:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591816448 00000100:00100000:1.0:1746143676.461052:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591816448 00002000:00100000:1.0:1746143676.461093:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3022848->3026943) req@ffff8800a5d80a80 x1830963591816448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.461103:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80a80 with x1830963591816448 ext(3022848->3026943) 00002000:00010000:1.0:1746143676.461108:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80a80 00000100:00100000:1.0:1746143676.461137:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2946 00000100:00100000:1.0:1746143676.461170:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963591816448:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143676.461325:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963591816448:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 155us (524us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143676.461331:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2946 00002000:00100000:1.0:1746143676.461336:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3022848->3026943) req@ffff8800a5d80a80 x1830963591816448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.461343:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80a80 with x1830963591816448 ext(3022848->3026943) 00002000:00010000:1.0:1746143676.461346:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80a80 00000100:00100000:0.0:1746143676.465097:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.484961:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.485349:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591816832 00000100:00100000:1.0:1746143676.485358:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591816832 00000100:00100000:0.0:1746143676.487991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.488130:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591816960 00000100:00100000:1.0:1746143676.488136:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591816960 00002000:00100000:1.0:1746143676.488199:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3022848->3039231) req@ffff8800a5d81500 x1830963591816960/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 16872/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.488208:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81500 with x1830963591816960 ext(3022848->3039231) 00010000:00010000:1.0:1746143676.488214:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c590200/0xe984082ccd723098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff19 expref: 34 pid: 25369 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.488226:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c590200/0xe984082ccd723098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff19 expref: 34 pid: 25369 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746143676.488233:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d81500 00000100:00100000:1.0:1746143676.488261:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 693 00000100:00100000:1.0:1746143676.488267:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591816960:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143676.488663:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963591816960:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 394us (671us total) trans 17179872272 rc 0/0 00000100:00100000:1.0:1746143676.488673:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 693 00002000:00100000:1.0:1746143676.488678:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3022848->3039231) req@ffff8800a5d81500 x1830963591816960/t17179872272(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 16872/448 e 0 to 0 dl 1746143687 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.488684:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81500 with x1830963591816960 ext(3022848->3039231) 00010000:00010000:1.0:1746143676.488688:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c590200/0xe984082ccd723098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff19 expref: 36 pid: 25369 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.488697:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c590200/0xe984082ccd723098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3039231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff19 expref: 36 pid: 25369 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746143676.488702:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d81500 00000100:00100000:0.0:1746143676.490759:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.494898:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.497385:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.508889:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.508943:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.509205:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4365 00000100:00100000:1.0:1746143676.509211:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963591817728:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143676.509218:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143676.509239:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a008b400/0xe984082ccd723052 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209feef expref: 31 pid: 25369 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.509250:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a008b400/0xe984082ccd723052 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209feef expref: 31 pid: 25369 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.509329:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a008b400/0xe984082ccd723052 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209feef expref: 31 pid: 25369 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.509341:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.509344:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.509351:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c37ee00/0xe984082ccd7230a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff27 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.509359:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c37ee00/0xe984082ccd7230a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff27 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.509392:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c37ee00/0xe984082ccd7230a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff27 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143676.509404:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593575168:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143676.513048:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143676.519383:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593575168:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143676.519406:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143676.519453:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963591817728:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10240us (10507us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143676.519463:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4365 00000100:00100000:0.0:1746143676.539766:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591817984 00000100:00100000:0.0:1746143676.539776:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591817984 00002000:00100000:0.0:1746143676.539823:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2957312->2961407) req@ffff88009bfe0380 x1830963591817984/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143676.539833:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0380 with x1830963591817984 ext(2957312->2961407) 00002000:00010000:0.0:1746143676.539838:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe0380 00000100:00100000:0.0:1746143676.540269:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2949 00000100:00100000:0.0:1746143676.540277:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963591817984:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143676.540510:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963591817984:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 232us (829us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143676.540516:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2949 00002000:00100000:0.0:1746143676.540522:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2957312->2961407) req@ffff88009bfe0380 x1830963591817984/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143676.540529:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0380 with x1830963591817984 ext(2957312->2961407) 00002000:00010000:0.0:1746143676.540532:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe0380 00000100:00100000:0.0:1746143676.554123:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.554222:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591818240 00000100:00100000:1.0:1746143676.554232:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591818240 00000100:00100000:1.0:1746143676.554339:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8066 00000100:00100000:1.0:1746143676.554348:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:27849:x1830963591818240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.554376:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.554395:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591e00/0xe984082ccd7230ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ff2e expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.554508:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591c00/0xe984082ccd7230b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554525:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591c00/0xe984082ccd7230b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554536:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591c00/0xe984082ccd7230b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554548:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591800/0xe984082ccd7230bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554554:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591800/0xe984082ccd7230bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554558:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591800/0xe984082ccd7230bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554661:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591600/0xe984082ccd7230c2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554670:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591600/0xe984082ccd7230c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554675:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591600/0xe984082ccd7230c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143676.554683:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143676.554766:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591c00/0xe984082ccd7230b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554773:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591c00/0xe984082ccd7230b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554779:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591c00/0xe984082ccd7230b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554789:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c591c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143676.554792:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591c00/0xe984082ccd7230b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554799:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591c00/0xe984082ccd7230b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554809:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143676.554812:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143676.554816:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591c00/0xe984082ccd7230b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554820:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591c00/0xe984082ccd7230b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554834:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591800/0xe984082ccd7230bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554838:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591800/0xe984082ccd7230bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554842:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591800/0xe984082ccd7230bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554846:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c591800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143676.554848:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591800/0xe984082ccd7230bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554852:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591800/0xe984082ccd7230bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554858:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74600) 00010000:00010000:1.0:1746143676.554860:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143676.554862:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591800/0xe984082ccd7230bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554867:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591800/0xe984082ccd7230bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.554904:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591e00/0xe984082ccd7230ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff2e expref: 264 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.554916:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591600/0xe984082ccd7230c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff2e expref: 263 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.554922:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143676.554924:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143676.554926:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c591600, rc 0) 00000100:00100000:1.0:1746143676.556462:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+263:27849:x1830963591818240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2105us (2338us total) trans 8589942096 rc 0/0 00000100:00100000:1.0:1746143676.556472:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8066 00000100:00100000:0.0:1746143676.561373:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.566203:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591818368 00000100:00100000:1.0:1746143676.566216:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591818368 00000100:00100000:0.0:1746143676.566669:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.567198:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 513 00000100:00100000:1.0:1746143676.567208:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+263:1963:x1830963591818368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143676.567225:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143676.567251:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591600/0xe984082ccd7230c2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff2e expref: 263 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.567280:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143676.567286:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143676.567333:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:1963:x1830963591818368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 126us (5970us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143676.567340:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 513 00000100:00100000:0.0:1746143676.570340:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.570399:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591818624 00000100:00100000:1.0:1746143676.570403:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591818624 00000100:00100000:1.0:1746143676.570445:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8647 00000100:00100000:1.0:1746143676.570450:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963591818624:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.570460:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.570480:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c591800/0xe984082ccd7230d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ff3c expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143676.570513:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593575424:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143676.571532:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1c00 going to sleep for 11 seconds 00002000:00010000:1.0:1746143676.581953:0:25369:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime: 1746143675 -> 1746143676 00002000:00010000:1.0:1746143676.581965:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143675 -> 1746143676 00002000:00010000:1.0:1746143676.581967:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime: 1746143675 -> 1746143676 00000100:00100000:1.0:1746143676.582011:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593575424:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143676.582053:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c591800/0xe984082ccd7230d7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff3c expref: 31 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.582073:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c591800/0xe984082ccd7230d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff3c expref: 31 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.582551:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c591800, rc 0) 00000100:00100000:1.0:1746143676.582630:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963591818624:12345-192.168.202.48@tcp:101:cat.0 Request processed in 12177us (12290us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143676.582639:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8647 00000100:00100000:0.0:1746143676.595593:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.595689:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591818880 00000100:00100000:1.0:1746143676.595699:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591818880 00002000:00100000:1.0:1746143676.595748:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a5d82d80 x1830963591818880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 504/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.595759:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830963591818880 ext(1048576->2097151) 00002000:00010000:1.0:1746143676.595765:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d82d80 00000100:00100000:1.0:1746143676.595785:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2950 00000100:00100000:1.0:1746143676.595794:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963591818880:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143676.612567:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963591818880:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16759us (16971us total) trans 0 rc 999424/999424 00000100:00100000:1.0:1746143676.612579:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2950 00002000:00100000:1.0:1746143676.612592:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a5d82d80 x1830963591818880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 504/440 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.612602:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830963591818880 ext(1048576->2097151) 00002000:00010000:1.0:1746143676.612608:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d82d80 00000100:00100000:0.0:1746143676.624757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.624861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.629312:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8648 00000100:00100000:1.0:1746143676.629333:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591819008:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.629356:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.629377:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c591e00/0xe984082ccd7230de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ff43 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143676.629438:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593575552:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143676.629546:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143676.639848:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593575552:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143676.639882:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c591e00/0xe984082ccd7230de lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff43 expref: 36 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.639895:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c591e00/0xe984082ccd7230de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff43 expref: 36 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.639916:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c591e00, rc 0) 00000100:00100000:1.0:1746143676.639975:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591819008:12345-192.168.202.48@tcp:101:cat.0 Request processed in 10650us (15228us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143676.639983:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8648 00000100:00100000:0.0:1746143676.647352:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.648471:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591819264 00000100:00100000:1.0:1746143676.648482:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591819264 00000100:00100000:1.0:1746143676.648618:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8650 00000100:00100000:1.0:1746143676.648626:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:27849:x1830963591819264:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.648646:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.648664:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c590e00/0xe984082ccd7230ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ff51 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.648697:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c37fa00/0xe984082ccd72309f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3141632->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff20 expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.648705:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143676.648707:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143676.648710:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c590e00/0xe984082ccd7230ec lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff51 expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.648737:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c37fa00/0xe984082ccd72309f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3141632->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff20 expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.648750:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c37fa00/0xe984082ccd72309f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3141632->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff20 expref: 27 pid: 8497 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746143676.648762:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593575808:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143676.651448:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143676.651849:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.655686:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593575808:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143676.655720:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c590e00/0xe984082ccd7230ec lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff51 expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.655738:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c590e00, rc 0) 00000100:00100000:1.0:1746143676.655847:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:27849:x1830963591819264:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7220us (8503us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143676.655856:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8650 00000100:00100000:0.0:1746143676.656407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.656546:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591819520 00000100:00100000:1.0:1746143676.656552:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591819520 00002000:00100000:1.0:1746143676.656591:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3141632->3145727) req@ffff88009445a300 x1830963591819520/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 4584/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.656599:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445a300 with x1830963591819520 ext(3141632->3145727) 00010000:00010000:1.0:1746143676.656605:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c37fa00/0xe984082ccd72309f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3141632->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff20 expref: 28 pid: 8497 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.656618:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c37fa00/0xe984082ccd72309f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3141632->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff20 expref: 28 pid: 8497 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746143676.656629:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009445a300 00000100:00100000:1.0:1746143676.656657:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 694 00000100:00100000:1.0:1746143676.656665:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1964:x1830963591819520:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143676.657131:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1964:x1830963591819520:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 467us (725us total) trans 17179872273 rc 0/0 00000100:00100000:1.0:1746143676.657158:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 694 00002000:00100000:1.0:1746143676.657163:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3141632->3145727) req@ffff88009445a300 x1830963591819520/t17179872273(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 4584/448 e 0 to 0 dl 1746143687 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.657171:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445a300 with x1830963591819520 ext(3141632->3145727) 00010000:00010000:1.0:1746143676.657175:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c37fa00/0xe984082ccd72309f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3141632->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff20 expref: 30 pid: 8497 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.657183:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c37fa00/0xe984082ccd72309f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3141632->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff20 expref: 30 pid: 8497 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746143676.657189:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009445a300 00000100:00100000:0.0:1746143676.661038:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.668547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.672440:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.672526:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591819904 00000100:00100000:1.0:1746143676.672534:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591819904 00002000:00100000:1.0:1746143676.672581:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1474560->1523711) req@ffff880094459f80 x1830963591819904/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.672591:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459f80 with x1830963591819904 ext(1474560->1523711) 00010000:00010000:1.0:1746143676.672601:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009331ec00/0xe984082ccd72302f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fecc expref: 30 pid: 8495 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.672618:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009331ec00/0xe984082ccd72302f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fecc expref: 30 pid: 8495 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746143676.672625:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094459f80 00000100:00100000:1.0:1746143676.672657:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 695 00000100:00100000:1.0:1746143676.672664:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963591819904:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143676.673562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.673678:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591820160 00000100:00100000:1.0:1746143676.673683:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591820160 00002000:00100000:1.0:1746143676.673704:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094459880 x1830963591820160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.673711:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459880 with x1830963591820160 ext(2097152->3145727) 00002000:00010000:1.0:1746143676.673715:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094459880 00000100:00100000:1.0:1746143676.673729:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2951 00000100:00100000:1.0:1746143676.673734:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963591820160:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143676.681726:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963591819904:12345-192.168.202.48@tcp:4:cat.0 Request processed in 9050us (9285us total) trans 21474839546 rc 0/0 00000100:00100000:1.0:1746143676.681740:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 695 00002000:00100000:1.0:1746143676.681752:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1474560->1523711) req@ffff880094459f80 x1830963591819904/t21474839546(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/448 e 0 to 0 dl 1746143687 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.681761:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459f80 with x1830963591819904 ext(1474560->1523711) 00010000:00010000:1.0:1746143676.681772:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009331ec00/0xe984082ccd72302f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fecc expref: 32 pid: 8495 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.681794:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009331ec00/0xe984082ccd72302f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->1523711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fecc expref: 32 pid: 8495 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746143676.681801:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094459f80 00000100:00100000:0.0:1746143676.691904:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.698189:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963591820160:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24447us (24620us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143676.698201:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2951 00002000:00100000:1.0:1746143676.698214:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094459880 x1830963591820160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/440 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.698223:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459880 with x1830963591820160 ext(2097152->3145727) 00002000:00010000:1.0:1746143676.698228:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094459880 00000100:00100000:0.0:1746143676.706029:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.708410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.708439:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.708453:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.708469:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.708527:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591821312 00000100:00100000:1.0:1746143676.708533:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591821312 00000100:00100000:1.0:1746143676.708574:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8067 00000100:00100000:1.0:1746143676.708582:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:27854:x1830963591821312:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143676.708601:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.708615:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591c00/0xe984082ccd723108 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ff6d expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.708720:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716c00/0xe984082ccd72310f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.708733:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716c00/0xe984082ccd72310f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.708743:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716c00/0xe984082ccd72310f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.708755:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd723116 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.708760:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd723116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.708764:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd723116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.708870:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717200/0xe984082ccd72311d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.708879:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717200/0xe984082ccd72311d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.708885:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717200/0xe984082ccd72311d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143676.708893:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143676.708977:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716c00/0xe984082ccd72310f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.708984:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716c00/0xe984082ccd72310f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.708990:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716c00/0xe984082ccd72310f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.708996:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a716c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143676.709011:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716c00/0xe984082ccd72310f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.709018:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716c00/0xe984082ccd72310f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.709029:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143676.709032:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143676.709037:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716c00/0xe984082ccd72310f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.709041:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716c00/0xe984082ccd72310f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.709067:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd723116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.709072:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd723116 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.709076:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd723116 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.709081:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a717a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143676.709083:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd723116 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.709088:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd723116 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.709094:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74200) 00010000:00010000:1.0:1746143676.709095:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143676.709097:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd723116 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.709101:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd723116 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143676.709136:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c591c00/0xe984082ccd723108 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff6d expref: 265 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.709168:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717200/0xe984082ccd72311d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff6d expref: 264 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.709174:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143676.709176:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143676.709178:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a717200, rc 0) 00000100:00100000:1.0:1746143676.709218:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:27854:x1830963591821312:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 637us (815us total) trans 8589942097 rc 0/0 00000100:00100000:1.0:1746143676.709224:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8067 00000100:00100000:1.0:1746143676.709246:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2952 00000100:00100000:1.0:1746143676.709252:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963591820672:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143676.709320:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2954 00000100:00100000:1.0:1746143676.709326:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1964:x1830963591821440:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143676.713462:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.734410:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1964:x1830963591821440:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25071us (25926us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143676.734422:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2954 00002000:00100000:1.0:1746143676.734434:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009445bb80 x1830963591821440/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/440 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.734443:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445bb80 with x1830963591821440 ext(1048576->2097151) 00002000:00010000:1.0:1746143676.734449:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009445bb80 00000100:00100000:1.0:1746143676.735797:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963591820672:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26539us (27350us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143676.735805:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2952 00002000:00100000:1.0:1746143676.735814:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88009445aa00 x1830963591820672/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/440 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.735822:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445aa00 with x1830963591820672 ext(1048576->2097151) 00002000:00010000:1.0:1746143676.735826:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445aa00 00000100:00100000:0.0:1746143676.747638:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.747736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.748559:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591822208 00000100:00100000:1.0:1746143676.748564:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591822208 00010000:00010000:1.0:1746143676.748592:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c37ee00/0xe984082ccd7230a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff27 expref: 21 pid: 8497 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746143676.748633:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4368 00000100:00100000:1.0:1746143676.748640:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963591822208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143676.748653:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143676.748678:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c37ee00/0xe984082ccd7230a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff27 expref: 21 pid: 8497 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.748690:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c37ee00/0xe984082ccd7230a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff27 expref: 21 pid: 8497 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.748709:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c37ee00/0xe984082ccd7230a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff27 expref: 21 pid: 8497 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.748726:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.748727:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.748734:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130848c00/0xe984082ccd723101 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff66 expref: 31 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.748741:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130848c00/0xe984082ccd723101 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff66 expref: 31 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.748765:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130848c00/0xe984082ccd723101 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff66 expref: 31 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143676.748775:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593576704:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143676.748982:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.749021:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143676.751020:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591822336 00000100:00100000:0.0:1746143676.751030:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591822336 00000100:00100000:0.0:1746143676.751085:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8655 00000100:00100000:0.0:1746143676.751093:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1962:x1830963591822336:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143676.751113:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143676.751130:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c37f600/0xe984082ccd723132 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ff7b expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143676.751182:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143676.751194:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c37f600/0xe984082ccd723132 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff7b expref: 30 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143676.751205:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c37f600/0xe984082ccd723132 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff7b expref: 30 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143676.751218:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c37f600, rc 0) 00000100:00100000:0.0:1746143676.751259:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1962:x1830963591822336:12345-192.168.202.48@tcp:101:cat.0 Request processed in 166us (2276us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143676.751264:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8655 00000100:00100000:1.0:1746143676.755071:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593576704:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143676.755093:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143676.755167:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963591822208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6526us (7428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143676.755178:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4368 00000100:00100000:0.0:1746143676.758721:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.758755:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591822592 00000100:00100000:0.0:1746143676.758763:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591822592 00000100:00100000:0.0:1746143676.763026:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.763059:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.763695:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.764044:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591822976 00000100:00100000:1.0:1746143676.764055:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591822976 00002000:00100000:1.0:1746143676.764107:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f0ad180 x1830963591822976/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.764116:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad180 with x1830963591822976 ext(3145728->4194303) 00010000:00010000:1.0:1746143676.764125:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c590e00/0xe984082ccd7230ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff51 expref: 37 pid: 25369 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.764167:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c590e00/0xe984082ccd7230ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff51 expref: 37 pid: 25369 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746143676.764174:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f0ad180 00000100:00100000:1.0:1746143676.764199:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591823104 00000100:00100000:1.0:1746143676.764201:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591823104 00002000:00100000:1.0:1746143676.764215:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f0ae300 x1830963591823104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.764221:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae300 with x1830963591823104 ext(2097152->3145727) 00002000:00010000:1.0:1746143676.764225:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ae300 00000100:00100000:1.0:1746143676.764234:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591823232 00000100:00100000:1.0:1746143676.764236:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591823232 00002000:00100000:1.0:1746143676.764243:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f0adc00 x1830963591823232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.764248:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0adc00 with x1830963591823232 ext(3145728->4194303) 00002000:00010000:1.0:1746143676.764250:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0adc00 00000100:00100000:1.0:1746143676.764260:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 697 00000100:00100000:1.0:1746143676.764266:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963591822976:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143676.764973:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2955 00000100:00100000:1.0:1746143676.764982:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963591823104:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143676.771899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.771944:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.775286:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2958 00000100:00100000:0.0:1746143676.775303:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963591823872:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143676.805533:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591823104:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 40539us (42459us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143676.805545:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2955 00002000:00100000:1.0:1746143676.805558:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f0ae300 x1830963591823104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/440 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.805568:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae300 with x1830963591823104 ext(2097152->3145727) 00002000:00010000:1.0:1746143676.805574:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ae300 00000100:00100000:0.0:1746143676.806978:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.812888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.812911:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591824128 00000100:00100000:0.0:1746143676.812918:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591824128 00000100:00100000:0.0:1746143676.812959:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8659 00000100:00100000:0.0:1746143676.812966:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:27849:x1830963591824128:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143676.812982:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143676.812997:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c37f000/0xe984082ccd72314e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ff97 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143676.813027:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143676.813031:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd72312b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3809280->4022271] (req 3809280->4022271) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff74 expref: 40 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143676.813037:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143676.813040:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c37f000/0xe984082ccd72314e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff97 expref: 40 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143676.813064:0:12618:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd72312b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3809280->4022271] (req 3809280->4022271) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff74 expref: 40 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143676.813075:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c37f000/0xe984082ccd72314e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff97 expref: 40 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143676.813083:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c37f000, rc 0) 00000100:00100000:0.0:1746143676.814819:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:27849:x1830963591824128:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1841us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143676.814830:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8659 00000100:00100000:0.0:1746143676.828910:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.829423:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591824256 00000100:00100000:1.0:1746143676.829430:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591824256 00010000:00010000:1.0:1746143676.829455:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130848c00/0xe984082ccd723101 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff66 expref: 32 pid: 8497 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746143676.829488:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4369 00000100:00100000:1.0:1746143676.829495:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963591824256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143676.829508:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143676.829526:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130848c00/0xe984082ccd723101 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff66 expref: 32 pid: 8497 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.829535:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130848c00/0xe984082ccd723101 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff66 expref: 32 pid: 8497 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.829557:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130848c00/0xe984082ccd723101 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff66 expref: 32 pid: 8497 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.829574:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143676.829589:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963591824256:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 96us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143676.829594:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4369 00000100:00100000:0.0:1746143676.836437:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.836473:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.837064:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591824512 00000100:00100000:1.0:1746143676.837070:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591824512 00010000:00010000:1.0:1746143676.837094:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130849c00/0xe984082ccd723139 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff82 expref: 22 pid: 8495 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746143676.837576:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4371 00000100:00100000:1.0:1746143676.837584:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963591824512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143676.837597:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143676.837617:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130849c00/0xe984082ccd723139 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff82 expref: 22 pid: 8495 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746143676.837625:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130849c00/0xe984082ccd723139 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff82 expref: 22 pid: 8495 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746143676.837641:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130849c00/0xe984082ccd723139 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff82 expref: 22 pid: 8495 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746143676.838910:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.838912:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.838921:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7600/0xe984082ccd723147 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3649535) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff90 expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.838930:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7600/0xe984082ccd723147 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3649535) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff90 expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143676.838958:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143676.838966:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7600/0xe984082ccd723147 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3649535) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff90 expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143676.838977:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593577344:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143676.839072:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143676.839083:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143676.842660:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.843207:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593577472:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143676.843233:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7c00/0xe984082ccd723155 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff9e expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143676.843250:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7c7c00, rc 0) 00000100:00100000:0.0:1746143676.843275:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:27852:x1830963591824640:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4334us (6802us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143676.843282:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8660 00000100:00100000:0.0:1746143676.843886:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591825408 00000100:00100000:0.0:1746143676.843889:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591825408 00002000:00100000:0.0:1746143676.843909:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (4018176->4022271) req@ffff88012e1e2300 x1830963591825408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143676.843919:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e2300 with x1830963591825408 ext(4018176->4022271) 00010000:00010000:0.0:1746143676.843927:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd72312b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4022271) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff74 expref: 37 pid: 8497 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746143676.843938:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd72312b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4022271) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff74 expref: 37 pid: 8497 timeout: 855 lvb_type: 0 00002000:00010000:0.0:1746143676.843944:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e1e2300 00000100:00100000:0.0:1746143676.843958:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 699 00000100:00100000:0.0:1746143676.843965:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963591825408:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143676.844135:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963591825408:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 170us (342us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143676.844163:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 699 00002000:00100000:0.0:1746143676.844169:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (4018176->4022271) req@ffff88012e1e2300 x1830963591825408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746143687 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143676.844175:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e2300 with x1830963591825408 ext(4018176->4022271) 00010000:00010000:0.0:1746143676.844179:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd72312b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4022271) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff74 expref: 37 pid: 8497 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746143676.844187:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd72312b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4022271) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff74 expref: 37 pid: 8497 timeout: 855 lvb_type: 0 00002000:00010000:0.0:1746143676.844192:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e1e2300 00000100:00100000:0.0:1746143676.849050:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.852454:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591825920 00000100:00100000:1.0:1746143676.852465:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591825920 00002000:00100000:1.0:1746143676.852513:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3645440->3649535) req@ffff88012fc12300 x1830963591825920/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.852529:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12300 with x1830963591825920 ext(3645440->3649535) 00010000:00010000:1.0:1746143676.852539:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7600/0xe984082ccd723147 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff90 expref: 22 pid: 25369 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.852550:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7600/0xe984082ccd723147 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff90 expref: 22 pid: 25369 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746143676.852556:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fc12300 00000100:00100000:1.0:1746143676.852591:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 702 00000100:00100000:1.0:1746143676.852598:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591825920:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143676.852771:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591825920:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 173us (483us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143676.852777:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 702 00002000:00100000:1.0:1746143676.852783:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3645440->3649535) req@ffff88012fc12300 x1830963591825920/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/4536 e 0 to 0 dl 1746143687 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.852790:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12300 with x1830963591825920 ext(3645440->3649535) 00010000:00010000:1.0:1746143676.852794:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7600/0xe984082ccd723147 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff90 expref: 22 pid: 25369 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746143676.852802:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7600/0xe984082ccd723147 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff90 expref: 22 pid: 25369 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746143676.852808:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fc12300 00000100:00100000:0.0:1746143676.859802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.862543:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.871619:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.871663:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.881725:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.895877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.903751:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.906207:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.914486:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143676.915479:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.915701:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591827840 00000100:00100000:1.0:1746143676.915712:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591827840 00002000:00100000:1.0:1746143676.915759:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800a5c20380 x1830963591827840/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.915769:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20380 with x1830963591827840 ext(3145728->4194303) 00002000:00010000:1.0:1746143676.915776:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c20380 00000100:00100000:1.0:1746143676.915805:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591827968 00000100:00100000:1.0:1746143676.915807:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591827968 00002000:00100000:1.0:1746143676.915821:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a5c21c00 x1830963591827968/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.915828:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21c00 with x1830963591827968 ext(3145728->4194303) 00002000:00010000:1.0:1746143676.915831:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c21c00 00000100:00100000:1.0:1746143676.915847:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2962 00000100:00100000:1.0:1746143676.915855:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591827840:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143676.934374:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.934848:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591828096 00000100:00100000:1.0:1746143676.934859:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591828096 00000100:00100000:1.0:1746143676.934921:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8663 00000100:00100000:1.0:1746143676.934929:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963591828096:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143676.934950:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143676.934970:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a717200/0xe984082ccd72316a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae461209ffb3 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143676.934993:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.934995:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143676.935013:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a717200/0xe984082ccd72316a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ffb3 expref: 33 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.935031:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a717200/0xe984082ccd72316a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ffb3 expref: 33 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143676.935042:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a717200, rc 0) 00000100:00100000:1.0:1746143676.935095:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963591828096:12345-192.168.202.48@tcp:101:cat.0 Request processed in 166us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143676.935101:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8663 00000100:00100000:1.0:1746143676.937734:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591827840:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 21870us (23252us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143676.937743:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2962 00002000:00100000:1.0:1746143676.937752:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800a5c20380 x1830963591827840/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:72/0 lens 488/440 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.937760:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20380 with x1830963591827840 ext(3145728->4194303) 00002000:00010000:1.0:1746143676.937765:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c20380 00000100:00100000:0.0:1746143676.939242:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.940254:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591828352 00000100:00100000:1.0:1746143676.940264:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591828352 00002000:00100000:1.0:1746143676.940317:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a5c22d80 x1830963591828352/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/0 e 0 to 0 dl 1746143687 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.940327:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22d80 with x1830963591828352 ext(4194304->4898815) 00002000:00010000:1.0:1746143676.940331:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c22d80 00000100:00100000:1.0:1746143676.940365:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2964 00000100:00100000:1.0:1746143676.940374:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963591828352:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143676.949012:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143676.951458:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963591828352:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11082us (12222us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143676.951467:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2964 00002000:00100000:1.0:1746143676.951476:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a5c22d80 x1830963591828352/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:72/0 lens 488/440 e 0 to 0 dl 1746143687 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143676.951483:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22d80 with x1830963591828352 ext(4194304->4898815) 00002000:00010000:1.0:1746143676.951487:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c22d80 00000100:00100000:0.0:1746143676.964126:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.057835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.062212:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.065374:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.074079:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.074255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.082693:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591830144 00000100:00100000:1.0:1746143677.082700:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591830144 00000100:00100000:1.0:1746143677.082728:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3222 00000100:00100000:1.0:1746143677.082735:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:27866:x1830963591830144:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143677.082943:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:27866:x1830963591830144:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 208us (1675us total) trans 8589942101 rc 0/0 00000100:00100000:1.0:1746143677.082948:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3222 00000100:00100000:0.0:1746143677.084492:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.090695:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.090724:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.090753:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.090923:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.104386:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.104484:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591831040 00000100:00100000:1.0:1746143677.104494:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591831040 00002000:00100000:1.0:1746143677.104542:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2334720->2338815) req@ffff880130fd4380 x1830963591831040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.104551:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4380 with x1830963591831040 ext(2334720->2338815) 00002000:00010000:1.0:1746143677.104556:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd4380 00000100:00100000:1.0:1746143677.104589:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2967 00000100:00100000:1.0:1746143677.104596:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1965:x1830963591831040:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143677.104791:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1965:x1830963591831040:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 194us (414us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143677.104798:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2967 00002000:00100000:1.0:1746143677.104803:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2334720->2338815) req@ffff880130fd4380 x1830963591831040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.104811:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4380 with x1830963591831040 ext(2334720->2338815) 00002000:00010000:1.0:1746143677.104814:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd4380 00000100:00100000:0.0:1746143677.108845:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.110868:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591831296 00000100:00100000:1.0:1746143677.110881:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591831296 00002000:00100000:1.0:1746143677.110935:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1601535) req@ffff880130fd5500 x1830963591831296/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.110946:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5500 with x1830963591831296 ext(1048576->1601535) 00002000:00010000:1.0:1746143677.110951:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd5500 00000100:00100000:1.0:1746143677.110986:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2968 00000100:00100000:1.0:1746143677.111003:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1965:x1830963591831296:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143677.111307:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.115121:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.119319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.119349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.119562:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591831808 00000100:00100000:1.0:1746143677.119570:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591831808 00010000:00010000:1.0:1746143677.119607:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6a00/0xe984082ccd72315c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ffa5 expref: 35 pid: 12618 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746143677.119630:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591831936 00000100:00100000:1.0:1746143677.119632:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591831936 00000100:00100000:1.0:1746143677.119648:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4379 00000100:00100000:1.0:1746143677.119654:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591831808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143677.119669:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143677.119693:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6a00/0xe984082ccd72315c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ffa5 expref: 35 pid: 12618 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.119704:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6a00/0xe984082ccd72315c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ffa5 expref: 35 pid: 12618 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.119736:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143677.119771:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591831808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 117us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143677.119777:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4379 00000100:00100000:1.0:1746143677.119791:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 516 00000100:00100000:1.0:1746143677.119795:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+269:1965:x1830963591831936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143677.119802:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143677.119814:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a5da00/0xe984082ccd7231c5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209ffdd expref: 269 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.119831:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143677.119835:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143677.119845:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:1965:x1830963591831936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 50us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143677.119850:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 516 00000100:00100000:1.0:1746143677.120297:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1965:x1830963591831296:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9303us (11463us total) trans 0 rc 552960/552960 00000100:00100000:1.0:1746143677.120304:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2968 00002000:00100000:1.0:1746143677.120313:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1601535) req@ffff880130fd5500 x1830963591831296/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/440 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 552960/552960 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.120322:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5500 with x1830963591831296 ext(1048576->1601535) 00002000:00010000:1.0:1746143677.120326:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd5500 00000100:00100000:0.0:1746143677.121012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.121034:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591832064 00000100:00100000:0.0:1746143677.121038:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591832064 00000100:00100000:1.0:1746143677.121910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.125050:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.125565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.125772:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591832320 00000100:00100000:1.0:1746143677.125781:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591832320 00000100:00100000:1.0:1746143677.126115:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591832448 00000100:00100000:1.0:1746143677.126118:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591832448 00000100:00100000:0.0:1746143677.126907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.127571:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.136719:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.139908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.139983:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.145199:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.150733:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.154260:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591833984 00000100:00100000:0.0:1746143677.154267:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591833984 00010000:00010000:0.0:1746143677.154296:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a5c000/0xe984082ccd7231a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ffd6 expref: 37 pid: 25369 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746143677.154331:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4382 00000100:00100000:0.0:1746143677.154337:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963591833984:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143677.154349:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143677.154370:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0a5c000/0xe984082ccd7231a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ffd6 expref: 37 pid: 25369 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.154379:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0a5c000/0xe984082ccd7231a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ffd6 expref: 37 pid: 25369 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.154398:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a5c000/0xe984082ccd7231a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ffd6 expref: 37 pid: 25369 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.154418:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.154419:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.154424:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd7231ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0000 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.154431:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd7231ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0000 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.154451:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd7231ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0000 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143677.154458:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593580032:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143677.154507:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f039c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143677.157443:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593580032:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143677.157457:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143677.157479:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963591833984:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3142us (3278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143677.157486:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4382 00000100:00100000:0.0:1746143677.158107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.159363:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.165401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.170854:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.170983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.175632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.175697:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591835008 00000100:00100000:0.0:1746143677.175703:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591835008 00002000:00100000:0.0:1746143677.175735:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4317183) req@ffff8801305c9180 x1830963591835008/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.175744:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9180 with x1830963591835008 ext(4194304->4317183) 00010000:00010000:0.0:1746143677.175750:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a5c600/0xe984082ccd7231e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4317183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fff9 expref: 38 pid: 8495 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.175760:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a5c600/0xe984082ccd7231e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4317183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fff9 expref: 38 pid: 8495 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746143677.175766:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305c9180 00000100:00100000:0.0:1746143677.175780:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 707 00000100:00100000:0.0:1746143677.175786:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963591835008:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143677.180356:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.180398:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.180471:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591835136 00000100:00100000:1.0:1746143677.180481:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591835136 00010000:00010000:1.0:1746143677.180516:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a5c600/0xe984082ccd7231e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4317183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fff9 expref: 40 pid: 8495 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746143677.180645:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4383 00000100:00100000:1.0:1746143677.180652:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963591835136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143677.180665:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143677.180685:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a5c600/0xe984082ccd7231e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4317183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fff9 expref: 40 pid: 8495 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.180694:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0a5c600/0xe984082ccd7231e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4317183) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fff9 expref: 40 pid: 8495 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.180715:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a5c600/0xe984082ccd7231e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4317183) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fff9 expref: 40 pid: 8495 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.180895:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143677.180898:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143677.180905:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7e00/0xe984082ccd7231fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a000e expref: 33 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.180916:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7e00/0xe984082ccd7231fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a000e expref: 33 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.180949:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7e00/0xe984082ccd7231fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a000e expref: 33 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143677.180960:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593580416:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143677.181336:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143677.182729:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593580416:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143677.182746:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143677.182774:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963591835136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2122us (2428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143677.183037:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4383 00000100:00100000:0.0:1746143677.185837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.191566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.191615:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.208742:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.208781:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.221342:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.223657:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.223690:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.223712:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.223733:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.224048:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2978 00000100:00100000:1.0:1746143677.224057:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963591836928:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143677.228133:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.250569:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1962:x1830963591836928:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26501us (26865us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143677.250583:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2978 00002000:00100000:1.0:1746143677.250594:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a63a1880 x1830963591836928/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/440 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.250603:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a1880 with x1830963591836928 ext(3145728->4194303) 00002000:00010000:1.0:1746143677.250609:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a1880 00000100:00100000:1.0:1746143677.271706:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.271812:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591837824 00000100:00100000:0.0:1746143677.271822:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591837824 00000100:00100000:0.0:1746143677.271880:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8678 00000100:00100000:0.0:1746143677.271889:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+34:27876:x1830963591837824:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143677.271909:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143677.271927:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130849a00/0xe984082ccd723219 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a002a expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.271958:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7e00/0xe984082ccd7231fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a000e expref: 35 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.271966:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f79f400/0xe984082ccd723204 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0015 expref: 39 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143677.271972:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.271974:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.271977:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130849a00/0xe984082ccd723219 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4149248->4194303] (req 4149248->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a002a expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.272019:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f79f400/0xe984082ccd723204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0015 expref: 39 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143677.272032:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f79f400/0xe984082ccd723204 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0015 expref: 39 pid: 8495 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746143677.272044:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593580672:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143677.274389:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7e00/0xe984082ccd7231fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a000e expref: 35 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.274406:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7e00/0xe984082ccd7231fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a000e expref: 35 pid: 8497 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746143677.274691:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593580800:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143677.274755:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143677.275300:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.285078:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.285178:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591838208 00000100:00100000:1.0:1746143677.285188:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591838208 00010000:00010000:1.0:1746143677.285228:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7e00/0xe984082ccd7231fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a000e expref: 35 pid: 8497 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746143677.285269:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4385 00000100:00100000:1.0:1746143677.285278:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1964:x1830963591838208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143677.285291:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143677.285313:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7e00/0xe984082ccd7231fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a000e expref: 35 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.285325:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7e00/0xe984082ccd7231fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a000e expref: 35 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.285349:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7e00/0xe984082ccd7231fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a000e expref: 35 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.285382:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143677.285432:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091714e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+34:1964:x1830963591838208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 155us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143677.285439:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4385 00000100:00100000:0.0:1746143677.293930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.294196:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591838464 00000100:00100000:0.0:1746143677.294200:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591838464 00010000:00010000:0.0:1746143677.294219:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79f400/0xe984082ccd723204 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0015 expref: 42 pid: 8495 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746143677.294259:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4386 00000100:00100000:0.0:1746143677.294263:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963591838464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143677.294272:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143677.294290:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f79f400/0xe984082ccd723204 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0015 expref: 41 pid: 8495 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746143677.294299:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f79f400/0xe984082ccd723204 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0015 expref: 41 pid: 8495 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746143677.294312:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f79f400/0xe984082ccd723204 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0015 expref: 41 pid: 8495 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746143677.294318:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591838720 00000100:00100000:1.0:1746143677.294322:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591838720 00010000:00010000:0.0:1746143677.294323:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.294324:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.294329:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130849a00/0xe984082ccd723219 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a002a expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.294335:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130849a00/0xe984082ccd723219 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a002a expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143677.294348:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8070 00000100:00100000:1.0:1746143677.294353:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:27879:x1830963591838720:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143677.294359:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130849a00/0xe984082ccd723219 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a002a expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.294365:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143677.294368:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091717100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593580928:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143677.294377:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd723227 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0038 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143677.294431:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f033c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143677.294474:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd72322e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294486:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd72322e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294496:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd72322e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294509:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc400/0xe984082ccd723235 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294514:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc400/0xe984082ccd723235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294520:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc400/0xe984082ccd723235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294618:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc600/0xe984082ccd72323c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294626:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc600/0xe984082ccd72323c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294631:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc600/0xe984082ccd72323c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143677.294640:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143677.294712:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd72322e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294719:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd72322e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294725:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd72322e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294731:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801351bd600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143677.294734:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd72322e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294740:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd72322e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294747:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143677.294750:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143677.294753:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd72322e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.294756:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd72322e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143677.298021:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091717100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593580928:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143677.298038:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143677.298060:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963591838464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3796us (4041us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143677.298069:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4386 00010000:00010000:1.0:1746143677.298590:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc400/0xe984082ccd723235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.298600:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc400/0xe984082ccd723235 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.298606:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc400/0xe984082ccd723235 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.298611:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801351bc400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143677.298615:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc400/0xe984082ccd723235 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.298622:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc400/0xe984082ccd723235 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.298645:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74600) 00010000:00010000:1.0:1746143677.298648:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143677.298652:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc400/0xe984082ccd723235 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.298657:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc400/0xe984082ccd723235 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143677.298714:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd723227 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0038 expref: 271 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.298726:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc600/0xe984082ccd72323c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0038 expref: 270 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.298732:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143677.298735:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143677.299112:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bc600, rc 0) 00000100:00100000:1.0:1746143677.299504:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+270:27879:x1830963591838720:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5147us (5583us total) trans 8589942103 rc 0/0 00000100:00100000:1.0:1746143677.299510:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8070 00000100:00100000:0.0:1746143677.303113:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.303466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.303493:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591839488 00000100:00100000:0.0:1746143677.303503:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591839488 00000100:00100000:1.0:1746143677.303512:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.303555:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 517 00000100:00100000:0.0:1746143677.303562:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+270:1964:x1830963591839488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143677.303577:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143677.303602:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc600/0xe984082ccd72323c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0038 expref: 270 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.303617:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143677.303621:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143677.303662:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+269:1964:x1830963591839488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143677.303668:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 517 00000100:00100000:0.0:1746143677.304917:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.317884:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.319065:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.319871:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591840000 00000100:00100000:1.0:1746143677.319878:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591840000 00000100:00100000:0.0:1746143677.319902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143677.319910:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130849a00/0xe984082ccd723219 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a002a expref: 36 pid: 25369 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746143677.320104:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4388 00000100:00100000:0.0:1746143677.320110:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963591840256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143677.320118:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143677.320199:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f79f200/0xe984082ccd72320b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a001c expref: 35 pid: 8495 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746143677.320207:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f79f200/0xe984082ccd72320b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a001c expref: 35 pid: 8495 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746143677.320219:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f79f200/0xe984082ccd72320b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a001c expref: 35 pid: 8495 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746143677.320233:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.320235:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.320241:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f79ea00/0xe984082ccd723251 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3289087) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0046 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.320248:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f79ea00/0xe984082ccd723251 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3289087) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0046 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.320275:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f79ea00/0xe984082ccd723251 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3289087) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0046 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143677.320285:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593581440:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143677.320330:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143677.320542:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4389 00000100:00100000:1.0:1746143677.320549:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+36:1964:x1830963591840000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143677.320557:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143677.320570:0:9890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143676 -> 1746143677 00002000:00010000:1.0:1746143677.320572:0:9890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143676 -> 1746143677 00010000:00010000:1.0:1746143677.320576:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130849a00/0xe984082ccd723219 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a002a expref: 36 pid: 25369 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.320585:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130849a00/0xe984082ccd723219 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a002a expref: 36 pid: 25369 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.320599:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130849a00/0xe984082ccd723219 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a002a expref: 36 pid: 25369 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.320622:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143677.320623:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143677.320628:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd72324a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a003f expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.320635:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd72324a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a003f expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.320655:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd72324a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a003f expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143677.320664:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593581568:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143677.320698:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143677.323657:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593581568:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143677.323667:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143677.323684:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1964:x1830963591840000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3136us (5811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143677.323690:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4389 00000100:00100000:0.0:1746143677.325229:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.326363:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.336392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.337181:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591840896 00000100:00100000:1.0:1746143677.337192:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591840896 00002000:00100000:1.0:1746143677.337243:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff88009c3fb800 x1830963591840896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.337253:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb800 with x1830963591840896 ext(4894720->4898815) 00002000:00010000:1.0:1746143677.337258:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb800 00000100:00100000:1.0:1746143677.337293:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2983 00000100:00100000:1.0:1746143677.337302:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963591840896:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143677.338890:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963591840896:12345-192.168.202.48@tcp:3:cat.0 Request processed in 1582us (2499us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143677.338899:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2983 00002000:00100000:1.0:1746143677.338906:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff88009c3fb800 x1830963591840896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.338915:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb800 with x1830963591840896 ext(4894720->4898815) 00002000:00010000:1.0:1746143677.338919:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb800 00000100:00100000:0.0:1746143677.353678:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.406400:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.409504:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.415593:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.418633:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591841536 00000100:00100000:1.0:1746143677.418649:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591841536 00010000:00010000:1.0:1746143677.418693:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7600/0xe984082ccd723212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0023 expref: 36 pid: 8497 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746143677.418737:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4390 00000100:00100000:1.0:1746143677.418746:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+36:1962:x1830963591841536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143677.418761:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143677.418833:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.418930:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143677.419324:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7600/0xe984082ccd723212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0023 expref: 37 pid: 8497 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746143677.419334:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7600/0xe984082ccd723212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0023 expref: 37 pid: 8497 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746143677.419350:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7600/0xe984082ccd723212 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0023 expref: 37 pid: 8497 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746143677.419373:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143677.419393:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+36:1962:x1830963591841536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 648us (3811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143677.419399:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4390 00000100:00100000:1.0:1746143677.419411:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4391 00000100:00100000:1.0:1746143677.419416:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1964:x1830963591841792:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143677.419422:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143677.419429:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7a00/0xe984082ccd7231f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0007 expref: 41 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.419438:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7a00/0xe984082ccd7231f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0007 expref: 41 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.419751:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7a00/0xe984082ccd7231f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0007 expref: 41 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.419765:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143677.419767:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143677.419774:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f79e800/0xe984082ccd723266 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a005b expref: 40 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.419782:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79e800/0xe984082ccd723266 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a005b expref: 40 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.419803:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f79e800/0xe984082ccd723266 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a005b expref: 40 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.419813:0:9890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f79e800/0xe984082ccd723266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a005b expref: 40 pid: 8497 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746143677.419825:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593582208:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143677.419883:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143677.421842:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593582208:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143677.421862:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143677.421912:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963591841792:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2494us (2980us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143677.421922:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4391 00000100:00100000:0.0:1746143677.424728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.426778:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591842176 00000100:00100000:1.0:1746143677.426791:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591842176 00002000:00100000:1.0:1746143677.426839:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1732608->2097151) req@ffff88009c3f8380 x1830963591842176/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.426856:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8380 with x1830963591842176 ext(1732608->2097151) 00010000:00010000:1.0:1746143677.426865:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f79e800/0xe984082ccd723266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a005b expref: 40 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.426878:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f79e800/0xe984082ccd723266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a005b expref: 40 pid: 8497 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746143677.426884:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3f8380 00000100:00100000:0.0:1746143677.427050:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.427472:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 711 00000100:00100000:1.0:1746143677.427479:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1962:x1830963591842176:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143677.435961:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.436012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.436035:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591842304 00000100:00100000:0.0:1746143677.436044:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591842304 00010000:00010000:0.0:1746143677.436083:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79e200/0xe984082ccd72325f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0054 expref: 36 pid: 8497 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746143677.436110:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591842432 00000100:00100000:0.0:1746143677.436112:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591842432 00010000:00010000:0.0:1746143677.436122:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd72324a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a003f expref: 44 pid: 8497 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746143677.436872:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4392 00000100:00100000:0.0:1746143677.437511:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+36:1965:x1830963591842304:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143677.437519:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143677.437529:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f79e200/0xe984082ccd72325f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0054 expref: 36 pid: 8497 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746143677.437538:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f79e200/0xe984082ccd72325f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0054 expref: 36 pid: 8497 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746143677.437551:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f79e200/0xe984082ccd72325f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0054 expref: 36 pid: 8497 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746143677.437564:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.437565:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.437572:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f79f600/0xe984082ccd723274 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0069 expref: 41 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.437580:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79f600/0xe984082ccd723274 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0069 expref: 41 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.437609:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f79f600/0xe984082ccd723274 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0069 expref: 41 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143677.437622:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f890700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593582592:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143677.437668:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143677.442248:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f890700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593582592:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143677.442272:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143677.443022:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1965:x1830963591842304:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6138us (7066us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143677.443033:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4392 00000100:00100000:0.0:1746143677.443836:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1962:x1830963591842176:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 16355us (19115us total) trans 17179872279 rc 0/0 00000100:00100000:0.0:1746143677.443846:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 711 00002000:00100000:0.0:1746143677.443857:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1732608->2097151) req@ffff88009c3f8380 x1830963591842176/t17179872279(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/448 e 0 to 0 dl 1746143688 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.443867:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8380 with x1830963591842176 ext(1732608->2097151) 00010000:00010000:0.0:1746143677.443876:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f79e800/0xe984082ccd723266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a005b expref: 42 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.443889:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f79e800/0xe984082ccd723266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a005b expref: 42 pid: 8497 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746143677.443895:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3f8380 00000100:00100000:1.0:1746143677.450183:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.450224:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.452929:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591842816 00000100:00100000:0.0:1746143677.452946:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591842816 00010000:00010000:0.0:1746143677.452991:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79e800/0xe984082ccd723266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a005b expref: 42 pid: 8497 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746143677.453039:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4394 00000100:00100000:0.0:1746143677.453048:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1962:x1830963591842816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143677.453062:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143677.453082:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143676 -> 1746143677 00002000:00010000:0.0:1746143677.453085:0:7150:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143676 -> 1746143677 00010000:00010000:0.0:1746143677.453091:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f79e800/0xe984082ccd723266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a005b expref: 42 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.453104:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f79e800/0xe984082ccd723266 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a005b expref: 42 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.453127:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f79e800/0xe984082ccd723266 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a005b expref: 42 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.453167:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.453169:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.453177:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f79e400/0xe984082ccd72326d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0062 expref: 34 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.453184:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79e400/0xe984082ccd72326d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0062 expref: 34 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.453229:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f79e400/0xe984082ccd72326d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0062 expref: 34 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143677.453246:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f890700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593582720:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143677.453338:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f033c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143677.453454:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591842688 00000100:00100000:0.0:1746143677.453458:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591842688 00002000:00100000:0.0:1746143677.453485:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2535424->2539519) req@ffff8800a5d81880 x1830963591842688/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.453494:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81880 with x1830963591842688 ext(2535424->2539519) 00002000:00010000:0.0:1746143677.453498:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d81880 00000100:00100000:0.0:1746143677.453515:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2984 00000100:00100000:0.0:1746143677.453520:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1964:x1830963591842688:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143677.453657:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1964:x1830963591842688:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 135us (3483us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143677.453662:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2984 00002000:00100000:0.0:1746143677.453667:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (2535424->2539519) req@ffff8800a5d81880 x1830963591842688/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.453673:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81880 with x1830963591842688 ext(2535424->2539519) 00002000:00010000:0.0:1746143677.453676:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d81880 00000100:00100000:0.0:1746143677.461355:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f890700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593582720:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143677.461382:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143677.461426:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963591842816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8378us (11199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143677.461438:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4394 00000100:00100000:0.0:1746143677.470161:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.473911:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591843072 00000100:00100000:1.0:1746143677.473926:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591843072 00002000:00100000:1.0:1746143677.473986:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008f892680 x1830963591843072/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.474006:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f892680 with x1830963591843072 ext(1048576->2097151) 00002000:00010000:1.0:1746143677.474012:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f892680 00000100:00100000:1.0:1746143677.474035:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2985 00000100:00100000:1.0:1746143677.474043:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1964:x1830963591843072:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143677.493738:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1964:x1830963591843072:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19684us (23575us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143677.493750:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2985 00002000:00100000:0.0:1746143677.493762:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008f892680 x1830963591843072/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/440 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.493772:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f892680 with x1830963591843072 ext(1048576->2097151) 00002000:00010000:0.0:1746143677.493778:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f892680 00000100:00100000:0.0:1746143677.503269:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.503297:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591843200 00000100:00100000:0.0:1746143677.503306:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591843200 00000100:00100000:0.0:1746143677.503349:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8687 00000100:00100000:0.0:1746143677.503357:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+35:27884:x1830963591843200:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143677.503374:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143677.503391:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130848600/0xe984082ccd72327b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0070 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.503421:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f79f600/0xe984082ccd723274 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0069 expref: 40 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.503429:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143677.503431:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143677.503435:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130848600/0xe984082ccd72327b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0070 expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.503462:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f79f600/0xe984082ccd723274 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0069 expref: 40 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.503479:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f79f600/0xe984082ccd723274 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0069 expref: 40 pid: 25369 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746143677.503489:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f892300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593582848:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143677.503555:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143677.507486:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f892300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593582848:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143677.507532:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130848600/0xe984082ccd72327b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0070 expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.507597:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130848600, rc 0) 00000100:00100000:0.0:1746143677.507638:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+36:27884:x1830963591843200:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4282us (4377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143677.507647:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8687 00000100:00100000:0.0:1746143677.507749:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.507798:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591843328 00000100:00100000:0.0:1746143677.507803:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591843328 00002000:00100000:0.0:1746143677.507837:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->2539519) req@ffff88008f892300 x1830963591843328/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.507846:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f892300 with x1830963591843328 ext(2097152->2539519) 00010000:00010000:0.0:1746143677.507852:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f79f600/0xe984082ccd723274 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0069 expref: 41 pid: 25369 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.507863:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f79f600/0xe984082ccd723274 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0069 expref: 41 pid: 25369 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746143677.507875:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f892300 00000100:00100000:0.0:1746143677.507888:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 712 00000100:00100000:0.0:1746143677.507894:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1964:x1830963591843328:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143677.526438:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.526509:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591843456 00000100:00100000:0.0:1746143677.526520:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591843456 00010000:00010000:0.0:1746143677.526559:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79f600/0xe984082ccd723274 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0069 expref: 43 pid: 25369 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746143677.526602:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4395 00000100:00100000:0.0:1746143677.526611:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1962:x1830963591843456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143677.526625:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143677.526647:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f79f600/0xe984082ccd723274 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0069 expref: 43 pid: 25369 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.526659:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f79f600/0xe984082ccd723274 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0069 expref: 43 pid: 25369 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.526826:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f79f600/0xe984082ccd723274 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0069 expref: 43 pid: 25369 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.526842:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.527015:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.527026:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130848600/0xe984082ccd72327b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0070 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.527038:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130848600/0xe984082ccd72327b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0070 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.527073:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130848600/0xe984082ccd72327b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0070 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143677.527085:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f891180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593582976:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143677.528654:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143677.546341:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.546366:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.546380:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.546404:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.546433:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591843840 00000100:00100000:0.0:1746143677.546442:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591843840 00002000:00100000:0.0:1746143677.546490:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f891180 x1830963591843840/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.546500:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f891180 with x1830963591843840 ext(3145728->4194303) 00002000:00010000:0.0:1746143677.546505:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f891180 00000100:00100000:0.0:1746143677.546528:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591843712 00000100:00100000:0.0:1746143677.546531:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591843712 00002000:00100000:0.0:1746143677.546539:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009c3fbb80 x1830963591843712/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.546545:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830963591843712 ext(2097152->3145727) 00002000:00010000:0.0:1746143677.546548:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fbb80 00000100:00100000:0.0:1746143677.546556:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591844224 00000100:00100000:0.0:1746143677.546558:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591844224 00000100:00100000:1.0:1746143677.546561:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591844352 00000100:00100000:1.0:1746143677.546565:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591844352 00002000:00100000:0.0:1746143677.546566:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009c3f9880 x1830963591844224/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.546573:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830963591844224 ext(2097152->3145727) 00002000:00010000:0.0:1746143677.546576:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9880 00002000:00100000:1.0:1746143677.546584:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3289088->4194303) req@ffff88009c3faa00 x1830963591844352/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143677.546585:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2986 00000100:00100000:0.0:1746143677.546592:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+37:1965:x1830963591843840:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:1.0:1746143677.546593:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830963591844352 ext(3289088->4194303) 00002000:00010000:1.0:1746143677.546596:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3faa00 00000100:00100000:1.0:1746143677.546609:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2987 00000100:00100000:1.0:1746143677.546615:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+37:1964:x1830963591843712:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143677.547888:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2988 00000100:00100000:0.0:1746143677.547900:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591844224:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143677.549366:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2989 00000100:00100000:0.0:1746143677.549378:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963591844352:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143677.571741:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591844352:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22358us (25328us total) trans 0 rc 905216/905216 00000100:00100000:1.0:1746143677.571752:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2989 00002000:00100000:1.0:1746143677.571762:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3289088->4194303) req@ffff88009c3faa00 x1830963591844352/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/440 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 905216/905216 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.571771:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830963591844352 ext(3289088->4194303) 00002000:00010000:1.0:1746143677.571776:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3faa00 00000100:00100000:0.0:1746143677.591516:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+36:1965:x1830963591843840:12345-192.168.202.48@tcp:3:cat.0 Request processed in 44910us (45171us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143677.591528:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2986 00002000:00100000:0.0:1746143677.591541:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f891180 x1830963591843840/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/440 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.591550:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f891180 with x1830963591843840 ext(3145728->4194303) 00002000:00010000:0.0:1746143677.591556:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f891180 00000100:00100000:0.0:1746143677.601926:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.602498:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591844992 00000100:00100000:1.0:1746143677.602508:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591844992 00002000:00100000:1.0:1746143677.602552:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a63a3800 x1830963591844992/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.602562:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a3800 with x1830963591844992 ext(4194304->4898815) 00002000:00010000:1.0:1746143677.602567:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a3800 00000100:00100000:1.0:1746143677.602596:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2990 00000100:00100000:1.0:1746143677.602603:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+36:1964:x1830963591844992:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143677.606824:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.606860:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.606880:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591845120 00000100:00100000:0.0:1746143677.606886:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591845120 00000100:00100000:0.0:1746143677.606914:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591845248 00000100:00100000:0.0:1746143677.606916:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591845248 00000100:00100000:0.0:1746143677.606941:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8688 00000100:00100000:0.0:1746143677.606948:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1962:x1830963591845120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143677.606962:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143677.606975:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd7232a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a007e expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.607001:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.607003:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.607011:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd7232a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a007e expref: 44 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143677.607022:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd7232a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a007e expref: 44 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143677.607031:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130849400, rc 0) 00000100:00100000:0.0:1746143677.607067:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1962:x1830963591845120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 119us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143677.607078:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8688 00000100:00100000:0.0:1746143677.607100:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8689 00000100:00100000:0.0:1746143677.607105:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1962:x1830963591845248:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143677.607110:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143677.607116:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130849800/0xe984082ccd7232ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0085 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.607124:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.607125:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.607129:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130849800/0xe984082ccd7232ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0085 expref: 44 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143677.607137:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130849800/0xe984082ccd7232ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0085 expref: 44 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143677.607165:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130849800, rc 0) 00000100:00100000:0.0:1746143677.607180:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1962:x1830963591845248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 75us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143677.607185:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8689 00000100:00100000:0.0:1746143677.607219:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.607237:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591845376 00000100:00100000:0.0:1746143677.607240:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591845376 00000100:00100000:0.0:1746143677.607254:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8690 00000100:00100000:0.0:1746143677.607262:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963591845376:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143677.607269:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143677.607276:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130848a00/0xe984082ccd7232b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a008c expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143677.607308:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593583104:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143677.607363:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da590c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143677.618518:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.618879:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593583104:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143677.618906:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130848a00/0xe984082ccd7232b3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a008c expref: 17 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143677.618919:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130848a00/0xe984082ccd7232b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a008c expref: 17 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143677.618933:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130848a00, rc 0) 00000100:00100000:0.0:1746143677.619804:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963591845376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 12542us (12582us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143677.619812:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8690 00000100:00100000:1.0:1746143677.621978:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+36:1964:x1830963591844992:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19374us (20159us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143677.621986:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2990 00002000:00100000:1.0:1746143677.622003:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a63a3800 x1830963591844992/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/440 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.622010:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a3800 with x1830963591844992 ext(4194304->4898815) 00002000:00010000:1.0:1746143677.622014:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a3800 00000100:00100000:0.0:1746143677.626588:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.636257:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.636976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.637013:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591846272 00000100:00100000:1.0:1746143677.637017:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591846272 00002000:00100000:1.0:1746143677.637202:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094307100 x1830963591846272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.637211:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307100 with x1830963591846272 ext(1048576->2097151) 00002000:00010000:1.0:1746143677.637216:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307100 00000100:00100000:1.0:1746143677.637237:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2991 00000100:00100000:1.0:1746143677.637243:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1963:x1830963591846272:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143677.642040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.645781:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1963:x1830963591846272:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8531us (8799us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143677.645791:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2991 00002000:00100000:0.0:1746143677.645800:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094307100 x1830963591846272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/440 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.645809:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307100 with x1830963591846272 ext(1048576->2097151) 00002000:00010000:0.0:1746143677.645814:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307100 00000100:00100000:0.0:1746143677.652761:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.652785:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591846656 00000100:00100000:0.0:1746143677.652791:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591846656 00002000:00100000:0.0:1746143677.653570:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094307b80 x1830963591846656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.653579:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307b80 with x1830963591846656 ext(2097152->3145727) 00002000:00010000:0.0:1746143677.653583:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307b80 00000100:00100000:0.0:1746143677.653662:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2992 00000100:00100000:0.0:1746143677.653707:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1963:x1830963591846656:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143677.716363:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1963:x1830963591846656:12345-192.168.202.48@tcp:3:cat.0 Request processed in 62684us (63600us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143677.716374:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2992 00002000:00100000:0.0:1746143677.716383:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094307b80 x1830963591846656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/440 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.716391:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307b80 with x1830963591846656 ext(2097152->3145727) 00002000:00010000:0.0:1746143677.716396:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307b80 00000100:00100000:0.0:1746143677.725750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.725777:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591846784 00000100:00100000:0.0:1746143677.725784:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591846784 00000100:00100000:0.0:1746143677.725822:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8691 00000100:00100000:0.0:1746143677.725829:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:27891:x1830963591846784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143677.725842:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143677.725856:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130849600/0xe984082ccd7232dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a009a expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.725882:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f79ea00/0xe984082ccd723251 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3289087) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0046 expref: 8 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.725888:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143677.725890:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143677.725893:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130849600/0xe984082ccd7232dd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a009a expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.725916:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f79ea00/0xe984082ccd723251 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3289087) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0046 expref: 8 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.725930:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f79ea00/0xe984082ccd723251 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3289087) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0046 expref: 8 pid: 8497 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746143677.725940:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090766a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593583232:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143677.726006:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143677.740383:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090766a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593583232:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143677.740407:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130849600/0xe984082ccd7232dd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a009a expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.740423:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130849600, rc 0) 00000100:00100000:0.0:1746143677.740461:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:27891:x1830963591846784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 14632us (14715us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143677.740468:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8691 00000100:00100000:0.0:1746143677.740520:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.740592:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.740610:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591846912 00000100:00100000:0.0:1746143677.740615:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591846912 00002000:00100000:0.0:1746143677.740647:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3837951) req@ffff880090766a00 x1830963591846912/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 504/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.740657:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766a00 with x1830963591846912 ext(3145728->3837951) 00010000:00010000:0.0:1746143677.740662:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f79ea00/0xe984082ccd723251 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0046 expref: 9 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.740672:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f79ea00/0xe984082ccd723251 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0046 expref: 9 pid: 8497 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746143677.740679:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090766a00 00000100:00100000:0.0:1746143677.740691:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 713 00000100:00100000:0.0:1746143677.740696:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963591846912:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143677.741093:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591847040 00000100:00100000:0.0:1746143677.741095:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591847040 00000100:00100000:0.0:1746143677.741108:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8692 00000100:00100000:0.0:1746143677.741113:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:27892:x1830963591847040:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143677.741119:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143677.741129:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130848000/0xe984082ccd7232e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a00a1 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.741169:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f79ee00/0xe984082ccd722ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae461209fea9 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.741177:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e61e200/0xe984082ccd72301a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209feb7 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143677.741182:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.741183:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.741187:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130848000/0xe984082ccd7232e4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1736704->2097151] (req 1736704->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00a1 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.741206:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e61e200/0xe984082ccd72301a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209feb7 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143677.741220:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e61e200/0xe984082ccd72301a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209feb7 expref: 10 pid: 25369 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746143677.741229:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090767800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593583360:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143677.741279:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f79ee00/0xe984082ccd722ff0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fea9 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.741287:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f79ee00/0xe984082ccd722ff0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fea9 expref: 18 pid: 8495 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746143677.741295:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593583488:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143677.741309:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da599c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143677.762731:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e61e200/0xe984082ccd72301a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209feb7 expref: 11 pid: 25369 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746143677.762744:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090767800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593583360:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143677.762752:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f79ee00/0xe984082ccd722ff0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fea9 expref: 18 pid: 8495 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746143677.762759:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090765f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593583488:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143677.762776:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130848000/0xe984082ccd7232e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00a1 expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.762788:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130848000, rc 0) 00000100:00100000:0.0:1746143677.762806:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:27892:x1830963591847040:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 21693us (22215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143677.762812:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8692 00000100:00100000:0.0:1746143677.766544:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963591846912:12345-192.168.202.48@tcp:4:cat.0 Request processed in 25842us (26018us total) trans 21474839550 rc 0/0 00000100:00100000:0.0:1746143677.766554:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 713 00002000:00100000:0.0:1746143677.766564:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3837951) req@ffff880090766a00 x1830963591846912/t21474839550(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 504/448 e 0 to 0 dl 1746143688 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.766572:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766a00 with x1830963591846912 ext(3145728->3837951) 00010000:00010000:0.0:1746143677.766580:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f79ea00/0xe984082ccd723251 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0046 expref: 11 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.766593:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f79ea00/0xe984082ccd723251 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0046 expref: 11 pid: 8497 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746143677.766600:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090766a00 00000100:00100000:0.0:1746143677.780964:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591847552 00000100:00100000:0.0:1746143677.780970:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591847552 00002000:00100000:0.0:1746143677.781006:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34b:0x0] (1736704->1740799) req@ffff8800930d1c00 x1830963591847552/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143677.781014:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1c00 with x1830963591847552 ext(1736704->1740799) 00002000:00010000:0.0:1746143677.781018:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1c00 00000100:00100000:0.0:1746143677.788967:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.800539:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591847808 00000100:00100000:0.0:1746143677.800545:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591847808 00000100:00100000:0.0:1746143677.800575:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8693 00000100:00100000:0.0:1746143677.800581:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:27892:x1830963591847808:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143677.800595:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143677.800608:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009331e600/0xe984082ccd7232eb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a00a8 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.800631:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f79e400/0xe984082ccd72326d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0062 expref: 35 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.800638:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd7232a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a007e expref: 45 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143677.800644:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.800646:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.800649:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009331e600/0xe984082ccd7232eb lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->1388543] (req 1048576->1388543) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00a8 expref: 45 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.800672:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd7232a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a007e expref: 45 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143677.800682:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd7232a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a007e expref: 45 pid: 8497 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746143677.800691:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090767800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593583872:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143677.802106:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f79e400/0xe984082ccd72326d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0062 expref: 35 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.802117:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f79e400/0xe984082ccd72326d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0062 expref: 35 pid: 8497 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746143677.802126:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593584000:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143677.802536:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143677.807817:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.807838:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.807856:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591848192 00000100:00100000:1.0:1746143677.807863:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591848192 00002000:00100000:1.0:1746143677.807897:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a5d83100 x1830963591848192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.807912:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83100 with x1830963591848192 ext(3145728->4194303) 00002000:00010000:1.0:1746143677.807917:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d83100 00000100:00100000:1.0:1746143677.807930:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591848320 00000100:00100000:1.0:1746143677.807932:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591848320 00002000:00100000:1.0:1746143677.807943:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a5d80380 x1830963591848320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.807949:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80380 with x1830963591848320 ext(2097152->3145727) 00002000:00010000:1.0:1746143677.807952:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80380 00000100:00100000:1.0:1746143677.807961:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2994 00000100:00100000:1.0:1746143677.807967:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+46:1963:x1830963591848192:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143677.809261:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2995 00000100:00100000:1.0:1746143677.809268:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963591848320:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143677.810477:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.817235:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591848704 00000100:00100000:0.0:1746143677.817243:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591848704 00010000:00010000:0.0:1746143677.817275:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd7232a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a007e expref: 48 pid: 8497 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746143677.817294:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591848832 00000100:00100000:0.0:1746143677.817296:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591848832 00010000:00010000:0.0:1746143677.817304:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79e400/0xe984082ccd72326d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0062 expref: 36 pid: 8497 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746143677.817320:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4399 00000100:00100000:0.0:1746143677.817325:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+48:1962:x1830963591848704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143677.817335:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143677.817354:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd7232a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a007e expref: 48 pid: 8497 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746143677.817363:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd7232a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a007e expref: 48 pid: 8497 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746143677.817380:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130849400/0xe984082ccd7232a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a007e expref: 48 pid: 8497 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746143677.817393:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143677.817427:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+47:1962:x1830963591848704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 101us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143677.817433:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4399 00000100:00100000:0.0:1746143677.817477:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4400 00000100:00100000:0.0:1746143677.817482:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+36:1965:x1830963591848832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143677.817490:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143677.817497:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f79e400/0xe984082ccd72326d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0062 expref: 36 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.817505:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f79e400/0xe984082ccd72326d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0062 expref: 36 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746143677.817515:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.817517:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143677.817522:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009331e600/0xe984082ccd7232eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00a8 expref: 46 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.817529:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009331e600/0xe984082ccd7232eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00a8 expref: 46 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143677.817553:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009331e600/0xe984082ccd7232eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00a8 expref: 46 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143677.817562:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593584128:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143677.817597:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143677.829701:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1963:x1830963591848192:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 21732us (21887us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143677.829707:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2994 00002000:00100000:1.0:1746143677.829712:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a5d83100 x1830963591848192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/440 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.829719:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83100 with x1830963591848192 ext(3145728->4194303) 00002000:00010000:1.0:1746143677.829722:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d83100 00000100:00100000:1.0:1746143677.829797:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090765f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593584128:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143677.829811:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143677.829831:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1965:x1830963591848832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12348us (14160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143677.829837:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4400 00000001:00080000:0.0:1746143677.836127:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872279 is committed 00000001:00080000:0.0:1746143677.836158:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872264 is committed 00000001:00080000:0.0:1746143677.836173:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872273 is committed 00000001:00080000:0.0:1746143677.836199:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872246 is committed 00000001:00080000:0.0:1746143677.836216:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872280 is committed 00000001:00080000:0.0:1746143677.836222:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872278 is committed 00000100:00100000:1.0:1746143677.842053:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963591848320:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 32779us (34207us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143677.842064:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2995 00002000:00100000:1.0:1746143677.842072:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a5d80380 x1830963591848320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/440 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.842079:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80380 with x1830963591848320 ext(2097152->3145727) 00002000:00010000:1.0:1746143677.842084:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80380 00000100:00100000:0.0:1746143677.856624:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.856649:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.856717:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.856769:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591849216 00000100:00100000:1.0:1746143677.856776:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591849216 00000100:00100000:1.0:1746143677.856806:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591849344 00000100:00100000:1.0:1746143677.856808:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591849344 00000100:00100000:1.0:1746143677.856816:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591849472 00000100:00100000:1.0:1746143677.856818:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591849472 00000100:00100000:1.0:1746143677.856829:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8694 00000100:00100000:1.0:1746143677.856835:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963591849216:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143677.856848:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143677.856862:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5a00/0xe984082ccd7232f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a00af expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143677.856902:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593584256:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143677.856955:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143677.856970:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8695 00000100:00100000:1.0:1746143677.856975:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+7:1965:x1830963591849344:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143677.856984:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143677.857000:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f9c5c00/0xe984082ccd7232f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a00b6 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143677.857021:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593584384:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143677.857038:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7540 going to sleep for 11 seconds 00002000:00010000:1.0:1746143677.865443:0:12618:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime: 1746143675 -> 1746143677 00002000:00010000:1.0:1746143677.865446:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime: 1746143675 -> 1746143677 00002000:00010000:1.0:1746143677.865448:0:12618:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime: 1746143675 -> 1746143677 00000100:00100000:1.0:1746143677.865462:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593584256:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143677.865484:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5a00/0xe984082ccd7232f2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00af expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143677.865494:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5a00/0xe984082ccd7232f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00af expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143677.865518:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9c5a00, rc 0) 00000100:00100000:1.0:1746143677.865543:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963591849216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8707us (8923us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143677.865873:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8694 00000100:00100000:0.0:1746143677.872621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.886771:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.888061:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591849856 00000100:00100000:1.0:1746143677.888069:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591849856 00000100:00100000:1.0:1746143677.888121:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8697 00000100:00100000:1.0:1746143677.888129:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+10:27900:x1830963591849856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143677.888163:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143677.888178:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f9c4600/0xe984082ccd723307 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a00c4 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.888201:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130848000/0xe984082ccd7232e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00a1 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.888207:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143677.888209:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143677.888212:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f9c4600/0xe984082ccd723307 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00c4 expref: 11 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.888234:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130848000/0xe984082ccd7232e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00a1 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.888242:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130848000/0xe984082ccd7232e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00a1 expref: 16 pid: 8497 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746143677.888252:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593584512:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143677.888312:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143677.895584:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593584512:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143677.895611:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f9c4600/0xe984082ccd723307 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00c4 expref: 11 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143677.895627:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9c4600, rc 0) 00000100:00100000:1.0:1746143677.895685:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+11:27900:x1830963591849856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7556us (8920us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143677.895692:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8697 00000100:00100000:0.0:1746143677.901203:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.902677:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 714 00000100:00100000:0.0:1746143677.902688:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963591849984:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143677.904013:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.904271:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591850112 00000100:00100000:0.0:1746143677.904276:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591850112 00000100:00100000:0.0:1746143677.904305:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8698 00000100:00100000:0.0:1746143677.904310:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963591850112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143677.904319:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143677.904331:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009331e800/0xe984082ccd72330e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a00cb expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143677.904368:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593584640:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143677.904411:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143677.908874:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.915598:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.915627:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.915654:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143677.918341:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963591849984:12345-192.168.202.48@tcp:4:cat.0 Request processed in 15655us (17143us total) trans 21474839551 rc 0/0 00000100:00100000:1.0:1746143677.918349:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 714 00002000:00100000:1.0:1746143677.918356:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1736704->2097151) req@ffff880090765500 x1830963591849984/t21474839551(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:73/0 lens 488/448 e 0 to 0 dl 1746143688 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.918364:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765500 with x1830963591849984 ext(1736704->2097151) 00010000:00010000:1.0:1746143677.918369:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130848000/0xe984082ccd7232e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00a1 expref: 19 pid: 8497 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746143677.918380:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130848000/0xe984082ccd7232e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00a1 expref: 19 pid: 8497 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746143677.918386:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090765500 00000100:00100000:1.0:1746143677.922692:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591851008 00000100:00100000:1.0:1746143677.922697:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591851008 00002000:00100000:1.0:1746143677.922724:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (167936->172031) req@ffff8800a0a57480 x1830963591851008/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.922732:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a57480 with x1830963591851008 ext(167936->172031) 00002000:00010000:1.0:1746143677.922736:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a57480 00000100:00100000:1.0:1746143677.922755:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 2999 00000100:00100000:1.0:1746143677.922760:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+7:1965:x1830963591851008:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143677.922891:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+7:1965:x1830963591851008:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 130us (411us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143677.922899:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 2999 00002000:00100000:1.0:1746143677.922903:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (167936->172031) req@ffff8800a0a57480 x1830963591851008/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/4536 e 0 to 0 dl 1746143688 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.922909:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a57480 with x1830963591851008 ext(167936->172031) 00002000:00010000:1.0:1746143677.922911:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a57480 00000100:00100000:0.0:1746143677.925661:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.926259:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.938070:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593585280:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143677.938088:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143677.938134:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963591851392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10722us (11873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143677.938162:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4403 00000100:00100000:1.0:1746143677.938163:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591851648 00000100:00100000:1.0:1746143677.938169:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591851648 00002000:00100000:1.0:1746143677.938201:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (548864->552959) req@ffff8800930d0a80 x1830963591851648/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.938209:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0a80 with x1830963591851648 ext(548864->552959) 00002000:00010000:1.0:1746143677.938213:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d0a80 00000100:00100000:1.0:1746143677.939312:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591851904 00000100:00100000:1.0:1746143677.939317:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591851904 00002000:00100000:1.0:1746143677.939334:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009bef4000 x1830963591851904/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:73/0 lens 488/0 e 0 to 0 dl 1746143688 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143677.939341:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef4000 with x1830963591851904 ext(1048576->2097151) 00002000:00010000:1.0:1746143677.939344:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bef4000 00000100:00100000:0.0:1746143677.967071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.976392:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143677.990344:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.001930:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.024269:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.024328:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.024438:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591852800 00000100:00100000:1.0:1746143678.024445:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591852800 00002000:00100000:1.0:1746143678.024481:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880093bf2a00 x1830963591852800/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:74/0 lens 488/0 e 0 to 0 dl 1746143689 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.024491:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf2a00 with x1830963591852800 ext(2097152->3145727) 00002000:00010000:1.0:1746143678.024496:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bf2a00 00000100:00100000:1.0:1746143678.025011:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591853056 00000100:00100000:1.0:1746143678.025016:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591853056 00002000:00100000:1.0:1746143678.025030:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800930ded80 x1830963591853056/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:74/0 lens 488/0 e 0 to 0 dl 1746143689 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.025037:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ded80 with x1830963591853056 ext(3145728->4194303) 00002000:00010000:1.0:1746143678.025040:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930ded80 00000100:00100000:0.0:1746143678.077937:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143678.079572:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143678.085046:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.085872:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.086088:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591853440 00000100:00100000:1.0:1746143678.086095:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591853440 00000100:00100000:1.0:1746143678.086133:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591853696 00000100:00100000:1.0:1746143678.086135:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591853696 00000100:00100000:1.0:1746143678.086175:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3227 00000100:00100000:1.0:1746143678.086181:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:27138:x1830963591853440:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143678.086481:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:27138:x1830963591853440:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 298us (1435us total) trans 8589942110 rc 0/0 00000100:00100000:1.0:1746143678.086487:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3227 00000100:00100000:1.0:1746143678.086500:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3228 00000100:00100000:1.0:1746143678.086505:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+275:15421:x1830963591853696:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143678.086568:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+276:15421:x1830963591853696:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 62us (697us total) trans 8589942111 rc 0/0 00000100:00100000:1.0:1746143678.086574:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3228 00000100:00080000:0.0:1746143678.086921:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143678.087707:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.088722:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.095113:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.095186:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.095204:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591854080 00000100:00100000:0.0:1746143678.095210:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591854080 00000100:00100000:0.0:1746143678.095253:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591854336 00000100:00100000:0.0:1746143678.095255:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591854336 00000100:00100000:0.0:1746143678.095270:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8703 00000100:00100000:0.0:1746143678.095277:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1962:x1830963591854080:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143678.095289:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.095301:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bcae600/0xe984082ccd72334d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a00f5 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143678.095339:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593585920:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143678.095399:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f000 going to sleep for 11 seconds 00000100:00080000:0.0:1746143678.095411:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143678.095414:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143678.095429:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.095441:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591854592 00000100:00100000:0.0:1746143678.095444:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591854592 00000100:00100000:0.0:1746143678.095459:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8704 00000100:00100000:0.0:1746143678.095463:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1962:x1830963591854336:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143678.095470:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.095478:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b89fc00/0xe984082ccd723354 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0103 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.095488:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.095489:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.095496:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b89fc00/0xe984082ccd723354 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0103 expref: 7 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.095508:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b89fc00/0xe984082ccd723354 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0103 expref: 7 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.095517:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b89fc00, rc 0) 00000100:00100000:0.0:1746143678.095534:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1962:x1830963591854336:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 70us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.095539:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8704 00000100:00100000:0.0:1746143678.095557:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8705 00000100:00100000:0.0:1746143678.095561:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963591854592:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143678.095566:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.095572:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b89ee00/0xe984082ccd72335b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0111 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.095580:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.095581:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.095584:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b89ee00/0xe984082ccd72335b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0111 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.095591:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b89ee00/0xe984082ccd72335b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0111 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.095597:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b89ee00, rc 0) 00000100:00100000:0.0:1746143678.095609:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963591854592:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 48us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.095614:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8705 00000100:00100000:0.0:1746143678.095657:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.096599:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.100881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.104241:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.108934:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.110902:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.111253:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591855488 00000100:00100000:1.0:1746143678.111258:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591855488 00000100:00100000:1.0:1746143678.111293:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8076 00000100:00100000:1.0:1746143678.111299:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:27905:x1830963591855488:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143678.111312:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.111321:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7233a1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a012d expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.111357:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7233a1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a012d expref: 14 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.111365:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7233a1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a012d expref: 14 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.111376:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143678.111378:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143678.111380:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2121600, rc 0) 00000100:00100000:1.0:1746143678.111410:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:27905:x1830963591855488:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 111us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.111414:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8076 00000100:00100000:0.0:1746143678.113099:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.113129:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.113176:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.113196:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.113208:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.113234:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.116956:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593586560:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143678.120526:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.120610:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593587328:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143678.120618:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a55180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593587456:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143678.120637:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d53a400/0xe984082ccd7233c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143678.128906:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.128947:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.128977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.129007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.129019:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.129037:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591856768 00000100:00100000:0.0:1746143678.129043:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591856768 00010000:00010000:0.0:1746143678.129072:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d59fa00/0xe984082ccd723370 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0118 expref: 12 pid: 8495 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746143678.129091:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591856896 00000100:00100000:0.0:1746143678.129092:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591856896 00010000:00010000:0.0:1746143678.129100:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd17600/0xe984082ccd72332a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00e7 expref: 8 pid: 4582 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746143678.129111:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591857408 00000100:00100000:0.0:1746143678.129112:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591857408 00010000:00010000:0.0:1746143678.129122:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130849600/0xe984082ccd7232dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a009a expref: 18 pid: 8497 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746143678.129129:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591856640 00000100:00100000:0.0:1746143678.129130:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591856640 00010000:00010000:0.0:1746143678.129164:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a717200/0xe984082ccd72316a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ffb3 expref: 19 pid: 12618 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746143678.129176:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4409 00000100:00100000:0.0:1746143678.129183:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963591856768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.129193:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.129211:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d59fa00/0xe984082ccd723370 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0118 expref: 12 pid: 8495 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.129221:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d59fa00/0xe984082ccd723370 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0118 expref: 12 pid: 8495 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.129238:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d59fa00/0xe984082ccd723370 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0118 expref: 12 pid: 8495 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.130461:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.130476:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591856768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1294us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.130482:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4409 00000100:00100000:0.0:1746143678.130512:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.130524:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591857280 00000100:00100000:0.0:1746143678.130526:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591857280 00010000:00010000:0.0:1746143678.130535:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b89fc00/0xe984082ccd723354 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0103 expref: 11 pid: 8497 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746143678.130546:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4413 00000100:00100000:0.0:1746143678.130551:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c29050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591857280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.130558:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.130566:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b89fc00/0xe984082ccd723354 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0103 expref: 11 pid: 8497 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.130573:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b89fc00/0xe984082ccd723354 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0103 expref: 11 pid: 8497 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.130583:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b89fc00/0xe984082ccd723354 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0103 expref: 11 pid: 8497 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.130590:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.130603:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c29050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963591857280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 52us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.130607:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4413 00000100:00100000:0.0:1746143678.130666:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.130676:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591857664 00000100:00100000:0.0:1746143678.130679:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591857664 00010000:00010000:0.0:1746143678.130688:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013010b000/0xe984082ccd723300 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00bd expref: 11 pid: 8495 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746143678.130700:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4414 00000100:00100000:0.0:1746143678.130704:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963591857664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.130709:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.130715:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013010b000/0xe984082ccd723300 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00bd expref: 11 pid: 8495 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.130725:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013010b000/0xe984082ccd723300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00bd expref: 11 pid: 8495 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.130735:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013010b000/0xe984082ccd723300 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00bd expref: 11 pid: 8495 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.130741:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.130742:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.130745:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368a3000/0xe984082ccd7233b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.130750:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a3000/0xe984082ccd7233b6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.130762:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.130775:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963591857664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 70us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.130779:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4414 00000100:00100000:0.0:1746143678.130810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.130819:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591856384 00000100:00100000:0.0:1746143678.130821:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591856384 00010000:00010000:0.0:1746143678.130830:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd723362 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00fc expref: 10 pid: 4582 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746143678.130841:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4415 00000100:00100000:0.0:1746143678.130845:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963591856384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.130852:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.130858:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd723362 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00fc expref: 10 pid: 4582 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.130865:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd723362 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00fc expref: 10 pid: 4582 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.130874:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd723362 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00fc expref: 10 pid: 4582 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.130880:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.130893:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963591856384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.130897:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4415 00000100:00100000:0.0:1746143678.130927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.130935:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591857152 00000100:00100000:0.0:1746143678.130938:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591857152 00010000:00010000:0.0:1746143678.130946:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130848400/0xe984082ccd7230fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff5f expref: 10 pid: 8497 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746143678.132535:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4416 00000100:00100000:0.0:1746143678.132546:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963591857152:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.132555:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.132564:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130848400/0xe984082ccd7230fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff5f expref: 10 pid: 8497 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.132577:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130848400/0xe984082ccd7230fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff5f expref: 10 pid: 8497 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.132587:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130848400/0xe984082ccd7230fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae461209ff5f expref: 10 pid: 8497 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.132596:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.132597:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.132599:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a962c00/0xe984082ccd7233a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.132605:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a962c00/0xe984082ccd7233a8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.132621:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.132638:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963591857152:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 95us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.133368:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.133381:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591857536 00000100:00100000:1.0:1746143678.133384:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591857536 00010000:00010000:1.0:1746143678.133398:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f9c4600/0xe984082ccd723307 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00c4 expref: 10 pid: 12618 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746143678.133410:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4417 00000100:00100000:1.0:1746143678.133415:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963591857536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.133421:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.133429:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f9c4600/0xe984082ccd723307 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00c4 expref: 10 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.133437:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f9c4600/0xe984082ccd723307 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00c4 expref: 10 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.133447:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f9c4600/0xe984082ccd723307 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00c4 expref: 10 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.133459:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143678.133461:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143678.133464:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d53a400/0xe984082ccd7233c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.133470:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d53a400/0xe984082ccd7233c4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.133482:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.133495:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963591857536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 79us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.133500:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4417 00000100:00100000:1.0:1746143678.133529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.133537:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591857792 00000100:00100000:1.0:1746143678.133539:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591857792 00010000:00010000:1.0:1746143678.133549:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b89ee00/0xe984082ccd72335b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0111 expref: 9 pid: 8497 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746143678.133557:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4418 00000100:00100000:1.0:1746143678.133561:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963591857792:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.133567:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.133575:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b89ee00/0xe984082ccd72335b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0111 expref: 9 pid: 8497 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.133586:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b89ee00/0xe984082ccd72335b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0111 expref: 9 pid: 8497 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.133595:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b89ee00/0xe984082ccd72335b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0111 expref: 9 pid: 8497 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.133602:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.133612:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963591857792:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 50us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.133617:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4418 00000100:00100000:1.0:1746143678.133661:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.133672:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591857920 00000100:00100000:1.0:1746143678.133675:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591857920 00010000:00010000:1.0:1746143678.133686:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130849800/0xe984082ccd7232ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0085 expref: 20 pid: 8497 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746143678.133696:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4419 00000100:00100000:1.0:1746143678.133700:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963591857920:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.133705:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.133711:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130849800/0xe984082ccd7232ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0085 expref: 20 pid: 8497 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.133718:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130849800/0xe984082ccd7232ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0085 expref: 20 pid: 8497 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.133732:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130849800/0xe984082ccd7232ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0085 expref: 20 pid: 8497 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.133739:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.133747:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963591857920:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.133751:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4419 00000100:00100000:0.0:1746143678.133823:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4416 00010000:00010000:0.0:1746143678.133844:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d53a400/0xe984082ccd7233c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.133851:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d53a400/0xe984082ccd7233c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.133865:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d53a400/0xe984082ccd7233c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.133875:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d53a400/0xe984082ccd7233c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.133880:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d53a400/0xe984082ccd7233c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.133884:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d53a400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143678.133887:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d53a400/0xe984082ccd7233c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.133893:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d53a400/0xe984082ccd7233c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.133901:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d53a400/0xe984082ccd7233c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.133905:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d53a400/0xe984082ccd7233c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143678.133934:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963591855872:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 19702us (20724us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.133940:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8713 00000100:00100000:1.0:1746143678.135948:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143678.143150:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746143678.143567:0:14800:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 24 done 00000100:00100000:1.0:1746143678.152364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.152514:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591858176 00000100:00100000:0.0:1746143678.152521:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591858176 00010000:00010000:0.0:1746143678.152550:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd16800/0xe984082ccd723315 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 167936->552959) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a00d2 expref: 8 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.154004:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd7233bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.154012:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd7233bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.154028:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd7233bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.154034:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd7233bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.154040:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd7233bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.154045:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d53bc00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143678.154047:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd7233bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.154053:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd7233bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.154062:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd7233bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.154067:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd7233bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143678.154120:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1963:x1830963591855616:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 40017us (40922us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.154126:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8712 00000100:00100000:1.0:1746143678.157720:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b20e2be-dc58-49ff-81b7-9c0574412294:3292:1830963593588096:0@lo:400:kworker.0 00000100:00100000:1.0:1746143678.157772:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143678.157811:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1830963593588608:0@lo:400:kworker.0 00000100:00100000:1.0:1746143678.157829:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143678.157845:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143678.157849:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1830963593588224:0@lo:400:kworker.0 00000100:00100000:1.0:1746143678.157862:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143678.157879:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1830963593588352:0@lo:400:kworker.0 00000100:00100000:1.0:1746143678.157894:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143678.157904:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746143678.157908:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593588480:0@lo:400:kworker.0 00000100:00100000:1.0:1746143678.157923:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143678.157942:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593588608 00000100:00100000:1.0:1746143678.157948:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593588608 00000100:00100000:1.0:1746143678.157976:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593588224 00000100:00100000:1.0:1746143678.157977:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593588224 00000100:00100000:1.0:1746143678.158009:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593588352 00000100:00100000:1.0:1746143678.158011:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593588352 00000100:00100000:1.0:1746143678.158025:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1746143678.158030:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1830963593588608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143678.158067:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1830963593588608:12345-0@lo:400:kworker.0 Request processed in 37us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.158072:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1746143678.158083:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1746143678.158087:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1830963593588224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143678.158105:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1830963593588224:12345-0@lo:400:kworker.0 Request processed in 17us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.158109:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1746143678.158116:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1746143678.158119:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830963593588352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143678.158162:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830963593588352:12345-0@lo:400:kworker.0 Request processed in 42us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.158167:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1746143678.158196:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1830963593588352:0@lo:400:kworker.0 00000100:00100000:1.0:1746143678.158212:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1830963593588224:0@lo:400:kworker.0 00000100:00100000:1.0:1746143678.158219:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1830963593588608:0@lo:400:kworker.0 00000100:00080000:0.0:1746143678.158967:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143678.158977:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593588480 00000100:00100000:0.0:1746143678.158980:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593588480 00000100:00100000:0.0:1746143678.159025:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1746143678.159033:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1830963593588480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143678.159068:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1830963593588480:12345-0@lo:400:kworker.0 Request processed in 38us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.159072:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1746143678.160657:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.160818:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872264 gen 2 00000004:00080000:1.0:1746143678.160824:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f890e00, transno 17179872235 00000004:00080000:1.0:1746143678.160834:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f891c00, transno 17179872236 00000004:00080000:1.0:1746143678.160836:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f890a80, transno 17179872237 00000004:00080000:1.0:1746143678.160838:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f891500, transno 17179872238 00000004:00080000:1.0:1746143678.160840:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f891f80, transno 17179872239 00000004:00080000:1.0:1746143678.160841:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f890380, transno 17179872240 00000004:00080000:1.0:1746143678.160843:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f893800, transno 17179872241 00000004:00080000:1.0:1746143678.160845:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f892a00, transno 17179872242 00000004:00080000:1.0:1746143678.160846:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef5f80, transno 17179872243 00000004:00080000:1.0:1746143678.160848:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef7800, transno 17179872247 00000004:00080000:1.0:1746143678.160850:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f891880, transno 17179872248 00000004:00080000:1.0:1746143678.160851:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef4e00, transno 17179872249 00000004:00080000:1.0:1746143678.160853:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef6a00, transno 17179872250 00000004:00080000:1.0:1746143678.160854:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef6300, transno 17179872251 00000004:00080000:1.0:1746143678.160856:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f893480, transno 17179872252 00000004:00080000:1.0:1746143678.160857:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef5880, transno 17179872253 00000004:00080000:1.0:1746143678.160859:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef4380, transno 17179872254 00000004:00080000:1.0:1746143678.160861:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cdc0380, transno 17179872255 00000004:00080000:1.0:1746143678.160863:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091717b80, transno 17179872256 00000004:00080000:1.0:1746143678.160865:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091715500, transno 17179872257 00000004:00080000:1.0:1746143678.160869:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091716680, transno 17179872258 00000004:00080000:1.0:1746143678.160871:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091715f80, transno 17179872259 00000004:00080000:1.0:1746143678.160872:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091715180, transno 17179872260 00000004:00080000:1.0:1746143678.160874:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091714000, transno 17179872261 00000004:00080000:1.0:1746143678.160876:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091717480, transno 17179872262 00000004:00080000:1.0:1746143678.160877:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091714380, transno 17179872263 00000004:00080000:1.0:1746143678.160879:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f890000, transno 17179872264 00000100:00100000:1.0:1746143678.160883:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593588480:0@lo:400:kworker.0 00000100:00100000:1.0:1746143678.160903:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b20e2be-dc58-49ff-81b7-9c0574412294:3292:1830963593588096:0@lo:400:kworker.0 00000100:00100000:0.0:1746143678.164219:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593588736:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143678.164228:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593588864:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143678.164463:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593588992:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143678.166422:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.167033:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.167048:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.167278:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593589248:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143678.167304:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593589376:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143678.167324:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593589120:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143678.167351:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143678.167379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.167907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.168345:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4424 00000100:00100000:1.0:1746143678.168351:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963591859072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.168358:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.168361:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173a00/0xe984082ccd722c7e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcaa expref: 22 pid: 20509 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.168369:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173a00/0xe984082ccd722c7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcaa expref: 22 pid: 20509 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.168379:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173a00/0xe984082ccd722c7e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcaa expref: 22 pid: 20509 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.168400:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143678.168403:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.168407:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.168422:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963591859072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 72us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.168427:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4424 00000100:00100000:0.0:1746143678.168712:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591859200 00000100:00100000:0.0:1746143678.168715:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591859200 00010000:00010000:0.0:1746143678.168728:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0xe984082ccd722c77 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc95 expref: 274 pid: 14763 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746143678.168740:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4425 00000100:00100000:0.0:1746143678.168744:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+274:1963:x1830963591859200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.168750:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.168753:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0xe984082ccd722c77 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc95 expref: 274 pid: 14763 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.168760:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0xe984082ccd722c77 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc95 expref: 274 pid: 14763 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.168770:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0xe984082ccd722c77 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fc95 expref: 274 pid: 14763 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.168780:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143678.168783:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143678.168788:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.168801:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+273:1963:x1830963591859200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 56us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.168806:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4425 00000100:00100000:0.0:1746143678.168852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.168862:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591859328 00000100:00100000:0.0:1746143678.168865:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591859328 00010000:00010000:0.0:1746143678.168874:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd722c93 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcb8 expref: 273 pid: 20509 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746143678.168883:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4426 00000100:00100000:0.0:1746143678.168888:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+273:1963:x1830963591859328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.168893:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.168896:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd722c93 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcb8 expref: 273 pid: 20509 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.168903:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd722c93 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcb8 expref: 273 pid: 20509 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.168913:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd722c93 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae461209fcb8 expref: 273 pid: 20509 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.168921:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143678.168923:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143678.168928:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.168940:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+272:1963:x1830963591859328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.168944:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4426 00000100:00100000:0.0:1746143678.170101:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143678.170953:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.170959:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000040:00080000:1.0:1746143678.172378:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2167, 88 off181632 00000004:00080000:1.0:1746143678.172386:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757182245856ns, next at 718104255928ns, rc = 0 00000040:00080000:1.0:1746143678.172704:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2128, 88 off178016 00000004:00080000:1.0:1746143678.172709:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757182569182ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143678.172924:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2129, 88 off178104 00000004:00080000:1.0:1746143678.172928:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757182787990ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143678.172935:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2168, 88 off181720 00000004:00080000:1.0:1746143678.172937:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757182797926ns, next at 718104255928ns, rc = 0 00000040:00080000:1.0:1746143678.172945:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2169, 88 off181808 00000004:00080000:1.0:1746143678.172947:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757182807898ns, next at 718104255928ns, rc = 0 00000040:00080000:1.0:1746143678.172953:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2130, 88 off178192 00000004:00080000:1.0:1746143678.172955:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757182815390ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143678.172961:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2131, 88 off178280 00000004:00080000:1.0:1746143678.172963:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757182823300ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143678.172969:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2132, 88 off178368 00000004:00080000:1.0:1746143678.172971:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757182831553ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143678.172977:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2170, 88 off181896 00000004:00080000:1.0:1746143678.172979:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757182839343ns, next at 718104255928ns, rc = 0 00000040:00080000:1.0:1746143678.172985:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2133, 88 off178456 00000004:00080000:1.0:1746143678.172999:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757182859315ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143678.173007:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2171, 88 off181984 00000004:00080000:1.0:1746143678.173010:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757182870155ns, next at 718104255928ns, rc = 0 00000040:00080000:1.0:1746143678.173016:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2134, 88 off178544 00000004:00080000:1.0:1746143678.173018:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757182878166ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143678.173024:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2172, 88 off182072 00000004:00080000:1.0:1746143678.173026:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757182886256ns, next at 718104255928ns, rc = 0 00000040:00080000:1.0:1746143678.173031:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2173, 88 off182160 00000004:00080000:1.0:1746143678.173033:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757182893940ns, next at 718104255928ns, rc = 0 00000040:00080000:1.0:1746143678.173039:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2174, 88 off182248 00000004:00080000:1.0:1746143678.173041:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757182901766ns, next at 718104255928ns, rc = 0 00000040:00080000:1.0:1746143678.173047:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2175, 88 off182336 00000004:00080000:1.0:1746143678.173050:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757182910590ns, next at 718104255928ns, rc = 0 00000040:00080000:1.0:1746143678.173057:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2135, 88 off178632 00000004:00080000:1.0:1746143678.173059:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757182919108ns, next at 718087967394ns, rc = 0 00000004:00080000:0.0:1746143678.173835:0:14805:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757183695016ns, next at 758183694006ns, rc = 0 00000100:00100000:1.0:1746143678.173886:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593589504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746143678.173930:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143678.176702:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593589504:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1746143678.197903:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1521 committed 00000001:00080000:0.0:1746143678.197923:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942087 is committed 00000001:00080000:0.0:1746143678.197933:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942115 is committed 00000004:00080000:0.0:1746143678.197935:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1482 committed 00000004:00080000:0.0:1746143678.197940:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1520 committed 00000004:00080000:0.0:1746143678.197942:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1519 committed 00000004:00080000:0.0:1746143678.197943:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1518 committed 00000004:00080000:0.0:1746143678.197944:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1517 committed 00000004:00080000:0.0:1746143678.197946:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1481 committed 00000004:00080000:0.0:1746143678.197947:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1516 committed 00000004:00080000:0.0:1746143678.197949:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1480 committed 00000004:00080000:0.0:1746143678.197950:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1515 committed 00000004:00080000:0.0:1746143678.197951:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1479 committed 00000004:00080000:0.0:1746143678.197953:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1478 committed 00000004:00080000:0.0:1746143678.197954:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1477 committed 00000004:00080000:0.0:1746143678.197955:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1514 committed 00000004:00080000:0.0:1746143678.197956:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1513 committed 00000004:00080000:0.0:1746143678.197958:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1476 committed 00000004:00080000:0.0:1746143678.197959:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1475 committed 00000004:00080000:0.0:1746143678.197960:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1512 committed 00000001:00080000:0.0:1746143678.197966:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942111 is committed 00000001:00080000:0.0:1746143678.197972:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942110 is committed 00000001:00080000:0.0:1746143678.198056:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942114 is committed 00000100:00100000:0.0:1746143678.198187:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593589888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143678.198239:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143678.198275:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593590400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143678.198289:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143678.198305:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143678.198309:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593590016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143678.198321:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143678.198330:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593590528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143678.198340:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143678.198362:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593589888 00000100:00100000:0.0:1746143678.198368:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593589888 00000100:00100000:0.0:1746143678.198393:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593590400 00000100:00100000:0.0:1746143678.198395:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593590400 00000100:00100000:0.0:1746143678.198404:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593590016 00000100:00100000:0.0:1746143678.198406:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593590016 00000100:00100000:0.0:1746143678.198413:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593590528 00000100:00100000:0.0:1746143678.198415:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593590528 00000100:00100000:0.0:1746143678.198426:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8715 00000100:00100000:0.0:1746143678.198432:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3292:x1830963593589888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143678.198604:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3292:x1830963593589888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 172us (365us total) trans 21474839552 rc 0/0 00000100:00100000:0.0:1746143678.198611:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8715 00000100:00100000:0.0:1746143678.198631:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8716 00000100:00100000:0.0:1746143678.198635:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3292:x1830963593590400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143678.198714:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3292:x1830963593590400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (423us total) trans 21474839553 rc 0/0 00000100:00100000:0.0:1746143678.198719:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8716 00000100:00100000:0.0:1746143678.198729:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8717 00000100:00100000:0.0:1746143678.198733:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3292:x1830963593590016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143678.198795:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143678.198798:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143678.198800:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143678.198801:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143678.198803:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143678.198820:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3292:x1830963593590016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (498us total) trans 21474839554 rc 0/0 00000100:00100000:0.0:1746143678.198825:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8717 00000100:00100000:0.0:1746143678.198835:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8718 00000100:00100000:0.0:1746143678.198839:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3292:x1830963593590528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143678.198911:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3292:x1830963593590528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (570us total) trans 21474839555 rc 0/0 00000100:00100000:0.0:1746143678.198916:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8718 00000004:00080000:0.0:1746143678.198947:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093500e00/2, rc 0, transno 21474839554 00000100:00100000:0.0:1746143678.198951:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593590016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143678.198957:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093501180/2, rc 0, transno 21474839555 00000100:00100000:0.0:1746143678.198959:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593590528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143678.198964:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093502300/2, rc 0, transno 21474839552 00000100:00100000:0.0:1746143678.198966:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593589888:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143678.198971:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093501500/2, rc 0, transno 21474839553 00000100:00100000:0.0:1746143678.198974:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593590400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143678.199106:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593589632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143678.199128:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143678.199156:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593590144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143678.199169:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143678.199179:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746143678.199183:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593589760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143678.199194:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143678.199202:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593590272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143678.199212:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143678.199229:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593589632 00000100:00100000:1.0:1746143678.199231:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593589632 00000100:00100000:1.0:1746143678.199246:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593590144 00000100:00100000:1.0:1746143678.199247:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593590144 00000100:00100000:1.0:1746143678.199254:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593589760 00000100:00100000:1.0:1746143678.199256:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593589760 00000100:00100000:1.0:1746143678.199261:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593590272 00000100:00100000:1.0:1746143678.199262:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593590272 00000100:00100000:1.0:1746143678.199267:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8719 00000100:00100000:1.0:1746143678.199271:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593589632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143678.199397:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593589632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (267us total) trans 21474839556 rc 0/0 00000100:00100000:1.0:1746143678.199402:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8719 00000100:00100000:1.0:1746143678.199412:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8720 00000100:00100000:1.0:1746143678.199415:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593590144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143678.199497:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:1.0:1746143678.199500:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:1.0:1746143678.199501:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143678.199503:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:1.0:1746143678.199505:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:1.0:1746143678.199519:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593590144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (350us total) trans 21474839557 rc 0/0 00000100:00100000:1.0:1746143678.199524:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8720 00000100:00100000:1.0:1746143678.199531:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8721 00000100:00100000:1.0:1746143678.199535:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593589760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143678.199597:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593589760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (402us total) trans 21474839558 rc 0/0 00000100:00100000:1.0:1746143678.199601:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8721 00000100:00100000:1.0:1746143678.199609:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8722 00000100:00100000:1.0:1746143678.199613:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593590272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143678.199678:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593590272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (464us total) trans 21474839559 rc 0/0 00000100:00100000:1.0:1746143678.199683:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8722 00000004:00010000:1.0:1746143678.199709:0:21713:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093502d80 reply state ffff880099c4d800 transno 8589942115 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:1.0:1746143678.199716:0:21713:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746143678.199766:0:21713:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746143678.199775:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:27905:x1830963591858432:12345-192.168.202.48@tcp:36:mirror_io.0 Request processed in 38814us (39121us total) trans 8589942115 rc 0/0 00000100:00100000:1.0:1746143678.199784:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8077 00010000:00010000:1.0:1746143678.199876:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.199883:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.199889:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.199895:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d59e800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143678.199898:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.199903:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.199914:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143678.199917:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143678.199920:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.199924:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e800/0xe984082ccd7233d2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00000004:00080000:1.0:1746143678.199947:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093502680/2, rc 0, transno 21474839558 00000100:00100000:1.0:1746143678.199950:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593589760:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143678.199956:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093503800/2, rc 0, transno 21474839559 00000100:00100000:1.0:1746143678.199958:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593590272:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143678.199963:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093503b80/2, rc 0, transno 21474839556 00000100:00100000:1.0:1746143678.199966:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593589632:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143678.199971:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093500000/2, rc 0, transno 21474839557 00000100:00100000:1.0:1746143678.199973:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593590144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143678.200419:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593591040 00000100:00100000:0.0:1746143678.200423:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593591040 00000100:00100000:0.0:1746143678.200440:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593590912 00000100:00100000:0.0:1746143678.200442:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593590912 00000100:00100000:0.0:1746143678.200449:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593591424 00000100:00100000:0.0:1746143678.200451:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593591424 00000100:00100000:0.0:1746143678.200461:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8724 00000100:00100000:0.0:1746143678.200466:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3293:x1830963593590912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143678.200593:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3293:x1830963593590912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 126us (192us total) trans 17179872283 rc 0/0 00000100:00100000:0.0:1746143678.200599:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8724 00000100:00100000:0.0:1746143678.201198:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593590784 00000100:00100000:0.0:1746143678.201201:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593590784 00000100:00100000:0.0:1746143678.201215:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593591296 00000100:00100000:0.0:1746143678.201217:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593591296 00000100:00100000:0.0:1746143678.201224:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593591168 00000100:00100000:0.0:1746143678.201226:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593591168 00000100:00100000:0.0:1746143678.201238:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8727 00000100:00100000:0.0:1746143678.201242:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963593590784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143678.201329:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3295:x1830963593590784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (251us total) trans 17179872287 rc 0/0 00000100:00100000:0.0:1746143678.201334:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8727 00000100:00100000:0.0:1746143678.201346:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8729 00000100:00100000:0.0:1746143678.201350:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593590656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143678.201429:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3295:x1830963593590656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (299us total) trans 17179872289 rc 0/0 00000100:00100000:0.0:1746143678.201434:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8729 00000100:00100000:0.0:1746143678.201444:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8731 00000100:00100000:0.0:1746143678.201448:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963593591680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143678.201802:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593591680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 353us (596us total) trans 17179872291 rc 0/0 00000100:00100000:0.0:1746143678.201808:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8731 00000100:00100000:0.0:1746143678.202126:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.202161:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591859584 00000100:00100000:1.0:1746143678.202165:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591859584 00000100:00100000:1.0:1746143678.202435:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8078 00000100:00100000:1.0:1746143678.202440:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:27905:x1830963591859584:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143678.202452:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.202463:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120200/0xe984082ccd7233d9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0134 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.202498:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120200/0xe984082ccd7233d9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0134 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.202508:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120200/0xe984082ccd7233d9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0134 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.202520:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143678.202522:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143678.202524:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2120200, rc 0) 00000100:00100000:1.0:1746143678.202920:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:27905:x1830963591859584:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 478us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.202926:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8078 00000100:00100000:1.0:1746143678.209119:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.212753:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.214463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.240584:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.242056:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591860480 00000100:00100000:1.0:1746143678.242064:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591860480 00000100:00100000:1.0:1746143678.242119:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8079 00000100:00100000:1.0:1746143678.242127:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+6:27913:x1830963591860480:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143678.242178:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.242197:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120a00/0xe984082ccd7233e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a013b expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.242278:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7233e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242288:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7233e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242298:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7233e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242309:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121200/0xe984082ccd7233ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242318:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121200/0xe984082ccd7233ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242324:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121200/0xe984082ccd7233ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242411:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210600/0xe984082ccd7233f5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242419:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210600/0xe984082ccd7233f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242424:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210600/0xe984082ccd7233f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143678.242432:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143678.242492:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7233e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242498:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7233e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242504:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7233e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242509:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a2121600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143678.242513:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7233e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242518:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7233e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242527:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143678.242529:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143678.242532:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7233e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242537:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7233e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242563:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121200/0xe984082ccd7233ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242568:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121200/0xe984082ccd7233ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242574:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121200/0xe984082ccd7233ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242578:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a2121200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143678.242580:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121200/0xe984082ccd7233ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242588:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121200/0xe984082ccd7233ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242594:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74b00) 00010000:00010000:1.0:1746143678.242596:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143678.242598:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121200/0xe984082ccd7233ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242602:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121200/0xe984082ccd7233ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.242635:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120a00/0xe984082ccd7233e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a013b expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.242645:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210600/0xe984082ccd7233f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a013b expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.242651:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143678.242653:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143678.242655:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2210600, rc 0) 00000100:00100000:1.0:1746143678.242704:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+8:27913:x1830963591860480:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 576us (2125us total) trans 8589942118 rc 0/0 00000100:00100000:1.0:1746143678.242709:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8079 00000100:00100000:0.0:1746143678.254621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.282362:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.282459:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591860992 00000100:00100000:1.0:1746143678.282467:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591860992 00000100:00100000:1.0:1746143678.282512:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8081 00000100:00100000:1.0:1746143678.282518:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:27915:x1830963591860992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143678.282535:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.282550:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd723426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0149 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.282619:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121a00/0xe984082ccd72342d lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.282629:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121a00/0xe984082ccd72342d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.282638:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121a00/0xe984082ccd72342d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143678.282645:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143678.282721:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd723426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0149 expref: 245 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.282748:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121a00/0xe984082ccd72342d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0149 expref: 244 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.282755:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143678.282758:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143678.282760:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2121a00, rc 0) 00000100:00100000:1.0:1746143678.282791:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:27915:x1830963591860992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 274us (437us total) trans 8589942120 rc 0/0 00000100:00100000:1.0:1746143678.282796:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8081 00000100:00100000:0.0:1746143678.287790:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.294472:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.298071:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.298162:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.298180:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.298190:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.298212:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.298231:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591861504 00000100:00100000:1.0:1746143678.298234:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591861504 00000100:00100000:1.0:1746143678.298249:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591861760 00000100:00100000:1.0:1746143678.298250:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591861760 00000100:00100000:1.0:1746143678.298259:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8734 00000100:00100000:1.0:1746143678.298264:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963591861504:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143678.298270:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.305616:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a2121200/0xe984082ccd723473 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0165 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143678.305642:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409bd, atime: 0x681409bc, ctime: 0x681409bd, blocks: 0x81f 00010000:00010000:1.0:1746143678.305659:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143678.305661:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143678.305671:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2121200/0xe984082ccd723473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0165 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.305685:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a2121200/0xe984082ccd723473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0165 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.305694:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2121200, rc 0) 00000100:00100000:1.0:1746143678.305745:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963591861504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7478us (7672us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.305752:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8734 00000100:00100000:0.0:1746143678.314280:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.314320:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.314345:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.314359:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.314370:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.314408:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.314432:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591862144 00000100:00100000:0.0:1746143678.314439:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591862144 00000100:00100000:0.0:1746143678.314467:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591862272 00000100:00100000:0.0:1746143678.314468:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591862272 00000100:00100000:0.0:1746143678.314477:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591862400 00000100:00100000:0.0:1746143678.314478:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591862400 00000100:00100000:0.0:1746143678.314487:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591862528 00000100:00100000:0.0:1746143678.314488:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591862528 00000100:00100000:0.0:1746143678.314498:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591862656 00000100:00100000:0.0:1746143678.314500:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591862656 00000100:00100000:0.0:1746143678.314506:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591862784 00000100:00100000:0.0:1746143678.314509:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591862784 00000100:00100000:0.0:1746143678.314518:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8738 00000100:00100000:0.0:1746143678.314524:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963591862144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143678.314539:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.314553:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bcafe00/0xe984082ccd72347a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0181 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.314572:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.314574:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.314582:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bcafe00/0xe984082ccd72347a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0181 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.314595:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bcafe00/0xe984082ccd72347a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0181 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.314604:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bcafe00, rc 0) 00000100:00100000:0.0:1746143678.314640:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963591862144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 115us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.314645:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8738 00000100:00100000:0.0:1746143678.314670:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8739 00000100:00100000:0.0:1746143678.314674:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963591862272:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143678.314681:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.314689:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bcae600/0xe984082ccd723481 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0188 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.314698:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.314699:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.314703:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bcae600/0xe984082ccd723481 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0188 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.314712:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bcae600/0xe984082ccd723481 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0188 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.314718:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bcae600, rc 0) 00000100:00100000:0.0:1746143678.314732:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963591862272:12345-192.168.202.48@tcp:101:cat.0 Request processed in 58us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.314740:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8739 00000100:00100000:0.0:1746143678.314750:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8740 00000100:00100000:0.0:1746143678.314754:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963591862400:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143678.314759:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.314764:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d53be00/0xe984082ccd723488 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a018f expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.314773:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.314774:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.314777:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d53be00/0xe984082ccd723488 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a018f expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.314785:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d53be00/0xe984082ccd723488 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a018f expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.314791:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d53be00, rc 0) 00000100:00100000:0.0:1746143678.314803:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963591862400:12345-192.168.202.48@tcp:101:cat.0 Request processed in 48us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.314807:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8740 00000100:00100000:0.0:1746143678.314816:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8741 00000100:00100000:0.0:1746143678.314820:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963591862528:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143678.314825:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.314830:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd72348f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0196 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.314840:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.314841:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.314845:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd72348f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0196 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.314852:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd72348f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0196 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.314858:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d53bc00, rc 0) 00000100:00100000:0.0:1746143678.314869:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963591862528:12345-192.168.202.48@tcp:101:cat.0 Request processed in 49us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.314874:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8741 00000100:00100000:0.0:1746143678.314884:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8742 00000100:00100000:0.0:1746143678.314888:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963591862656:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143678.314893:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.314898:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d53ba00/0xe984082ccd723496 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a019d expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.314906:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.314907:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.314910:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d53ba00/0xe984082ccd723496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a019d expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.314917:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d53ba00/0xe984082ccd723496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a019d expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.314923:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d53ba00, rc 0) 00000100:00100000:0.0:1746143678.314935:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963591862656:12345-192.168.202.48@tcp:101:cat.0 Request processed in 47us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.314942:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8742 00000100:00100000:0.0:1746143678.314952:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8743 00000100:00100000:0.0:1746143678.314956:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963591862784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143678.314961:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.314966:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd16800/0xe984082ccd72349d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a01a4 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.314974:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.314975:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.314978:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd16800/0xe984082ccd72349d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01a4 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.314998:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd16800/0xe984082ccd72349d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01a4 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.315004:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd16800, rc 0) 00000100:00100000:0.0:1746143678.315019:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963591862784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 62us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.315023:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8743 00000100:00100000:0.0:1746143678.336248:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.336282:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.336304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.337290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.338199:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3005 00000100:00100000:0.0:1746143678.338211:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963591863168:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143678.338830:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3007 00000100:00100000:0.0:1746143678.338836:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963591863680:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143678.346768:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.346806:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.346832:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.346861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.363638:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.367972:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963591863168:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29752us (31718us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143678.367994:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3005 00002000:00100000:0.0:1746143678.368008:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008f891880 x1830963591863168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:74/0 lens 488/440 e 0 to 0 dl 1746143689 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143678.368017:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f891880 with x1830963591863168 ext(0->1048575) 00002000:00010000:0.0:1746143678.368023:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f891880 00000100:00100000:0.0:1746143678.369376:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4429 00000100:00100000:0.0:1746143678.369383:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:1964:x1830963591865216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.369389:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.369393:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e200/0xe984082ccd723418 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0142 expref: 245 pid: 16090 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.369400:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d59e200/0xe984082ccd723418 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0142 expref: 245 pid: 16090 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.369410:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143678.369412:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716c00/0xe984082ccd7234ab lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143678.369418:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a716c00/0xe984082ccd7234ab lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143678.369422:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.369435:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:1964:x1830963591865216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.369440:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4429 00000100:00100000:0.0:1746143678.375521:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963591863552:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35352us (38221us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143678.375534:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3008 00002000:00100000:0.0:1746143678.375548:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008f890700 x1830963591863552/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:74/0 lens 488/440 e 0 to 0 dl 1746143689 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143678.375558:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f890700 with x1830963591863552 ext(1048576->2097151) 00002000:00010000:0.0:1746143678.375564:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f890700 00000100:00100000:0.0:1746143678.414669:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000001:00080000:1.0:1746143678.418735:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942120 is committed 00000001:00080000:1.0:1746143678.418748:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942118 is committed 00000001:00080000:1.0:1746143678.418755:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942117 is committed 00000001:00080000:1.0:1746143678.418761:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942122 is committed 00000004:00080000:1.0:1746143678.418765:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1490 committed 00000004:00080000:1.0:1746143678.418772:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1530 committed 00000004:00080000:1.0:1746143678.418777:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1529 committed 00000004:00080000:1.0:1746143678.418779:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1528 committed 00000004:00080000:1.0:1746143678.418781:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1527 committed 00000004:00080000:1.0:1746143678.418783:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1489 committed 00000004:00080000:1.0:1746143678.418784:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1526 committed 00000004:00080000:1.0:1746143678.418786:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1488 committed 00000004:00080000:1.0:1746143678.418788:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1525 committed 00000004:00080000:1.0:1746143678.418790:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1487 committed 00000004:00080000:1.0:1746143678.418792:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1486 committed 00000004:00080000:1.0:1746143678.418794:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1485 committed 00000004:00080000:1.0:1746143678.418796:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1524 committed 00000004:00080000:1.0:1746143678.418798:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1523 committed 00000004:00080000:1.0:1746143678.418800:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1484 committed 00000004:00080000:1.0:1746143678.418801:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1483 committed 00000004:00080000:1.0:1746143678.418804:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1522 committed 00000100:00100000:0.0:1746143678.418955:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593592320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143678.419027:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143678.419068:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593592832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143678.419082:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143678.419098:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143678.419102:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593592448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143678.419114:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143678.419123:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593592960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143678.419133:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143678.421564:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593593344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143678.421588:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143678.421606:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593593856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143678.421619:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143678.421634:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930de300/2, rc 0, transno 21474839562 00000100:00100000:0.0:1746143678.421637:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593592448:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143678.421644:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930de680/2, rc 0, transno 21474839563 00000100:00100000:0.0:1746143678.421647:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593592960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143678.421653:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f9500/2, rc 0, transno 21474839560 00000100:00100000:0.0:1746143678.421655:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593592320:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143678.421661:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dc380/2, rc 0, transno 21474839561 00000100:00100000:0.0:1746143678.421663:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593592832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143678.421670:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143678.421675:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593593472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143678.421688:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143678.421697:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593593984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143678.421707:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143678.421722:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593593344 00000100:00100000:0.0:1746143678.421724:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593593344 00000100:00100000:0.0:1746143678.421737:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593593856 00000100:00100000:0.0:1746143678.421738:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593593856 00000100:00100000:0.0:1746143678.421744:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593593472 00000100:00100000:0.0:1746143678.421745:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593593472 00000100:00100000:0.0:1746143678.421751:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8757 00000100:00100000:0.0:1746143678.421755:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963593593344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143678.421844:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143678.421847:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143677 -> 1746143677 00002000:00010000:0.0:1746143678.421849:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143676 -> 1746143676 00002000:00010000:0.0:1746143678.421851:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143677 -> 1746143677 00002000:00010000:0.0:1746143678.421853:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746143678.421873:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963593593344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (284us total) trans 17179872297 rc 0/0 00000100:00100000:0.0:1746143678.421879:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8757 00000100:00100000:0.0:1746143678.421889:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593593984 00000100:00100000:0.0:1746143678.421892:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593593984 00000100:00100000:0.0:1746143678.421900:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8758 00000100:00100000:0.0:1746143678.421904:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963593593856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143678.421974:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3292:x1830963593593856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (353us total) trans 17179872298 rc 0/0 00000100:00100000:0.0:1746143678.421979:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8758 00000100:00100000:0.0:1746143678.422002:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8759 00000100:00100000:0.0:1746143678.422007:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963593593472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143678.422072:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:0.0:1746143678.422075:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143677 -> 1746143677 00002000:00010000:0.0:1746143678.422077:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143676 -> 1746143676 00002000:00010000:0.0:1746143678.422079:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143677 -> 1746143677 00002000:00010000:0.0:1746143678.422081:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5543 -> 5543 00000100:00100000:0.0:1746143678.422098:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3292:x1830963593593472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (408us total) trans 17179872299 rc 0/0 00000100:00100000:0.0:1746143678.422103:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8759 00000100:00100000:0.0:1746143678.422113:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8760 00000100:00100000:0.0:1746143678.422118:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963593593984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143678.422212:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3292:x1830963593593984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (503us total) trans 17179872300 rc 0/0 00000100:00100000:0.0:1746143678.422217:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8760 00000004:00080000:0.0:1746143678.422295:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0a55c00/2, rc 0, transno 17179872299 00000100:00100000:0.0:1746143678.422299:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593593472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143678.422305:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0a57100/2, rc 0, transno 17179872300 00000100:00100000:0.0:1746143678.422307:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593593984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143678.422312:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0a55880/2, rc 0, transno 17179872297 00000100:00100000:0.0:1746143678.422315:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593593344:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143678.422320:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0a55180/2, rc 0, transno 17179872298 00000100:00100000:0.0:1746143678.422322:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593593856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143678.426133:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.429754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.429792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.429833:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.436650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.436804:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591866368 00000100:00100000:0.0:1746143678.436814:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591866368 00000100:00100000:0.0:1746143678.436874:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 521 00000100:00100000:0.0:1746143678.436882:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:1963:x1830963591866368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.436896:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.436920:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57af200/0xe984082ccd7234c0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01c0 expref: 242 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.436937:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143678.436940:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.436994:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:1963:x1830963591866368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 104us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.437000:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 521 00000100:00100000:0.0:1746143678.440993:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.441047:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.446186:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.447676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.454793:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.454833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.454896:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591867392 00000100:00100000:0.0:1746143678.454907:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591867392 00010000:00010000:0.0:1746143678.454949:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a963200/0xe984082ccd723449 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0173 expref: 22 pid: 6929 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746143678.454998:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591867264 00000100:00100000:0.0:1746143678.455001:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591867264 00010000:00010000:0.0:1746143678.455012:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd16800/0xe984082ccd72349d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01a4 expref: 14 pid: 25369 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746143678.455028:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4431 00000100:00100000:0.0:1746143678.455035:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963591867392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.455050:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.455074:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a963200/0xe984082ccd723449 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0173 expref: 22 pid: 6929 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.455084:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a963200/0xe984082ccd723449 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0173 expref: 22 pid: 6929 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.455109:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a963200/0xe984082ccd723449 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0173 expref: 22 pid: 6929 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.455124:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.455186:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963591867392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 150us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.455195:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4431 00000100:00100000:0.0:1746143678.455225:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4432 00000100:00100000:0.0:1746143678.455230:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963591867264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.455236:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.455243:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd16800/0xe984082ccd72349d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01a4 expref: 14 pid: 25369 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.455251:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd16800/0xe984082ccd72349d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01a4 expref: 14 pid: 25369 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.455263:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd16800/0xe984082ccd72349d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01a4 expref: 14 pid: 25369 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.455271:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.455273:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.455280:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930c5c00/0xe984082ccd7234c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4169728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01c7 expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.455288:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930c5c00/0xe984082ccd7234c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4169728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01c7 expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.455296:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.455297:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.455300:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae600/0xe984082ccd7234ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01ce expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.455307:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae600/0xe984082ccd7234ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01ce expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.455340:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae600/0xe984082ccd7234ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01ce expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143678.455353:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593594880:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143678.455413:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800930c5c00/0xe984082ccd7234c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4169728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01c7 expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143678.455421:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593595008:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143678.455439:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143678.459293:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.459954:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593594880:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143678.459966:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593595008:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143678.459998:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.460018:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963591867264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4787us (5184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.460025:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4432 00000100:00100000:0.0:1746143678.462289:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.463019:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.467482:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.469199:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.469235:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.469258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.469313:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591868544 00000100:00100000:1.0:1746143678.469318:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591868544 00002000:00100000:1.0:1746143678.469356:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880093f01880 x1830963591868544/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:74/0 lens 488/0 e 0 to 0 dl 1746143689 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.469365:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01880 with x1830963591868544 ext(1048576->2097151) 00002000:00010000:1.0:1746143678.469369:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01880 00000100:00100000:1.0:1746143678.469393:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591868928 00000100:00100000:1.0:1746143678.469396:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591868928 00002000:00100000:1.0:1746143678.469407:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880093f01c00 x1830963591868928/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:74/0 lens 488/0 e 0 to 0 dl 1746143689 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.469418:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01c00 with x1830963591868928 ext(1048576->2097151) 00002000:00010000:1.0:1746143678.469421:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01c00 00000100:00100000:1.0:1746143678.469486:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3018 00000100:00100000:1.0:1746143678.469492:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963591868800:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143678.470020:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3019 00000100:00100000:0.0:1746143678.470029:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963591868928:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143678.470671:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.470695:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.470919:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591869056 00000100:00100000:1.0:1746143678.470924:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591869056 00010000:00010000:1.0:1746143678.470941:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d53ba00/0xe984082ccd723496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a019d expref: 12 pid: 25369 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746143678.470969:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591869184 00000100:00100000:1.0:1746143678.470972:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591869184 00010000:00010000:1.0:1746143678.470982:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a963e00/0xe984082ccd723457 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a016c expref: 23 pid: 6929 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746143678.471007:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4433 00000100:00100000:1.0:1746143678.471013:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963591869056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.471024:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.471041:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d53ba00/0xe984082ccd723496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a019d expref: 12 pid: 25369 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.471051:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d53ba00/0xe984082ccd723496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a019d expref: 12 pid: 25369 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.471069:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d53ba00/0xe984082ccd723496 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a019d expref: 12 pid: 25369 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.471084:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.471106:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963591869056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 93us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.471111:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4433 00000100:00100000:1.0:1746143678.471121:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4434 00000100:00100000:1.0:1746143678.471125:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963591869184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.471130:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.471137:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a963e00/0xe984082ccd723457 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a016c expref: 23 pid: 6929 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.471276:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a963e00/0xe984082ccd723457 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a016c expref: 23 pid: 6929 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.471288:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a963e00/0xe984082ccd723457 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a016c expref: 23 pid: 6929 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.471302:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143678.471304:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143678.471311:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57afc00/0xe984082ccd7234d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3727360->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01d5 expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.471319:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57afc00/0xe984082ccd7234d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3727360->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01d5 expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.471325:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143678.471326:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143678.471329:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b5c600/0xe984082ccd7234dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3727359] (req 3145728->3723263) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01dc expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.471334:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b5c600/0xe984082ccd7234dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3727359] (req 3145728->3723263) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01dc expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.471360:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093b5c600/0xe984082ccd7234dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3727359] (req 3145728->3723263) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01dc expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143678.471370:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091717480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593595392:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143678.471426:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57afc00/0xe984082ccd7234d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3727360->18446744073709551615] (req 4194304->4677631) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01d5 expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143678.471433:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593595520:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143678.471449:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143678.471840:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.482661:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.482683:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591869696 00000100:00100000:1.0:1746143678.482691:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591869696 00002000:00100000:1.0:1746143678.482733:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3719168->3723263) req@ffff880091715880 x1830963591869696/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:74/0 lens 488/0 e 0 to 0 dl 1746143689 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.482744:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091715880 with x1830963591869696 ext(3719168->3723263) 00002000:00010000:1.0:1746143678.482749:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091715880 00000100:00100000:1.0:1746143678.482782:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3021 00000100:00100000:1.0:1746143678.482789:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963591869696:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143678.482950:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963591869696:12345-192.168.202.48@tcp:3:cat.0 Request processed in 161us (300us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143678.482957:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3021 00002000:00100000:1.0:1746143678.482962:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3719168->3723263) req@ffff880091715880 x1830963591869696/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:74/0 lens 488/4536 e 0 to 0 dl 1746143689 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.482969:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091715880 with x1830963591869696 ext(3719168->3723263) 00002000:00010000:1.0:1746143678.482972:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091715880 00000100:00100000:1.0:1746143678.483069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.483079:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591869952 00000100:00100000:1.0:1746143678.483082:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591869952 00002000:00100000:1.0:1746143678.483094:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4673536->4677631) req@ffff880091716a00 x1830963591869952/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:74/0 lens 488/0 e 0 to 0 dl 1746143689 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.483101:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091716a00 with x1830963591869952 ext(4673536->4677631) 00002000:00010000:1.0:1746143678.483104:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091716a00 00000100:00100000:1.0:1746143678.483114:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3022 00000100:00100000:1.0:1746143678.483118:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963591869952:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143678.483197:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963591869952:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 78us (128us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143678.483202:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3022 00002000:00100000:1.0:1746143678.483206:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4673536->4677631) req@ffff880091716a00 x1830963591869952/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:74/0 lens 488/4536 e 0 to 0 dl 1746143689 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.483213:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091716a00 with x1830963591869952 ext(4673536->4677631) 00002000:00010000:1.0:1746143678.483216:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091716a00 00000100:00100000:0.0:1746143678.483341:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091717480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593595392:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143678.483353:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091715c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593595520:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143678.483374:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.483410:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963591869184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12284us (12714us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.483418:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4434 00000100:00100000:1.0:1746143678.496534:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963591868800:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 27029us (27286us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143678.496548:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3018 00002000:00100000:1.0:1746143678.496561:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880093f00000 x1830963591868800/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:74/0 lens 488/440 e 0 to 0 dl 1746143689 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.496570:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00000 with x1830963591868800 ext(1048576->2097151) 00002000:00010000:1.0:1746143678.496577:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f00000 00000100:00100000:0.0:1746143678.497559:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.503749:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.504123:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.504156:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591870720 00000100:00100000:0.0:1746143678.504159:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591870720 00000100:00100000:0.0:1746143678.504180:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8766 00000100:00100000:0.0:1746143678.504185:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963591870720:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143678.504192:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.504202:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013013d400/0xe984082ccd7234ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a01ea expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143678.504228:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593595776:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143678.504391:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143678.506033:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:1.0:1746143678.506177:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime: 1746143677 -> 1746143678 00002000:00010000:1.0:1746143678.506180:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143677 -> 1746143678 00002000:00010000:1.0:1746143678.506182:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime: 1746143677 -> 1746143678 00000100:00100000:1.0:1746143678.506195:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009509a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593595776:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143678.506210:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013013d400/0xe984082ccd7234ea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01ea expref: 20 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.506219:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013013d400/0xe984082ccd7234ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01ea expref: 20 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.506239:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013d400, rc 0) 00000100:00100000:1.0:1746143678.506257:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963591870720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2072us (2135us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143678.506262:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8766 00000100:00100000:0.0:1746143678.510230:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.511930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.513718:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.513878:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591871488 00000100:00100000:1.0:1746143678.513885:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591871488 00002000:00100000:1.0:1746143678.513912:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880095098700 x1830963591871488/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:74/0 lens 488/0 e 0 to 0 dl 1746143689 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.513919:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098700 with x1830963591871488 ext(2097152->3145727) 00002000:00010000:1.0:1746143678.513923:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095098700 00000100:00100000:1.0:1746143678.514356:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3024 00000100:00100000:1.0:1746143678.514364:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963591871488:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143678.525517:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963591871488:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11140us (11787us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143678.525532:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3024 00002000:00100000:1.0:1746143678.525545:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880095098700 x1830963591871488/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:74/0 lens 488/440 e 0 to 0 dl 1746143689 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.525554:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098700 with x1830963591871488 ext(2097152->3145727) 00002000:00010000:1.0:1746143678.525565:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095098700 00000100:00100000:0.0:1746143678.530933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.531346:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591871616 00000100:00100000:1.0:1746143678.531356:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591871616 00000100:00100000:1.0:1746143678.531936:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8769 00000100:00100000:1.0:1746143678.531946:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:27915:x1830963591871616:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143678.531966:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.531995:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd7234ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a01ff expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.532025:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae600/0xe984082ccd7234ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01ce expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.532032:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143678.532034:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143678.532037:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd7234ff lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01ff expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.532076:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae600/0xe984082ccd7234ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01ce expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.532087:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae600/0xe984082ccd7234ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3141632->3145727] (req 3141632->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01ce expref: 20 pid: 21542 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746143678.532099:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091717800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593595904:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143678.532198:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143678.535022:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091717800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593595904:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143678.535050:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd7234ff lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01ff expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.535067:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7bde00, rc 0) 00000100:00100000:1.0:1746143678.535102:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:27915:x1830963591871616:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3158us (4180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.535109:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8769 00000100:00100000:0.0:1746143678.542622:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591871872 00000100:00100000:0.0:1746143678.542629:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591871872 00000100:00100000:0.0:1746143678.542679:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8770 00000100:00100000:0.0:1746143678.542685:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+11:27918:x1830963591871872:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143678.542704:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.542722:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57af800/0xe984082ccd723506 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0206 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.542752:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143678.542757:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57af800/0xe984082ccd723506 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0206 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.542768:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57af800/0xe984082ccd723506 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0206 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.542780:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57af800, rc 0) 00000100:00100000:0.0:1746143678.542832:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:27918:x1830963591871872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 146us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.542838:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8770 00000100:00100000:0.0:1746143678.544395:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.550711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.552995:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.553036:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.553104:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591872640 00000100:00100000:1.0:1746143678.553112:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591872640 00002000:00100000:1.0:1746143678.553170:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880095099f80 x1830963591872640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:74/0 lens 488/0 e 0 to 0 dl 1746143689 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.553179:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099f80 with x1830963591872640 ext(2097152->3145727) 00002000:00010000:1.0:1746143678.553184:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095099f80 00000100:00100000:1.0:1746143678.553204:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591872768 00000100:00100000:1.0:1746143678.553207:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591872768 00002000:00100000:1.0:1746143678.553220:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3723264->3727359) req@ffff880095099180 x1830963591872768/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:74/0 lens 488/0 e 0 to 0 dl 1746143689 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.553228:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099180 with x1830963591872768 ext(3723264->3727359) 00002000:00010000:1.0:1746143678.553231:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095099180 00000100:00100000:1.0:1746143678.553246:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3027 00000100:00100000:1.0:1746143678.553251:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963591872768:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143678.553441:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963591872768:12345-192.168.202.48@tcp:3:cat.0 Request processed in 188us (403us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143678.553447:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3027 00002000:00100000:1.0:1746143678.553453:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3723264->3727359) req@ffff880095099180 x1830963591872768/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:74/0 lens 488/4536 e 0 to 0 dl 1746143689 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.553459:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099180 with x1830963591872768 ext(3723264->3727359) 00002000:00010000:1.0:1746143678.553462:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095099180 00000100:00100000:0.0:1746143678.583103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.588910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.588991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.602865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.613298:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.619571:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.625694:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.630037:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.631191:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.631377:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.631408:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591874560 00000100:00100000:1.0:1746143678.631411:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591874560 00002000:00100000:1.0:1746143678.631432:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4169727) req@ffff880091714a80 x1830963591874560/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:74/0 lens 488/0 e 0 to 0 dl 1746143689 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143678.631440:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091714a80 with x1830963591874560 ext(3145728->4169727) 00002000:00010000:1.0:1746143678.631444:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091714a80 00000100:00100000:1.0:1746143678.631464:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3029 00000100:00100000:1.0:1746143678.631470:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963591874432:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143678.637618:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.637971:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591874688 00000100:00100000:1.0:1746143678.637990:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591874688 00000100:00100000:1.0:1746143678.638046:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8773 00000100:00100000:1.0:1746143678.638054:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:27922:x1830963591874688:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143678.638073:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.638093:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72353e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0222 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.638257:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd7234ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01ff expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.638267:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57af800/0xe984082ccd723506 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0206 expref: 13 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.638274:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143678.638275:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143678.638279:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72353e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2113536->2297855] (req 2113536->2297855) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0222 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.638316:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57af800/0xe984082ccd723506 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0206 expref: 13 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.638328:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57af800/0xe984082ccd723506 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0206 expref: 13 pid: 21542 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746143678.638341:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091714e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593596800:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143678.638440:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd7234ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01ff expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.638448:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd7234ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01ff expref: 22 pid: 21542 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746143678.638456:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593596928:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143678.638475:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143678.645487:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.645710:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091714e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593596800:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143678.645721:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091715c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593596928:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143678.645748:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72353e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2113536->2297855] (req 2113536->2297855) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0222 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.645761:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7bd000, rc 0) 00000100:00100000:1.0:1746143678.645785:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:27922:x1830963591874688:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7731us (8178us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.645795:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8773 00000100:00100000:0.0:1746143678.649312:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.662964:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.667643:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.667831:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591875328 00000100:00100000:1.0:1746143678.667843:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591875328 00000100:00100000:1.0:1746143678.667902:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8774 00000100:00100000:1.0:1746143678.667910:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:27915:x1830963591875328:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143678.667930:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.667950:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd800/0xe984082ccd723545 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0229 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.667994:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930c5c00/0xe984082ccd7234c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4169728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01c7 expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.668002:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143678.668004:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143678.668008:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd800/0xe984082ccd723545 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0229 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.668040:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930c5c00/0xe984082ccd7234c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4169728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01c7 expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.668053:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930c5c00/0xe984082ccd7234c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4169728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01c7 expref: 10 pid: 12618 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746143678.668066:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593597184:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143678.668853:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143678.670254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.670437:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091715c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593597184:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143678.670464:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd800/0xe984082ccd723545 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0229 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.670481:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7bd800, rc 0) 00000100:00100000:0.0:1746143678.670520:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:27915:x1830963591875328:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2611us (2886us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.670528:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8774 00000100:00100000:0.0:1746143678.670555:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591875456 00000100:00100000:0.0:1746143678.670559:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591875456 00000100:00100000:0.0:1746143678.670604:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8775 00000100:00100000:0.0:1746143678.670610:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963591875456:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143678.670682:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.670698:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72354c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0230 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143678.670741:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593597312:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143678.670801:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143678.671668:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.672451:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593597312:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143678.672476:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72354c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0230 expref: 13 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.672486:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72354c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0230 expref: 13 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.672520:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c25aa00, rc 0) 00000100:00100000:1.0:1746143678.672556:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963591875456:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1946us (2418us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143678.672562:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8775 00000100:00100000:0.0:1746143678.672722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.675673:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.683505:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.683897:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.693044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.693089:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.693262:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591876608 00000100:00100000:1.0:1746143678.693266:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591876608 00000100:00100000:0.0:1746143678.693522:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe35c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593597440:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143678.693543:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.693583:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963591876224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9454us (9687us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.693591:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4440 00000100:00100000:1.0:1746143678.694255:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8776 00000100:00100000:1.0:1746143678.694264:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963591876608:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143678.694274:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.694292:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ee1600/0xe984082ccd723553 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0237 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.694320:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ee1600/0xe984082ccd723553 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0237 expref: 13 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.694331:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ee1600/0xe984082ccd723553 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0237 expref: 13 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.694353:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ee1600, rc 0) 00000100:00100000:1.0:1746143678.694377:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963591876608:12345-192.168.202.48@tcp:101:cat.0 Request processed in 115us (1287us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143678.694381:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8776 00000100:00100000:0.0:1746143678.707778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.713596:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.713673:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591877120 00000100:00100000:1.0:1746143678.713682:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591877120 00000100:00100000:1.0:1746143678.713733:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8778 00000100:00100000:1.0:1746143678.713740:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963591877120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143678.713760:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.713777:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ee0400/0xe984082ccd723561 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0245 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.713807:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ee0400/0xe984082ccd723561 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0245 expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.713817:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ee0400/0xe984082ccd723561 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0245 expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.713829:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ee0400, rc 0) 00000100:00100000:1.0:1746143678.713869:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963591877120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 130us (285us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143678.713874:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8778 00000100:00100000:0.0:1746143678.724581:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.732731:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.735728:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591877888 00000100:00100000:0.0:1746143678.735736:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591877888 00000100:00100000:0.0:1746143678.735782:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8088 00000100:00100000:0.0:1746143678.735789:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:27925:x1830963591877888:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143678.735811:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.735830:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1c00/0xe984082ccd723568 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a024c expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.735940:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd72356f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.735953:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd72356f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.735964:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd72356f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.735978:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd723576 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.735996:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd723576 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736001:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd723576 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736106:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0e00/0xe984082ccd72357d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736113:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0e00/0xe984082ccd72357d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736119:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0e00/0xe984082ccd72357d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143678.736127:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143678.736226:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd72356f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736232:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd72356f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736238:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd72356f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736243:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800957e0000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143678.736247:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd72356f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736253:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd72356f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736264:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143678.736267:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143678.736271:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd72356f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736276:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd72356f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736308:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd723576 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736313:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd723576 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736318:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd723576 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736322:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800957e0600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143678.736324:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd723576 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736328:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd723576 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736334:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800939cdb00) 00010000:00010000:0.0:1746143678.736336:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143678.736337:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd723576 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736341:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd723576 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143678.736377:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1c00/0xe984082ccd723568 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a024c expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.736393:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0e00/0xe984082ccd72357d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a024c expref: 12 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.736398:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143678.736400:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143678.736403:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0e00, rc 0) 00000100:00100000:0.0:1746143678.736439:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:27925:x1830963591877888:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 650us (781us total) trans 8589942128 rc 0/0 00000100:00100000:0.0:1746143678.736445:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8088 00000100:00100000:0.0:1746143678.743676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.823243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.823282:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.823301:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.823312:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.823331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.823342:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.823362:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.823384:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591878144 00000100:00100000:0.0:1746143678.823392:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591878144 00000100:00100000:0.0:1746143678.823428:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591878272 00000100:00100000:0.0:1746143678.823429:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591878272 00000100:00100000:0.0:1746143678.823439:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591878528 00000100:00100000:0.0:1746143678.823440:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591878528 00000100:00100000:0.0:1746143678.823448:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591878400 00000100:00100000:0.0:1746143678.823449:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591878400 00000100:00100000:0.0:1746143678.823456:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591878656 00000100:00100000:0.0:1746143678.823458:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591878656 00000100:00100000:0.0:1746143678.823463:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591878784 00000100:00100000:0.0:1746143678.823465:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591878784 00000100:00100000:0.0:1746143678.823470:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591878912 00000100:00100000:0.0:1746143678.823471:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591878912 00000100:00100000:0.0:1746143678.823479:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8779 00000100:00100000:0.0:1746143678.823486:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963591878144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143678.823506:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.823523:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e0a00/0xe984082ccd7235a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a025a expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.823554:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957e0a00/0xe984082ccd7235a7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a025a expref: 23 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823564:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957e0a00/0xe984082ccd7235a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a025a expref: 23 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823578:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0a00, rc 0) 00000100:00100000:0.0:1746143678.823619:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963591878144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 133us (387us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143678.823624:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8779 00000100:00100000:0.0:1746143678.823648:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8780 00000100:00100000:0.0:1746143678.823652:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591878272:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143678.823657:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.823665:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800957e0400/0xe984082ccd7235ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0261 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.823675:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.823677:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.823684:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e0400/0xe984082ccd7235ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0261 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823697:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800957e0400/0xe984082ccd7235ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0261 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823706:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0400, rc 0) 00000100:00100000:0.0:1746143678.823715:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963591878272:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 63us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.823720:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8780 00000100:00100000:0.0:1746143678.823727:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8781 00000100:00100000:0.0:1746143678.823730:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591878528:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143678.823734:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.823738:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd7235b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a026f expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.823746:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.823747:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.823751:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd7235b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a026f expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823760:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd7235b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a026f expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823765:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1e00, rc 0) 00000100:00100000:0.0:1746143678.823774:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963591878528:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 44us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.823781:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8781 00000100:00100000:0.0:1746143678.823787:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8782 00000100:00100000:0.0:1746143678.823790:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591878400:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143678.823794:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.823797:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd7235bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0268 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.823804:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.823806:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.823809:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd7235bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0268 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823815:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd7235bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0268 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823820:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1800, rc 0) 00000100:00100000:0.0:1746143678.823829:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963591878400:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 38us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.823832:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8782 00000100:00100000:0.0:1746143678.823837:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8783 00000100:00100000:0.0:1746143678.823840:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591878656:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143678.823844:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.823849:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800957e1600/0xe984082ccd7235c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0276 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.823855:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.823857:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.823860:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e1600/0xe984082ccd7235c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0276 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823867:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800957e1600/0xe984082ccd7235c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0276 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823872:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1600, rc 0) 00000100:00100000:0.0:1746143678.823881:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963591878656:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 40us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.823884:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8783 00000100:00100000:0.0:1746143678.823890:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8784 00000100:00100000:0.0:1746143678.823893:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591878784:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143678.823897:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.823901:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800957e1c00/0xe984082ccd7235ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a027d expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.823908:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.823909:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.823912:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e1c00/0xe984082ccd7235ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a027d expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823918:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800957e1c00/0xe984082ccd7235ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a027d expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823923:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1c00, rc 0) 00000100:00100000:0.0:1746143678.823930:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963591878784:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 37us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.823937:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8784 00000100:00100000:0.0:1746143678.823944:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8785 00000100:00100000:0.0:1746143678.823947:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591878912:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143678.823952:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.823956:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e0600/0xe984082ccd7235d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0284 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.823967:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957e0600/0xe984082ccd7235d1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0284 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823974:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957e0600/0xe984082ccd7235d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0284 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.823990:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0600, rc 0) 00000100:00100000:0.0:1746143678.824004:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591878912:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 56us (641us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143678.824009:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8785 00000100:00100000:0.0:1746143678.831349:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.831449:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591879040 00000100:00100000:1.0:1746143678.831459:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591879040 00000100:00100000:1.0:1746143678.831509:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8786 00000100:00100000:1.0:1746143678.831516:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963591879040:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143678.831535:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.831553:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd7235d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a028b expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.831584:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd7235d8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a028b expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.831593:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd7235d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a028b expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.831612:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f6e00, rc 0) 00000100:00100000:1.0:1746143678.831654:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963591879040:12345-192.168.202.48@tcp:101:cat.0 Request processed in 138us (315us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143678.831658:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8786 00000100:00100000:0.0:1746143678.832830:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.832957:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.834859:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.834887:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.834902:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591879808 00000100:00100000:0.0:1746143678.834906:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591879808 00000100:00100000:1.0:1746143678.834907:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591879680 00010000:00010000:0.0:1746143678.834932:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0e00/0xe984082ccd72357d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a024c expref: 12 pid: 14763 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746143678.834957:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4441 00000100:00100000:1.0:1746143678.834963:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591879680 00000100:00100000:0.0:1746143678.834963:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963591879808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.834973:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.834978:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0e00/0xe984082ccd72357d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a024c expref: 12 pid: 14763 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.834979:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792a00/0xe984082ccd7235a0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0253 expref: 9 pid: 16090 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.834996:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0e00/0xe984082ccd72357d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a024c expref: 12 pid: 14763 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.835014:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143678.835019:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd7235e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143678.835031:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd7235e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143678.835035:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.835068:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963591879808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 105us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.835170:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4441 00000100:00100000:0.0:1746143678.835200:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4442 00000100:00100000:0.0:1746143678.835205:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963591879680:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.835212:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.835216:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792a00/0xe984082ccd7235a0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0253 expref: 9 pid: 16090 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.835229:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792a00/0xe984082ccd7235a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0253 expref: 9 pid: 16090 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746143678.835239:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143678.835242:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd7235e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143678.835247:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd7235e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143678.835251:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143678.835318:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963591879680:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 112us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.835324:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4442 00000100:00100000:0.0:1746143678.835494:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.835514:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591879936 00000100:00100000:1.0:1746143678.835517:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591879936 00010000:00010000:1.0:1746143678.835528:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598600/0xe984082ccd723530 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a021b expref: 247 pid: 16090 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746143678.835542:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4443 00000100:00100000:1.0:1746143678.835547:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:1962:x1830963591879936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.835553:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.835556:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598600/0xe984082ccd723530 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a021b expref: 247 pid: 16090 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.835569:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598600/0xe984082ccd723530 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a021b expref: 247 pid: 16090 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.835799:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598600/0xe984082ccd723530 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a021b expref: 247 pid: 16090 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.835819:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143678.835822:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd7235e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143678.835828:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd7235e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143678.835834:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd7235e6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143678.835840:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c600/0xe984082ccd7235f4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.835844:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c600/0xe984082ccd7235f4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.835848:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c600/0xe984082ccd7235f4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.836008:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.836025:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:1962:x1830963591879936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 478us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.836030:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4443 00000100:00100000:0.0:1746143678.838212:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.838243:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591880192 00000100:00100000:1.0:1746143678.838250:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591880192 00000100:00100000:1.0:1746143678.838289:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3239 00000100:00100000:1.0:1746143678.838296:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:27915:x1830963591880192:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143678.838432:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:27915:x1830963591880192:12345-192.168.202.48@tcp:35:cat.0 Request processed in 136us (225us total) trans 8589942130 rc 0/0 00000100:00100000:1.0:1746143678.838438:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3239 00000100:00100000:0.0:1746143678.845768:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.847410:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.855179:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.855221:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.855248:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.855279:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.855305:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591880832 00000100:00100000:1.0:1746143678.855312:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591880832 00010000:00010000:1.0:1746143678.855347:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd72348f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0196 expref: 13 pid: 25369 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746143678.855377:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591880960 00000100:00100000:1.0:1746143678.855379:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591880960 00010000:00010000:1.0:1746143678.855389:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c600/0xe984082ccd7235f4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0299 expref: 247 pid: 21713 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746143678.855404:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591880704 00000100:00100000:1.0:1746143678.855406:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591880704 00010000:00010000:1.0:1746143678.855415:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd7235e6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0292 expref: 10 pid: 16090 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746143678.855423:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591880576 00000100:00100000:1.0:1746143678.855425:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591880576 00010000:00010000:1.0:1746143678.855434:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e1600/0xe984082ccd7235c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0276 expref: 9 pid: 4582 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746143678.855451:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4444 00000100:00100000:1.0:1746143678.855458:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963591880832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.855473:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.855497:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd72348f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0196 expref: 13 pid: 25369 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.855508:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd72348f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0196 expref: 13 pid: 25369 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.855530:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d53bc00/0xe984082ccd72348f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0196 expref: 13 pid: 25369 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.855545:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.855580:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963591880832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 122us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.855586:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4444 00000100:00100000:1.0:1746143678.855600:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4445 00000100:00100000:1.0:1746143678.855604:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:1964:x1830963591880960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.855610:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.855615:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c600/0xe984082ccd7235f4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0299 expref: 247 pid: 21713 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.855622:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c600/0xe984082ccd7235f4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0299 expref: 247 pid: 21713 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.855639:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c600/0xe984082ccd7235f4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0299 expref: 247 pid: 21713 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.855650:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143678.855655:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c200/0xe984082ccd723617 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.855672:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c200/0xe984082ccd723617 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.855677:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c200/0xe984082ccd723617 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.855682:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.855700:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:1964:x1830963591880960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 95us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.855708:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4445 00000100:00100000:1.0:1746143678.855716:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4446 00000100:00100000:1.0:1746143678.855724:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963591880704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.855730:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.855734:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd7235e6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0292 expref: 10 pid: 16090 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.855740:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd7235e6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0292 expref: 10 pid: 16090 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.855750:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd7235e6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0292 expref: 10 pid: 16090 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.855762:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143678.855764:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c200/0xe984082ccd723617 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.855771:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c200/0xe984082ccd723617 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.855776:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c200/0xe984082ccd723617 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143678.856168:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.856197:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963591880704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 472us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.856202:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4446 00000100:00100000:0.0:1746143678.857115:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591881088 00000100:00100000:0.0:1746143678.857119:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591881088 00010000:00010000:0.0:1746143678.857134:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2121200/0xe984082ccd723473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0165 expref: 26 pid: 8495 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746143678.857499:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4448 00000100:00100000:0.0:1746143678.857506:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963591881088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143678.857515:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143678.857527:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a2121200/0xe984082ccd723473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0165 expref: 26 pid: 8495 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.857537:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a2121200/0xe984082ccd723473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0165 expref: 26 pid: 8495 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.857549:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a2121200/0xe984082ccd723473 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0165 expref: 26 pid: 8495 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746143678.857564:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.857566:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143678.857572:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094768000/0xe984082ccd723609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1683455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02a7 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.857579:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094768000/0xe984082ccd723609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1683455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02a7 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.857604:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094768000/0xe984082ccd723609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02a7 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143678.857615:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593598592:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143678.857669:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143678.859058:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.859077:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.860229:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591881472 00000100:00100000:1.0:1746143678.860237:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591881472 00000100:00100000:1.0:1746143678.860268:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591881600 00000100:00100000:1.0:1746143678.860270:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591881600 00000100:00100000:1.0:1746143678.860296:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8788 00000100:00100000:1.0:1746143678.860302:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591881472:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143678.860318:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.860333:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd723641 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a02b5 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143678.860382:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593598720:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143678.860447:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143678.860516:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593598592:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143678.860535:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.860553:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963591881088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3047us (3669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.860561:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4448 00000100:00100000:0.0:1746143678.860700:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8789 00000100:00100000:0.0:1746143678.860707:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591881600:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143678.860716:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.860726:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e0600/0xe984082ccd723648 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a02bc expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.860748:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957e0600/0xe984082ccd723648 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02bc expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.860757:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957e0600/0xe984082ccd723648 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02bc expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143678.860764:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0600, rc 0) 00000100:00100000:0.0:1746143678.860780:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591881600:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 75us (1703us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143678.860784:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8789 00000100:00100000:1.0:1746143678.861615:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.862573:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.862610:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:1.0:1746143678.863782:0:21542:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143677 -> 1746143678 00002000:00010000:1.0:1746143678.863786:0:21542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143676 -> 1746143678 00002000:00010000:1.0:1746143678.863788:0:21542:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143677 -> 1746143678 00000100:00100000:1.0:1746143678.863799:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091715500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593598720:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143678.863819:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd723641 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02b5 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.863828:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd723641 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02b5 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.863835:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f6800, rc 0) 00000100:00100000:1.0:1746143678.863854:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591881472:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3552us (4798us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143678.863858:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8788 00000100:00100000:0.0:1746143678.869491:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.869545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.870031:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591882496 00000100:00100000:1.0:1746143678.870035:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591882496 00000100:00100000:1.0:1746143678.870058:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8792 00000100:00100000:1.0:1746143678.870062:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+14:27925:x1830963591882496:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143678.870072:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.870090:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6200/0xe984082ccd72365d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a02d1 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.870116:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094768000/0xe984082ccd723609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02a7 expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.870124:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143678.870126:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143678.870129:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6200/0xe984082ccd72365d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1572864->2097151] (req 1572864->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02d1 expref: 15 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.870178:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094768000/0xe984082ccd723609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->1683455) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02a7 expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.870189:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094768000/0xe984082ccd723609 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->1683455) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02a7 expref: 24 pid: 12618 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746143678.870201:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593598976:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143678.870255:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143678.875397:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591882752 00000100:00100000:1.0:1746143678.875406:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591882752 00000100:00100000:1.0:1746143678.875449:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3240 00000100:00100000:1.0:1746143678.875456:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009498c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:27930:x1830963591882752:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143678.875662:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009498c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:27930:x1830963591882752:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 202us (426us total) trans 8589942133 rc 0/0 00000100:00100000:1.0:1746143678.875669:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3240 00000100:00100000:0.0:1746143678.875771:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091715500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593598976:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143678.875791:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6200/0xe984082ccd72365d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1572864->2097151] (req 1572864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02d1 expref: 13 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143678.875805:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f6200, rc 0) 00000100:00100000:0.0:1746143678.875821:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+13:27925:x1830963591882496:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5759us (6277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143678.875827:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8792 00000100:00100000:0.0:1746143678.878237:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.886234:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.886261:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591883648 00000100:00100000:1.0:1746143678.886271:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591883648 00000100:00100000:1.0:1746143678.886313:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3241 00000100:00100000:1.0:1746143678.886320:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:27927:x1830963591883648:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:1.0:1746143678.886528:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:27927:x1830963591883648:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 208us (303us total) trans 8589942134 rc 0/0 00000100:00100000:1.0:1746143678.886535:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3241 00000100:00100000:0.0:1746143678.899654:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.899843:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591883776 00000100:00100000:1.0:1746143678.899854:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591883776 00010000:00010000:1.0:1746143678.899895:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094768000/0xe984082ccd723609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1626112->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02a7 expref: 27 pid: 12618 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746143678.899940:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4449 00000100:00100000:1.0:1746143678.899949:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963591883776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.899963:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.900018:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094768000/0xe984082ccd723609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02a7 expref: 27 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.900032:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094768000/0xe984082ccd723609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->1683455) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02a7 expref: 27 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.900054:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094768000/0xe984082ccd723609 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1626112->1683455) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02a7 expref: 27 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.902298:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143678.902301:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143678.902312:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6200/0xe984082ccd72365d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02d1 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.902327:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6200/0xe984082ccd72365d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02d1 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143678.902370:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6200/0xe984082ccd72365d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02d1 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143678.902383:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593599104:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143678.902449:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143678.909399:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.909694:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091715500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593599104:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143678.909715:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.909758:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963591883776:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9810us (10115us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.909767:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4449 00000100:00100000:0.0:1746143678.919568:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.925814:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.928136:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.928170:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.930781:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591884800 00000100:00100000:1.0:1746143678.930792:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591884800 00010000:00010000:1.0:1746143678.930828:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e1c00/0xe984082ccd7235ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a027d expref: 8 pid: 4582 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746143678.930851:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591884288 00000100:00100000:1.0:1746143678.930854:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591884288 00010000:00010000:1.0:1746143678.930864:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57f2400/0xe984082ccd7234f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01f8 expref: 26 pid: 12618 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746143678.930878:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4450 00000100:00100000:1.0:1746143678.930884:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591884800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.930896:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.930916:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800957e1c00/0xe984082ccd7235ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a027d expref: 8 pid: 4582 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.930926:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800957e1c00/0xe984082ccd7235ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a027d expref: 8 pid: 4582 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.930949:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800957e1c00/0xe984082ccd7235ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a027d expref: 8 pid: 4582 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746143678.930975:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.931014:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963591884800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 129us (2886us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.931021:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4450 00000100:00100000:1.0:1746143678.931035:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4451 00000100:00100000:1.0:1746143678.931040:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963591884288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.931046:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.931052:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57f2400/0xe984082ccd7234f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01f8 expref: 26 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.931061:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57f2400/0xe984082ccd7234f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01f8 expref: 26 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.931072:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57f2400/0xe984082ccd7234f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01f8 expref: 26 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.931087:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.931101:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963591884288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 61us (2930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.931107:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4451 00000100:00100000:1.0:1746143678.931166:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.931178:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591884416 00000100:00100000:1.0:1746143678.931181:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591884416 00010000:00010000:1.0:1746143678.931374:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57f2a00/0xe984082ccd7234f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01f1 expref: 16 pid: 12618 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746143678.931394:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4452 00000100:00100000:1.0:1746143678.931400:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963591884416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.931407:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.931414:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57f2a00/0xe984082ccd7234f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01f1 expref: 16 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.931422:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57f2a00/0xe984082ccd7234f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01f1 expref: 16 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.931433:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57f2a00/0xe984082ccd7234f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01f1 expref: 16 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.931442:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.931456:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963591884416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 57us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.931464:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4452 00000100:00100000:1.0:1746143678.931520:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.931531:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591884928 00000100:00100000:1.0:1746143678.931534:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591884928 00010000:00010000:1.0:1746143678.931545:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57f2000/0xe984082ccd72350d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a020d expref: 25 pid: 12618 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746143678.931935:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4453 00000100:00100000:1.0:1746143678.931941:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963591884928:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143678.931947:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143678.931955:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57f2000/0xe984082ccd72350d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a020d expref: 25 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.931962:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57f2000/0xe984082ccd72350d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a020d expref: 25 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.931973:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57f2000/0xe984082ccd72350d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a020d expref: 25 pid: 12618 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746143678.931991:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143678.932006:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963591884928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 65us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143678.932011:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4453 00000100:00100000:0.0:1746143678.935931:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.945247:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.953317:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.953408:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591885568 00000100:00100000:1.0:1746143678.953419:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591885568 00000100:00100000:1.0:1746143678.953479:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3242 00000100:00100000:1.0:1746143678.953488:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+13:27925:x1830963591885568:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143678.953748:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:27925:x1830963591885568:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 260us (441us total) trans 8589942135 rc 0/0 00000100:00100000:1.0:1746143678.953755:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3242 00000100:00100000:0.0:1746143678.957339:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.967517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.973793:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.975739:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.976064:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.976399:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8795 00000100:00100000:0.0:1746143678.976406:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963591886336:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143678.976414:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143678.976425:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6dbc00/0xe984082ccd7236a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a02f4 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143678.976453:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593600128:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143678.976473:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143678.976874:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591886464 00000100:00100000:1.0:1746143678.976878:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591886464 00000100:00100000:1.0:1746143678.976897:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8796 00000100:00100000:1.0:1746143678.976902:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963591886464:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143678.976908:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143678.976914:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012faf7a00/0xe984082ccd7236aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a02fb expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143678.976936:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593600256:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143678.976956:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143678.977255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.980860:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143678.981561:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593600256:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143678.981582:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012faf7a00/0xe984082ccd7236aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02fb expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.981591:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012faf7a00/0xe984082ccd7236aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02fb expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143678.981614:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012faf7a00, rc 0) 00000100:00100000:1.0:1746143678.981642:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963591886464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4739us (5578us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143678.981647:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8796 00000100:00100000:0.0:1746143678.992258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143678.995118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.010887:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.010924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.011065:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.013212:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3045 00000100:00100000:0.0:1746143679.013222:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963591887488:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143679.014488:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3046 00000100:00100000:0.0:1746143679.014496:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963591887872:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143679.021190:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143679.027395:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143679.028155:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.031833:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963591887488:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18599us (20894us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143679.031847:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3045 00002000:00100000:0.0:1746143679.031861:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800a5c20e00 x1830963591887488/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/440 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.031871:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20e00 with x1830963591887488 ext(3145728->4194303) 00002000:00010000:0.0:1746143679.031877:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c20e00 00000100:00100000:0.0:1746143679.047867:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963591887872:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33358us (36787us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143679.047880:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3046 00002000:00100000:0.0:1746143679.047891:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a5c22a00 x1830963591887872/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/440 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.047900:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22a00 with x1830963591887872 ext(3145728->4194303) 00002000:00010000:0.0:1746143679.047906:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c22a00 00000100:00100000:0.0:1746143679.052674:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.058721:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.058798:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.059322:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3048 00000100:00100000:1.0:1746143679.059330:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963591888896:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143679.076756:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963591888896:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17417us (17947us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143679.076767:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3048 00002000:00100000:1.0:1746143679.076778:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88012e1e0e00 x1830963591888896/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/440 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.076787:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0e00 with x1830963591888896 ext(4194304->4898815) 00002000:00010000:1.0:1746143679.076792:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e0e00 00000100:00100000:0.0:1746143679.084409:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.084458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.084535:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591889024 00000100:00100000:1.0:1746143679.084544:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591889024 00000100:00100000:1.0:1746143679.084595:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591889152 00000100:00100000:1.0:1746143679.084597:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591889152 00000100:00100000:1.0:1746143679.084613:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8800 00000100:00100000:1.0:1746143679.084620:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963591889024:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143679.084639:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143679.084656:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f198e00/0xe984082ccd7236c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0317 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.084683:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.084685:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.084693:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f198e00/0xe984082ccd7236c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0317 expref: 14 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.084707:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f198e00/0xe984082ccd7236c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0317 expref: 14 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.084716:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f198e00, rc 0) 00000100:00100000:1.0:1746143679.085315:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963591889024:12345-192.168.202.48@tcp:101:cat.0 Request processed in 694us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.085321:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8800 00000100:00100000:0.0:1746143679.088807:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.088892:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.088929:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591889408 00000100:00100000:1.0:1746143679.088938:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591889408 00000100:00100000:1.0:1746143679.088992:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8802 00000100:00100000:1.0:1746143679.088999:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+14:27934:x1830963591889408:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143679.089020:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143679.089039:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f199200/0xe984082ccd7236d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0325 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.089849:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143679.089852:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143679.089888:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f199200/0xe984082ccd7236d4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4894720->5242879] (req 4894720->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0325 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.089899:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f199200/0xe984082ccd7236d4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4894720->5242879] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0325 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.089912:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f199200, rc 0) 00000100:00100000:1.0:1746143679.089944:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:27934:x1830963591889408:12345-192.168.202.48@tcp:101:cat.0 Request processed in 945us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.089949:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8802 00000100:00100000:0.0:1746143679.098677:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.106585:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.108673:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.116367:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.117518:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591890304 00000100:00100000:1.0:1746143679.117529:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591890304 00000100:00100000:1.0:1746143679.117588:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3243 00000100:00100000:1.0:1746143679.117597:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:27934:x1830963591890304:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1746143679.118398:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.120441:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+15:27934:x1830963591890304:12345-192.168.202.48@tcp:35:cat.0 Request processed in 2842us (4081us total) trans 8589942137 rc 0/0 00000100:00100000:1.0:1746143679.120452:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3243 00000100:00100000:0.0:1746143679.125714:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.125731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.125775:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.126044:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591890688 00000100:00100000:1.0:1746143679.126053:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591890688 00010000:00010000:1.0:1746143679.126095:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba31800/0xe984082ccd72368e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02e6 expref: 251 pid: 21713 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746143679.126117:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591890944 00000100:00100000:1.0:1746143679.126119:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591890944 00010000:00010000:1.0:1746143679.126129:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c200/0xe984082ccd723617 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02a0 expref: 9 pid: 21713 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746143679.126162:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591890816 00000100:00100000:1.0:1746143679.126164:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591890816 00010000:00010000:1.0:1746143679.126174:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800955dba00/0xe984082ccd723633 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02ae expref: 15 pid: 21713 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746143679.126194:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4458 00000100:00100000:1.0:1746143679.126200:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1965:x1830963591890688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143679.126213:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143679.126218:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba31800/0xe984082ccd72368e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02e6 expref: 251 pid: 21713 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.126227:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba31800/0xe984082ccd72368e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02e6 expref: 251 pid: 21713 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.126251:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143679.126254:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb7c00/0xe984082ccd7236e2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143679.126262:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb7c00/0xe984082ccd7236e2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143679.126267:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143679.126313:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1965:x1830963591890688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 113us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.126319:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4458 00000100:00100000:1.0:1746143679.126333:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4459 00000100:00100000:1.0:1746143679.126338:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963591890944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143679.126345:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143679.126349:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c200/0xe984082ccd723617 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02a0 expref: 9 pid: 21713 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.126359:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c200/0xe984082ccd723617 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02a0 expref: 9 pid: 21713 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.126370:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143679.126373:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb7c00/0xe984082ccd7236e2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143679.126378:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb7c00/0xe984082ccd7236e2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143679.126382:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143679.126397:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963591890944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 59us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.126402:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4459 00000100:00100000:1.0:1746143679.126411:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4460 00000100:00100000:1.0:1746143679.126415:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963591890816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143679.126421:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143679.126425:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800955dba00/0xe984082ccd723633 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02ae expref: 15 pid: 21713 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.126431:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800955dba00/0xe984082ccd723633 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a02ae expref: 15 pid: 21713 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.126441:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143679.126443:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb7c00/0xe984082ccd7236e2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143679.126450:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb7c00/0xe984082ccd7236e2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143679.126456:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb7c00/0xe984082ccd7236e2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143679.126470:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143679.126483:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963591890816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 68us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.126488:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4460 00000100:00100000:0.0:1746143679.136834:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.136918:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591891072 00000100:00100000:1.0:1746143679.136927:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591891072 00000100:00100000:1.0:1746143679.136992:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8803 00000100:00100000:1.0:1746143679.137003:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:27940:x1830963591891072:12345-192.168.202.48@tcp:101:cat.0 00000100:00080000:0.0:1746143679.137022:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746143679.137023:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143679.137044:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d000/0xe984082ccd7236f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0333 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.137072:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.137074:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.137081:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d000/0xe984082ccd7236f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0333 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.137097:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d000/0xe984082ccd7236f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0333 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.137106:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e6d000, rc 0) 00000100:00100000:1.0:1746143679.137182:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:27940:x1830963591891072:12345-192.168.202.48@tcp:101:cat.0 Request processed in 182us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.137187:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8803 00000100:00100000:0.0:1746143679.143645:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.146259:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.184663:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.185055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.202447:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.207072:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591892352 00000100:00100000:1.0:1746143679.207088:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591892352 00000100:00100000:1.0:1746143679.207219:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3244 00000100:00100000:1.0:1746143679.207228:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:27940:x1830963591892352:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143679.207515:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:27940:x1830963591892352:12345-192.168.202.48@tcp:35:cat.0 Request processed in 288us (5078us total) trans 8589942140 rc 0/0 00000100:00100000:1.0:1746143679.207522:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3244 00000100:00100000:0.0:1746143679.215711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.219781:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.220033:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591892608 00000100:00100000:1.0:1746143679.220040:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591892608 00010000:00010000:1.0:1746143679.220068:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f199200/0xe984082ccd7236d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0325 expref: 17 pid: 8495 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746143679.220090:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4461 00000100:00100000:1.0:1746143679.220095:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963591892608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143679.220107:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143679.220128:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f199200/0xe984082ccd7236d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0325 expref: 17 pid: 8495 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.220166:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f199200/0xe984082ccd7236d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0325 expref: 17 pid: 8495 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.220187:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f199200/0xe984082ccd7236d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0325 expref: 17 pid: 8495 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.220209:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143679.220228:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963591892608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 133us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.220236:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4461 00000100:00100000:0.0:1746143679.223605:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.223682:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591892736 00000100:00100000:1.0:1746143679.223691:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591892736 00010000:00010000:1.0:1746143679.223728:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79fa00/0xe984082ccd7236cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a031e expref: 26 pid: 21542 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746143679.223754:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4462 00000100:00100000:1.0:1746143679.223761:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963591892736:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143679.223775:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143679.223796:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f79fa00/0xe984082ccd7236cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a031e expref: 26 pid: 21542 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.223808:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f79fa00/0xe984082ccd7236cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a031e expref: 26 pid: 21542 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.223828:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f79fa00/0xe984082ccd7236cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a031e expref: 26 pid: 21542 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.226990:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.226997:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.227013:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72371a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0341 expref: 15 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.227024:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72371a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0341 expref: 15 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.227078:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72371a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0341 expref: 15 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143679.227092:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba47b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593601920:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143679.229548:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143679.231443:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba47b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593601920:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143679.231468:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143679.231519:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963591892736:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7757us (7923us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.231530:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4462 00000100:00100000:0.0:1746143679.231937:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.235653:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.244892:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.244938:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.245276:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591893248 00000100:00100000:0.0:1746143679.245282:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591893248 00010000:00010000:0.0:1746143679.245311:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d000/0xe984082ccd7236f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0333 expref: 24 pid: 8495 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746143679.245341:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591893376 00000100:00100000:0.0:1746143679.245343:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591893376 00010000:00010000:0.0:1746143679.245351:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd800/0xe984082ccd723545 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0229 expref: 25 pid: 21542 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746143679.245370:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4463 00000100:00100000:0.0:1746143679.245377:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963591893248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143679.245389:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143679.245411:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d000/0xe984082ccd7236f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0333 expref: 25 pid: 8495 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.245421:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d000/0xe984082ccd7236f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0333 expref: 25 pid: 8495 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.245442:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d000/0xe984082ccd7236f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0333 expref: 25 pid: 8495 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.245456:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143679.245470:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963591893248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 94us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143679.245476:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4463 00000100:00100000:0.0:1746143679.245498:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4464 00000100:00100000:0.0:1746143679.245503:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963591893376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143679.245508:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143679.245514:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd800/0xe984082ccd723545 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0229 expref: 23 pid: 21542 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.245522:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd800/0xe984082ccd723545 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0229 expref: 23 pid: 21542 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.245533:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd800/0xe984082ccd723545 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0229 expref: 23 pid: 21542 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.245547:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143679.245558:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963591893376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 55us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143679.245563:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4464 00000100:00100000:0.0:1746143679.246743:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.253832:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.260515:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.340123:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.348217:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.348836:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.348848:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591894528 00000100:00100000:0.0:1746143679.348851:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591894528 00010000:00010000:0.0:1746143679.348865:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd723442 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0150 expref: 27 pid: 8496 timeout: 858 lvb_type: 1 00000100:00100000:0.0:1746143679.348880:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4467 00000100:00100000:0.0:1746143679.348886:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963591894528:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143679.348892:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143679.348900:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd723442 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0150 expref: 27 pid: 8496 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746143679.348908:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd723442 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0150 expref: 27 pid: 8496 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746143679.348920:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143679.348938:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963591894528:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 52us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143679.348943:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4467 00000100:00100000:0.0:1746143679.349019:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.349029:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591894400 00000100:00100000:0.0:1746143679.349032:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591894400 00010000:00010000:0.0:1746143679.349042:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e0400/0xe984082ccd7235ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0261 expref: 7 pid: 4582 timeout: 858 lvb_type: 1 00000100:00100000:0.0:1746143679.349056:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4468 00000100:00100000:0.0:1746143679.349061:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1962:x1830963591894400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143679.349066:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143679.349073:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800957e0400/0xe984082ccd7235ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0261 expref: 7 pid: 4582 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746143679.349081:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800957e0400/0xe984082ccd7235ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0261 expref: 7 pid: 4582 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746143679.349092:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800957e0400/0xe984082ccd7235ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0261 expref: 7 pid: 4582 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746143679.349106:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143679.349107:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143679.349114:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd723728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a034f expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143679.349122:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd723728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a034f expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143679.349173:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd723728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a034f expref: 25 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143679.349185:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593602944:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143679.349229:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143679.358669:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.360192:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.366220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.369067:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.369120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.369487:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591895296 00000100:00100000:1.0:1746143679.369495:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591895296 00010000:00010000:1.0:1746143679.369520:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a962a00/0xe984082ccd72343b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0157 expref: 23 pid: 8496 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746143679.369541:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591895168 00000100:00100000:1.0:1746143679.369543:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591895168 00010000:00010000:1.0:1746143679.369553:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bcae600/0xe984082ccd723481 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0188 expref: 13 pid: 25369 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746143679.369576:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4470 00000100:00100000:1.0:1746143679.369581:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963591895296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143679.369591:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143679.369608:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a962a00/0xe984082ccd72343b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0157 expref: 23 pid: 8496 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746143679.369617:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a962a00/0xe984082ccd72343b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0157 expref: 23 pid: 8496 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746143679.369634:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a962a00/0xe984082ccd72343b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0157 expref: 23 pid: 8496 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746143679.369651:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143679.369679:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963591895296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 98us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.369685:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4470 00000100:00100000:1.0:1746143679.369698:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4471 00000100:00100000:1.0:1746143679.369702:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963591895168:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143679.369709:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143679.369715:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bcae600/0xe984082ccd723481 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0188 expref: 13 pid: 25369 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746143679.369722:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bcae600/0xe984082ccd723481 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0188 expref: 13 pid: 25369 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746143679.369732:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bcae600/0xe984082ccd723481 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0188 expref: 13 pid: 25369 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746143679.369739:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.371041:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.371053:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013013c400/0xe984082ccd723744 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a035d expref: 21 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.371063:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013013c400/0xe984082ccd723744 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a035d expref: 21 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.371104:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013013c400/0xe984082ccd723744 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a035d expref: 21 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143679.371118:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba47b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593603456:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143679.372046:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143679.373662:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.373696:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.373745:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.373894:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8808 00000100:00100000:1.0:1746143679.373903:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963591895424:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143679.373925:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143679.373941:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57afe00/0xe984082ccd723759 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0364 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143679.374312:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593603584:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143679.374340:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143679.374366:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba47b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593603456:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143679.374383:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143679.374400:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963591895168:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4697us (5280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.374408:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4471 00000100:00100000:1.0:1746143679.374423:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591895680 00000100:00100000:1.0:1746143679.374426:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591895680 00000100:00100000:1.0:1746143679.374715:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 522 00000100:00100000:1.0:1746143679.374721:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963591895680:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143679.374731:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143679.374750:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79ee00/0xe984082ccd72374b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0356 expref: 19 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.374767:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143679.374771:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143679.376915:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963591895680:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2183us (3158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.376927:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 522 00000100:00100000:1.0:1746143679.379442:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:1.0:1746143679.379529:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime: 1746143677 -> 1746143679 00002000:00010000:1.0:1746143679.379534:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime: 1746143673 -> 1746143678 00002000:00010000:1.0:1746143679.379536:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime: 1746143677 -> 1746143679 00000100:00100000:1.0:1746143679.379557:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593603584:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143679.379589:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57afe00/0xe984082ccd723759 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0364 expref: 16 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.379603:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57afe00/0xe984082ccd723759 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0364 expref: 16 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.379612:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57afe00, rc 0) 00000100:00100000:1.0:1746143679.379652:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963591895424:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5750us (5996us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143679.379659:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8808 00000100:00100000:0.0:1746143679.379768:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591895936 00000100:00100000:0.0:1746143679.379775:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591895936 00002000:00100000:0.0:1746143679.379812:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1359872->1363967) req@ffff88009ba47b80 x1830963591895936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.379821:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba47b80 with x1830963591895936 ext(1359872->1363967) 00002000:00010000:0.0:1746143679.379826:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba47b80 00000100:00100000:0.0:1746143679.379851:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3056 00000100:00100000:0.0:1746143679.379857:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963591895936:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143679.380185:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963591895936:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 327us (753us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143679.380191:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3056 00002000:00100000:0.0:1746143679.380197:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1359872->1363967) req@ffff88009ba47b80 x1830963591895936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/4536 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.380204:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba47b80 with x1830963591895936 ext(1359872->1363967) 00002000:00010000:0.0:1746143679.380207:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba47b80 00000100:00100000:0.0:1746143679.383376:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.388888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.388937:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591896192 00000100:00100000:1.0:1746143679.388945:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591896192 00002000:00100000:1.0:1746143679.388996:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (380928->1048575) req@ffff88008f7c2a00 x1830963591896192/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.389011:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c2a00 with x1830963591896192 ext(380928->1048575) 00010000:00010000:1.0:1746143679.389017:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd723728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a034f expref: 25 pid: 15784 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.389030:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd723728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a034f expref: 25 pid: 15784 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746143679.389036:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7c2a00 00000100:00100000:1.0:1746143679.389058:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 725 00000100:00100000:1.0:1746143679.389065:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963591896192:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143679.389911:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.400547:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591896576 00000100:00100000:0.0:1746143679.400559:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591896576 00000100:00100000:0.0:1746143679.401158:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 523 00000100:00100000:0.0:1746143679.401168:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963591896576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143679.401182:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143679.401207:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79f000/0xe984082ccd723783 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0379 expref: 20 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143679.401237:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143679.401242:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143679.401310:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963591896576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 142us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143679.401318:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 523 00000100:00100000:1.0:1746143679.406416:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963591896192:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 17339us (17520us total) trans 17179872306 rc 0/0 00000100:00100000:1.0:1746143679.406429:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 725 00002000:00100000:1.0:1746143679.406441:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (380928->1048575) req@ffff88008f7c2a00 x1830963591896192/t17179872306(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/448 e 0 to 0 dl 1746143690 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.406450:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c2a00 with x1830963591896192 ext(380928->1048575) 00010000:00010000:1.0:1746143679.406460:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd723728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a034f expref: 27 pid: 15784 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.406474:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd723728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a034f expref: 27 pid: 15784 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746143679.406480:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7c2a00 00000100:00100000:0.0:1746143679.413458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.413577:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591896704 00000100:00100000:1.0:1746143679.413588:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591896704 00010000:00010000:1.0:1746143679.413630:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd723728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a034f expref: 27 pid: 15784 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746143679.413669:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4472 00000100:00100000:1.0:1746143679.413676:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963591896704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143679.413691:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143679.413714:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd723728 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a034f expref: 27 pid: 15784 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.413727:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd723728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a034f expref: 27 pid: 15784 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.416677:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd723728 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 380928->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a034f expref: 27 pid: 15784 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.416715:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.416717:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.416725:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5d0600/0xe984082ccd723767 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0372 expref: 15 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.416734:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5d0600/0xe984082ccd723767 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0372 expref: 15 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.416779:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5d0600/0xe984082ccd723767 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0372 expref: 15 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143679.416792:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba47800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593603968:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143679.416893:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143679.418360:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba47800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593603968:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143679.418376:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143679.418408:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963591896704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4731us (4958us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.418418:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4472 00000100:00100000:0.0:1746143679.420057:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.420296:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591896960 00000100:00100000:1.0:1746143679.420304:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591896960 00002000:00100000:1.0:1746143679.420347:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008f7c0380 x1830963591896960/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.420357:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c0380 with x1830963591896960 ext(0->1048575) 00002000:00010000:1.0:1746143679.420362:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7c0380 00000100:00100000:1.0:1746143679.420393:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3057 00000100:00100000:1.0:1746143679.420400:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963591896960:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143679.423907:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.433371:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.435751:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963591896960:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15348us (15697us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143679.435763:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3057 00002000:00100000:0.0:1746143679.435772:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008f7c0380 x1830963591896960/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/440 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.435781:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c0380 with x1830963591896960 ext(0->1048575) 00002000:00010000:0.0:1746143679.435787:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7c0380 00000100:00100000:0.0:1746143679.439356:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.439390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.439416:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.439455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.439478:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591898112 00000100:00100000:0.0:1746143679.439487:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591898112 00002000:00100000:0.0:1746143679.439533:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3809280->3813375) req@ffff88009cdc2a00 x1830963591898112/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.439542:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2a00 with x1830963591898112 ext(3809280->3813375) 00002000:00010000:0.0:1746143679.439547:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc2a00 00000100:00100000:0.0:1746143679.439567:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3059 00000100:00100000:0.0:1746143679.439574:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963591898112:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143679.439911:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8813 00000100:00100000:1.0:1746143679.439919:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963591897856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143679.439926:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143679.439933:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd7237c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a038e expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143679.439958:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593604224:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143679.440461:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963591898112:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 887us (1004us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143679.440468:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3059 00002000:00100000:0.0:1746143679.440475:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3809280->3813375) req@ffff88009cdc2a00 x1830963591898112/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/4536 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.440482:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2a00 with x1830963591898112 ext(3809280->3813375) 00002000:00010000:0.0:1746143679.440486:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc2a00 00000100:00100000:1.0:1746143679.440839:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143679.449860:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.451886:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:1.0:1746143679.451952:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime: 1746143678 -> 1746143679 00002000:00010000:1.0:1746143679.451955:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime: 1746143678 -> 1746143679 00002000:00010000:1.0:1746143679.451957:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime: 1746143678 -> 1746143679 00000100:00100000:1.0:1746143679.451972:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593604224:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143679.452000:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd7237c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a038e expref: 28 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.452010:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd7237c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a038e expref: 28 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.452032:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094677000, rc 0) 00000100:00100000:1.0:1746143679.452057:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963591897856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 12140us (12640us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143679.452063:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8813 00000100:00100000:0.0:1746143679.455116:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.455939:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591898624 00000100:00100000:1.0:1746143679.455947:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591898624 00002000:00100000:1.0:1746143679.455997:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1363967) req@ffff88009cdc1c00 x1830963591898624/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.456006:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1c00 with x1830963591898624 ext(1048576->1363967) 00010000:00010000:1.0:1746143679.456013:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013013c400/0xe984082ccd723744 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a035d expref: 22 pid: 15784 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.456026:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013013c400/0xe984082ccd723744 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a035d expref: 22 pid: 15784 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746143679.456032:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc1c00 00000100:00100000:1.0:1746143679.456058:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 726 00000100:00100000:1.0:1746143679.456065:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963591898624:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143679.461959:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.462684:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591898880 00000100:00100000:1.0:1746143679.462696:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591898880 00002000:00100000:1.0:1746143679.462741:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009cdc3b80 x1830963591898880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.462751:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3b80 with x1830963591898880 ext(0->1048575) 00002000:00010000:1.0:1746143679.462756:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3b80 00000100:00100000:1.0:1746143679.462777:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3060 00000100:00100000:1.0:1746143679.462784:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963591898880:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143679.468344:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963591898624:12345-192.168.202.48@tcp:4:cat.0 Request processed in 12266us (13225us total) trans 21474839571 rc 0/0 00000100:00100000:1.0:1746143679.468357:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 726 00002000:00100000:1.0:1746143679.468369:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1363967) req@ffff88009cdc1c00 x1830963591898624/t21474839571(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/448 e 0 to 0 dl 1746143690 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.468379:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1c00 with x1830963591898624 ext(1048576->1363967) 00010000:00010000:1.0:1746143679.468389:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013013c400/0xe984082ccd723744 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a035d expref: 24 pid: 15784 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.468405:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013013c400/0xe984082ccd723744 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a035d expref: 24 pid: 15784 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746143679.468411:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc1c00 00000100:00100000:0.0:1746143679.475263:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.475552:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963591898880:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12766us (13603us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143679.475560:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3060 00002000:00100000:1.0:1746143679.475569:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009cdc3b80 x1830963591898880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/440 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.475583:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3b80 with x1830963591898880 ext(0->1048575) 00002000:00010000:1.0:1746143679.475586:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3b80 00000100:00100000:0.0:1746143679.506388:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.506549:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591899392 00000100:00100000:1.0:1746143679.506560:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591899392 00002000:00100000:1.0:1746143679.506612:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880131e9e300 x1830963591899392/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.506622:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9e300 with x1830963591899392 ext(1048576->2097151) 00002000:00010000:1.0:1746143679.506629:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9e300 00000100:00100000:1.0:1746143679.506661:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3061 00000100:00100000:1.0:1746143679.506669:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963591899392:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143679.513534:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.513583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.513684:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591899648 00000100:00100000:1.0:1746143679.513693:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591899648 00000100:00100000:1.0:1746143679.514200:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8815 00000100:00100000:1.0:1746143679.514208:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:27957:x1830963591899648:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143679.514223:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143679.514240:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094677000/0xe984082ccd7237d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a03a3 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.514266:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.514269:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.514276:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094677000/0xe984082ccd7237d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03a3 expref: 24 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.514291:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094677000/0xe984082ccd7237d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03a3 expref: 24 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.514307:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094677000, rc 0) 00000100:00100000:1.0:1746143679.514355:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:27957:x1830963591899648:12345-192.168.202.48@tcp:101:cat.0 Request processed in 147us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.514361:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8815 00000100:00100000:1.0:1746143679.518214:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963591899392:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 11539us (11831us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143679.518225:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3061 00002000:00100000:1.0:1746143679.518236:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880131e9e300 x1830963591899392/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/440 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.518245:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9e300 with x1830963591899392 ext(1048576->2097151) 00002000:00010000:1.0:1746143679.518251:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9e300 00000100:00100000:0.0:1746143679.532908:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.533464:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591899904 00000100:00100000:1.0:1746143679.533474:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591899904 00002000:00100000:1.0:1746143679.533525:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880131e9f800 x1830963591899904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.533534:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9f800 with x1830963591899904 ext(1048576->2097151) 00002000:00010000:1.0:1746143679.533539:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9f800 00000100:00100000:1.0:1746143679.534635:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3063 00000100:00100000:1.0:1746143679.534646:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963591899904:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143679.544374:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.548678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.548924:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.548953:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.548972:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591900544 00000100:00100000:1.0:1746143679.548985:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591900544 00002000:00100000:1.0:1746143679.549010:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880131e9fb80 x1830963591900544/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.549022:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9fb80 with x1830963591900544 ext(2097152->3145727) 00002000:00010000:1.0:1746143679.549026:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9fb80 00000100:00100000:1.0:1746143679.549036:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591901056 00000100:00100000:1.0:1746143679.549038:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591901056 00002000:00100000:1.0:1746143679.549046:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3928063) req@ffff880131e9ce00 x1830963591901056/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.549051:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9ce00 with x1830963591901056 ext(3145728->3928063) 00002000:00010000:1.0:1746143679.549054:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9ce00 00000100:00100000:1.0:1746143679.549077:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3065 00000100:00100000:1.0:1746143679.549081:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963591900544:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143679.550078:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3067 00000100:00100000:0.0:1746143679.550087:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963591900928:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143679.552120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.552167:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591901440 00000100:00100000:1.0:1746143679.552174:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591901440 00000100:00100000:1.0:1746143679.552233:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3247 00000100:00100000:1.0:1746143679.552240:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:27960:x1830963591901440:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143679.552476:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:27960:x1830963591901440:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 235us (363us total) trans 8589942147 rc 0/0 00000100:00100000:1.0:1746143679.552482:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3247 00000100:00100000:1.0:1746143679.552584:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.552605:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591901568 00000100:00100000:1.0:1746143679.552608:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591901568 00000100:00100000:1.0:1746143679.552633:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 524 00000100:00100000:1.0:1746143679.552637:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:1965:x1830963591901568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143679.552648:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143679.552671:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c21c000/0xe984082ccd7237ec lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03aa expref: 256 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.552686:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143679.552690:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143679.552704:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1965:x1830963591901568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 67us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.552709:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 524 00000100:00100000:1.0:1746143679.554524:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963591899904:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19872us (21619us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143679.554535:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3063 00002000:00100000:1.0:1746143679.554546:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880131e9f800 x1830963591899904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/440 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.554556:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9f800 with x1830963591899904 ext(1048576->2097151) 00002000:00010000:1.0:1746143679.554561:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9f800 00010000:00010000:0.0:1746143679.555743:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143679.579759:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.579894:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.592184:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591902080 00000100:00100000:0.0:1746143679.592196:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591902080 00002000:00100000:0.0:1746143679.592256:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008fe37100 x1830963591902080/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.592266:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe37100 with x1830963591902080 ext(4194304->4898815) 00002000:00010000:0.0:1746143679.592272:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe37100 00000100:00100000:0.0:1746143679.592302:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3068 00000100:00100000:0.0:1746143679.592313:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963591902080:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143679.601403:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593604864:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143679.601435:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c21da00/0xe984082ccd723808 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03bf expref: 28 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143679.601454:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c21da00, rc 0) 00000100:00100000:0.0:1746143679.601508:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:27957:x1830963591902208:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8144us (8225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143679.601517:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8818 00000100:00100000:1.0:1746143679.610342:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963591902080:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18027us (18816us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143679.610351:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3068 00002000:00100000:1.0:1746143679.610358:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008fe37100 x1830963591902080/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/440 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.610365:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe37100 with x1830963591902080 ext(4194304->4898815) 00010000:00010000:1.0:1746143679.610371:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72371a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0341 expref: 18 pid: 15784 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.610382:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72371a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0341 expref: 18 pid: 15784 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746143679.610388:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fe37100 00000100:00100000:0.0:1746143679.613612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.617495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.620617:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591902592 00000100:00100000:1.0:1746143679.620629:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591902592 00010000:00010000:1.0:1746143679.620672:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72371a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0341 expref: 20 pid: 15784 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746143679.620703:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4474 00000100:00100000:1.0:1746143679.620710:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963591902592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143679.620724:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143679.620747:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72371a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0341 expref: 20 pid: 15784 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.620757:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72371a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3928064->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0341 expref: 20 pid: 15784 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.620781:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.620783:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.620790:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c21da00/0xe984082ccd723808 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03bf expref: 27 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.620796:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c21da00/0xe984082ccd723808 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03bf expref: 27 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.620827:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c21da00/0xe984082ccd723808 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03bf expref: 27 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143679.620842:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593605120:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143679.620907:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143679.622557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.622662:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593605120:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143679.622673:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143679.622697:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963591902592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1987us (5213us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.622704:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4474 00000100:00100000:1.0:1746143679.626398:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.627136:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.627198:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.627326:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591903104 00000100:00100000:1.0:1746143679.627329:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591903104 00010000:00010000:1.0:1746143679.627348:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd7235b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a026f expref: 7 pid: 4582 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746143679.628262:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4475 00000100:00100000:1.0:1746143679.628277:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963591903104:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143679.628289:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143679.628315:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd7235b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a026f expref: 7 pid: 4582 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746143679.628325:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd7235b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a026f expref: 7 pid: 4582 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746143679.628342:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd7235b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a026f expref: 7 pid: 4582 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746143679.628362:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143679.628393:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1963:x1830963591903104:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 120us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.628399:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4475 00000100:00100000:1.0:1746143679.628420:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591903232 00000100:00100000:1.0:1746143679.628423:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591903232 00002000:00100000:1.0:1746143679.628449:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880131e9c380 x1830963591903232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.628458:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9c380 with x1830963591903232 ext(2097152->3145727) 00002000:00010000:1.0:1746143679.628461:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9c380 00000100:00100000:1.0:1746143679.628598:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3069 00000100:00100000:1.0:1746143679.628603:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963591903232:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143679.629394:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.629434:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.631824:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.631846:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591903616 00000100:00100000:0.0:1746143679.631852:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591903616 00010000:00010000:0.0:1746143679.631879:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a963a00/0xe984082ccd723450 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a015e expref: 25 pid: 6929 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746143679.632421:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.636566:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.641505:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.645925:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.648775:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.660330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.670798:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.670835:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.670866:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.686304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.696711:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963591905408:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 23109us (25913us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143679.696723:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3074 00002000:00100000:1.0:1746143679.696735:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800930c2300 x1830963591905408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/440 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.696744:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c2300 with x1830963591905408 ext(2097152->3145727) 00002000:00010000:1.0:1746143679.696750:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930c2300 00000100:00100000:0.0:1746143679.698592:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.708070:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.708269:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591906432 00000100:00100000:1.0:1746143679.708279:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591906432 00002000:00100000:1.0:1746143679.708330:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800930c3100 x1830963591906432/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.708339:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c3100 with x1830963591906432 ext(4194304->4898815) 00002000:00010000:1.0:1746143679.708345:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c3100 00000100:00100000:1.0:1746143679.708461:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3076 00000100:00100000:1.0:1746143679.708468:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963591906432:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143679.714173:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963591906432:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5669us (6078us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143679.714186:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3076 00002000:00100000:1.0:1746143679.714198:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800930c3100 x1830963591906432/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/440 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.714207:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c3100 with x1830963591906432 ext(4194304->4898815) 00002000:00010000:1.0:1746143679.714213:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c3100 00000100:00100000:0.0:1746143679.722898:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.724171:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591906688 00000100:00100000:1.0:1746143679.724182:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591906688 00000100:00100000:1.0:1746143679.724244:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3249 00000100:00100000:1.0:1746143679.724253:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:27957:x1830963591906688:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143679.724627:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:27957:x1830963591906688:12345-192.168.202.48@tcp:35:cat.0 Request processed in 373us (1740us total) trans 8589942150 rc 0/0 00000100:00100000:1.0:1746143679.724633:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3249 00000100:00100000:0.0:1746143679.771735:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.774379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.774720:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.775117:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591907456 00000100:00100000:1.0:1746143679.775125:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591907456 00000100:00100000:1.0:1746143679.775194:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3250 00000100:00100000:1.0:1746143679.775201:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:27970:x1830963591907456:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143679.775379:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:27970:x1830963591907456:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 178us (659us total) trans 8589942152 rc 0/0 00000100:00100000:1.0:1746143679.775385:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3250 00000100:00100000:0.0:1746143679.775815:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591907584 00000100:00100000:0.0:1746143679.775818:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591907584 00000100:00100000:0.0:1746143679.775845:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 526 00000100:00100000:0.0:1746143679.775851:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1962:x1830963591907584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143679.775860:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143679.775878:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a04b9e00/0xe984082ccd72386a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03f0 expref: 259 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143679.775898:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143679.775902:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143679.775923:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:1962:x1830963591907584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 72us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143679.775928:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 526 00000100:00100000:0.0:1746143679.781223:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.781257:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.781297:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.782167:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8825 00000100:00100000:1.0:1746143679.782175:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963591907840:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143679.782182:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143679.782189:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbcac00/0xe984082ccd7238a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0405 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.782201:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.782202:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.782210:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcac00/0xe984082ccd7238a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0405 expref: 16 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.782225:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcac00/0xe984082ccd7238a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0405 expref: 16 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.782234:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcac00, rc 0) 00000100:00100000:1.0:1746143679.782252:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963591907840:12345-192.168.202.48@tcp:101:cat.0 Request processed in 78us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.782257:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8825 00000100:00100000:0.0:1746143679.798803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.804764:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.804855:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591908224 00000100:00100000:1.0:1746143679.804867:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591908224 00002000:00100000:1.0:1746143679.804903:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1417216->2011135) req@ffff8800949f3800 x1830963591908224/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.804916:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3800 with x1830963591908224 ext(1417216->2011135) 00010000:00010000:1.0:1746143679.804924:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9000/0xe984082ccd723816 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03cd expref: 25 pid: 8495 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746143679.804937:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9000/0xe984082ccd723816 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03cd expref: 25 pid: 8495 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746143679.804943:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800949f3800 00000100:00100000:1.0:1746143679.804981:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 729 00000100:00100000:1.0:1746143679.804988:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963591908224:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143679.839497:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591908352 00000100:00100000:0.0:1746143679.839505:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591908352 00010000:00010000:0.0:1746143679.839532:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9000/0xe984082ccd723816 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03cd expref: 27 pid: 8495 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746143679.839560:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4479 00000100:00100000:0.0:1746143679.839566:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963591908352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143679.839577:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143679.839594:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9000/0xe984082ccd723816 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->2011135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03cd expref: 27 pid: 8495 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.839604:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9000/0xe984082ccd723816 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->2011135) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03cd expref: 27 pid: 8495 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.839620:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9000/0xe984082ccd723816 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->2011135) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03cd expref: 27 pid: 8495 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.839943:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143679.839946:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143679.839953:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6dee00/0xe984082ccd7238a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a040c expref: 14 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143679.839960:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6dee00/0xe984082ccd7238a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a040c expref: 14 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143679.839994:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6dee00/0xe984082ccd7238a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a040c expref: 14 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143679.840007:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593606272:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143679.840732:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143679.841660:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.853517:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.853554:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.853592:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.854499:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593606272:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143679.854510:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143679.854527:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963591908352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 14961us (15141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.854533:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4479 00000100:00100000:0.0:1746143679.859247:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.859293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.859317:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591909248 00000100:00100000:0.0:1746143679.859325:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591909248 00002000:00100000:0.0:1746143679.859367:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (962560->966655) req@ffff8800949f0000 x1830963591909248/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.859377:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0000 with x1830963591909248 ext(962560->966655) 00002000:00010000:0.0:1746143679.859381:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f0000 00000100:00100000:0.0:1746143679.859401:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3078 00000100:00100000:0.0:1746143679.859409:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963591909248:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143679.859573:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963591909248:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 165us (333us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143679.859579:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3078 00002000:00100000:0.0:1746143679.859584:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (962560->966655) req@ffff8800949f0000 x1830963591909248/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/4536 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.859591:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0000 with x1830963591909248 ext(962560->966655) 00002000:00010000:0.0:1746143679.859594:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f0000 00000100:00100000:0.0:1746143679.867528:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.867564:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.867597:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.868299:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591909760 00000100:00100000:1.0:1746143679.868303:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591909760 00000100:00100000:1.0:1746143679.868328:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591909888 00000100:00100000:1.0:1746143679.868330:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591909888 00000100:00100000:1.0:1746143679.868349:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8828 00000100:00100000:1.0:1746143679.868354:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963591909760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143679.868367:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143679.868379:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bbcb800/0xe984082ccd7238da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0421 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143679.868417:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593606784:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143679.868469:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143679.868484:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8829 00000100:00100000:1.0:1746143679.868489:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963591909888:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143679.868497:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143679.868506:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbcbe00/0xe984082ccd7238e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0428 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.868517:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.868519:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.868526:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcbe00/0xe984082ccd7238e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0428 expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.868538:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcbe00/0xe984082ccd7238e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0428 expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.868547:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcbe00, rc 0) 00000100:00100000:1.0:1746143679.868564:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963591909888:12345-192.168.202.48@tcp:101:cat.0 Request processed in 74us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.868569:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8829 00000100:00100000:0.0:1746143679.871392:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:1.0:1746143679.873891:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime: 1746143678 -> 1746143679 00000100:00100000:1.0:1746143679.873906:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593606784:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143679.873924:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bbcb800/0xe984082ccd7238da lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0421 expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.873933:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcb800/0xe984082ccd7238da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0421 expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.873945:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcb800, rc 0) 00000100:00100000:1.0:1746143679.873963:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963591909760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5609us (6398us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143679.873968:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8828 00000100:00100000:0.0:1746143679.879380:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.879485:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591910144 00000100:00100000:1.0:1746143679.879492:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591910144 00000100:00100000:1.0:1746143679.879544:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8831 00000100:00100000:1.0:1746143679.879552:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:27975:x1830963591910144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143679.879569:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143679.879584:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bbcba00/0xe984082ccd7238ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0436 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.879607:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9800/0xe984082ccd7238b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 962560->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0413 expref: 17 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.879614:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143679.879615:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143679.879619:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bbcba00/0xe984082ccd7238ef lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0436 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.879641:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9800/0xe984082ccd7238b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 962560->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0413 expref: 17 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.879651:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a04b9800/0xe984082ccd7238b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 962560->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0413 expref: 17 pid: 12618 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746143679.879662:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593607168:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143679.879721:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143679.885318:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591910272 00000100:00100000:0.0:1746143679.885325:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591910272 00010000:00010000:0.0:1746143679.885357:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1800/0xe984082ccd7237c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a039c expref: 16 pid: 15784 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746143679.885377:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591910400 00000100:00100000:0.0:1746143679.885379:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591910400 00010000:00010000:0.0:1746143679.885387:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094677000/0xe984082ccd7237d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03a3 expref: 27 pid: 15784 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746143679.885400:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4483 00000100:00100000:0.0:1746143679.885404:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963591910400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143679.885409:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143679.885420:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094677000/0xe984082ccd7237d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03a3 expref: 27 pid: 15784 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.885429:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094677000/0xe984082ccd7237d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03a3 expref: 27 pid: 15784 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746143679.885595:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593607168:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143679.885614:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bbcba00/0xe984082ccd7238ef lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0436 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.885624:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcba00, rc 0) 00000100:00100000:1.0:1746143679.885657:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:27975:x1830963591910144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6106us (6283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.885664:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8831 00010000:00010000:0.0:1746143679.886349:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094677000/0xe984082ccd7237d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03a3 expref: 27 pid: 15784 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.886362:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143679.886365:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143679.886371:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9000/0xe984082ccd7238e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1835007) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a042f expref: 15 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143679.886378:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9000/0xe984082ccd7238e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1835007) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a042f expref: 15 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143679.886406:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9000/0xe984082ccd7238e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1835007) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a042f expref: 15 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143679.886416:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593607296:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143679.886459:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143679.899262:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.899307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.899331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.899359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.899382:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591911040 00000100:00100000:0.0:1746143679.899391:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591911040 00000100:00100000:1.0:1746143679.899402:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591910912 00000100:00100000:1.0:1746143679.899413:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591910912 00002000:00100000:0.0:1746143679.899440:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1830912->1835007) req@ffff8800949f2a00 x1830963591911040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.899449:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f2a00 with x1830963591911040 ext(1830912->1835007) 00002000:00100000:1.0:1746143679.899451:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800949f1880 x1830963591910912/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746143679.899455:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f2a00 00002000:00100000:1.0:1746143679.899459:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1880 with x1830963591910912 ext(2097152->3145727) 00002000:00010000:1.0:1746143679.899464:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1880 00000100:00100000:0.0:1746143679.899484:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591911168 00000100:00100000:0.0:1746143679.899488:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591911168 00002000:00100000:0.0:1746143679.899501:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800949f1c00 x1830963591911168/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.899507:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1c00 with x1830963591911168 ext(3145728->4194303) 00002000:00010000:0.0:1746143679.899511:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1c00 00000100:00100000:0.0:1746143679.899640:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591911552 00000100:00100000:0.0:1746143679.899643:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591911552 00002000:00100000:0.0:1746143679.899661:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800949f3b80 x1830963591911552/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/0 e 0 to 0 dl 1746143690 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.899667:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3b80 with x1830963591911552 ext(3145728->4194303) 00002000:00010000:0.0:1746143679.899670:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f3b80 00000100:00100000:0.0:1746143679.899683:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3079 00000100:00100000:0.0:1746143679.899690:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963591911040:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143679.899887:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963591911040:12345-192.168.202.48@tcp:3:cat.0 Request processed in 196us (637us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143679.899894:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3079 00002000:00100000:0.0:1746143679.899899:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34a:0x0] (1830912->1835007) req@ffff8800949f2a00 x1830963591911040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/4536 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.899906:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f2a00 with x1830963591911040 ext(1830912->1835007) 00002000:00010000:0.0:1746143679.899909:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f2a00 00000100:00100000:0.0:1746143679.899924:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3080 00000100:00100000:0.0:1746143679.899930:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963591910912:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143679.899938:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3081 00000100:00100000:1.0:1746143679.899947:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963591911168:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143679.907423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.916038:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.917259:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963591911168:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17312us (17924us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143679.917268:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3081 00002000:00100000:1.0:1746143679.917277:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800949f1c00 x1830963591911168/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/440 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143679.917287:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1c00 with x1830963591911168 ext(3145728->4194303) 00002000:00010000:1.0:1746143679.917292:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1c00 00000100:00100000:0.0:1746143679.933034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.934574:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591912448 00000100:00100000:1.0:1746143679.934583:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591912448 00000100:00100000:1.0:1746143679.934640:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8832 00000100:00100000:1.0:1746143679.934648:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:27970:x1830963591912448:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143679.934663:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143679.934683:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbcbc00/0xe984082ccd7238f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a043d expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.934712:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9c00/0xe984082ccd72382b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03e2 expref: 27 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.934721:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcac00/0xe984082ccd7238a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0405 expref: 14 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.934728:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.934729:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143679.934733:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcbc00/0xe984082ccd7238f6 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3547136->4194303] (req 3547136->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a043d expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.934764:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbcac00/0xe984082ccd7238a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0405 expref: 14 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143679.934776:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcac00/0xe984082ccd7238a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0405 expref: 14 pid: 15784 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746143679.934788:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593607552:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143679.934852:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9c00/0xe984082ccd72382b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03e2 expref: 27 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.934865:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9c00/0xe984082ccd72382b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03e2 expref: 27 pid: 8495 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746143679.934873:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593607680:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143679.934892:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143679.940981:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.941259:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143679.942036:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcac00/0xe984082ccd7238a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0405 expref: 14 pid: 15784 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746143679.942054:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593607552:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143679.942063:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a04b9c00/0xe984082ccd72382b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03e2 expref: 28 pid: 8495 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746143679.942076:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593607680:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143679.942098:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcbc00/0xe984082ccd7238f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a043d expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.942107:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcbc00, rc 0) 00000100:00100000:1.0:1746143679.942129:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:27970:x1830963591912448:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7483us (9108us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.942135:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8832 00000100:00100000:0.0:1746143679.942722:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963591912320:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24340us (26686us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143679.942732:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3084 00002000:00100000:0.0:1746143679.942740:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008e626a00 x1830963591912320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:75/0 lens 488/440 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143679.942748:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e626a00 with x1830963591912320 ext(0->1048575) 00002000:00010000:0.0:1746143679.942752:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e626a00 00000100:00100000:0.0:1746143679.943804:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.943851:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591912832 00000100:00100000:1.0:1746143679.943856:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591912832 00000100:00100000:1.0:1746143679.943890:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8833 00000100:00100000:1.0:1746143679.943896:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:27971:x1830963591912832:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143679.943912:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143679.943925:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbcae00/0xe984082ccd7238fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0444 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.943946:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcbc00/0xe984082ccd7238f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a043d expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.943954:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143679.943956:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143679.943959:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcae00/0xe984082ccd7238fd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0444 expref: 15 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.944172:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbcbc00/0xe984082ccd7238f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a043d expref: 25 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.944183:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcbc00/0xe984082ccd7238f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3547136->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a043d expref: 25 pid: 15784 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746143679.944194:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593607936:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143679.944255:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143679.945942:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593607936:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143679.945960:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcae00/0xe984082ccd7238fd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0444 expref: 15 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143679.945982:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcae00, rc 0) 00000100:00100000:1.0:1746143679.946089:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+15:27971:x1830963591912832:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2191us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143679.946096:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8833 00000100:00100000:1.0:1746143679.950902:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.952781:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.953852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.957967:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143679.970800:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.978455:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591913728 00000100:00100000:0.0:1746143679.978467:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591913728 00010000:00010000:0.0:1746143679.978505:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c21da00/0xe984082ccd723808 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03bf expref: 29 pid: 8495 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746143679.978550:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4488 00000100:00100000:0.0:1746143679.978559:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963591913728:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143679.978574:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143679.978596:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c21da00/0xe984082ccd723808 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03bf expref: 29 pid: 8495 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.978608:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c21da00/0xe984082ccd723808 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03bf expref: 29 pid: 8495 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.978631:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c21da00/0xe984082ccd723808 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a03bf expref: 29 pid: 8495 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746143679.978656:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143679.978658:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143679.978677:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7e00/0xe984082ccd72390b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4321279) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0452 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143679.978686:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7e00/0xe984082ccd72390b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4321279) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0452 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143679.978722:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7e00/0xe984082ccd72390b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4321279) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0452 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143679.978734:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e624a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593608448:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143679.978810:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143679.983603:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.986606:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143679.986838:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.004600:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.004647:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.008113:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963591914368:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20794us (21495us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143680.008124:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3086 00002000:00100000:0.0:1746143680.008135:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008e625500 x1830963591914368/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:75/0 lens 488/440 e 0 to 0 dl 1746143690 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143680.008159:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e625500 with x1830963591914368 ext(2097152->3145727) 00002000:00010000:0.0:1746143680.008164:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e625500 00000100:00100000:0.0:1746143680.025728:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.030824:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.031231:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143680.032088:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143680.032285:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143680.034789:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.039881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.044439:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.046259:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593608960:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143680.046267:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593609088:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143680.046283:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143680.046308:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963591915904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1475us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.046316:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4491 00000100:00100000:0.0:1746143680.058987:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.059189:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591916416 00000100:00100000:1.0:1746143680.059196:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591916416 00002000:00100000:1.0:1746143680.059235:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800930c0000 x1830963591916416/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:76/0 lens 488/0 e 0 to 0 dl 1746143691 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.059245:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0000 with x1830963591916416 ext(3145728->4194303) 00002000:00010000:1.0:1746143680.059251:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c0000 00000100:00100000:1.0:1746143680.059266:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591916672 00000100:00100000:1.0:1746143680.059268:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591916672 00002000:00100000:1.0:1746143680.059278:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008fe34a80 x1830963591916672/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:76/0 lens 488/0 e 0 to 0 dl 1746143691 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.059285:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe34a80 with x1830963591916672 ext(3145728->4194303) 00002000:00010000:1.0:1746143680.059288:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe34a80 00000100:00100000:1.0:1746143680.059300:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3090 00000100:00100000:1.0:1746143680.059306:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963591916416:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143680.060548:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3091 00000100:00100000:1.0:1746143680.060555:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963591916672:12345-192.168.202.48@tcp:3:cat.0 00000100:00080000:0.0:1746143680.063455:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143680.084542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.086172:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.086301:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963591916416:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26993us (27222us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143680.086310:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3090 00002000:00100000:1.0:1746143680.086320:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800930c0000 x1830963591916416/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:76/0 lens 488/440 e 0 to 0 dl 1746143691 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.086336:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0000 with x1830963591916416 ext(3145728->4194303) 00002000:00010000:1.0:1746143680.086341:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c0000 00000100:00100000:1.0:1746143680.087667:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963591916672:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27110us (28546us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143680.087675:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3091 00002000:00100000:1.0:1746143680.087682:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008fe34a80 x1830963591916672/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:76/0 lens 488/440 e 0 to 0 dl 1746143691 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.087689:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe34a80 with x1830963591916672 ext(3145728->4194303) 00002000:00010000:1.0:1746143680.087693:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe34a80 00000100:00100000:0.0:1746143680.091935:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.091987:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.092029:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.092132:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591917696 00000100:00100000:1.0:1746143680.092157:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591917696 00002000:00100000:1.0:1746143680.092190:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800935a2d80 x1830963591917696/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:76/0 lens 488/0 e 0 to 0 dl 1746143691 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.092200:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a2d80 with x1830963591917696 ext(3145728->4194303) 00002000:00010000:1.0:1746143680.092205:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a2d80 00000100:00100000:1.0:1746143680.092279:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3092 00000100:00100000:1.0:1746143680.092288:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963591917440:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143680.093234:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3094 00000100:00100000:0.0:1746143680.093242:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963591917952:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143680.103281:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.104465:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.113310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.119170:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963591917440:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26846us (27210us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143680.119180:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3092 00002000:00100000:1.0:1746143680.119191:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800935a0000 x1830963591917440/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:76/0 lens 488/440 e 0 to 0 dl 1746143691 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.119200:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0000 with x1830963591917440 ext(2097152->3145727) 00002000:00010000:1.0:1746143680.119206:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a0000 00000100:00100000:0.0:1746143680.141632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.154301:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.169512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143680.170309:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143680.187074:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.187198:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591919360 00000100:00100000:1.0:1746143680.187208:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591919360 00000100:00100000:1.0:1746143680.187264:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8841 00000100:00100000:1.0:1746143680.187271:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:27979:x1830963591919360:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143680.187288:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143680.187305:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff26600/0xe984082ccd723958 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0483 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.187330:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06d9200/0xe984082ccd723904 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a044b expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.187338:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cbd600/0xe984082ccd72394a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a047c expref: 18 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.187343:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.187345:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.187348:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff26600/0xe984082ccd723958 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1736704->2097151] (req 1736704->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0483 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.187377:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130cbd600/0xe984082ccd72394a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a047c expref: 18 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.187386:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130cbd600/0xe984082ccd72394a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a047c expref: 18 pid: 12618 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746143680.187395:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593609216:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143680.187495:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06d9200/0xe984082ccd723904 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a044b expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.187502:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a06d9200/0xe984082ccd723904 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a044b expref: 28 pid: 15784 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.187509:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593609344:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143680.187525:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143680.188686:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593609216:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143680.188696:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593609344:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143680.188717:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff26600/0xe984082ccd723958 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1736704->2097151] (req 1736704->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0483 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.188732:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff26600, rc 0) 00000100:00100000:1.0:1746143680.188763:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:27979:x1830963591919360:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1493us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.188770:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8841 00000100:00100000:0.0:1746143680.190115:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.190167:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.199319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.207915:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591920000 00000100:00100000:1.0:1746143680.207925:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591920000 00000100:00100000:1.0:1746143680.209049:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8842 00000100:00100000:1.0:1746143680.209061:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:27979:x1830963591920000:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143680.209082:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143680.209102:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff26e00/0xe984082ccd72395f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a048a expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.210020:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6dee00/0xe984082ccd7238a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a040c expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.210032:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcbe00/0xe984082ccd7238e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0428 expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.210038:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.210040:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.210044:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff26e00/0xe984082ccd72395f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->1495039] (req 1048576->1495039) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a048a expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.210076:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbcbe00/0xe984082ccd7238e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0428 expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.210087:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcbe00/0xe984082ccd7238e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0428 expref: 27 pid: 8495 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746143680.210099:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593609600:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143680.210219:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6dee00/0xe984082ccd7238a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a040c expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.210228:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d6dee00/0xe984082ccd7238a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a040c expref: 18 pid: 12618 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.210235:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593609728:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143680.210257:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143680.218444:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.219422:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143680.219908:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcbe00/0xe984082ccd7238e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0428 expref: 27 pid: 8495 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746143680.219924:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593609600:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143680.219932:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6dee00/0xe984082ccd7238a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a040c expref: 19 pid: 12618 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.219939:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593609728:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143680.219959:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff26e00/0xe984082ccd72395f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1495039) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a048a expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.219966:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff26e00, rc 0) 00000100:00100000:1.0:1746143680.219997:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:27979:x1830963591920000:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 10940us (12181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.220004:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8842 00000100:00100000:0.0:1746143680.227032:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.229357:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.231625:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.234411:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.234456:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.280022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.280131:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591921536 00000100:00100000:1.0:1746143680.280169:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591921536 00000100:00100000:1.0:1746143680.280292:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8843 00000100:00100000:1.0:1746143680.280302:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:27983:x1830963591921536:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143680.280323:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143680.280343:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff27200/0xe984082ccd723989 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0498 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.280375:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcae00/0xe984082ccd7238fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0444 expref: 16 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.280384:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b459e00/0xe984082ccd723943 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a046e expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.280390:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.280391:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.280395:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff27200/0xe984082ccd723989 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3772416->4194303] (req 3772416->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0498 expref: 28 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.280423:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b459e00/0xe984082ccd723943 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a046e expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.280435:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b459e00/0xe984082ccd723943 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a046e expref: 28 pid: 8496 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.280448:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593609984:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143680.283365:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbcae00/0xe984082ccd7238fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0444 expref: 16 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.283381:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcae00/0xe984082ccd7238fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0444 expref: 16 pid: 15784 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.283394:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593610112:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143680.285008:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143680.285044:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593609984:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143680.289935:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.291211:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593610112:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143680.291239:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff27200/0xe984082ccd723989 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3772416->4194303] (req 3772416->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0498 expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.291256:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff27200, rc 0) 00000100:00100000:0.0:1746143680.291304:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:27983:x1830963591921536:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 11004us (11293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.291312:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8843 00000100:00100000:0.0:1746143680.293220:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.298736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.304431:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.312814:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.316619:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.322932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.336319:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.341554:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.346959:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143680.347478:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458c00/0xe984082ccd7239ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347484:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458c00/0xe984082ccd7239ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143680.347517:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:1.0:1746143680.347520:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143680.347532:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458c00/0xe984082ccd7239ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347540:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458c00/0xe984082ccd7239ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347548:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458800/0xe984082ccd72399e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347553:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458800/0xe984082ccd72399e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347558:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458800/0xe984082ccd72399e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347563:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b458800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143680.347566:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458800/0xe984082ccd72399e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347571:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458800/0xe984082ccd72399e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347579:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143680.347581:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143680.347583:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458800/0xe984082ccd72399e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347588:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458800/0xe984082ccd72399e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347601:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458e00/0xe984082ccd7239a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347605:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458e00/0xe984082ccd7239a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347609:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458e00/0xe984082ccd7239a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347612:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b458e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143680.347614:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458e00/0xe984082ccd7239a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347619:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458e00/0xe984082ccd7239a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347624:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9d600) 00010000:00010000:1.0:1746143680.347626:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143680.347628:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458e00/0xe984082ccd7239a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347632:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458e00/0xe984082ccd7239a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.347655:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458a00/0xe984082ccd723997 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04a6 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.347665:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458c00/0xe984082ccd7239ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04a6 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.347674:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143680.347676:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143680.347678:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b458c00, rc 0) 00000100:00100000:1.0:1746143680.347709:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:27986:x1830963591922816:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 11124us (11396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.347715:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8108 00000100:00100000:0.0:1746143680.351520:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.351559:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.351586:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.351600:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.351611:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.351633:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143680.352157:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143680.352169:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8849 00000100:00100000:0.0:1746143680.352176:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963591923584:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143680.352182:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143680.352187:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094cfd400/0xe984082ccd7239cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a04bb expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143680.352206:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593611136:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143680.352235:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143680.356819:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593611136:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143680.356838:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094cfd400/0xe984082ccd7239cf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04bb expref: 7 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.356846:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094cfd400/0xe984082ccd7239cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04bb expref: 7 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.356872:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cfd400, rc 0) 00000100:00100000:1.0:1746143680.356908:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1963:x1830963591923584:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4732us (5294us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143680.356913:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8849 00000100:00100000:0.0:1746143680.359920:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.360117:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591924224 00000100:00100000:1.0:1746143680.360319:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591924224 00000100:00100000:1.0:1746143680.360380:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8109 00000100:00100000:1.0:1746143680.360388:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:27986:x1830963591924224:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143680.360410:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143680.360430:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff27800/0xe984082ccd7239dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a04d7 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.360767:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff27a00/0xe984082ccd7239e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.360784:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458c00/0xe984082ccd7239ac lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04a6 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.360791:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff27a00/0xe984082ccd7239e4 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.360824:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458c00/0xe984082ccd7239ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04a6 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.360837:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458c00/0xe984082ccd7239ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04a6 expref: 10 pid: 16090 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.360849:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593611392:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143680.361663:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143680.364300:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593611392:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143680.364328:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff27a00/0xe984082ccd7239e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143680.366252:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143680.367030:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff27a00/0xe984082ccd7239e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143680.367038:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff27a00/0xe984082ccd7239e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:0.0:1746143680.367055:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143680.367196:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff27800/0xe984082ccd7239dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04d7 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.367212:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff27a00/0xe984082ccd7239e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04d7 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.367218:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143680.367220:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143680.367222:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff27a00, rc 0) 00000100:00100000:0.0:1746143680.367248:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:27986:x1830963591924224:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 6861us (7344us total) trans 8589942163 rc 0/0 00000100:00100000:0.0:1746143680.367254:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8109 00000100:00100000:0.0:1746143680.369693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.372044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.372115:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591924608 00000100:00100000:1.0:1746143680.372120:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591924608 00010000:00010000:1.0:1746143680.372221:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff27a00/0xe984082ccd7239e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04d7 expref: 12 pid: 16090 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.372253:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4502 00000100:00100000:1.0:1746143680.372260:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963591924608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143680.372273:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143680.372279:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff27a00/0xe984082ccd7239e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04d7 expref: 12 pid: 16090 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.372289:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff27a00/0xe984082ccd7239e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04d7 expref: 12 pid: 16090 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.372309:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff27a00/0xe984082ccd7239e4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04d7 expref: 12 pid: 16090 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.372332:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143680.372336:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458800/0xe984082ccd7239f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.372344:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458800/0xe984082ccd7239f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.372351:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458800/0xe984082ccd7239f9 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.373605:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143680.373627:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963591924608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1367us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.373633:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4502 00000100:00100000:1.0:1746143680.375843:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591924736 00000100:00100000:1.0:1746143680.375854:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591924736 00000100:00100000:1.0:1746143680.375914:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8851 00000100:00100000:1.0:1746143680.375924:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1963:x1830963591924736:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143680.375944:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143680.375963:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff27000/0xe984082ccd723a00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a04e5 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.376028:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593611648:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143680.376120:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143680.376253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.376341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.376364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.376446:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8853 00000100:00100000:1.0:1746143680.376451:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963591924992:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143680.376460:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143680.376470:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff26800/0xe984082ccd723a0e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a04f3 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.376495:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593611904:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143680.376517:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143680.378632:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593611648:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143680.378647:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff27000/0xe984082ccd723a00 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04e5 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.378655:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff27000/0xe984082ccd723a00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04e5 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.378663:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff27000, rc 0) 00000100:00100000:1.0:1746143680.378713:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963591924736:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2789us (2971us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143680.378722:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8851 00000100:00100000:1.0:1746143680.378772:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593611904:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143680.378789:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff26800/0xe984082ccd723a0e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04f3 expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.378798:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff26800/0xe984082ccd723a0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04f3 expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.378806:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff26800, rc 0) 00000100:00100000:1.0:1746143680.378824:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963591924992:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2372us (2483us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143680.378829:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8853 00000100:00100000:0.0:1746143680.382506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.386130:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.386195:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.386231:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.386257:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.386271:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.386303:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.386698:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591925760 00000100:00100000:1.0:1746143680.386701:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591925760 00000100:00100000:1.0:1746143680.386716:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591925888 00000100:00100000:1.0:1746143680.386718:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591925888 00000100:00100000:1.0:1746143680.386728:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8855 00000100:00100000:1.0:1746143680.386734:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963591925504:12345-192.168.202.48@tcp:1:lfs.0 00000100:00100000:1.0:1746143680.386751:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8857 00000100:00100000:1.0:1746143680.386755:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963591925760:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143680.386773:0:8497:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff27800/0xe984082ccd723a38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.386787:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff26e00/0xe984082ccd72395f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1495039) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a048a expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.386794:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143680.386795:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143680.386798:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff27800/0xe984082ccd723a38 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.386820:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff26e00/0xe984082ccd72395f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1495039) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a048a expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143680.387118:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8860 00000100:00100000:0.0:1746143680.387124:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963591926144:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143680.387163:0:8496:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094cfc600/0xe984082ccd723a4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.387173:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff27200/0xe984082ccd723989 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0498 expref: 26 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.387178:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143680.387179:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143680.387181:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094cfc600/0xe984082ccd723a4d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.387195:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff27200/0xe984082ccd723989 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0498 expref: 26 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.387248:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff26e00/0xe984082ccd72395f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1495039) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a048a expref: 15 pid: 8495 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.387258:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593612160:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143680.387285:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7600 going to sleep for 11 seconds 00010000:00010000:1.0:1746143680.387302:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.387311:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcba00/0xe984082ccd7238ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0436 expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.387318:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cbdc00/0xe984082ccd7239c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04ad expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.387323:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cbd200/0xe984082ccd723951 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0475 expref: 18 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.387328:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.387329:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.387330:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.387343:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130cbd200/0xe984082ccd723951 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0475 expref: 18 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.387349:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130cbd200/0xe984082ccd723951 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0475 expref: 18 pid: 12618 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746143680.387355:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593612800:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143680.387379:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130cbdc00/0xe984082ccd7239c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04ad expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.387385:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130cbdc00/0xe984082ccd7239c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04ad expref: 10 pid: 12618 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746143680.387391:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593612928:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143680.388095:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff27200/0xe984082ccd723989 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0498 expref: 26 pid: 8495 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746143680.388103:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593612672:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143680.388123:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0480 going to sleep for 11 seconds 00010000:00010000:1.0:1746143680.388268:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bbcba00/0xe984082ccd7238ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0436 expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.388275:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bbcba00/0xe984082ccd7238ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0436 expref: 29 pid: 15784 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.388283:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593613312:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143680.388298:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143680.400613:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.400643:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.400681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.400691:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.400702:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.400723:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591926528 00000100:00100000:0.0:1746143680.400729:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591926528 00010000:00010000:0.0:1746143680.400757:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f198e00/0xe984082ccd7236c6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0317 expref: 19 pid: 8495 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746143680.400777:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591926784 00000100:00100000:0.0:1746143680.400779:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591926784 00010000:00010000:0.0:1746143680.400790:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130cbd000/0xe984082ccd7239ba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04c2 expref: 11 pid: 25369 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746143680.400803:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591926656 00000100:00100000:0.0:1746143680.400805:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591926656 00010000:00010000:0.0:1746143680.400812:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130cbd200/0xe984082ccd723951 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0475 expref: 20 pid: 12618 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746143680.400827:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4503 00000100:00100000:0.0:1746143680.400833:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963591926528:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143680.400843:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143680.400861:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f198e00/0xe984082ccd7236c6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0317 expref: 20 pid: 8495 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746143680.400870:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f198e00/0xe984082ccd7236c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0317 expref: 20 pid: 8495 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746143680.400891:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143680.400925:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963591926528:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 91us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.400931:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4503 00000100:00100000:0.0:1746143680.400953:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4504 00000100:00100000:0.0:1746143680.400958:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591926784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143680.400990:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143680.400998:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130cbd000/0xe984082ccd7239ba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04c2 expref: 11 pid: 25369 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746143680.401010:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130cbd000/0xe984082ccd7239ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04c2 expref: 11 pid: 25369 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746143680.401019:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143680.401034:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591926784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 75us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.401039:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4504 00000100:00100000:0.0:1746143680.401050:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4505 00000100:00100000:0.0:1746143680.401054:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963591926656:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143680.401060:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143680.401067:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130cbd200/0xe984082ccd723951 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0475 expref: 19 pid: 12618 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746143680.401074:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130cbd200/0xe984082ccd723951 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0475 expref: 19 pid: 12618 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746143680.401083:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143680.401095:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963591926656:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 40us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.401099:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4505 00000100:00100000:0.0:1746143680.401136:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593612672:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143680.401183:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593612160:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143680.401183:0:8496:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094cfc600/0xe984082ccd723a4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.401193:0:8497:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ff27800/0xe984082ccd723a38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.401210:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cbd200/0xe984082ccd723951 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0475 expref: 18 pid: 12618 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746143680.401223:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593612800:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143680.401225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.401236:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591926272 00000100:00100000:1.0:1746143680.401239:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591926272 00002000:00100000:1.0:1746143680.401262:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4263935) req@ffff880094c0ea00 x1830963591926272/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:76/0 lens 488/0 e 0 to 0 dl 1746143691 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.401269:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ea00 with x1830963591926272 ext(4194304->4263935) 00000100:00100000:0.0:1746143680.401273:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591926400 00010000:00010000:1.0:1746143680.401275:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b459000/0xe984082ccd723990 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a049f expref: 30 pid: 8495 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746143680.401276:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591926400 00010000:00010000:1.0:1746143680.401283:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b459000/0xe984082ccd723990 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a049f expref: 30 pid: 8495 timeout: 859 lvb_type: 0 00002000:00100000:0.0:1746143680.401287:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1495039) req@ffff880094c0c380 x1830963591926400/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:76/0 lens 488/0 e 0 to 0 dl 1746143691 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:1.0:1746143680.401288:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0ea00 00002000:00100000:0.0:1746143680.401294:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c380 with x1830963591926400 ext(1048576->1495039) 00000100:00100000:1.0:1746143680.401298:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591926912 00010000:00010000:0.0:1746143680.401298:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff26e00/0xe984082ccd72395f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1495039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a048a expref: 16 pid: 8495 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.401299:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591926912 00010000:00010000:0.0:1746143680.401305:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff26e00/0xe984082ccd72395f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1495039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a048a expref: 16 pid: 8495 timeout: 859 lvb_type: 0 00002000:00100000:1.0:1746143680.401308:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3772416->4194303) req@ffff880094c0d500 x1830963591926912/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:76/0 lens 488/0 e 0 to 0 dl 1746143691 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:0.0:1746143680.401311:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c0c380 00002000:00100000:1.0:1746143680.401314:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d500 with x1830963591926912 ext(3772416->4194303) 00010000:00010000:1.0:1746143680.401317:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff27200/0xe984082ccd723989 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0498 expref: 27 pid: 8495 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746143680.401320:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 734 00010000:00010000:1.0:1746143680.401324:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff27200/0xe984082ccd723989 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3772416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0498 expref: 27 pid: 8495 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746143680.401325:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963591926272:12345-192.168.202.48@tcp:4:multiop.0 00002000:00010000:1.0:1746143680.401329:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c0d500 00000100:00100000:1.0:1746143680.401338:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 735 00000100:00100000:1.0:1746143680.401342:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963591926400:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143680.404416:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.404442:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.405609:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593612928:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143680.405618:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593613312:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143680.405633:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.405648:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591927168 00000100:00100000:1.0:1746143680.405650:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591927168 00010000:00010000:1.0:1746143680.405662:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130cbdc00/0xe984082ccd7239c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04ad expref: 10 pid: 12618 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746143680.405678:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4506 00000100:00100000:1.0:1746143680.405682:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963591927168:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143680.405689:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143680.405701:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130cbdc00/0xe984082ccd7239c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04ad expref: 10 pid: 12618 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746143680.405708:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130cbdc00/0xe984082ccd7239c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04ad expref: 10 pid: 12618 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746143680.405722:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cbdc00/0xe984082ccd7239c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a04ad expref: 10 pid: 12618 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746143680.405733:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143680.405750:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963591927168:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 68us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.405755:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4506 00000100:00100000:1.0:1746143680.408053:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.408070:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591927424 00000100:00100000:1.0:1746143680.408074:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591927424 00010000:00010000:1.0:1746143680.408086:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bbcba00/0xe984082ccd7238ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0436 expref: 31 pid: 15784 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.408102:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4508 00000100:00100000:1.0:1746143680.408107:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963591927424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143680.408114:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143680.408123:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bbcba00/0xe984082ccd7238ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0436 expref: 31 pid: 15784 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.408131:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bbcba00/0xe984082ccd7238ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0436 expref: 31 pid: 15784 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.408163:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bbcba00/0xe984082ccd7238ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0436 expref: 31 pid: 15784 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.408171:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.408172:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.408175:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.408181:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.408197:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143680.408214:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963591927424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 106us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.408219:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4508 00010000:00010000:1.0:1746143680.408235:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.408242:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.408254:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.408260:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.408266:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.408271:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff26400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143680.408273:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.408279:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.408292:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.408297:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff26400/0xe984082ccd723a54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.408326:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1962:x1830963591925504:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 21591us (22204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.408332:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8855 00000100:00100000:0.0:1746143680.408886:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963591926272:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 7559us (8283us total) trans 17179872310 rc 0/0 00000100:00100000:0.0:1746143680.408894:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 734 00002000:00100000:0.0:1746143680.408900:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4263935) req@ffff880094c0ea00 x1830963591926272/t17179872310(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:76/0 lens 488/448 e 0 to 0 dl 1746143691 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143680.408908:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ea00 with x1830963591926272 ext(4194304->4263935) 00010000:00010000:0.0:1746143680.408914:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b459000/0xe984082ccd723990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a049f expref: 30 pid: 8495 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746143680.408922:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b459000/0xe984082ccd723990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4263935) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a049f expref: 30 pid: 8495 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746143680.408928:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0ea00 00000100:00100000:0.0:1746143680.414897:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.416942:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963591926400:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 15599us (16296us total) trans 21474839576 rc 0/0 00000100:00100000:1.0:1746143680.416950:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 735 00002000:00100000:1.0:1746143680.416957:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1495039) req@ffff880094c0c380 x1830963591926400/t21474839576(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:76/0 lens 488/448 e 0 to 0 dl 1746143691 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.416977:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c380 with x1830963591926400 ext(1048576->1495039) 00010000:00010000:1.0:1746143680.416984:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff26e00/0xe984082ccd72395f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1495039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a048a expref: 20 pid: 8495 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.416992:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff26e00/0xe984082ccd72395f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1495039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a048a expref: 20 pid: 8495 timeout: 859 lvb_type: 0 00002000:00010000:1.0:1746143680.416997:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c0c380 00000100:00100000:1.0:1746143680.422199:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.422271:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143680.422441:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094cfc600/0xe984082ccd723a4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.422449:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094cfc600/0xe984082ccd723a4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.422467:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094cfc600/0xe984082ccd723a4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.422473:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094cfc600/0xe984082ccd723a4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.422479:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094cfc600/0xe984082ccd723a4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.422483:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094cfc600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143680.422487:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094cfc600/0xe984082ccd723a4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.422493:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094cfc600/0xe984082ccd723a4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.422503:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094cfc600/0xe984082ccd723a4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.422509:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094cfc600/0xe984082ccd723a4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143680.422548:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963591926144:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 35425us (36244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.422555:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8860 00010000:00010000:1.0:1746143680.422738:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ff27800/0xe984082ccd723a38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.422745:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff27800/0xe984082ccd723a38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.422756:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff27800/0xe984082ccd723a38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.422761:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff27800/0xe984082ccd723a38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.422766:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ff27800/0xe984082ccd723a38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.422771:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff27800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143680.422773:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff27800/0xe984082ccd723a38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.422779:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff27800/0xe984082ccd723a38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.422786:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ff27800/0xe984082ccd723a38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.422791:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff27800/0xe984082ccd723a38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.422820:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1962:x1830963591925760:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 36064us (36625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.422826:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8857 00000100:00100000:0.0:1746143680.428076:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.428174:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591927936 00000100:00100000:1.0:1746143680.428181:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591927936 00010000:00010000:1.0:1746143680.428208:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff26600/0xe984082ccd723958 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0483 expref: 19 pid: 8495 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.428231:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4512 00000100:00100000:1.0:1746143680.428238:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963591927936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143680.428250:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143680.428269:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff26600/0xe984082ccd723958 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0483 expref: 19 pid: 8495 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.428279:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff26600/0xe984082ccd723958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0483 expref: 19 pid: 8495 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.428296:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff26600/0xe984082ccd723958 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0483 expref: 19 pid: 8495 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.428309:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.428310:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.428314:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8c00/0xe984082ccd723a3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.428347:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8c00/0xe984082ccd723a3f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.428379:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143680.428423:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963591927936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 185us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.428429:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4512 00000100:00100000:0.0:1746143680.430729:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.434000:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.434077:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.434097:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591928320 00000100:00100000:0.0:1746143680.434103:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591928320 00010000:00010000:0.0:1746143680.434130:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79f800/0xe984082ccd7237a6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0380 expref: 262 pid: 21713 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746143680.434179:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591928576 00000100:00100000:0.0:1746143680.434182:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591928576 00010000:00010000:0.0:1746143680.434192:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57aee00/0xe984082ccd7234b9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01b9 expref: 27 pid: 21713 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746143680.434207:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4513 00000100:00100000:0.0:1746143680.434213:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:1965:x1830963591928320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143680.434223:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143680.434228:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79f800/0xe984082ccd7237a6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0380 expref: 262 pid: 21713 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746143680.434236:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79f800/0xe984082ccd7237a6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0380 expref: 262 pid: 21713 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746143680.434252:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143680.434256:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbe00/0xe984082ccd723a5b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143680.434263:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143680.434292:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:1965:x1830963591928320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 78us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.434297:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4513 00000100:00100000:0.0:1746143680.434319:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4514 00000100:00100000:0.0:1746143680.434323:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963591928576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143680.434329:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143680.434332:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57aee00/0xe984082ccd7234b9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01b9 expref: 27 pid: 21713 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746143680.434338:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57aee00/0xe984082ccd7234b9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a01b9 expref: 27 pid: 21713 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746143680.434346:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143680.434348:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbe00/0xe984082ccd723a5b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143680.434352:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143680.434363:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963591928576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 40us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.434367:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4514 00000100:00100000:0.0:1746143680.435363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.435605:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.435885:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.436476:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4516 00000100:00100000:0.0:1746143680.436482:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963591928448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143680.436488:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143680.436492:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79e000/0xe984082ccd72370c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a033a expref: 26 pid: 21713 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746143680.436499:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79e000/0xe984082ccd72370c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a033a expref: 26 pid: 21713 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746143680.436509:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79e000/0xe984082ccd72370c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a033a expref: 26 pid: 21713 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746143680.437643:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:0.0:1746143680.437646:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143680.437663:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963591928448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1181us (2058us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.437668:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4516 00000001:00080000:1.0:1746143680.465905:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942163 is committed 00000001:00080000:1.0:1746143680.465916:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942128 is committed 00000001:00080000:1.0:1746143680.465921:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942152 is committed 00000001:00080000:1.0:1746143680.465932:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942137 is committed 00000001:00080000:1.0:1746143680.465942:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942162 is committed 00000001:00080000:1.0:1746143680.465950:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942160 is committed 00000001:00080000:1.0:1746143680.466010:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942165 is committed 00000004:00080000:1.0:1746143680.466014:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1498 committed 00000004:00080000:1.0:1746143680.466022:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1539 committed 00000004:00080000:1.0:1746143680.466028:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1538 committed 00000004:00080000:1.0:1746143680.466030:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1537 committed 00000004:00080000:1.0:1746143680.466031:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1536 committed 00000004:00080000:1.0:1746143680.466032:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1497 committed 00000004:00080000:1.0:1746143680.466034:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1535 committed 00000004:00080000:1.0:1746143680.466035:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1496 committed 00000004:00080000:1.0:1746143680.466037:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1534 committed 00000004:00080000:1.0:1746143680.466038:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1495 committed 00000004:00080000:1.0:1746143680.466040:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1494 committed 00000004:00080000:1.0:1746143680.466041:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1493 committed 00000004:00080000:1.0:1746143680.466043:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1533 committed 00000004:00080000:1.0:1746143680.466045:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1532 committed 00000004:00080000:1.0:1746143680.466046:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1492 committed 00000004:00080000:1.0:1746143680.466048:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1491 committed 00000004:00080000:1.0:1746143680.466049:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1531 committed 00000100:00100000:1.0:1746143680.466335:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593614080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.466386:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466419:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593614592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.466437:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466449:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593615104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.466465:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466475:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593615616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.466487:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466501:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746143680.466505:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593614208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.466517:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466526:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593614720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.466538:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466547:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593615232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.466558:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466567:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593615744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.466577:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466593:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593614336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.466609:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466619:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593614848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.466631:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466639:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593615360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.466651:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466660:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593615872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.466672:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466679:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746143680.466683:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593614464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.466695:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466701:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593614976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.466711:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466717:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593615488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.466730:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466736:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593616000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.466746:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.466764:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593614080 00000100:00100000:1.0:1746143680.466771:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593614080 00000100:00100000:1.0:1746143680.466805:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593614592 00000100:00100000:1.0:1746143680.466808:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593614592 00000100:00100000:1.0:1746143680.466814:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593615104 00000100:00100000:1.0:1746143680.466816:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593615104 00000100:00100000:1.0:1746143680.466840:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593615616 00000100:00100000:1.0:1746143680.466841:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593615616 00000100:00100000:1.0:1746143680.466847:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593614208 00000100:00100000:1.0:1746143680.466849:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593614208 00000100:00100000:1.0:1746143680.466854:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593614720 00000100:00100000:1.0:1746143680.466855:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593614720 00000100:00100000:1.0:1746143680.466861:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593615232 00000100:00100000:1.0:1746143680.466864:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593615232 00000100:00100000:1.0:1746143680.466868:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593615744 00000100:00100000:1.0:1746143680.466870:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593615744 00000100:00100000:1.0:1746143680.466874:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593614336 00000100:00100000:1.0:1746143680.466875:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593614336 00000100:00100000:1.0:1746143680.466880:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593614848 00000100:00100000:1.0:1746143680.466882:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593614848 00000100:00100000:1.0:1746143680.466887:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593615360 00000100:00100000:1.0:1746143680.466889:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593615360 00000100:00100000:1.0:1746143680.466894:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593615872 00000100:00100000:1.0:1746143680.466895:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593615872 00000100:00100000:1.0:1746143680.466901:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593614464 00000100:00100000:1.0:1746143680.466903:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593614464 00000100:00100000:1.0:1746143680.466908:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593614976 00000100:00100000:1.0:1746143680.466909:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593614976 00000100:00100000:1.0:1746143680.466914:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593615488 00000100:00100000:1.0:1746143680.466916:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593615488 00000100:00100000:1.0:1746143680.466921:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593616000 00000100:00100000:1.0:1746143680.466922:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593616000 00000100:00100000:1.0:1746143680.466930:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8861 00000100:00100000:1.0:1746143680.466936:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3292:x1830963593614080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.467162:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963593614080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (775us total) trans 21474839579 rc 0/0 00000100:00100000:1.0:1746143680.467168:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8861 00000100:00100000:1.0:1746143680.467179:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8862 00000100:00100000:1.0:1746143680.467183:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3292:x1830963593614592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143680.467261:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:1.0:1746143680.467263:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:1.0:1746143680.467266:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143680.467267:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:1.0:1746143680.467269:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:1.0:1746143680.467288:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963593614592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (851us total) trans 21474839580 rc 0/0 00000100:00100000:1.0:1746143680.467293:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8862 00000100:00100000:1.0:1746143680.467302:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8863 00000100:00100000:1.0:1746143680.467306:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3292:x1830963593615104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.467416:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3292:x1830963593615104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (949us total) trans 17179872311 rc 0/0 00000100:00100000:1.0:1746143680.467423:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8863 00000100:00100000:1.0:1746143680.467432:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8864 00000100:00100000:1.0:1746143680.467436:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3292:x1830963593615616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.467509:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3292:x1830963593615616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1021us total) trans 17179872312 rc 0/0 00000100:00100000:1.0:1746143680.467514:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8864 00000100:00100000:1.0:1746143680.467521:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8865 00000100:00100000:1.0:1746143680.467525:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3292:x1830963593614208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.467599:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963593614208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1080us total) trans 21474839581 rc 0/0 00000100:00100000:1.0:1746143680.467603:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8865 00000100:00100000:1.0:1746143680.467610:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8866 00000100:00100000:1.0:1746143680.467614:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3292:x1830963593614720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.467683:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963593614720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (1144us total) trans 21474839582 rc 0/0 00000100:00100000:1.0:1746143680.467688:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8866 00000100:00100000:1.0:1746143680.467695:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8867 00000100:00100000:1.0:1746143680.467699:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3292:x1830963593615232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.467790:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3292:x1830963593615232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (1230us total) trans 17179872313 rc 0/0 00000100:00100000:1.0:1746143680.467795:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8867 00000100:00100000:1.0:1746143680.467803:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8868 00000100:00100000:1.0:1746143680.467807:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3292:x1830963593615744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.477176:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3292:x1830963593615744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 9367us (10596us total) trans 17179872314 rc 0/0 00000100:00100000:1.0:1746143680.477183:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8868 00000004:00080000:1.0:1746143680.477286:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800908f0e00/2, rc 0, transno 21474839585 00000100:00100000:1.0:1746143680.477291:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593614464:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143680.477298:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800908f1880/2, rc 0, transno 21474839586 00000100:00100000:1.0:1746143680.477300:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593614976:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143680.477310:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e3800/2, rc 0, transno 17179872317 00000100:00100000:1.0:1746143680.477316:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593615488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.477322:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e63ea00/2, rc 0, transno 17179872318 00000100:00100000:1.0:1746143680.477324:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593616000:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.477330:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800908f2a00/2, rc 0, transno 21474839583 00000100:00100000:1.0:1746143680.477332:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593614336:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143680.477337:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800908f2300/2, rc 0, transno 21474839584 00000100:00100000:1.0:1746143680.477339:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593614848:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143680.477344:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e1500/2, rc 0, transno 17179872315 00000100:00100000:1.0:1746143680.477347:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593615360:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.477353:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e63e680/2, rc 0, transno 17179872316 00000100:00100000:1.0:1746143680.477355:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593615872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.477404:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746143680.477412:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593616128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.477439:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143680.479752:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba47800/2, rc 0, transno 17179872319 00000100:00100000:1.0:1746143680.479760:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593616128:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143680.480084:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800908f3480/2, rc 0, transno 21474839581 00000100:00100000:0.0:1746143680.480090:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593614208:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143680.480099:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800908f0a80/2, rc 0, transno 21474839582 00000100:00100000:0.0:1746143680.480102:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593614720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143680.480114:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800908f3800/2, rc 0, transno 17179872313 00000100:00100000:0.0:1746143680.480117:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593615232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143680.480125:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e0a80/2, rc 0, transno 17179872314 00000100:00100000:0.0:1746143680.480127:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593615744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143680.480135:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800908f0700/2, rc 0, transno 21474839579 00000100:00100000:0.0:1746143680.480155:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593614080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143680.480167:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800908f1f80/2, rc 0, transno 21474839580 00000100:00100000:0.0:1746143680.480170:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593614592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143680.480178:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800908f0380/2, rc 0, transno 17179872311 00000100:00100000:0.0:1746143680.480180:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593615104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143680.480187:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e1f80/2, rc 0, transno 17179872312 00000100:00100000:0.0:1746143680.480190:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593615616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143680.492202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.492234:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.492253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.492275:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.492337:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591929216 00000100:00100000:1.0:1746143680.492347:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591929216 00000100:00100000:1.0:1746143680.492383:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591929344 00000100:00100000:1.0:1746143680.492385:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591929344 00000100:00100000:1.0:1746143680.492395:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591929472 00000100:00100000:1.0:1746143680.492397:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591929472 00000100:00100000:1.0:1746143680.492406:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591929728 00000100:00100000:1.0:1746143680.492408:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591929728 00000100:00100000:1.0:1746143680.492422:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8878 00000100:00100000:1.0:1746143680.492430:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963591929216:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143680.492448:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143680.492468:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f8e4000/0xe984082ccd723a77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0516 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143680.492493:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409bf, atime: 0x681409be, ctime: 0x681409bf, blocks: 0x809 00010000:00010000:1.0:1746143680.492513:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.492515:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.492523:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8e4000/0xe984082ccd723a77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0516 expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.492538:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f8e4000/0xe984082ccd723a77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0516 expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.492550:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8e4000, rc 0) 00000100:00100000:1.0:1746143680.492590:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591929216:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 161us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.492596:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8878 00000100:00100000:1.0:1746143680.492610:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8879 00000100:00100000:1.0:1746143680.492616:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963591929344:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143680.492622:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143680.492632:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4800/0xe984082ccd723a7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a051d expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143680.492647:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34a:0x0] initial LVB size: 2097152, mtime: 0x681409bf, atime: 0x681409be, ctime: 0x681409bf, blocks: 0x821 00010000:00010000:1.0:1746143680.492655:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.492656:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.492660:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4800/0xe984082ccd723a7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a051d expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.492670:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4800/0xe984082ccd723a7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a051d expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.492677:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8e4800, rc 0) 00000100:00100000:1.0:1746143680.492691:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963591929344:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 75us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.492695:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8879 00000100:00100000:1.0:1746143680.492703:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8880 00000100:00100000:1.0:1746143680.492707:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963591929472:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143680.492712:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143680.492718:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4600/0xe984082ccd723a85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0524 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143680.492729:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34b:0x0] initial LVB size: 2097152, mtime: 0x681409bf, atime: 0x681409bf, ctime: 0x681409bf, blocks: 0x821 00010000:00010000:1.0:1746143680.492735:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.492737:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.492740:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4600/0xe984082ccd723a85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0524 expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.492748:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4600/0xe984082ccd723a85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0524 expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.492755:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8e4600, rc 0) 00000100:00100000:1.0:1746143680.492766:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591929472:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 59us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.492771:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8880 00000100:00100000:1.0:1746143680.492778:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8881 00000100:00100000:1.0:1746143680.492782:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963591929728:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143680.492788:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143680.492794:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f8e4400/0xe984082ccd723a8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0532 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143680.492803:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 4897312, mtime: 0x681409c0, atime: 0x681409bf, ctime: 0x681409c0, blocks: 0x15a7 00010000:00010000:1.0:1746143680.492809:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.492810:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.492813:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8e4400/0xe984082ccd723a8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0532 expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.492821:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f8e4400/0xe984082ccd723a8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0532 expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143680.492827:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8e4400, rc 0) 00000100:00100000:1.0:1746143680.492842:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591929728:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 59us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.492846:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8881 00000100:00100000:0.0:1746143680.496136:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591929600 00000100:00100000:0.0:1746143680.496158:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591929600 00000100:00100000:0.0:1746143680.496201:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8882 00000100:00100000:0.0:1746143680.496209:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963591929600:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143680.496225:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143680.496242:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094cfde00/0xe984082ccd723a93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a052b expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143680.496271:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409be, atime: 0x681409be, ctime: 0x681409be, blocks: 0x81f 00010000:00010000:0.0:1746143680.496292:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143680.496294:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143680.496302:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094cfde00/0xe984082ccd723a93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a052b expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143680.496315:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094cfde00/0xe984082ccd723a93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a052b expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143680.496325:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cfde00, rc 0) 00000100:00100000:0.0:1746143680.498223:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963591929600:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2003us (2154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.498233:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8882 00000100:00100000:0.0:1746143680.498606:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591929856 00000100:00100000:0.0:1746143680.498637:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591929856 00000100:00100000:0.0:1746143680.506415:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.506464:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.507391:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3101 00000100:00100000:1.0:1746143680.507409:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963591930368:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143680.507460:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4200/0xe984082ccd723aa1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143680.507467:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3102 00010000:00010000:1.0:1746143680.507475:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.507477:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143680.507479:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963591930112:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143680.507481:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4200/0xe984082ccd723aa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.507494:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4200/0xe984082ccd723aa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.507513:0:21518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094cfcc00/0xe984082ccd723aa8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.507525:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143680.507527:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143680.507531:0:21518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094cfcc00/0xe984082ccd723aa8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.507547:0:21518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094cfcc00/0xe984082ccd723aa8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143680.509122:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.510018:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.518695:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.518728:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.518757:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.518781:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.518784:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591931264 00000100:00100000:1.0:1746143680.518796:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591931264 00000100:00100000:1.0:1746143680.518862:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591931904 00000100:00100000:1.0:1746143680.518864:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591931904 00000100:00100000:1.0:1746143680.518880:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591931648 00000100:00100000:1.0:1746143680.518882:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591931648 00000100:00100000:1.0:1746143680.518915:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3106 00000100:00100000:1.0:1746143680.518922:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1965:x1830963591931904:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143680.518948:0:25543:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f8e5a00/0xe984082ccd723ac4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.519686:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.519689:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.519695:0:25543:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8e5a00/0xe984082ccd723ac4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.519707:0:25543:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f8e5a00/0xe984082ccd723ac4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.521225:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3108 00000100:00100000:1.0:1746143680.521234:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1964:x1830963591931648:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143680.521260:0:8502:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5800/0xe984082ccd723ad2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.521270:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.521272:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.521275:0:8502:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5800/0xe984082ccd723ad2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.521285:0:8502:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5800/0xe984082ccd723ad2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.530456:0:21518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094cfcc00/0xe984082ccd723aa8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.530475:0:21518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094cfcc00/0xe984082ccd723aa8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.530483:0:21518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094cfcc00/0xe984082ccd723aa8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.530490:0:21518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094cfcc00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143680.530495:0:21518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094cfcc00/0xe984082ccd723aa8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.530502:0:21518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094cfcc00/0xe984082ccd723aa8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.530521:0:21518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094cfcc00/0xe984082ccd723aa8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.530526:0:21518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094cfcc00/0xe984082ccd723aa8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.530627:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1965:x1830963591930112:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 23146us (24157us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143680.530636:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3102 00010000:00010000:1.0:1746143680.535427:0:31338:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4200/0xe984082ccd723aa1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.535441:0:31338:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4200/0xe984082ccd723aa1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.535447:0:31338:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4200/0xe984082ccd723aa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.535454:0:31338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f8e4200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143680.535457:0:31338:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4200/0xe984082ccd723aa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.535464:0:31338:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4200/0xe984082ccd723aa1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.535480:0:31338:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4200/0xe984082ccd723aa1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.535486:0:31338:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4200/0xe984082ccd723aa1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.535554:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1965:x1830963591930368:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 28149us (29143us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143680.535561:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3101 00010000:00010000:0.0:1746143680.544326:0:8500:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b458600/0xe984082ccd723aaf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.544340:0:8500:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b458600/0xe984082ccd723aaf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.544347:0:8500:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b458600/0xe984082ccd723aaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.544354:0:8500:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b458600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143680.544357:0:8500:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b458600/0xe984082ccd723aaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.544364:0:8500:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b458600/0xe984082ccd723aaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.544380:0:8500:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b458600/0xe984082ccd723aaf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.544391:0:8500:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b458600/0xe984082ccd723aaf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143680.547205:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1965:x1830963591930752:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 37012us (38075us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143680.547217:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3103 00010000:00010000:1.0:1746143680.566415:0:25543:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f8e5a00/0xe984082ccd723ac4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.566429:0:25543:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8e5a00/0xe984082ccd723ac4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.566436:0:25543:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f8e5a00/0xe984082ccd723ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.566448:0:25543:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f8e5a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143680.566451:0:25543:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f8e5a00/0xe984082ccd723ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.566458:0:25543:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f8e5a00/0xe984082ccd723ac4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.566474:0:25543:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f8e5a00/0xe984082ccd723ac4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.566485:0:25543:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f8e5a00/0xe984082ccd723ac4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.566842:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963591931904:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 47919us (48083us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143680.566848:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3106 00010000:00010000:1.0:1746143680.575846:0:8502:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5800/0xe984082ccd723ad2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.575860:0:8502:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5800/0xe984082ccd723ad2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.575869:0:8502:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5800/0xe984082ccd723ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.575875:0:8502:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f8e5800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143680.575878:0:8502:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5800/0xe984082ccd723ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.575885:0:8502:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5800/0xe984082ccd723ad2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.575901:0:8502:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5800/0xe984082ccd723ad2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.575906:0:8502:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5800/0xe984082ccd723ad2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.576010:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963591931648:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 54773us (57222us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143680.576018:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3108 00000100:00100000:0.0:1746143680.581518:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143680.585420:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4ca00/0xe984082ccd723ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.585429:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4ca00/0xe984082ccd723ad9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.585434:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4ca00/0xe984082ccd723ad9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.585439:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ff4ca00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143680.585441:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4ca00/0xe984082ccd723ad9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.585446:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4ca00/0xe984082ccd723ad9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.585454:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880090e74700) 00010000:00010000:1.0:1746143680.585456:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143680.585458:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4ca00/0xe984082ccd723ad9 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143680.585462:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4ca00/0xe984082ccd723ad9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143680.587823:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.594910:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.594954:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591932416 00000100:00100000:0.0:1746143680.594960:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591932416 00010000:00010000:0.0:1746143680.594998:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8e4000/0xe984082ccd723a77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0516 expref: 10 pid: 25369 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746143680.595019:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4518 00000100:00100000:0.0:1746143680.595025:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963591932416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143680.595034:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143680.595051:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f8e4000/0xe984082ccd723a77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0516 expref: 10 pid: 25369 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746143680.595061:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f8e4000/0xe984082ccd723a77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0516 expref: 10 pid: 25369 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746143680.595078:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f8e4000/0xe984082ccd723a77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0516 expref: 10 pid: 25369 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746143680.595094:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143680.595096:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143680.595101:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ff4c800/0xe984082ccd723ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0540 expref: 9 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.595108:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff4c800/0xe984082ccd723ae0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0540 expref: 9 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.595131:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ff4c800/0xe984082ccd723ae0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0540 expref: 9 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143680.595156:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095098e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593616384:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143680.595700:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143680.599233:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.602305:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.603948:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.609198:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.614605:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593616896:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143680.614622:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143680.614675:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963591932928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5054us (5483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.614688:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4520 00000100:00100000:0.0:1746143680.617226:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.622528:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.626951:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.631084:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.633389:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.637651:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.637665:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.638315:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.638849:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.638971:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.639005:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591933952 00000100:00100000:1.0:1746143680.639009:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591933952 00000100:00100000:1.0:1746143680.639074:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8891 00000100:00100000:1.0:1746143680.639080:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963591934080:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:0.0:1746143680.640121:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:1.0:1746143680.640825:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143680.640828:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143679 -> 1746143680 00002000:00010000:1.0:1746143680.640830:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143679 -> 1746143679 00002000:00010000:1.0:1746143680.640831:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143679 -> 1746143680 00002000:00010000:1.0:1746143680.640833:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143680.640866:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963591934080:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 1786us (2551us total) trans 21474839587 rc 0/0 00000100:00100000:1.0:1746143680.640871:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8891 00000100:00100000:0.0:1746143680.647844:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.652184:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000001:00080000:1.0:1746143680.680770:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942167 is committed 00000004:00080000:1.0:1746143680.680779:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1506 committed 00000004:00080000:1.0:1746143680.680794:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1548 committed 00000004:00080000:1.0:1746143680.680799:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1547 committed 00000004:00080000:1.0:1746143680.680800:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1546 committed 00000004:00080000:1.0:1746143680.680802:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1545 committed 00000004:00080000:1.0:1746143680.680803:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1505 committed 00000004:00080000:1.0:1746143680.680805:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1544 committed 00000004:00080000:1.0:1746143680.680806:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1504 committed 00000004:00080000:1.0:1746143680.680807:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1543 committed 00000004:00080000:1.0:1746143680.680809:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1503 committed 00000004:00080000:1.0:1746143680.680810:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1502 committed 00000004:00080000:1.0:1746143680.680811:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1501 committed 00000004:00080000:1.0:1746143680.680812:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1542 committed 00000004:00080000:1.0:1746143680.680813:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1541 committed 00000004:00080000:1.0:1746143680.680815:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1500 committed 00000004:00080000:1.0:1746143680.680816:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1499 committed 00000004:00080000:1.0:1746143680.680817:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1540 committed 00000100:00100000:1.0:1746143680.680912:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593617920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.680975:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.680999:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593618432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.681014:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.681029:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143680.681032:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593618304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.681043:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.681051:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593618816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.681061:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.681074:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593618048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.681085:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.681091:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593618560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.681100:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.681108:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746143680.681111:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593618176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.681120:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.681127:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593618688:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.681137:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.681172:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593617920 00000100:00100000:1.0:1746143680.681179:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593617920 00000100:00100000:1.0:1746143680.681204:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593618432 00000100:00100000:1.0:1746143680.681206:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593618432 00000100:00100000:1.0:1746143680.681216:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593618304 00000100:00100000:1.0:1746143680.681217:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593618304 00000100:00100000:1.0:1746143680.681227:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593618816 00000100:00100000:1.0:1746143680.681228:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593618816 00000100:00100000:1.0:1746143680.681235:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593618048 00000100:00100000:1.0:1746143680.681238:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593618048 00000100:00100000:1.0:1746143680.681244:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593618560 00000100:00100000:1.0:1746143680.681245:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593618560 00000100:00100000:1.0:1746143680.681251:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593618176 00000100:00100000:1.0:1746143680.681252:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593618176 00000100:00100000:1.0:1746143680.681257:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593618688 00000100:00100000:1.0:1746143680.681258:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593618688 00000100:00100000:1.0:1746143680.681266:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8896 00000100:00100000:1.0:1746143680.681272:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3293:x1830963593617920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143680.681429:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143680.681432:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143680 -> 1746143680 00002000:00010000:1.0:1746143680.681434:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143679 -> 1746143679 00002000:00010000:1.0:1746143680.681436:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143680 -> 1746143680 00002000:00010000:1.0:1746143680.681437:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:1.0:1746143680.681463:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3293:x1830963593617920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (499us total) trans 17179872323 rc 0/0 00000100:00100000:1.0:1746143680.681469:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8896 00000100:00100000:1.0:1746143680.681482:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8897 00000100:00100000:1.0:1746143680.681486:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3293:x1830963593618432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.681560:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3293:x1830963593618432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (545us total) trans 17179872324 rc 0/0 00000100:00100000:1.0:1746143680.681565:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8897 00000100:00100000:1.0:1746143680.681574:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8898 00000100:00100000:1.0:1746143680.681578:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3293:x1830963593618304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143680.681639:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143680.681641:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746143680.681643:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143680.681645:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746143680.681646:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143680.681664:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3293:x1830963593618304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (619us total) trans 17179872325 rc 0/0 00000100:00100000:1.0:1746143680.681669:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8898 00000100:00100000:1.0:1746143680.681677:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8899 00000100:00100000:1.0:1746143680.681681:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3293:x1830963593618816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.681741:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3293:x1830963593618816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (678us total) trans 17179872326 rc 0/0 00000100:00100000:1.0:1746143680.681745:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8899 00000100:00100000:1.0:1746143680.681753:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8900 00000100:00100000:1.0:1746143680.681756:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3294:x1830963593618048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143680.681805:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143680.681807:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143680 -> 1746143680 00002000:00010000:1.0:1746143680.681809:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143679 -> 1746143679 00002000:00010000:1.0:1746143680.681810:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143680 -> 1746143680 00002000:00010000:1.0:1746143680.681812:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746143680.681827:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3294:x1830963593618048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (742us total) trans 17179872327 rc 0/0 00000100:00100000:1.0:1746143680.681831:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8900 00000100:00100000:1.0:1746143680.681838:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8901 00000100:00100000:1.0:1746143680.681841:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3294:x1830963593618560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.681893:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3294:x1830963593618560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (791us total) trans 17179872328 rc 0/0 00000100:00100000:1.0:1746143680.681897:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8901 00000100:00100000:1.0:1746143680.681903:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8902 00000100:00100000:1.0:1746143680.681907:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3294:x1830963593618176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143680.681952:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:1.0:1746143680.681954:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143680 -> 1746143680 00002000:00010000:1.0:1746143680.681956:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143679 -> 1746143679 00002000:00010000:1.0:1746143680.681957:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143680 -> 1746143680 00002000:00010000:1.0:1746143680.681959:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5543 -> 5543 00000100:00100000:1.0:1746143680.681983:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3294:x1830963593618176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (862us total) trans 17179872329 rc 0/0 00000100:00100000:1.0:1746143680.681987:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8902 00000100:00100000:1.0:1746143680.681994:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8903 00000100:00100000:1.0:1746143680.681997:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3294:x1830963593618688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.682055:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3294:x1830963593618688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (917us total) trans 17179872330 rc 0/0 00000100:00100000:1.0:1746143680.682059:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8903 00000004:00080000:1.0:1746143680.682089:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131e9df80/2, rc 0, transno 17179872329 00000100:00100000:1.0:1746143680.682095:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593618176:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.682101:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131e9d180/2, rc 0, transno 17179872330 00000100:00100000:1.0:1746143680.682103:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593618688:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.682110:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba47100/2, rc 0, transno 17179872327 00000100:00100000:1.0:1746143680.682112:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593618048:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.682117:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131e9d500/2, rc 0, transno 17179872328 00000100:00100000:1.0:1746143680.682119:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593618560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.682164:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143680.682171:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593618944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.682190:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.682208:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593618944 00000100:00100000:1.0:1746143680.682211:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593618944 00000100:00100000:1.0:1746143680.682226:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8904 00000100:00100000:1.0:1746143680.682229:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963593618944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.682304:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3292:x1830963593618944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (113us total) trans 17179872331 rc 0/0 00000100:00100000:1.0:1746143680.682308:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8904 00000004:00080000:1.0:1746143680.682325:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f890380/2, rc 0, transno 17179872331 00000100:00100000:1.0:1746143680.682327:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593618944:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.682338:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131e9d880/2, rc 0, transno 17179872325 00000100:00100000:1.0:1746143680.682340:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593618304:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.682345:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131e9dc00/2, rc 0, transno 17179872326 00000100:00100000:1.0:1746143680.682347:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131e9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593618816:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.682352:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba44e00/2, rc 0, transno 17179872323 00000100:00100000:1.0:1746143680.682355:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593617920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.682360:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131e9c700/2, rc 0, transno 17179872324 00000100:00100000:1.0:1746143680.682362:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593618432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.685086:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593619328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.685380:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143680.685741:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b850700/2, rc 0, transno 21474839594 00000100:00100000:1.0:1746143680.685750:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593619328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.685756:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593619840:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.685775:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.685800:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746143680.685805:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593619456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.685820:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.685979:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593619968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.685994:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.686076:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8912 00000100:00100000:1.0:1746143680.686081:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3292:x1830963593619968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143680.686209:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3292:x1830963593619968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 128us (213us total) trans 21474839596 rc 0/0 00000100:00100000:0.0:1746143680.686215:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8912 00000004:00080000:1.0:1746143680.686767:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b851180/2, rc 0, transno 21474839595 00000100:00100000:1.0:1746143680.686771:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593619456:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143680.686777:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094760700/2, rc 0, transno 21474839596 00000100:00100000:1.0:1746143680.686780:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593619968:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143680.686785:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b852d80/2, rc 0, transno 21474839597 00000100:00100000:1.0:1746143680.686790:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593619840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143680.687097:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.689662:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.723503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.723563:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.728208:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.729227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.729281:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.729296:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591936000 00000100:00100000:0.0:1746143680.729300:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591936000 00000100:00100000:0.0:1746143680.729321:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8914 00000100:00100000:0.0:1746143680.729326:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:27998:x1830963591936000:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143680.729334:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143680.729340:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a64de800/0xe984082ccd723b65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0586 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.729352:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143680.729356:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a64de800/0xe984082ccd723b65 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0586 expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.729365:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a64de800/0xe984082ccd723b65 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0586 expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.729373:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64de800, rc 0) 00000100:00100000:0.0:1746143680.729396:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:27998:x1830963591936000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 69us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.729401:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8914 00000100:00100000:1.0:1746143680.734064:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.734110:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.734129:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591936640 00000100:00100000:1.0:1746143680.734134:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591936640 00010000:00010000:1.0:1746143680.734177:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff4c800/0xe984082ccd723ae0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0540 expref: 12 pid: 9527 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.734197:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4525 00000100:00100000:1.0:1746143680.734204:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963591936640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143680.734212:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143680.734230:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ff4c800/0xe984082ccd723ae0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0540 expref: 12 pid: 9527 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.734239:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ff4c800/0xe984082ccd723ae0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0540 expref: 12 pid: 9527 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.734257:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.734259:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.734265:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd1a000/0xe984082ccd723b5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a057f expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.734273:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd1a000/0xe984082ccd723b5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a057f expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.734279:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.734280:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.734284:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a64de800/0xe984082ccd723b65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0586 expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.734289:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a64de800/0xe984082ccd723b65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0586 expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.734309:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a64de800/0xe984082ccd723b65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0586 expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.734316:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593620480:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143680.734368:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd1a000/0xe984082ccd723b5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a057f expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.734379:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593620608:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143680.734401:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143680.734804:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591936512 00000100:00100000:0.0:1746143680.734809:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591936512 00000100:00100000:0.0:1746143680.734840:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8120 00000100:00100000:0.0:1746143680.734846:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+8:27995:x1830963591936512:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143680.734860:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143680.734871:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64de000/0xe984082ccd723b7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0594 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.734937:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143680.734945:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143680.734952:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143680.738940:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593620480:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143680.738950:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593620608:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143680.738971:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143680.739021:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591936640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4816us (4908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.739029:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4525 00000100:00100000:0.0:1746143680.739213:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.739256:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591936768 00000100:00100000:1.0:1746143680.739261:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591936768 00010000:00010000:1.0:1746143680.739281:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b800/0xe984082ccd723b50 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0578 expref: 244 pid: 21713 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.739298:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4526 00000100:00100000:1.0:1746143680.739304:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:1964:x1830963591936768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143680.739313:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143680.739317:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b800/0xe984082ccd723b50 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0578 expref: 244 pid: 21713 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.739326:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b800/0xe984082ccd723b50 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0578 expref: 244 pid: 21713 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.739342:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b800/0xe984082ccd723b50 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0578 expref: 244 pid: 21713 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.739359:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143680.739363:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1aa00/0xe984082ccd723b73 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143680.739370:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1aa00/0xe984082ccd723b73 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143680.739374:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143680.739391:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1964:x1830963591936768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 87us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.739395:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4526 00000100:00100000:0.0:1746143680.741917:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.742321:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.742352:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.743080:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3109 00000100:00100000:1.0:1746143680.743088:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963591937280:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143680.744270:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591937152 00000100:00100000:1.0:1746143680.744274:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591937152 00010000:00010000:1.0:1746143680.744292:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd723b34 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0571 expref: 10 pid: 16090 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.744318:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4527 00000100:00100000:1.0:1746143680.744324:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963591937152:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143680.744331:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143680.744336:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd723b34 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0571 expref: 10 pid: 16090 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.744346:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd723b34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0571 expref: 10 pid: 16090 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.744366:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd723b34 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0571 expref: 10 pid: 16090 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.744378:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143680.744382:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1aa00/0xe984082ccd723b73 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143680.744389:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1aa00/0xe984082ccd723b73 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143680.744395:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1aa00/0xe984082ccd723b73 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143680.744400:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143680.744404:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143680.744409:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143680.744427:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143680.744448:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963591937152:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 125us (2095us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.744453:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4527 00010000:00010000:0.0:1746143680.745874:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143680.745883:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:0.0:1746143680.745896:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143680.745985:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64de000/0xe984082ccd723b7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0594 expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.746010:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0594 expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.746016:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:0.0:1746143680.746018:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143680.746020:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64dea00, rc 0) 00000100:00100000:0.0:1746143680.746042:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:27995:x1830963591936512:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 11196us (11980us total) trans 8589942172 rc 0/0 00000100:00100000:0.0:1746143680.746046:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8120 00000100:00100000:1.0:1746143680.759340:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963591937280:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16244us (17421us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143680.759350:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3109 00002000:00100000:1.0:1746143680.759359:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800930d0380 x1830963591937280/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:76/0 lens 488/440 e 0 to 0 dl 1746143691 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.759369:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0380 with x1830963591937280 ext(0->1048575) 00002000:00010000:1.0:1746143680.759373:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d0380 00000100:00100000:0.0:1746143680.763537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.763811:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591937536 00000100:00100000:1.0:1746143680.763818:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591937536 00000100:00100000:1.0:1746143680.763865:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8121 00000100:00100000:1.0:1746143680.763872:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:27995:x1830963591937536:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143680.763889:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143680.763905:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0xe984082ccd723b96 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a059b expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.763954:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0xe984082ccd723b96 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a059b expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.763975:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0fc00/0xe984082ccd723b96 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a059b expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.763989:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143680.763992:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143680.763995:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0fc00, rc 0) 00000100:00100000:1.0:1746143680.764026:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:27995:x1830963591937536:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 155us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.764031:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8121 00000100:00100000:0.0:1746143680.777178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.777252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.777322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.777518:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8916 00000100:00100000:0.0:1746143680.777525:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:27998:x1830963591938048:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143680.777532:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143680.777538:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a64df400/0xe984082ccd723ba4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a05b0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.777555:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143680.777558:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a64df400/0xe984082ccd723ba4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b0 expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.777567:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a64df400/0xe984082ccd723ba4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b0 expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.777576:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64df400, rc 0) 00000100:00100000:0.0:1746143680.777606:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:27998:x1830963591938048:12345-192.168.202.48@tcp:101:cat.0 Request processed in 82us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.777611:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8916 00000100:00100000:0.0:1746143680.780858:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.780901:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591938176 00000100:00100000:1.0:1746143680.780907:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591938176 00000100:00100000:0.0:1746143680.780919:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143680.780928:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff4c400/0xe984082ccd723ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0547 expref: 12 pid: 9527 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.780961:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591938304 00000100:00100000:1.0:1746143680.780976:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591938304 00010000:00010000:1.0:1746143680.780988:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff26a00/0xe984082ccd723b11 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a056a expref: 8 pid: 16090 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.781010:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4528 00000100:00100000:1.0:1746143680.781015:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963591938176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143680.781025:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143680.781041:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ff4c400/0xe984082ccd723ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0547 expref: 12 pid: 9527 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.781051:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ff4c400/0xe984082ccd723ae7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0547 expref: 12 pid: 9527 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.781068:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ff4c400/0xe984082ccd723ae7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0547 expref: 12 pid: 9527 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.781081:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.781083:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.781089:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723b9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a9 expref: 18 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.781097:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723b9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a9 expref: 18 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.781104:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.781106:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.781109:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a64df400/0xe984082ccd723ba4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b0 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.781115:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a64df400/0xe984082ccd723ba4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b0 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.781136:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a64df400/0xe984082ccd723ba4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b0 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.781162:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a55500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593620992:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143680.782401:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723b9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a9 expref: 18 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.782411:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a56a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593621120:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143680.782433:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143680.794664:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.795036:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591938432 00000100:00100000:1.0:1746143680.795042:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591938432 00000100:00100000:1.0:1746143680.795072:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591938560 00000100:00100000:1.0:1746143680.795074:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591938560 00000100:00100000:1.0:1746143680.795088:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8123 00000100:00100000:1.0:1746143680.795094:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:27999:x1830963591938432:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143680.795109:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143680.795122:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e200/0xe984082ccd723bb9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a05b7 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.795185:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b800/0xe984082ccd723bb2 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143680.795196:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e200/0xe984082ccd723bb9 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b7 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.795208:0:14763:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b800/0xe984082ccd723bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143680.795216:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e200/0xe984082ccd723bb9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b7 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.795226:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143680.795228:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143680.795230:0:14763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e200/0xe984082ccd723bb9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b7 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.795235:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0e200, rc 0) 00000100:00100000:0.0:1746143680.795476:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8124 00000100:00100000:0.0:1746143680.795491:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:27998:x1830963591938560:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143680.795500:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143680.795508:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dee00/0xe984082ccd723bc0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a05be expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.795538:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dee00/0xe984082ccd723bc0 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05be expref: 244 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.795546:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dee00/0xe984082ccd723bc0 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05be expref: 244 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.795557:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:0.0:1746143680.795560:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143680.795562:0:16090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e200/0xe984082ccd723bb9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b7 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143680.795567:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6dee00, rc 0) 00000100:00100000:0.0:1746143680.795592:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:27998:x1830963591938560:12345-192.168.202.48@tcp:101:cat.0 Request processed in 110us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143680.795597:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8124 00000100:00100000:1.0:1746143680.796087:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:27999:x1830963591938432:12345-192.168.202.48@tcp:101:cat.0 Request processed in 991us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.796093:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8123 00000001:00080000:1.0:1746143680.815655:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942172 is committed 00000001:00080000:1.0:1746143680.815667:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942173 is committed 00000004:00080000:1.0:1746143680.815670:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1514 committed 00000004:00080000:1.0:1746143680.815676:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1557 committed 00000004:00080000:1.0:1746143680.815686:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1556 committed 00000004:00080000:1.0:1746143680.815688:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1555 committed 00000004:00080000:1.0:1746143680.815689:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1554 committed 00000004:00080000:1.0:1746143680.815691:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1513 committed 00000004:00080000:1.0:1746143680.815692:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1553 committed 00000004:00080000:1.0:1746143680.815694:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1512 committed 00000004:00080000:1.0:1746143680.815696:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1552 committed 00000004:00080000:1.0:1746143680.815697:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1511 committed 00000004:00080000:1.0:1746143680.815699:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1510 committed 00000004:00080000:1.0:1746143680.815700:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1509 committed 00000004:00080000:1.0:1746143680.815701:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1551 committed 00000004:00080000:1.0:1746143680.815703:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1550 committed 00000004:00080000:1.0:1746143680.815704:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1508 committed 00000004:00080000:1.0:1746143680.815705:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1507 committed 00000004:00080000:1.0:1746143680.815707:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1549 committed 00000001:00080000:1.0:1746143680.815714:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942168 is committed 00000001:00080000:1.0:1746143680.815718:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942171 is committed 00000100:00100000:1.0:1746143680.816314:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593621760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.816339:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593621888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.816353:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143680.816950:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593621632 00000100:00100000:0.0:1746143680.816957:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593621632 00000100:00100000:1.0:1746143680.816981:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593622400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143680.816995:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593622144 00000100:00100000:0.0:1746143680.816997:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593622144 00000100:00100000:1.0:1746143680.817000:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143680.817010:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593621504 00000100:00100000:0.0:1746143680.817012:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593621504 00000100:00100000:1.0:1746143680.817015:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593622912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143680.817021:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593622016 00000100:00100000:0.0:1746143680.817023:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593622016 00000100:00100000:1.0:1746143680.817029:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143680.817033:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8917 00000100:00100000:0.0:1746143680.817038:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3295:x1830963593621632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.817040:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593623424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.817053:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.817060:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143680.817064:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593622784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.817077:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.817083:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593623296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.817096:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.817110:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593621888 00000100:00100000:1.0:1746143680.817113:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593621888 00000100:00100000:1.0:1746143680.817127:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593622400 00000100:00100000:1.0:1746143680.817128:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593622400 00000100:00100000:1.0:1746143680.817135:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593622912 00000100:00100000:1.0:1746143680.817136:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593622912 00000100:00100000:1.0:1746143680.817164:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593623424 00000100:00100000:1.0:1746143680.817166:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593623424 00000100:00100000:1.0:1746143680.817171:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593622784 00000100:00100000:1.0:1746143680.817172:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593622784 00000100:00100000:1.0:1746143680.817176:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593623296 00000100:00100000:1.0:1746143680.817178:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593623296 00000100:00100000:1.0:1746143680.817186:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8918 00000100:00100000:1.0:1746143680.817191:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3295:x1830963593622144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.817202:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143680.817213:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593622272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.817227:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746143680.817227:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143680.817231:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143680 -> 1746143680 00002000:00010000:0.0:1746143680.817232:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143679 -> 1746143679 00002000:00010000:0.0:1746143680.817234:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143680 -> 1746143680 00002000:00010000:0.0:1746143680.817236:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143680.817264:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3295:x1830963593621632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (1193us total) trans 21474839598 rc 0/0 00000100:00100000:0.0:1746143680.817269:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8917 00000100:00100000:0.0:1746143680.817301:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593621760 00000100:00100000:0.0:1746143680.817304:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593621760 00000100:00100000:0.0:1746143680.817313:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593622272 00000100:00100000:0.0:1746143680.817315:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593622272 00000100:00100000:0.0:1746143680.817323:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8919 00000100:00100000:0.0:1746143680.817327:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3295:x1830963593621504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.817336:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3295:x1830963593622144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 144us (1233us total) trans 21474839599 rc 0/0 00000100:00100000:1.0:1746143680.817341:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8918 00000100:00100000:1.0:1746143680.817354:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8920 00000100:00100000:1.0:1746143680.817359:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3295:x1830963593622016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143680.817390:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143680.817392:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143680 -> 1746143680 00002000:00010000:0.0:1746143680.817394:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143679 -> 1746143679 00002000:00010000:0.0:1746143680.817396:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143680 -> 1746143680 00002000:00010000:0.0:1746143680.817397:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143680.817414:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3295:x1830963593621504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1250us total) trans 21474839600 rc 0/0 00000100:00100000:0.0:1746143680.817418:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8919 00002000:00010000:1.0:1746143680.817428:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00000100:00100000:0.0:1746143680.817429:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8921 00002000:00010000:1.0:1746143680.817430:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:1.0:1746143680.817432:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746143680.817433:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3293:x1830963593621888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143680.817434:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:1.0:1746143680.817435:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:1.0:1746143680.817452:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3295:x1830963593622016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (1262us total) trans 21474839601 rc 0/0 00000100:00100000:1.0:1746143680.817457:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8920 00000100:00100000:1.0:1746143680.817468:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8922 00000100:00100000:1.0:1746143680.817472:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3293:x1830963593622400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143680.817489:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143680.817491:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143680.817493:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143680.817494:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143680.817496:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143680.817515:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3293:x1830963593621888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (1161us total) trans 21474839602 rc 0/0 00000100:00100000:0.0:1746143680.817519:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8921 00000100:00100000:0.0:1746143680.817528:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8923 00000100:00100000:0.0:1746143680.817532:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3293:x1830963593622912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.817550:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3293:x1830963593622400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (548us total) trans 21474839603 rc 0/0 00000100:00100000:1.0:1746143680.817555:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8922 00000100:00100000:1.0:1746143680.817563:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8924 00000100:00100000:1.0:1746143680.817567:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3293:x1830963593623424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143680.817608:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8925 00000100:00100000:0.0:1746143680.817612:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3293:x1830963593622784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.817648:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3293:x1830963593623424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (593us total) trans 17179872333 rc 0/0 00000100:00100000:1.0:1746143680.817653:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8924 00000100:00100000:1.0:1746143680.817661:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8926 00000100:00100000:1.0:1746143680.817665:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3293:x1830963593623296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143680.817678:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:0.0:1746143680.817680:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143680 -> 1746143680 00002000:00010000:0.0:1746143680.817681:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143679 -> 1746143679 00002000:00010000:0.0:1746143680.817683:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143680 -> 1746143680 00002000:00010000:0.0:1746143680.817685:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5543 -> 5543 00000100:00100000:0.0:1746143680.817702:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3293:x1830963593622784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (625us total) trans 17179872334 rc 0/0 00000100:00100000:0.0:1746143680.817706:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8925 00000100:00100000:0.0:1746143680.817715:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8927 00000100:00100000:0.0:1746143680.817718:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3292:x1830963593621760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.817741:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3293:x1830963593623296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (643us total) trans 17179872335 rc 0/0 00000100:00100000:1.0:1746143680.817746:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8926 00000100:00100000:1.0:1746143680.817754:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8928 00000100:00100000:1.0:1746143680.817758:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3292:x1830963593622272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143680.817779:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143680.817782:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143680 -> 1746143680 00002000:00010000:0.0:1746143680.817783:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143679 -> 1746143679 00002000:00010000:0.0:1746143680.817785:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143680 -> 1746143680 00002000:00010000:0.0:1746143680.817786:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143680.817807:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3292:x1830963593621760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (604us total) trans 21474839604 rc 0/0 00000100:00100000:0.0:1746143680.817812:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8927 00000100:00100000:1.0:1746143680.817825:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3292:x1830963593622272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (597us total) trans 21474839605 rc 0/0 00000100:00100000:1.0:1746143680.817830:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8928 00000004:00080000:1.0:1746143680.817858:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba44700/2, rc 0, transno 21474839604 00000100:00100000:1.0:1746143680.817862:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593621760:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143680.817868:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f02680/2, rc 0, transno 21474839605 00000100:00100000:1.0:1746143680.817870:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593622272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143680.817882:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593622528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.817898:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143680.817904:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593622528 00000100:00100000:0.0:1746143680.817907:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593622528 00000100:00100000:1.0:1746143680.817908:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593623040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.817919:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143680.817920:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8929 00000100:00100000:0.0:1746143680.817924:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3294:x1830963593622528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143680.817934:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593623040 00000100:00100000:1.0:1746143680.817937:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593623040 00000100:00100000:1.0:1746143680.817946:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8930 00000100:00100000:1.0:1746143680.817951:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3294:x1830963593623040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143680.818014:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143680.818016:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143680.818018:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143680.818019:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143680.818021:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143680.818039:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3293:x1830963593622912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 506us (1008us total) trans 17179872332 rc 0/0 00000100:00100000:0.0:1746143680.818044:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8923 00000100:00100000:1.0:1746143680.818051:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3294:x1830963593623040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (130us total) trans 17179872337 rc 0/0 00000100:00100000:1.0:1746143680.818056:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8930 00002000:00010000:0.0:1746143680.818062:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143680.818064:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143680 -> 1746143680 00002000:00010000:0.0:1746143680.818066:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143679 -> 1746143679 00002000:00010000:0.0:1746143680.818067:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143680 -> 1746143680 00002000:00010000:0.0:1746143680.818069:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2057 -> 2057 00000004:00080000:1.0:1746143680.818077:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094304e00/2, rc 0, transno 17179872337 00000100:00100000:1.0:1746143680.818083:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593623040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143680.818085:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3294:x1830963593622528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (187us total) trans 17179872336 rc 0/0 00000004:00080000:1.0:1746143680.818090:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090767b80/2, rc 0, transno 17179872336 00000100:00100000:0.0:1746143680.818090:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8929 00000100:00100000:1.0:1746143680.818092:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593622528:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.818103:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090765c00/2, rc 0, transno 17179872334 00000100:00100000:1.0:1746143680.818106:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593622784:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.818112:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013691bb80/2, rc 0, transno 17179872335 00000100:00100000:1.0:1746143680.818115:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593623296:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.818121:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094304380/2, rc 0, transno 17179872332 00000100:00100000:1.0:1746143680.818123:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593622912:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.818128:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136919880/2, rc 0, transno 17179872333 00000100:00100000:1.0:1746143680.818130:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593623424:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143680.820407:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095098e00/2, rc 0, transno 21474839602 00000100:00100000:1.0:1746143680.820413:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593621888:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143680.820428:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f00380/2, rc 0, transno 21474839603 00000100:00100000:1.0:1746143680.820430:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593622400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143680.836369:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.838590:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.838620:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.838645:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.838663:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591939584 00000100:00100000:1.0:1746143680.838669:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591939584 00000100:00100000:0.0:1746143680.838671:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:1.0:1746143680.838692:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880095099c00 x1830963591939584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:76/0 lens 488/0 e 0 to 0 dl 1746143691 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.838700:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099c00 with x1830963591939584 ext(1048576->2097151) 00002000:00010000:1.0:1746143680.838703:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095099c00 00000100:00100000:1.0:1746143680.838717:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3112 00000100:00100000:1.0:1746143680.838722:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963591939584:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143680.860283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.860364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.860425:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591939968 00000100:00100000:1.0:1746143680.860432:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591939968 00010000:00010000:1.0:1746143680.860457:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3d6e00/0xe984082ccd723af5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0555 expref: 11 pid: 9527 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.860607:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591940096 00000100:00100000:1.0:1746143680.860610:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591940096 00010000:00010000:1.0:1746143680.860621:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7000/0xe984082ccd723afc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a055c expref: 12 pid: 9527 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.860929:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4531 00000100:00100000:1.0:1746143680.860935:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591940096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143680.860941:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143680.860952:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7000/0xe984082ccd723afc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a055c expref: 11 pid: 9527 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.860959:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7000/0xe984082ccd723afc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a055c expref: 11 pid: 9527 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.860978:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7000/0xe984082ccd723afc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a055c expref: 11 pid: 9527 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.860991:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.860993:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.860997:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cbde00/0xe984082ccd723bd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3219456->3661823) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05d3 expref: 30 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.861003:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130cbde00/0xe984082ccd723bd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3219456->3661823) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05d3 expref: 30 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.861019:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130cbde00/0xe984082ccd723bd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3219456->3661823) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05d3 expref: 30 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.861026:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593624064:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143680.861048:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143680.863752:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963591939584:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 25023us (25124us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143680.863760:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3112 00002000:00100000:1.0:1746143680.863768:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880095099c00 x1830963591939584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:76/0 lens 488/440 e 0 to 0 dl 1746143691 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.863782:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099c00 with x1830963591939584 ext(1048576->2097151) 00002000:00010000:1.0:1746143680.863786:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095099c00 00000100:00100000:1.0:1746143680.867250:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593624064:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143680.867261:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143680.867275:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963591940096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6341us (6911us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.867280:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4531 00000100:00100000:0.0:1746143680.868981:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.869023:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.869099:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591940352 00000100:00100000:1.0:1746143680.869106:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591940352 00002000:00100000:1.0:1746143680.869171:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3219456->3223551) req@ffff880130fd4000 x1830963591940352/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:76/0 lens 488/0 e 0 to 0 dl 1746143691 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.869179:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4000 with x1830963591940352 ext(3219456->3223551) 00002000:00010000:1.0:1746143680.869183:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd4000 00000100:00100000:1.0:1746143680.869198:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591940608 00000100:00100000:1.0:1746143680.869200:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591940608 00002000:00100000:1.0:1746143680.869211:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1495040->1499135) req@ffff88008f532a00 x1830963591940608/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:76/0 lens 488/0 e 0 to 0 dl 1746143691 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746143680.869213:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3113 00002000:00100000:1.0:1746143680.869218:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f532a00 with x1830963591940608 ext(1495040->1499135) 00002000:00010000:1.0:1746143680.869220:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f532a00 00000100:00100000:0.0:1746143680.869222:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963591940352:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143680.869232:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3114 00000100:00100000:1.0:1746143680.869237:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963591940608:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143680.869359:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963591940352:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 138us (382us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143680.869365:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3113 00002000:00100000:0.0:1746143680.869370:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3219456->3223551) req@ffff880130fd4000 x1830963591940352/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:76/0 lens 488/4536 e 0 to 0 dl 1746143691 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143680.869377:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4000 with x1830963591940352 ext(3219456->3223551) 00002000:00010000:0.0:1746143680.869379:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd4000 00000100:00100000:1.0:1746143680.872016:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963591940608:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 2773us (2986us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143680.872028:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3114 00002000:00100000:1.0:1746143680.872034:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1495040->1499135) req@ffff88008f532a00 x1830963591940608/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:76/0 lens 488/4536 e 0 to 0 dl 1746143691 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.872042:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f532a00 with x1830963591940608 ext(1495040->1499135) 00002000:00010000:1.0:1746143680.872046:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f532a00 00000100:00100000:0.0:1746143680.876040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.880832:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591940992 00000100:00100000:1.0:1746143680.880840:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591940992 00002000:00100000:1.0:1746143680.880879:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34e:0x0] (1605632->1609727) req@ffff880094c0d880 x1830963591940992/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:76/0 lens 488/0 e 0 to 0 dl 1746143691 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.880889:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d880 with x1830963591940992 ext(1605632->1609727) 00002000:00010000:1.0:1746143680.880894:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0d880 00000100:00100000:1.0:1746143680.880922:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3115 00000100:00100000:1.0:1746143680.880929:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963591940992:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143680.881094:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963591940992:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 165us (409us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143680.881387:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3115 00002000:00100000:1.0:1746143680.881400:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34e:0x0] (1605632->1609727) req@ffff880094c0d880 x1830963591940992/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:76/0 lens 488/4536 e 0 to 0 dl 1746143691 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.881407:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d880 with x1830963591940992 ext(1605632->1609727) 00002000:00010000:1.0:1746143680.881409:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0d880 00000100:00100000:0.0:1746143680.885168:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.885957:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591941248 00000100:00100000:1.0:1746143680.885970:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591941248 00010000:00010000:1.0:1746143680.885996:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723aee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a054e expref: 11 pid: 9527 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.886030:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4532 00000100:00100000:1.0:1746143680.886036:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963591941248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143680.886045:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143680.886062:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723aee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a054e expref: 11 pid: 9527 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.886071:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723aee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a054e expref: 11 pid: 9527 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.886088:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723aee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a054e expref: 11 pid: 9527 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.886104:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.886106:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.886117:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ca00/0xe984082ccd723bdc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05da expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.886124:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ca00/0xe984082ccd723bdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05da expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.886239:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ca00/0xe984082ccd723bdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05da expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.886248:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593624320:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143680.886723:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.886759:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143680.888342:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593624320:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143680.888356:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143680.888580:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963591941248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2542us (3411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.888587:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4532 00000100:00100000:0.0:1746143680.897837:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.897871:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.898799:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.900321:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591942144 00000100:00100000:1.0:1746143680.900330:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591942144 00002000:00100000:1.0:1746143680.900368:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880131e9c000 x1830963591942144/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:76/0 lens 504/0 e 0 to 0 dl 1746143691 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143680.900378:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9c000 with x1830963591942144 ext(1048576->2097151) 00002000:00010000:1.0:1746143680.900381:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9c000 00000100:00100000:0.0:1746143680.901720:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3118 00000100:00100000:0.0:1746143680.901729:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963591941888:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143680.938278:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.941952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.946210:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.946405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.946421:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.958894:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.959717:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.959769:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591943168 00000100:00100000:1.0:1746143680.959773:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591943168 00010000:00010000:1.0:1746143680.959791:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130cbce00/0xe984082ccd723bce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05cc expref: 22 pid: 25369 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.959819:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4533 00000100:00100000:1.0:1746143680.959824:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f890a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963591943168:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143680.959833:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143680.959850:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130cbce00/0xe984082ccd723bce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05cc expref: 22 pid: 25369 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.959860:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130cbce00/0xe984082ccd723bce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1609727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05cc expref: 22 pid: 25369 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.959876:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cbce00/0xe984082ccd723bce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->1609727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05cc expref: 22 pid: 25369 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.959891:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.959893:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.959898:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cbca00/0xe984082ccd723bea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e8 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.959904:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130cbca00/0xe984082ccd723bea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e8 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.959925:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130cbca00/0xe984082ccd723bea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e8 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.959935:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593625088:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143680.960052:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143680.965686:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593625088:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143680.965702:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143680.965743:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f890a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963591943168:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5918us (6025us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.965752:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4533 00000100:00100000:0.0:1746143680.966920:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.987611:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143680.989769:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.989824:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591943808 00000100:00100000:1.0:1746143680.989829:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591943808 00010000:00010000:1.0:1746143680.989847:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130cbde00/0xe984082ccd723bd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3219456->3661823) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05d3 expref: 35 pid: 21542 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746143680.990474:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4534 00000100:00100000:1.0:1746143680.990481:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963591943808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143680.990492:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143680.990510:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880130cbde00/0xe984082ccd723bd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3219456->3661823) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05d3 expref: 35 pid: 21542 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.990520:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130cbde00/0xe984082ccd723bd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3219456->3661823) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05d3 expref: 35 pid: 21542 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.990536:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cbde00/0xe984082ccd723bd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3219456->3661823) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05d3 expref: 35 pid: 21542 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746143680.991205:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.991208:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.991215:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a087ac00/0xe984082ccd723c06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0604 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.991223:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a087ac00/0xe984082ccd723c06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0604 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.991230:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.991231:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143680.991234:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 34 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.991737:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 34 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143680.991770:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 34 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.991784:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593625216:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143680.991868:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a087ac00/0xe984082ccd723c06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0604 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143680.991876:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593625344:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143680.991891:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143680.996228:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143680.997989:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593625216:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143680.997999:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593625344:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143680.998015:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143680.998039:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591943808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7558us (8271us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143680.998047:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4534 00000100:00100000:0.0:1746143681.002818:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.005994:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591944320 00000100:00100000:0.0:1746143681.006006:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591944320 00002000:00100000:0.0:1746143681.006063:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f892a00 x1830963591944320/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.006071:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f892a00 with x1830963591944320 ext(2097152->3145727) 00002000:00010000:0.0:1746143681.006077:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f892a00 00000100:00100000:0.0:1746143681.006095:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3122 00000100:00100000:0.0:1746143681.006102:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963591944320:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143681.027444:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143681.027713:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143681.034822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.034872:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.034942:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591944704 00000100:00100000:1.0:1746143681.034949:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591944704 00000100:00100000:1.0:1746143681.034999:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8126 00000100:00100000:1.0:1746143681.035006:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:28003:x1830963591944704:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143681.035025:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.035038:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6400/0xe984082ccd723c1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0620 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.035081:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6600/0xe984082ccd723c22 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143681.035091:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6600/0xe984082ccd723c22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143681.035101:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6600/0xe984082ccd723c22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143681.035111:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6e00/0xe984082ccd723c29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143681.035116:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6e00/0xe984082ccd723c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143681.035121:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6e00/0xe984082ccd723c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143681.035239:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723c30 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143681.035246:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1aa00/0xe984082ccd723b73 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a058d expref: 241 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.035253:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0594 expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.035259:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723c30 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143681.035281:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0594 expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.035289:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0594 expref: 8 pid: 14764 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.035299:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593625600:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143681.035320:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143681.035369:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1aa00/0xe984082ccd723b73 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a058d expref: 241 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.035375:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1aa00/0xe984082ccd723b73 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a058d expref: 241 pid: 21713 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.035382:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593625728:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143681.035397:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143681.035411:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591944832 00000100:00100000:1.0:1746143681.035413:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591944832 00010000:00010000:1.0:1746143681.035426:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7200/0xe984082ccd723b03 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0563 expref: 10 pid: 9527 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.035441:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4535 00000100:00100000:1.0:1746143681.035445:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963591944832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143681.035453:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143681.035466:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7200/0xe984082ccd723b03 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0563 expref: 10 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.035474:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7200/0xe984082ccd723b03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0563 expref: 10 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.035491:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.035492:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.035498:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd1b200/0xe984082ccd723c14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0612 expref: 31 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.035509:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd1b200/0xe984082ccd723c14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0612 expref: 31 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.035525:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd1b200/0xe984082ccd723c14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0612 expref: 31 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143681.035532:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593625856:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143681.035549:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.037615:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.037880:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591945088 00000100:00100000:1.0:1746143681.037884:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591945088 00000100:00100000:1.0:1746143681.037920:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3261 00000100:00100000:1.0:1746143681.037926:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+9:7696:x1830963591945088:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143681.038186:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+10:7696:x1830963591945088:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 259us (574us total) trans 8589942174 rc 0/0 00000100:00100000:1.0:1746143681.038191:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3261 00000100:00100000:0.0:1746143681.039406:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.040604:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593625856:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143681.040618:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143681.040638:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963591944832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5192us (5319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.040645:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4535 00000100:00100000:0.0:1746143681.041007:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.041198:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591945472 00000100:00100000:1.0:1746143681.041203:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591945472 00010000:00010000:1.0:1746143681.041219:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0594 expref: 10 pid: 14764 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.041248:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4536 00000100:00100000:1.0:1746143681.041253:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963591945472:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143681.041260:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143681.041265:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0594 expref: 10 pid: 14764 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.041274:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0594 expref: 10 pid: 14764 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.041290:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64dea00/0xe984082ccd723b81 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0594 expref: 10 pid: 14764 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.041307:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143681.041312:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723c30 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143681.041318:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723c30 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143681.041323:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723c30 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143681.041327:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143681.041355:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963591945472:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 101us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.041360:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4536 00000100:00100000:0.0:1746143681.043768:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143681.045278:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723c30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045284:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723c30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143681.045318:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:0.0:1746143681.045322:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143681.045336:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723c30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045344:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723c30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045353:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6600/0xe984082ccd723c22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045359:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6600/0xe984082ccd723c22 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045364:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6600/0xe984082ccd723c22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045369:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c3d6600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143681.045371:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6600/0xe984082ccd723c22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045377:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6600/0xe984082ccd723c22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045384:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143681.045387:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143681.045390:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6600/0xe984082ccd723c22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045393:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6600/0xe984082ccd723c22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045597:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6e00/0xe984082ccd723c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045611:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6e00/0xe984082ccd723c29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045615:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6e00/0xe984082ccd723c29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045619:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c3d6e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143681.045622:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6e00/0xe984082ccd723c29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045627:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6e00/0xe984082ccd723c29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045634:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74b00) 00010000:00010000:0.0:1746143681.045636:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143681.045639:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6e00/0xe984082ccd723c29 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045643:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6e00/0xe984082ccd723c29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.045670:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6400/0xe984082ccd723c1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0620 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.045680:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723c30 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0620 expref: 7 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.045686:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:0.0:1746143681.045688:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143681.045690:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d6c00, rc 0) 00000100:00100000:0.0:1746143681.045724:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28003:x1830963591944704:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 10719us (10851us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143681.045730:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8126 00000100:00100000:0.0:1746143681.049297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.049330:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.049373:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.050126:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8948 00000100:00100000:0.0:1746143681.050133:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591945984:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143681.050165:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143681.050171:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca9d400/0xe984082ccd723c4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0635 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.050180:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.050182:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143681.050361:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.050374:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591946112 00000100:00100000:1.0:1746143681.050377:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591946112 00000100:00100000:1.0:1746143681.050394:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8949 00000100:00100000:1.0:1746143681.050399:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963591946112:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143681.050405:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.050411:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff4cc00/0xe984082ccd723c53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a063c expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.050421:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.050422:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.050427:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff4cc00/0xe984082ccd723c53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a063c expref: 11 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.050435:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff4cc00/0xe984082ccd723c53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a063c expref: 11 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.050442:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff4cc00, rc 0) 00000100:00100000:1.0:1746143681.050457:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963591946112:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 58us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.050461:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8949 00000100:00100000:1.0:1746143681.050503:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.050513:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591946240 00000100:00100000:1.0:1746143681.050515:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591946240 00000100:00100000:1.0:1746143681.050529:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8950 00000100:00100000:1.0:1746143681.050533:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591946240:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143681.050539:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.050544:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d000/0xe984082ccd723c5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0643 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.050557:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.050558:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.050563:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d000/0xe984082ccd723c5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0643 expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.050570:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d000/0xe984082ccd723c5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0643 expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.050577:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff4d000, rc 0) 00000100:00100000:1.0:1746143681.050590:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963591946240:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 56us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.050595:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8950 00000100:00100000:1.0:1746143681.050631:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.050642:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591946368 00000100:00100000:1.0:1746143681.050644:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591946368 00000100:00100000:1.0:1746143681.050657:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8951 00000100:00100000:1.0:1746143681.050661:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963591946368:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143681.050667:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.050672:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ff4d200/0xe984082ccd723c61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a064a expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.050682:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.050683:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.050687:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff4d200/0xe984082ccd723c61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a064a expref: 14 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.050695:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ff4d200/0xe984082ccd723c61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a064a expref: 14 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.050702:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff4d200, rc 0) 00010000:00010000:0.0:1746143681.051055:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca9d400/0xe984082ccd723c4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0635 expref: 13 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.051066:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca9d400/0xe984082ccd723c4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0635 expref: 13 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.051073:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca9d400, rc 0) 00000100:00100000:0.0:1746143681.051088:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1963:x1830963591945984:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 958us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143681.051093:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8948 00000100:00100000:1.0:1746143681.052180:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963591946368:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 1515us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.052186:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8951 00000100:00100000:0.0:1746143681.052270:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.052431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.052849:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.053306:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.054338:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.054351:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591947392 00000100:00100000:0.0:1746143681.054353:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591947392 00002000:00100000:0.0:1746143681.054369:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008fe34700 x1830963591947392/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.054376:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe34700 with x1830963591947392 ext(2097152->3145727) 00002000:00010000:0.0:1746143681.054379:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe34700 00000100:00100000:0.0:1746143681.054388:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591947648 00000100:00100000:0.0:1746143681.054390:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591947648 00002000:00100000:0.0:1746143681.054398:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008fe37b80 x1830963591947648/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.054404:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe37b80 with x1830963591947648 ext(3145728->4194303) 00002000:00010000:0.0:1746143681.054406:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe37b80 00000100:00100000:0.0:1746143681.054414:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3126 00000100:00100000:0.0:1746143681.054418:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963591947392:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143681.054665:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3127 00000100:00100000:1.0:1746143681.054672:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963591947648:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143681.055463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.055478:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591947904 00000100:00100000:0.0:1746143681.055481:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591947904 00002000:00100000:0.0:1746143681.055495:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008fe36d80 x1830963591947904/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.055502:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe36d80 with x1830963591947904 ext(3145728->4194303) 00002000:00010000:0.0:1746143681.055506:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe36d80 00000100:00100000:0.0:1746143681.055516:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3128 00000100:00100000:0.0:1746143681.055521:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963591947904:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143681.059492:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.064494:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143681.067285:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6d200/0xe984082ccd723c68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0651 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.067318:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1aa00/0xe984082ccd723c6f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0651 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.067325:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143681.067328:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143681.067330:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd1aa00, rc 0) 00000100:00100000:2.0:1746143681.067367:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28003:x1830963591948160:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 7382us (7882us total) trans 8589942176 rc 0/0 00000100:00100000:2.0:1746143681.067373:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8127 00000100:00100000:2.0:1746143681.080833:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963591947136:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27160us (27976us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143681.080843:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3124 00002000:00100000:2.0:1746143681.080853:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008fe35c00 x1830963591947136/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.080862:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe35c00 with x1830963591947136 ext(3145728->4194303) 00002000:00010000:2.0:1746143681.080867:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe35c00 00000100:00100000:1.0:1746143681.085009:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591947648:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30329us (30662us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143681.085020:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3127 00002000:00100000:1.0:1746143681.085029:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008fe37b80 x1830963591947648/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.085038:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe37b80 with x1830963591947648 ext(3145728->4194303) 00002000:00010000:1.0:1746143681.085043:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe37b80 00000100:00100000:2.0:1746143681.099047:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963591947392:12345-192.168.202.48@tcp:3:cat.0 Request processed in 44619us (45733us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143681.099057:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3126 00002000:00100000:2.0:1746143681.099066:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008fe34700 x1830963591947392/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.099075:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe34700 with x1830963591947392 ext(2097152->3145727) 00002000:00010000:2.0:1746143681.099424:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe34700 00000100:00100000:0.0:1746143681.102463:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.103056:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963591947904:12345-192.168.202.48@tcp:3:cat.0 Request processed in 47532us (47591us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143681.103065:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3128 00002000:00100000:1.0:1746143681.103073:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008fe36d80 x1830963591947904/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.103082:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe36d80 with x1830963591947904 ext(3145728->4194303) 00002000:00010000:1.0:1746143681.103087:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fe36d80 00000100:00100000:0.0:1746143681.105030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.105827:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591948672 00000100:00100000:2.0:1746143681.105834:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591948672 00000100:00100000:2.0:1746143681.105884:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8129 00000100:00100000:2.0:1746143681.105890:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28003:x1830963591948672:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143681.105909:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.105923:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b800/0xe984082ccd723c92 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a065f expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.105975:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b800/0xe984082ccd723c92 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a065f expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.105985:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b800/0xe984082ccd723c92 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a065f expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.105999:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143681.106002:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143681.106004:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336b800, rc 0) 00000100:00100000:2.0:1746143681.106037:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28003:x1830963591948672:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 147us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.106042:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8129 00000100:00100000:0.0:1746143681.108019:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.108053:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.108079:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.108096:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591948800 00000100:00100000:0.0:1746143681.108102:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591948800 00000100:00100000:0.0:1746143681.108156:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591948928 00000100:00100000:0.0:1746143681.108159:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591948928 00000100:00100000:0.0:1746143681.108172:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591949056 00000100:00100000:0.0:1746143681.108173:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591949056 00000100:00100000:0.0:1746143681.108185:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8952 00000100:00100000:0.0:1746143681.108190:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963591948800:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143681.108222:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.108235:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd1a000/0xe984082ccd723b5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a057f expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.108242:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe6c800/0xe984082ccd723c3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0627 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.108249:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a64de800/0xe984082ccd723b65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0586 expref: 33 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.108254:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.108256:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.108258:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.108281:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a64de800/0xe984082ccd723b65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0586 expref: 33 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.108291:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a64de800/0xe984082ccd723b65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0586 expref: 33 pid: 12618 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746143681.108307:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e624380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593626112:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143681.108370:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8953 00000100:00100000:1.0:1746143681.108377:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963591948928:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143681.108383:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe6c800/0xe984082ccd723c3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0627 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.108391:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe6c800/0xe984082ccd723c3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0627 expref: 12 pid: 4581 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746143681.108398:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e627800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593626240:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143681.108399:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.108410:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723b9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a9 expref: 20 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.108416:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe6ce00/0xe984082ccd723c45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a062e expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.108418:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd1a000/0xe984082ccd723b5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a057f expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.108423:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a64df400/0xe984082ccd723ba4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b0 expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.108426:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd1a000/0xe984082ccd723b5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a057f expref: 20 pid: 4581 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.108429:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.108430:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.108432:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143681.108433:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e626300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593626368:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143681.108446:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0780 going to sleep for 11 seconds 00010000:00010000:1.0:1746143681.108448:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a64df400/0xe984082ccd723ba4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b0 expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.108455:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a64df400/0xe984082ccd723ba4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b0 expref: 30 pid: 12618 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.108463:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593626496:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143681.108468:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.108482:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591949184 00000100:00100000:0.0:1746143681.108485:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591949184 00010000:00010000:1.0:1746143681.108495:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe6ce00/0xe984082ccd723c45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a062e expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143681.108499:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8954 00000100:00100000:0.0:1746143681.108503:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963591949056:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143681.108505:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe6ce00/0xe984082ccd723c45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a062e expref: 13 pid: 4581 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746143681.108517:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b160800/0xe984082ccd723ca7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.108531:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ca00/0xe984082ccd723bdc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05da expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.108538:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca9d400/0xe984082ccd723c4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0635 expref: 13 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.108544:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ce00/0xe984082ccd723be3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e1 expref: 30 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.108549:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.108551:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.108553:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b160800/0xe984082ccd723ca7 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.108566:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ce00/0xe984082ccd723be3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e1 expref: 30 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.108573:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ce00/0xe984082ccd723be3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e1 expref: 30 pid: 21542 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746143681.108580:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593626752:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143681.108593:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095098a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593626624:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143681.108601:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca9d400/0xe984082ccd723c4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0635 expref: 13 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.108608:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca9d400/0xe984082ccd723c4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0635 expref: 13 pid: 25369 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746143681.108620:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e624a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593626880:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143681.108624:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723b9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a9 expref: 20 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.108631:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723b9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a9 expref: 20 pid: 8496 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.108638:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593627008:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143681.108641:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ca00/0xe984082ccd723bdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05da expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.108648:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ca00/0xe984082ccd723bdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05da expref: 20 pid: 21542 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.108653:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.108656:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e626680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593627136:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143681.108667:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.108680:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8955 00000100:00100000:0.0:1746143681.108686:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963591949184:12345-192.168.202.48@tcp:1:mirror_io.0 00000100:00100000:2.0:1746143681.108986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.109025:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.109035:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591949312 00000100:00100000:2.0:1746143681.109038:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591949312 00000100:00100000:2.0:1746143681.109050:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591949440 00000100:00100000:2.0:1746143681.109052:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591949440 00000100:00100000:2.0:1746143681.109062:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8956 00000100:00100000:2.0:1746143681.109066:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1962:x1830963591949312:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143681.109084:0:8496:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.109094:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a087ac00/0xe984082ccd723c06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0604 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.109101:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d000/0xe984082ccd723c5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0643 expref: 14 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.109107:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 33 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.109112:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.109113:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.109116:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.109130:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 33 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.109165:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 33 pid: 6929 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.109174:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593627264:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143681.109195:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d000/0xe984082ccd723c5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0643 expref: 14 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.109207:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d000/0xe984082ccd723c5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0643 expref: 14 pid: 8496 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.109214:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593627392:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143681.109229:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a087ac00/0xe984082ccd723c06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0604 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.109236:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a087ac00/0xe984082ccd723c06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0604 expref: 20 pid: 6929 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.109243:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593627520:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143681.109252:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d70c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143681.110746:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.110757:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cbca00/0xe984082ccd723bea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e8 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.110763:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ff4cc00/0xe984082ccd723c53 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a063c expref: 14 pid: 8496 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143681.110767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143681.110769:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.110770:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.110772:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 5/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.110795:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ff4cc00/0xe984082ccd723c53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a063c expref: 14 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.110803:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ff4cc00/0xe984082ccd723c53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a063c expref: 14 pid: 8496 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746143681.110818:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593628032:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143681.110857:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130cbca00/0xe984082ccd723bea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e8 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.110869:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130cbca00/0xe984082ccd723bea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e8 expref: 33 pid: 25369 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746143681.110876:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593628160:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143681.110880:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591949568 00000100:00100000:2.0:1746143681.110885:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591949568 00000100:00100000:0.0:1746143681.110889:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143681.110907:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8958 00000100:00100000:2.0:1746143681.110912:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963591949568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.110919:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.110927:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b872e00/0xe984082ccd723cc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0666 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.110939:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.110946:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b872e00/0xe984082ccd723cc3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0666 expref: 22 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.110955:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b872e00/0xe984082ccd723cc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0666 expref: 22 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.110978:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b872e00, rc 0) 00000100:00100000:2.0:1746143681.110996:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963591949568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 83us (229us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143681.111001:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8958 00000100:00100000:0.0:1746143681.111691:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.111757:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591949824 00000100:00100000:1.0:1746143681.111760:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591949824 00002000:00100000:1.0:1746143681.111782:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008f0afb80 x1830963591949824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.111790:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0afb80 with x1830963591949824 ext(4194304->4898815) 00010000:00010000:1.0:1746143681.111796:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 34 pid: 6929 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.111805:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 34 pid: 6929 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746143681.111815:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f0afb80 00000100:00100000:1.0:1746143681.112814:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 740 00000100:00100000:1.0:1746143681.112824:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963591949824:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143681.123568:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.123638:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593626752:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143681.123681:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e624a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593626880:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143681.123711:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e626680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593627136:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143681.123732:0:4582:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b160800/0xe984082ccd723ca7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143681.123838:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593628032:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143681.123866:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593628160:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143681.123878:0:15784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143681.123913:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.123926:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.123939:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.123949:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.123969:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.123983:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.123991:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.124020:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.124093:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591949952 00000100:00100000:2.0:1746143681.124098:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591949952 00010000:00010000:2.0:1746143681.124124:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a64de800/0xe984082ccd723b65 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0586 expref: 36 pid: 12618 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.124166:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591950464 00000100:00100000:2.0:1746143681.124168:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591950464 00010000:00010000:2.0:1746143681.124177:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ce00/0xe984082ccd723be3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e1 expref: 31 pid: 21542 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.124184:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591950848 00000100:00100000:2.0:1746143681.124185:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591950848 00010000:00010000:2.0:1746143681.124192:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a087ac00/0xe984082ccd723c06 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0604 expref: 21 pid: 6929 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.124198:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591951104 00000100:00100000:2.0:1746143681.124199:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591951104 00010000:00010000:2.0:1746143681.124206:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd1b200/0xe984082ccd723c14 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0612 expref: 32 pid: 21542 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.124211:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591951616 00000100:00100000:2.0:1746143681.124212:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591951616 00010000:00010000:2.0:1746143681.124217:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130cbca00/0xe984082ccd723bea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e8 expref: 37 pid: 25369 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.124224:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591950080 00000100:00100000:2.0:1746143681.124225:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591950080 00010000:00010000:2.0:1746143681.124231:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe6c800/0xe984082ccd723c3e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0627 expref: 15 pid: 4581 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.124236:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591950592 00000100:00100000:2.0:1746143681.124238:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591950592 00010000:00010000:2.0:1746143681.124242:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d000/0xe984082ccd723c5a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0643 expref: 16 pid: 8496 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.124248:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591950976 00000100:00100000:2.0:1746143681.124249:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591950976 00010000:00010000:2.0:1746143681.124254:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff4d200/0xe984082ccd723c61 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a064a expref: 15 pid: 8496 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.124260:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591951232 00000100:00100000:2.0:1746143681.124261:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591951232 00010000:00010000:2.0:1746143681.124265:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff4cc00/0xe984082ccd723c53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a063c expref: 17 pid: 8496 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.124273:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4539 00000100:00100000:2.0:1746143681.124278:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963591949952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.124288:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.124304:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a64de800/0xe984082ccd723b65 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0586 expref: 37 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.124313:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a64de800/0xe984082ccd723b65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0586 expref: 37 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.124333:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.124364:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963591949952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 85us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.124370:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4539 00000100:00100000:2.0:1746143681.124383:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4540 00000100:00100000:2.0:1746143681.124387:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963591950464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.124396:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.124407:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ce00/0xe984082ccd723be3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e1 expref: 32 pid: 21542 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.124414:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ce00/0xe984082ccd723be3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e1 expref: 32 pid: 21542 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.124424:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ce00/0xe984082ccd723be3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e1 expref: 32 pid: 21542 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.124439:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.124452:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963591950464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 65us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.124456:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4540 00000100:00100000:2.0:1746143681.124466:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4541 00000100:00100000:2.0:1746143681.124470:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963591950848:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.124476:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.124483:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a087ac00/0xe984082ccd723c06 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0604 expref: 21 pid: 6929 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.124491:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a087ac00/0xe984082ccd723c06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0604 expref: 21 pid: 6929 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.124501:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.124512:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963591950848:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 42us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.124516:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4541 00000100:00100000:2.0:1746143681.124549:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4542 00000100:00100000:2.0:1746143681.124553:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963591951104:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.124559:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.124567:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd1b200/0xe984082ccd723c14 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0612 expref: 30 pid: 21542 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.124574:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd1b200/0xe984082ccd723c14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0612 expref: 30 pid: 21542 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.124583:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.124596:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963591951104:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 42us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.124601:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4542 00000100:00100000:2.0:1746143681.124609:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4543 00000100:00100000:2.0:1746143681.124613:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591951616:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.124618:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.124626:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130cbca00/0xe984082ccd723bea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e8 expref: 36 pid: 25369 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.124634:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130cbca00/0xe984082ccd723bea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e8 expref: 36 pid: 25369 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.124643:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cbca00/0xe984082ccd723bea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05e8 expref: 36 pid: 25369 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.124651:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.124663:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963591951616:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.124667:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4543 00000100:00100000:2.0:1746143681.124676:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4544 00000100:00100000:2.0:1746143681.124680:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+17:1962:x1830963591950080:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.124685:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.124690:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe6c800/0xe984082ccd723c3e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0627 expref: 17 pid: 4581 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.124697:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe6c800/0xe984082ccd723c3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0627 expref: 17 pid: 4581 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.124705:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.124717:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+17:1962:x1830963591950080:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 37us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.124721:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4544 00000100:00100000:2.0:1746143681.124728:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4545 00000100:00100000:2.0:1746143681.124732:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:1962:x1830963591950592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.124737:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.124742:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d000/0xe984082ccd723c5a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0643 expref: 16 pid: 8496 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.124748:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d000/0xe984082ccd723c5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0643 expref: 16 pid: 8496 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.124756:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.124767:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:1962:x1830963591950592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 34us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.124771:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4545 00000100:00100000:2.0:1746143681.124778:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4547 00000100:00100000:2.0:1746143681.124781:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1962:x1830963591951232:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.124786:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.124792:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ff4cc00/0xe984082ccd723c53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a063c expref: 15 pid: 8496 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.124798:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ff4cc00/0xe984082ccd723c53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a063c expref: 15 pid: 8496 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.124807:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff4cc00/0xe984082ccd723c53 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a063c expref: 15 pid: 8496 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.124814:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.124816:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.124819:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.124826:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.124843:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.124853:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1962:x1830963591951232:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 71us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.124858:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4547 00010000:00010000:2.0:1746143681.124896:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a64de800/0xe984082ccd723b65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0586 expref: 34 pid: 12618 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.124903:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e624380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593626112:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143681.124910:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe6c800/0xe984082ccd723c3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0627 expref: 12 pid: 4581 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.124918:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e627800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593626240:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143681.124926:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e626300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593626368:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143681.124936:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143681.125021:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593626496:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143681.125029:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095098a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593626624:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143681.125036:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009509ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593627008:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143681.125052:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.129417:0:15784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.129429:0:15784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.129456:0:15784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.129463:0:15784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.129475:0:15784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.129481:0:15784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ff4d400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143681.129484:0:15784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.129490:0:15784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.129505:0:15784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.129510:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff4d400/0xe984082ccd723cbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143681.129590:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963591949184:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 20901us (21118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143681.129598:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8955 00000100:00100000:0.0:1746143681.129773:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591950208 00000100:00100000:0.0:1746143681.129777:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591950208 00010000:00010000:0.0:1746143681.129797:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe6ce00/0xe984082ccd723c45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a062e expref: 14 pid: 4581 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746143681.129813:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4548 00000100:00100000:0.0:1746143681.129817:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1965:x1830963591950208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143681.129826:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143681.129839:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe6ce00/0xe984082ccd723c45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a062e expref: 14 pid: 4581 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746143681.129847:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe6ce00/0xe984082ccd723c45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a062e expref: 14 pid: 4581 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746143681.129858:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe6ce00/0xe984082ccd723c45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a062e expref: 14 pid: 4581 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746143681.129867:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143681.129877:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1965:x1830963591950208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 60us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143681.129882:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4548 00000100:00100000:1.0:1746143681.129976:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.129991:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.130000:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.130010:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591950720 00000100:00100000:1.0:1746143681.130012:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591950720 00010000:00010000:1.0:1746143681.130024:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ca00/0xe984082ccd723bdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05da expref: 21 pid: 21542 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.130041:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591951488 00000100:00100000:1.0:1746143681.130043:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591951488 00010000:00010000:1.0:1746143681.130050:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723b9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a9 expref: 22 pid: 8496 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.130062:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4549 00000100:00100000:1.0:1746143681.130066:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591950720:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143681.130072:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143681.130081:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ca00/0xe984082ccd723bdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05da expref: 22 pid: 21542 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.130089:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ca00/0xe984082ccd723bdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05da expref: 22 pid: 21542 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.130100:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca9ca00/0xe984082ccd723bdc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05da expref: 22 pid: 21542 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.130112:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143681.130123:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963591950720:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 57us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.130128:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4549 00000100:00100000:1.0:1746143681.130158:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4551 00000100:00100000:1.0:1746143681.130163:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963591951872:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143681.130170:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143681.130176:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a64df400/0xe984082ccd723ba4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b0 expref: 29 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.130184:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a64df400/0xe984082ccd723ba4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b0 expref: 29 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.130193:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a64df400/0xe984082ccd723ba4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b0 expref: 29 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.130206:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.130207:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.130210:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130216:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130228:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143681.130237:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963591951872:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.130240:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4551 00010000:00010000:1.0:1746143681.130253:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130259:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130270:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130276:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130281:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130289:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0242600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143681.130292:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130298:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130305:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130310:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0242600/0xe984082ccd723ca0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143681.130337:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963591948928:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 21961us (22283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.130343:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8953 00000100:00100000:1.0:1746143681.130373:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.130386:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.130395:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.130402:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591952000 00000100:00100000:1.0:1746143681.130404:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591952000 00000100:00100000:1.0:1746143681.130418:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8959 00000100:00100000:1.0:1746143681.130422:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:27999:x1830963591952000:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143681.130429:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.130436:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0242400/0xe984082ccd723ce6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a066d expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130446:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.130449:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130453:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143681.130456:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0242400/0xe984082ccd723ce6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a066d expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130463:0:21542:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130471:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0242400/0xe984082ccd723ce6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a066d expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.130478:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0242400, rc 0) 00000100:00100000:1.0:1746143681.130488:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:27999:x1830963591952000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 66us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.130493:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8959 00000100:00100000:3.0:1746143681.130554:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963591951744:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143681.130561:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143681.130569:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd1a000/0xe984082ccd723b5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a057f expref: 21 pid: 4581 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.130577:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd1a000/0xe984082ccd723b5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a057f expref: 21 pid: 4581 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.130586:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd1a000/0xe984082ccd723b5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a057f expref: 21 pid: 4581 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.130593:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.130594:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.130596:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.130602:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.130613:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143681.130623:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963591951744:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 68us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.130628:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4554 00010000:00010000:3.0:1746143681.130644:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009be99c00/0xe984082ccd723cb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.130651:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009be99c00/0xe984082ccd723cb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.130667:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009be99c00/0xe984082ccd723cb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.130673:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009be99c00/0xe984082ccd723cb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.130679:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009be99c00/0xe984082ccd723cb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.130684:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be99c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143681.130686:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009be99c00/0xe984082ccd723cb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.130691:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009be99c00/0xe984082ccd723cb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.130700:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009be99c00/0xe984082ccd723cb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.130705:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009be99c00/0xe984082ccd723cb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143681.130710:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963591949824:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17887us (19019us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143681.130716:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 740 00002000:00100000:1.0:1746143681.130722:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008f0afb80 x1830963591949824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:H/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143681.130727:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963591949440:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 21262us (21702us total) trans 0 rc 0/0 00002000:00100000:1.0:1746143681.130730:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0afb80 with x1830963591949824 ext(4194304->4898815) 00000100:00100000:3.0:1746143681.130733:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8957 00010000:00010000:1.0:1746143681.130735:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 32 pid: 6929 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.130743:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 32 pid: 6929 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746143681.130749:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f0afb80 00010000:00010000:2.0:1746143681.130835:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.130843:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.130860:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.130866:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.130871:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.130875:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b161400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143681.130878:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.130883:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.130891:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.130897:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b161400/0xe984082ccd723c99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143681.130926:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963591948800:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 22735us (22913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.130931:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8952 00010000:00010000:0.0:1746143681.131002:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b160800/0xe984082ccd723ca7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.131009:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b160800/0xe984082ccd723ca7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.131021:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b160800/0xe984082ccd723ca7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.131026:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b160800/0xe984082ccd723ca7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.131031:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b160800/0xe984082ccd723ca7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.131036:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b160800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143681.131038:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b160800/0xe984082ccd723ca7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.131043:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b160800/0xe984082ccd723ca7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.131052:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b160800/0xe984082ccd723ca7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.131056:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b160800/0xe984082ccd723ca7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143681.131083:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963591949056:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 22578us (23002us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143681.131088:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8954 00000100:00100000:3.0:1746143681.134311:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593628288:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143681.134333:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98e00/0xe984082ccd723cdf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143681.135253:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.135332:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591952384 00000100:00100000:2.0:1746143681.135338:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591952384 00010000:00010000:2.0:1746143681.135363:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99600/0xe984082ccd723c84 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0658 expref: 10 pid: 14763 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.135383:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4555 00000100:00100000:2.0:1746143681.135388:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963591952384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.135398:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.135403:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99600/0xe984082ccd723c84 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0658 expref: 10 pid: 14763 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.135412:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99600/0xe984082ccd723c84 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0658 expref: 10 pid: 14763 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.135427:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99600/0xe984082ccd723c84 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0658 expref: 10 pid: 14763 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.135439:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143681.135443:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98e00/0xe984082ccd723cdf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.135449:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98e00/0xe984082ccd723cdf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.135455:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98e00/0xe984082ccd723cdf lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.135477:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.135509:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963591952384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 120us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.135515:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4555 00010000:00010000:3.0:1746143681.135773:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98e00/0xe984082ccd723cdf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135779:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98e00/0xe984082ccd723cdf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143681.135793:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143681.135885:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98e00/0xe984082ccd723cdf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135890:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98e00/0xe984082ccd723cdf lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135895:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98e00/0xe984082ccd723cdf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135899:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be98e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.135902:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98e00/0xe984082ccd723cdf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135907:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98e00/0xe984082ccd723cdf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135914:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143681.135916:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143681.135919:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98e00/0xe984082ccd723cdf lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135922:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98e00/0xe984082ccd723cdf lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135936:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99e00/0xe984082ccd723cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135940:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99e00/0xe984082ccd723cd1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135944:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99e00/0xe984082ccd723cd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135947:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be99e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.135948:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99e00/0xe984082ccd723cd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135952:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99e00/0xe984082ccd723cd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135957:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143681.135988:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143681.135990:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99e00/0xe984082ccd723cd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.135994:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99e00/0xe984082ccd723cd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.136002:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99800/0xe984082ccd723cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.136006:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99800/0xe984082ccd723cd8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.136010:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99800/0xe984082ccd723cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.136014:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009be99800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.136016:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99800/0xe984082ccd723cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.136020:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99800/0xe984082ccd723cd8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.136025:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5ec00) 00010000:00010000:3.0:1746143681.136027:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143681.136029:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99800/0xe984082ccd723cd8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.136032:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be99800/0xe984082ccd723cd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.136068:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98c00/0xe984082ccd723cca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0674 expref: 11 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.136074:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be98c00/0xe984082ccd723cca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0674 expref: 11 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.136081:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be98c00, rc 0) 00000100:00100000:3.0:1746143681.136213:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28005:x1830963591952256:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6405us (6455us total) trans 8589942178 rc 301/301 00000100:00100000:3.0:1746143681.136219:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8130 00000100:00100000:0.0:1746143681.141440:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.141476:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.141504:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.141516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.141540:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.141566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.141638:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591952512 00000100:00100000:2.0:1746143681.141645:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591952512 00000100:00100000:2.0:1746143681.141675:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591952768 00000100:00100000:2.0:1746143681.141677:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591952768 00000100:00100000:2.0:1746143681.141687:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591953024 00000100:00100000:2.0:1746143681.141689:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591953024 00000100:00100000:2.0:1746143681.141697:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591952640 00000100:00100000:2.0:1746143681.141698:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591952640 00000100:00100000:2.0:1746143681.141705:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591952896 00000100:00100000:2.0:1746143681.141706:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591952896 00000100:00100000:2.0:1746143681.141712:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591953152 00000100:00100000:2.0:1746143681.141713:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591953152 00000100:00100000:2.0:1746143681.141724:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8960 00000100:00100000:2.0:1746143681.141730:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591952512:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.141744:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.141760:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0383800/0xe984082ccd723cf4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a067b expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143681.141781:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409c0, atime: 0x681409bf, ctime: 0x681409c0, blocks: 0x809 00010000:00010000:2.0:1746143681.141796:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.141798:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.141805:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0383800/0xe984082ccd723cf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a067b expref: 35 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.141818:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0383800/0xe984082ccd723cf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a067b expref: 35 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.141826:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0383800, rc 0) 00000100:00100000:2.0:1746143681.141859:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591952512:12345-192.168.202.48@tcp:101:cat.0 Request processed in 129us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.141868:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8960 00000100:00100000:2.0:1746143681.141880:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8961 00000100:00100000:2.0:1746143681.141884:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963591952768:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.141890:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.141899:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0382a00/0xe984082ccd723cfb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0689 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143681.141910:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34b:0x0] initial LVB size: 2097152, mtime: 0x681409c0, atime: 0x681409bf, ctime: 0x681409c0, blocks: 0x821 00010000:00010000:2.0:1746143681.141917:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.141919:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.141922:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0382a00/0xe984082ccd723cfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0689 expref: 31 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.141931:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0382a00/0xe984082ccd723cfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0689 expref: 31 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.141937:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0382a00, rc 0) 00000100:00100000:2.0:1746143681.141950:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963591952768:12345-192.168.202.48@tcp:101:cat.0 Request processed in 66us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.141955:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8961 00000100:00100000:2.0:1746143681.141976:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8962 00000100:00100000:2.0:1746143681.141981:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591953024:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.141987:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.141992:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0382c00/0xe984082ccd723d02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0697 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.142005:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.142012:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0382c00/0xe984082ccd723d02 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0697 expref: 35 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.142019:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0382c00/0xe984082ccd723d02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0697 expref: 35 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.142027:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0382c00, rc 0) 00000100:00100000:2.0:1746143681.142040:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591953024:12345-192.168.202.48@tcp:101:cat.0 Request processed in 59us (536us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143681.142045:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8962 00000100:00100000:2.0:1746143681.142052:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8963 00000100:00100000:2.0:1746143681.142056:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963591952640:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.142060:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.142067:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0382e00/0xe984082ccd723d09 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0682 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143681.142076:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34a:0x0] initial LVB size: 2097152, mtime: 0x681409c0, atime: 0x681409bf, ctime: 0x681409c0, blocks: 0x821 00010000:00010000:2.0:1746143681.142083:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.142084:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.142087:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0382e00/0xe984082ccd723d09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0682 expref: 31 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.142095:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0382e00/0xe984082ccd723d09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0682 expref: 31 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.142106:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0382e00, rc 0) 00000100:00100000:2.0:1746143681.142118:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963591952640:12345-192.168.202.48@tcp:101:cat.0 Request processed in 62us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.142123:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8963 00000100:00100000:2.0:1746143681.142131:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8964 00000100:00100000:2.0:1746143681.142134:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963591952896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.142166:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.142174:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0383200/0xe984082ccd723d10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0690 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143681.142183:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409c0, atime: 0x681409bf, ctime: 0x681409c0, blocks: 0x81f 00010000:00010000:2.0:1746143681.142189:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.142190:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.142194:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0383200/0xe984082ccd723d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0690 expref: 34 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.142201:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0383200/0xe984082ccd723d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0690 expref: 34 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.142206:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0383200, rc 0) 00000100:00100000:2.0:1746143681.142225:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591952896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 85us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.142229:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8964 00000100:00100000:2.0:1746143681.142238:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8965 00000100:00100000:2.0:1746143681.142242:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963591953152:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.142248:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.142254:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0383400/0xe984082ccd723d17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a069e expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143681.142264:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409c0, atime: 0x681409bf, ctime: 0x681409c0, blocks: 0x1029 00010000:00010000:2.0:1746143681.142270:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.142271:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.142274:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0383400/0xe984082ccd723d17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a069e expref: 31 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.142281:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0383400/0xe984082ccd723d17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a069e expref: 31 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.142287:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0383400, rc 0) 00000100:00100000:2.0:1746143681.142301:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963591953152:12345-192.168.202.48@tcp:101:cat.0 Request processed in 58us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.142305:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8965 00000100:00100000:1.0:1746143681.147358:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.147481:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.147823:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591953536 00000100:00100000:3.0:1746143681.147831:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591953536 00000100:00100000:1.0:1746143681.147878:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.147970:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591953664 00000100:00100000:0.0:1746143681.147973:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591953664 00010000:00010000:0.0:1746143681.147995:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 34 pid: 6929 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.148037:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591953280 00000100:00100000:2.0:1746143681.148041:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591953280 00000100:00100000:2.0:1746143681.148062:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8966 00000100:00100000:2.0:1746143681.148068:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28005:x1830963591953280:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143681.148081:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.148094:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a06a5 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.148115:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0383400/0xe984082ccd723d17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a069e expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.148127:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.148128:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.148131:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2887680->2899967] (req 2887680->2899967) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.148173:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0383400/0xe984082ccd723d17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a069e expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.148183:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0383400/0xe984082ccd723d17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a069e expref: 30 pid: 4582 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.148193:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593628416:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143681.148246:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143681.148553:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8131 00000100:00100000:3.0:1746143681.148559:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28007:x1830963591953536:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143681.148570:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143681.148579:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6ce00/0xe984082ccd723d25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a06ac expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.148660:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6cc00/0xe984082ccd723d2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148670:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6cc00/0xe984082ccd723d2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148680:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6cc00/0xe984082ccd723d2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148691:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a000/0xe984082ccd723d33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148696:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a000/0xe984082ccd723d33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148701:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a000/0xe984082ccd723d33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148789:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723d3a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148796:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723d3a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148801:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723d3a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143681.148808:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143681.148871:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723d3a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148877:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723d3a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148886:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723d3a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148890:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd1ae00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.148894:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723d3a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148899:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723d3a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148908:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143681.148910:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143681.148913:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723d3a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148918:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723d3a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148928:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6cc00/0xe984082ccd723d2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148933:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6cc00/0xe984082ccd723d2c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148938:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6cc00/0xe984082ccd723d2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148941:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe6cc00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.148944:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6cc00/0xe984082ccd723d2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148948:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6cc00/0xe984082ccd723d2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148956:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143681.148972:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143681.148974:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6cc00/0xe984082ccd723d2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148978:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6cc00/0xe984082ccd723d2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148984:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a000/0xe984082ccd723d33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148988:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a000/0xe984082ccd723d33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148991:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a000/0xe984082ccd723d33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.148995:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd1a000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.148996:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a000/0xe984082ccd723d33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.149000:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a000/0xe984082ccd723d33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.149005:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f0f2e00) 00010000:00010000:3.0:1746143681.149007:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143681.149009:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a000/0xe984082ccd723d33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.149012:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a000/0xe984082ccd723d33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.149038:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6ce00/0xe984082ccd723d25 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ac expref: 244 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.149045:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe6ce00/0xe984082ccd723d25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ac expref: 244 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.149051:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe6ce00, rc 0) 00000100:00100000:3.0:1746143681.149079:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28007:x1830963591953536:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 521us (1599us total) trans 8589942179 rc 301/301 00000100:00100000:3.0:1746143681.149085:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8131 00000100:00100000:0.0:1746143681.149227:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4556 00000100:00100000:0.0:1746143681.149234:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591953664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143681.149242:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143681.149258:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 34 pid: 6929 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746143681.149266:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 34 pid: 6929 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746143681.149276:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be99a00/0xe984082ccd723c0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a060b expref: 34 pid: 6929 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746143681.149288:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.149289:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.149292:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.149299:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.149320:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143681.149337:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963591953664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 104us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143681.149342:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4556 00000100:00100000:2.0:1746143681.149511:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.150818:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591953792 00000100:00100000:0.0:1746143681.150823:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591953792 00000100:00100000:0.0:1746143681.150846:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8967 00000100:00100000:0.0:1746143681.150852:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:27998:x1830963591953792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143681.150862:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143681.150871:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a06b3 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.150888:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143681.150890:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143681.150893:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4894720->5242879] (req 4894720->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.150900:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4894720->5242879] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.150907:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff4da00, rc 0) 00000100:00100000:0.0:1746143681.150928:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:27998:x1830963591953792:12345-192.168.202.48@tcp:101:cat.0 Request processed in 76us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143681.150932:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8967 00000100:00100000:0.0:1746143681.151028:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.151040:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591953920 00000100:00100000:0.0:1746143681.151043:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591953920 00010000:00010000:0.0:1746143681.151055:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0383400/0xe984082ccd723d17 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a069e expref: 31 pid: 4582 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746143681.151068:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4557 00000100:00100000:0.0:1746143681.151072:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963591953920:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143681.151079:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143681.151092:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0383400/0xe984082ccd723d17 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a069e expref: 31 pid: 4582 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746143681.151101:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0383400/0xe984082ccd723d17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a069e expref: 31 pid: 4582 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746143681.151113:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.151114:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.151118:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.151125:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.151161:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143681.151170:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593628544:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143681.151198:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00010000:00010000:2.0:1746143681.151331:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0383400/0xe984082ccd723d17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a069e expref: 31 pid: 4582 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.151342:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593628416:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143681.151356:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.151363:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0382200, rc 0) 00000100:00100000:2.0:1746143681.151382:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28005:x1830963591953280:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3314us (4031us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.151387:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8966 00010000:00010000:3.0:1746143681.151585:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.151593:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.151612:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.151619:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.151625:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.151630:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b873e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143681.151632:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.151642:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.151651:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.151652:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.151656:0:8496:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0242400/0xe984082ccd723ce6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a066d expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.151662:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0242400/0xe984082ccd723ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a066d expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.151667:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.151668:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.151671:0:8496:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 33 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.151677:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 33 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.151693:0:8496:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 33 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143681.151701:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593628672:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143681.151738:0:8496:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0242400/0xe984082ccd723ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a066d expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143681.151749:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593628800:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143681.151763:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.155688:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.156991:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591954048 00000100:00100000:1.0:1746143681.156999:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591954048 00000100:00100000:1.0:1746143681.157050:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8968 00000100:00100000:1.0:1746143681.157056:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:28007:x1830963591954048:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143681.157071:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.157084:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a06ba expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.157109:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.157117:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143681.157118:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143681.157121:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3264512->3407871] (req 3264512->3407871) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.157160:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.157171:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 18 pid: 8495 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.157182:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593628928:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143681.157254:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.157657:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.157691:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.157838:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593628672:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143681.157848:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593628800:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143681.157866:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.157872:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b873e00/0xe984082ccd723cae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143681.158276:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591954432 00000100:00100000:0.0:1746143681.158280:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591954432 00000100:00100000:0.0:1746143681.158303:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8969 00000100:00100000:0.0:1746143681.158308:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963591954432:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143681.158315:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143681.158323:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ff4de00/0xe984082ccd723d56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a06c1 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143681.158353:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e626300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593629056:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143681.158383:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591954304 00000100:00100000:0.0:1746143681.158384:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143681.158387:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591954304 00002000:00100000:1.0:1746143681.158411:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2887680->2891775) req@ffff88008f0ad880 x1830963591954304/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.158418:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad880 with x1830963591954304 ext(2887680->2891775) 00010000:00010000:1.0:1746143681.158425:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 7/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 19 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.158434:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 7/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 19 pid: 8495 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746143681.158440:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f0ad880 00000100:00100000:1.0:1746143681.158452:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 741 00000100:00100000:1.0:1746143681.158457:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963591954304:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143681.158480:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593628544:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143681.158491:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.158512:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591953920:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7439us (7484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.158519:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4557 00000100:00100000:1.0:1746143681.158579:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963591954304:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 121us (922us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143681.158584:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 741 00002000:00100000:1.0:1746143681.158589:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2887680->2891775) req@ffff88008f0ad880 x1830963591954304/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.158595:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad880 with x1830963591954304 ext(2887680->2891775) 00010000:00010000:1.0:1746143681.158599:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 19 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.158607:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 19 pid: 8495 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746143681.158612:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f0ad880 00000100:00100000:3.0:1746143681.158686:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963591949312:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 49618us (49699us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.158692:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8956 00000100:00100000:0.0:1746143681.160468:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.160544:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.160786:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591954688 00000100:00100000:3.0:1746143681.160793:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591954688 00002000:00010000:2.0:1746143681.160817:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143679 -> 1746143680 00000100:00100000:3.0:1746143681.160822:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8132 00000100:00100000:3.0:1746143681.160827:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28003:x1830963591954688:12345-192.168.202.48@tcp:36:mirror_io.0 00000100:00100000:2.0:1746143681.160832:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e626300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593629056:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143681.160853:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ff4de00/0xe984082ccd723d56 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06c1 expref: 33 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143681.160861:0:14764:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.160863:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ff4de00/0xe984082ccd723d56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06c1 expref: 33 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143681.160878:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b800/0xe984082ccd723c92 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a065f expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.160878:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff4de00, rc 0) 00010000:00010000:3.0:1746143681.160890:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143681.160894:0:14764:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.160907:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963591954432:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2599us (3215us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143681.160913:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8969 00000100:00100000:3.0:1746143681.160925:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28003:x1830963591954688:12345-192.168.202.48@tcp:36:mirror_io.0 Request processed in 97us (463us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746143681.160931:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8132 00000100:00100000:3.0:1746143681.160947:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591954944 00000100:00100000:3.0:1746143681.160950:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591954944 00002000:00100000:3.0:1746143681.160977:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008e624380 x1830963591954944/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.160985:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624380 with x1830963591954944 ext(4194304->4898815) 00002000:00010000:3.0:1746143681.160989:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e624380 00000100:00100000:3.0:1746143681.161002:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3129 00000100:00100000:3.0:1746143681.161007:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963591954944:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143681.161057:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593628928:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143681.161072:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3264512->3407871] (req 3264512->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.161082:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0243e00, rc 0) 00000100:00100000:1.0:1746143681.161100:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:28007:x1830963591954048:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4044us (5420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.161106:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8968 00000100:00100000:0.0:1746143681.163524:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.163943:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591955456 00000100:00100000:2.0:1746143681.163950:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591955456 00000100:00100000:2.0:1746143681.163996:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3263 00000100:00100000:2.0:1746143681.164003:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28003:x1830963591955456:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143681.164191:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28003:x1830963591955456:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 189us (674us total) trans 8589942180 rc 0/0 00000100:00100000:2.0:1746143681.164198:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3263 00000100:00100000:0.0:1746143681.165831:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.165877:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591955200 00000100:00100000:2.0:1746143681.165884:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591955200 00002000:00100000:2.0:1746143681.165914:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2895872->2899967) req@ffff88008e624a80 x1830963591955200/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.165921:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624a80 with x1830963591955200 ext(2895872->2899967) 00010000:00010000:2.0:1746143681.165929:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 19 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.165941:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 19 pid: 8495 timeout: 860 lvb_type: 0 00002000:00010000:2.0:1746143681.165947:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e624a80 00000100:00100000:2.0:1746143681.165976:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 742 00000100:00100000:2.0:1746143681.165981:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963591955200:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143681.166416:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963591955200:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 433us (588us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143681.166422:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 742 00002000:00100000:2.0:1746143681.166427:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2895872->2899967) req@ffff88008e624a80 x1830963591955200/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.166434:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624a80 with x1830963591955200 ext(2895872->2899967) 00010000:00010000:2.0:1746143681.166439:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 19 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.166447:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 19 pid: 8495 timeout: 860 lvb_type: 0 00002000:00010000:2.0:1746143681.166452:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e624a80 00000100:00100000:1.0:1746143681.166536:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.166600:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591955712 00000100:00100000:0.0:1746143681.166604:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591955712 00002000:00100000:0.0:1746143681.166621:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff8800930df100 x1830963591955712/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.166628:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df100 with x1830963591955712 ext(4894720->4898815) 00002000:00010000:0.0:1746143681.166631:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930df100 00000100:00100000:0.0:1746143681.166649:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3130 00000100:00100000:0.0:1746143681.166654:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591955712:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143681.166760:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591955712:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 105us (224us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143681.166765:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3130 00002000:00100000:0.0:1746143681.166770:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff8800930df100 x1830963591955712/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.166777:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df100 with x1830963591955712 ext(4894720->4898815) 00002000:00010000:0.0:1746143681.166779:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930df100 00000100:00100000:3.0:1746143681.166972:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963591954944:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 5963us (6427us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143681.166978:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3129 00002000:00100000:3.0:1746143681.166983:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008e624380 x1830963591954944/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 704512/704512 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.166989:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624380 with x1830963591954944 ext(4194304->4898815) 00002000:00010000:3.0:1746143681.166992:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e624380 00000100:00100000:0.0:1746143681.168579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.168627:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591955968 00000100:00100000:1.0:1746143681.168632:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591955968 00000100:00100000:1.0:1746143681.168671:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3264 00000100:00100000:1.0:1746143681.168677:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28003:x1830963591955968:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143681.168828:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28003:x1830963591955968:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 151us (252us total) trans 8589942181 rc 0/0 00000100:00100000:1.0:1746143681.168834:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3264 00000100:00100000:0.0:1746143681.171324:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.171358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.171392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.171555:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591956096 00000100:00100000:3.0:1746143681.171562:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591956096 00000100:00100000:2.0:1746143681.171564:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591956224 00000100:00100000:2.0:1746143681.171568:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591956224 00000100:00100000:3.0:1746143681.171593:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591956352 00000100:00100000:3.0:1746143681.171595:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591956352 00000100:00100000:2.0:1746143681.171650:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8970 00000100:00100000:2.0:1746143681.171656:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963591956096:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.171671:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.171683:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0383c00/0xe984082ccd723d5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a06c8 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.171699:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.171701:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.171708:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0383c00/0xe984082ccd723d5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06c8 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.171719:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0383c00/0xe984082ccd723d5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06c8 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.171728:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0383c00, rc 0) 00000100:00100000:2.0:1746143681.171759:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963591956096:12345-192.168.202.48@tcp:101:cat.0 Request processed in 103us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.171765:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8970 00000100:00100000:2.0:1746143681.171778:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8971 00000100:00100000:2.0:1746143681.171782:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963591956224:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.171788:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.171796:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0383e00/0xe984082ccd723d64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a06cf expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.171806:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.171807:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.171810:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0383e00/0xe984082ccd723d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06cf expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.171819:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0383e00/0xe984082ccd723d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06cf expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.171824:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0383e00, rc 0) 00000100:00100000:2.0:1746143681.171838:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963591956224:12345-192.168.202.48@tcp:101:cat.0 Request processed in 55us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.171842:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8971 00000100:00100000:2.0:1746143681.171851:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8972 00000100:00100000:2.0:1746143681.171855:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963591956352:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.171860:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.171865:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0383000/0xe984082ccd723d6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a06d6 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.171875:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.171876:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.171879:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0383000/0xe984082ccd723d6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06d6 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.171887:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0383000/0xe984082ccd723d6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06d6 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.171893:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0383000, rc 0) 00000100:00100000:2.0:1746143681.171906:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963591956352:12345-192.168.202.48@tcp:101:cat.0 Request processed in 50us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.171913:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8972 00000100:00100000:1.0:1746143681.172173:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.172187:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591956480 00000100:00100000:1.0:1746143681.172190:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591956480 00000100:00100000:1.0:1746143681.172219:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8973 00000100:00100000:1.0:1746143681.172224:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963591956480:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143681.172230:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.172237:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0243a00/0xe984082ccd723d72 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a06dd expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.172247:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.172248:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.172252:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0243a00/0xe984082ccd723d72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06dd expref: 22 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.172260:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0243a00/0xe984082ccd723d72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06dd expref: 22 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.172267:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0243a00, rc 0) 00000100:00100000:1.0:1746143681.172281:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963591956480:12345-192.168.202.48@tcp:101:cat.0 Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.172285:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8973 00000100:00100000:0.0:1746143681.172405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.172467:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591956736 00000100:00100000:3.0:1746143681.172470:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591956736 00000100:00100000:3.0:1746143681.172489:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3265 00000100:00100000:3.0:1746143681.172494:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:27998:x1830963591956736:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143681.172803:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:27998:x1830963591956736:12345-192.168.202.48@tcp:35:cat.0 Request processed in 308us (397us total) trans 8589942182 rc 0/0 00000100:00100000:3.0:1746143681.172810:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3265 00000100:00100000:0.0:1746143681.175025:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.175548:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591956992 00000100:00100000:3.0:1746143681.175556:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591956992 00002000:00100000:3.0:1746143681.175755:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2887680->2899967) req@ffff88009bfe0000 x1830963591956992/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 12776/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.175764:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0000 with x1830963591956992 ext(2887680->2899967) 00010000:00010000:3.0:1746143681.175773:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 21 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.175787:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 21 pid: 8495 timeout: 860 lvb_type: 0 00002000:00010000:3.0:1746143681.175794:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe0000 00000100:00100000:3.0:1746143681.175815:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 743 00000100:00100000:3.0:1746143681.175822:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963591956992:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143681.176211:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591956992:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 388us (1189us total) trans 21474839606 rc 0/0 00000100:00100000:3.0:1746143681.176217:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 743 00002000:00100000:3.0:1746143681.176223:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2887680->2899967) req@ffff88009bfe0000 x1830963591956992/t21474839606(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 12776/448 e 0 to 0 dl 1746143692 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.176230:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0000 with x1830963591956992 ext(2887680->2899967) 00010000:00010000:3.0:1746143681.176234:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 23 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.176248:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 23 pid: 8495 timeout: 860 lvb_type: 0 00002000:00010000:3.0:1746143681.176254:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe0000 00000100:00100000:0.0:1746143681.176617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.176676:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591957120 00000100:00100000:2.0:1746143681.176681:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591957120 00000100:00100000:2.0:1746143681.176707:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8974 00000100:00100000:2.0:1746143681.176712:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1962:x1830963591957120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.176723:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.176734:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0383a00/0xe984082ccd723d79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a06e4 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143681.176773:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593629184:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143681.176977:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.178620:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.178649:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593629184:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143681.178657:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143681.178670:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0383a00/0xe984082ccd723d79 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06e4 expref: 24 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.178681:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0383a00/0xe984082ccd723d79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06e4 expref: 24 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.178694:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0383a00, rc 0) 00000100:00100000:3.0:1746143681.178715:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591957504 00000100:00100000:3.0:1746143681.178719:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591957504 00000100:00100000:2.0:1746143681.178721:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1962:x1830963591957120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2008us (2105us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143681.178727:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8974 00010000:00010000:3.0:1746143681.178741:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 23 pid: 8495 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746143681.178757:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4558 00000100:00100000:3.0:1746143681.178763:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591957504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143681.178805:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591957376 00000100:00100000:1.0:1746143681.178809:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591957376 00000100:00100000:1.0:1746143681.178840:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3266 00000100:00100000:1.0:1746143681.178845:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28005:x1830963591957376:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143681.178992:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28005:x1830963591957376:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 146us (334us total) trans 8589942183 rc 0/0 00000100:00100000:1.0:1746143681.178998:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3266 00010000:00010000:3.0:1746143681.179305:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143681.179316:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 23 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.179326:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 23 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.179340:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0382200/0xe984082ccd723d1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2887680->2899967) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06a5 expref: 23 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.179356:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.179358:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.179364:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.179376:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.179398:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143681.179408:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593629312:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143681.179463:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.182985:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.183010:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591957760 00000100:00100000:1.0:1746143681.183018:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591957760 00000100:00100000:3.0:1746143681.183036:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593629312:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143681.183052:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746143681.183053:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3264512->3268607) req@ffff880091717b80 x1830963591957760/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.183061:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091717b80 with x1830963591957760 ext(3264512->3268607) 00002000:00010000:1.0:1746143681.183065:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091717b80 00000100:00100000:1.0:1746143681.183094:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3131 00000100:00100000:1.0:1746143681.183100:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963591957760:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143681.183101:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591957504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4337us (4484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.183109:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4558 00000100:00100000:1.0:1746143681.183409:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963591957760:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 308us (431us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143681.183414:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3131 00002000:00100000:1.0:1746143681.183418:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3264512->3268607) req@ffff880091717b80 x1830963591957760/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.183424:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091717b80 with x1830963591957760 ext(3264512->3268607) 00002000:00010000:1.0:1746143681.183427:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091717b80 00000100:00100000:0.0:1746143681.184117:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.184199:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591958016 00000100:00100000:2.0:1746143681.184204:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591958016 00000100:00100000:2.0:1746143681.184236:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3267 00000100:00100000:2.0:1746143681.184242:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+11:27999:x1830963591958016:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143681.184375:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:27999:x1830963591958016:12345-192.168.202.48@tcp:35:cat.0 Request processed in 132us (258us total) trans 8589942184 rc 0/0 00000100:00100000:2.0:1746143681.184381:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3267 00000100:00100000:2.0:1746143681.189623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.189707:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591958272 00000100:00100000:1.0:1746143681.189716:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591958272 00002000:00100000:1.0:1746143681.189754:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3403776->3407871) req@ffff88012f184e00 x1830963591958272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.189767:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f184e00 with x1830963591958272 ext(3403776->3407871) 00002000:00010000:1.0:1746143681.189772:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f184e00 00000100:00100000:1.0:1746143681.189791:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3132 00000100:00100000:1.0:1746143681.189798:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963591958272:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143681.189949:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963591958272:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 151us (334us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143681.189955:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3132 00002000:00100000:1.0:1746143681.189971:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3403776->3407871) req@ffff88012f184e00 x1830963591958272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.189978:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f184e00 with x1830963591958272 ext(3403776->3407871) 00002000:00010000:1.0:1746143681.189980:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f184e00 00000100:00100000:0.0:1746143681.192097:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.192187:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591958528 00000100:00100000:1.0:1746143681.192193:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591958528 00000100:00100000:1.0:1746143681.192233:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3268 00000100:00100000:1.0:1746143681.192239:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009498e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28007:x1830963591958528:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143681.192411:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009498e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28007:x1830963591958528:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 171us (319us total) trans 8589942185 rc 0/0 00000100:00100000:1.0:1746143681.192446:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3268 00000100:00100000:0.0:1746143681.305244:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.305312:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591958784 00000100:00100000:3.0:1746143681.305320:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591958784 00000100:00100000:3.0:1746143681.305371:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8133 00000100:00100000:3.0:1746143681.305380:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28017:x1830963591958784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143681.305400:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143681.305416:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723d80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a06eb expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.305508:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723d87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305518:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723d87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305528:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723d87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305540:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbe00/0xe984082ccd723d8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305545:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbe00/0xe984082ccd723d8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305549:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbe00/0xe984082ccd723d8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305637:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbc00/0xe984082ccd723d95 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305644:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbc00/0xe984082ccd723d95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305649:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbc00/0xe984082ccd723d95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143681.305656:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143681.305722:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723d87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305727:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723d87 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305732:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723d87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305737:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd1b200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.305740:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723d87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305745:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723d87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305754:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143681.305756:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143681.305759:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723d87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305763:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723d87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305794:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbe00/0xe984082ccd723d8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305798:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbe00/0xe984082ccd723d8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305801:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbe00/0xe984082ccd723d8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305805:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094cfbe00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.305806:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbe00/0xe984082ccd723d8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305810:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbe00/0xe984082ccd723d8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305816:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f0f2200) 00010000:00010000:3.0:1746143681.305818:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143681.305819:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbe00/0xe984082ccd723d8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305823:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbe00/0xe984082ccd723d8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.305852:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723d80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06eb expref: 248 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.305861:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbc00/0xe984082ccd723d95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06eb expref: 247 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.305866:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143681.305868:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143681.305869:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cfbc00, rc 0) 00000100:00100000:3.0:1746143681.309659:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:28017:x1830963591958784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4270us (4411us total) trans 8589942186 rc 0/0 00000100:00100000:3.0:1746143681.309669:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8133 00000100:00100000:0.0:1746143681.315950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.318224:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591959040 00000100:00100000:3.0:1746143681.318235:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591959040 00000100:00100000:3.0:1746143681.318279:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8134 00000100:00100000:3.0:1746143681.318285:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28020:x1830963591959040:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143681.318306:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143681.318321:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723da3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a06f2 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.318430:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723daa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318441:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723daa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318450:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723daa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318464:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a200/0xe984082ccd723db1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318469:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a200/0xe984082ccd723db1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318474:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a200/0xe984082ccd723db1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318553:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723db8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318559:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723db8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318564:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723db8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143681.318570:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143681.318638:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723daa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318644:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723daa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318649:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723daa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318654:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd1b200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.318657:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723daa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318662:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723daa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318672:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143681.318674:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143681.318677:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723daa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318681:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b200/0xe984082ccd723daa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318707:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a200/0xe984082ccd723db1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318712:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a200/0xe984082ccd723db1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318716:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a200/0xe984082ccd723db1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318720:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd1a200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.318722:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a200/0xe984082ccd723db1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318727:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a200/0xe984082ccd723db1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318733:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f0f2500) 00010000:00010000:3.0:1746143681.318735:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143681.318737:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a200/0xe984082ccd723db1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318741:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1a200/0xe984082ccd723db1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143681.318770:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1ae00/0xe984082ccd723da3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06f2 expref: 15 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.318781:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723db8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06f2 expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.318786:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143681.318788:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143681.318790:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d6c00, rc 0) 00000100:00100000:3.0:1746143681.318830:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28020:x1830963591959040:12345-192.168.202.48@tcp:101:cat.0 Request processed in 545us (2886us total) trans 8589942187 rc 0/0 00000100:00100000:3.0:1746143681.318836:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8134 00000100:00100000:0.0:1746143681.326981:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.327047:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591959168 00000100:00100000:2.0:1746143681.327056:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591959168 00000100:00100000:2.0:1746143681.327108:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8975 00000100:00100000:2.0:1746143681.327115:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591959168:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.327132:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.327177:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0383400/0xe984082ccd723dc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a06f9 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143681.327220:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593629440:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143681.327298:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143681.327561:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.327569:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.327595:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591959552 00000100:00100000:0.0:1746143681.327598:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591959552 00000100:00100000:2.0:1746143681.327606:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591959680 00000100:00100000:2.0:1746143681.327610:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591959680 00000100:00100000:0.0:1746143681.327622:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8135 00000100:00100000:0.0:1746143681.327627:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:28019:x1830963591959552:12345-192.168.202.48@tcp:101:multiop.0 00002000:00100000:2.0:1746143681.327633:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880093503100 x1830963591959680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746143681.327639:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746143681.327642:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503100 with x1830963591959680 ext(0->1048575) 00002000:00010000:2.0:1746143681.327646:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093503100 00010000:00010000:0.0:1746143681.327648:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4d000/0xe984082ccd723dcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0700 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143681.327657:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3133 00000100:00100000:2.0:1746143681.327662:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963591959680:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:0.0:1746143681.327714:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.327725:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbc00/0xe984082ccd723d95 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06eb expref: 248 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.327737:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723db8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06f2 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.327743:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.327760:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723db8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06f2 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.327769:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723db8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06f2 expref: 13 pid: 14763 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746143681.327777:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593629568:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143681.327812:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbc00/0xe984082ccd723d95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06eb expref: 248 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.327819:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbc00/0xe984082ccd723d95 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06eb expref: 248 pid: 14763 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746143681.327826:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593629696:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143681.327839:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.327866:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.327896:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591960064 00000100:00100000:2.0:1746143681.327900:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591960064 00002000:00100000:2.0:1746143681.327915:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008f1eed80 x1830963591960064/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.327921:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eed80 with x1830963591960064 ext(1048576->2097151) 00002000:00010000:2.0:1746143681.327925:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1eed80 00000100:00100000:2.0:1746143681.327936:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3134 00000100:00100000:2.0:1746143681.327940:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963591960064:12345-192.168.202.48@tcp:3:cat.0 00002000:00010000:3.0:1746143681.329435:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143680 -> 1746143681 00000100:00100000:3.0:1746143681.329449:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593629440:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143681.329467:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0383400/0xe984082ccd723dc6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06f9 expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143681.329476:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0383400/0xe984082ccd723dc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06f9 expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143681.329489:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0383400, rc 0) 00000100:00100000:3.0:1746143681.329518:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591959168:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2403us (2543us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143681.329524:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8975 00000100:00100000:1.0:1746143681.329598:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593629568:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143681.329607:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593629696:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143681.329621:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143681.331418:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.331440:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591960192 00000100:00100000:1.0:1746143681.331446:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591960192 00002000:00100000:1.0:1746143681.331474:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800930ddf80 x1830963591960192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.331483:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ddf80 with x1830963591960192 ext(1048576->2097151) 00002000:00010000:1.0:1746143681.331487:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930ddf80 00000100:00100000:1.0:1746143681.331502:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3135 00000100:00100000:1.0:1746143681.331508:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963591960192:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143681.332249:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.332266:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591960448 00000100:00100000:3.0:1746143681.332269:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591960448 00010000:00010000:3.0:1746143681.332288:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723db8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06f2 expref: 14 pid: 14763 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746143681.332319:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4559 00000100:00100000:3.0:1746143681.332324:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963591960448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143681.332333:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143681.332338:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723db8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06f2 expref: 14 pid: 14763 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.332348:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723db8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06f2 expref: 14 pid: 14763 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.332363:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6c00/0xe984082ccd723db8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06f2 expref: 14 pid: 14763 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.332375:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143681.332379:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.332387:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.332392:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143681.332421:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963591960448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 96us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.332426:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4559 00000100:00100000:3.0:1746143681.332456:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.332469:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591960576 00000100:00100000:3.0:1746143681.332471:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591960576 00002000:00100000:3.0:1746143681.332485:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094c0e300 x1830963591960576/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.332492:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0e300 with x1830963591960576 ext(1048576->2097151) 00002000:00010000:3.0:1746143681.332496:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0e300 00000100:00100000:3.0:1746143681.332507:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3136 00000100:00100000:3.0:1746143681.332511:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963591960576:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143681.333629:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.333645:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591960704 00000100:00100000:3.0:1746143681.333648:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591960704 00010000:00010000:3.0:1746143681.333664:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbc00/0xe984082ccd723d95 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06eb expref: 249 pid: 14763 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746143681.333681:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4560 00000100:00100000:3.0:1746143681.333686:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1964:x1830963591960704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143681.333693:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143681.333697:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbc00/0xe984082ccd723d95 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06eb expref: 249 pid: 14763 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.333705:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbc00/0xe984082ccd723d95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06eb expref: 249 pid: 14763 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.333717:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cfbc00/0xe984082ccd723d95 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06eb expref: 249 pid: 14763 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.333727:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143681.333730:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.333740:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.333746:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.333761:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143681.333775:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1964:x1830963591960704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 89us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.333780:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4560 00010000:00010000:3.0:1746143681.333842:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.333848:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143681.333864:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143681.333987:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4d000/0xe984082ccd723dcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0700 expref: 249 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.334006:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0700 expref: 248 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.334012:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143681.334014:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143681.334016:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff4cc00, rc 0) 00000100:00100000:3.0:1746143681.334032:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:28019:x1830963591959552:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6405us (6472us total) trans 8589942188 rc 0/0 00000100:00100000:3.0:1746143681.334037:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8135 00000100:00100000:2.0:1746143681.349794:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963591960064:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21845us (21919us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143681.349803:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3134 00002000:00100000:2.0:1746143681.349812:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008f1eed80 x1830963591960064/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.349821:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eed80 with x1830963591960064 ext(1048576->2097151) 00002000:00010000:2.0:1746143681.349827:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1eed80 00000100:00100000:0.0:1746143681.354980:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.355014:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.355026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.355038:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.355049:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591961088 00000100:00100000:3.0:1746143681.355057:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591961088 00002000:00100000:3.0:1746143681.355095:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008f1ef800 x1830963591961088/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.355103:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef800 with x1830963591961088 ext(0->1048575) 00002000:00010000:3.0:1746143681.355108:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ef800 00000100:00100000:3.0:1746143681.355165:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591961216 00000100:00100000:3.0:1746143681.355169:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591961216 00002000:00100000:3.0:1746143681.355182:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008f1eea00 x1830963591961216/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.355188:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eea00 with x1830963591961216 ext(1048576->2097151) 00002000:00010000:3.0:1746143681.355191:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1eea00 00000100:00100000:3.0:1746143681.355202:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591961600 00000100:00100000:3.0:1746143681.355204:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591961600 00002000:00100000:3.0:1746143681.355215:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88008f1efb80 x1830963591961600/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.355222:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1efb80 with x1830963591961600 ext(1048576->2097151) 00002000:00010000:3.0:1746143681.355224:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1efb80 00000100:00100000:3.0:1746143681.355232:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591961472 00000100:00100000:3.0:1746143681.355234:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591961472 00002000:00100000:3.0:1746143681.355243:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008f1edc00 x1830963591961472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.355249:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1edc00 with x1830963591961472 ext(1048576->2097151) 00002000:00010000:3.0:1746143681.355252:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1edc00 00000100:00100000:3.0:1746143681.355262:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3137 00000100:00100000:3.0:1746143681.355269:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591961088:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143681.356821:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1963:x1830963591960576:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24303us (24359us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143681.356828:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3136 00002000:00100000:3.0:1746143681.356835:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094c0e300 x1830963591960576/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.356842:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0e300 with x1830963591960576 ext(1048576->2097151) 00002000:00010000:3.0:1746143681.356846:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0e300 00000100:00100000:3.0:1746143681.356863:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3138 00000100:00100000:3.0:1746143681.356874:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963591961216:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143681.358848:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3139 00000100:00100000:2.0:1746143681.358859:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591961600:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143681.359695:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3140 00000100:00100000:1.0:1746143681.359703:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963591961472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143681.366697:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963591960192:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35178us (35273us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143681.366708:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3135 00002000:00100000:1.0:1746143681.366719:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800930ddf80 x1830963591960192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.366728:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ddf80 with x1830963591960192 ext(1048576->2097151) 00002000:00010000:1.0:1746143681.366734:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930ddf80 00000100:00100000:2.0:1746143681.368320:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963591959680:12345-192.168.202.48@tcp:3:cat.0 Request processed in 40651us (40746us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143681.368329:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3133 00002000:00100000:2.0:1746143681.368336:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880093503100 x1830963591959680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.368345:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503100 with x1830963591959680 ext(0->1048575) 00002000:00010000:2.0:1746143681.368349:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093503100 00000100:00100000:2.0:1746143681.372881:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591961088:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17603us (17899us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143681.372892:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3137 00002000:00100000:2.0:1746143681.372902:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008f1ef800 x1830963591961088/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.372912:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef800 with x1830963591961088 ext(0->1048575) 00002000:00010000:2.0:1746143681.372917:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ef800 00000100:00100000:3.0:1746143681.380195:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591961216:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23317us (25171us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143681.380207:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3138 00002000:00100000:3.0:1746143681.380215:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008f1eea00 x1830963591961216/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.380224:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eea00 with x1830963591961216 ext(1048576->2097151) 00002000:00010000:3.0:1746143681.380228:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1eea00 00000100:00100000:2.0:1746143681.385326:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591961600:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26462us (30290us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143681.385337:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3139 00002000:00100000:2.0:1746143681.385348:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88008f1efb80 x1830963591961600/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.385356:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1efb80 with x1830963591961600 ext(1048576->2097151) 00002000:00010000:2.0:1746143681.385361:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1efb80 00000100:00100000:1.0:1746143681.389299:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591961472:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29577us (34239us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143681.389308:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3140 00002000:00100000:1.0:1746143681.389319:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008f1edc00 x1830963591961472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.389327:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1edc00 with x1830963591961472 ext(1048576->2097151) 00002000:00010000:1.0:1746143681.389332:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1edc00 00000100:00100000:0.0:1746143681.397686:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.397727:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.397749:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.397785:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.397863:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591961984 00000100:00100000:1.0:1746143681.397871:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591961984 00002000:00100000:1.0:1746143681.397911:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f1ee300 x1830963591961984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.397920:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ee300 with x1830963591961984 ext(2097152->3145727) 00002000:00010000:1.0:1746143681.397926:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ee300 00000100:00100000:1.0:1746143681.398231:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591962240 00000100:00100000:2.0:1746143681.398233:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591962496 00000100:00100000:1.0:1746143681.398235:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591962240 00000100:00100000:2.0:1746143681.398237:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591962496 00002000:00100000:1.0:1746143681.398247:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f1ed500 x1830963591962240/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.398253:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ed500 with x1830963591962240 ext(3145728->4194303) 00002000:00010000:1.0:1746143681.398256:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ed500 00002000:00100000:2.0:1746143681.398258:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f1eca80 x1830963591962496/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.398265:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eca80 with x1830963591962496 ext(2097152->3145727) 00000100:00100000:1.0:1746143681.398265:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591962752 00000100:00100000:1.0:1746143681.398267:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591962752 00002000:00010000:2.0:1746143681.398268:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1eca80 00002000:00100000:1.0:1746143681.398276:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f1ee680 x1830963591962752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 504/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143681.398282:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3141 00002000:00100000:1.0:1746143681.398282:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ee680 with x1830963591962752 ext(3145728->4194303) 00002000:00010000:1.0:1746143681.398285:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ee680 00000100:00100000:1.0:1746143681.398294:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3142 00000100:00100000:1.0:1746143681.398299:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963591962240:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143681.399154:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1963:x1830963591961984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143681.399791:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3143 00000100:00100000:3.0:1746143681.399801:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963591962496:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143681.402458:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3144 00000100:00100000:0.0:1746143681.402474:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963591962752:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143681.425247:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.426496:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591963008 00000100:00100000:3.0:1746143681.426506:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591963008 00002000:00100000:3.0:1746143681.426548:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f1ef480 x1830963591963008/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.426558:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef480 with x1830963591963008 ext(2097152->3145727) 00002000:00010000:3.0:1746143681.426564:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ef480 00000100:00100000:3.0:1746143681.426587:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3145 00000100:00100000:3.0:1746143681.426594:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591963008:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143681.426993:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963591962496:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27192us (29240us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143681.427000:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3143 00002000:00100000:2.0:1746143681.427007:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f1eca80 x1830963591962496/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.427013:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eca80 with x1830963591962496 ext(2097152->3145727) 00002000:00010000:2.0:1746143681.427017:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1eca80 00000100:00100000:2.0:1746143681.428418:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.429421:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591963264 00000100:00100000:0.0:1746143681.429429:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591963264 00000100:00100000:0.0:1746143681.429478:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8136 00000100:00100000:0.0:1746143681.429484:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28022:x1830963591963264:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143681.429502:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143681.430221:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161c00/0xe984082ccd723de2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0707 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.430310:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161e00/0xe984082ccd723de9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430321:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161e00/0xe984082ccd723de9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430329:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161e00/0xe984082ccd723de9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430339:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161600/0xe984082ccd723df0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430344:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161600/0xe984082ccd723df0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430349:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161600/0xe984082ccd723df0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430437:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161a00/0xe984082ccd723df7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430445:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161a00/0xe984082ccd723df7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430449:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161a00/0xe984082ccd723df7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:0.0:1746143681.430456:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143681.430523:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161e00/0xe984082ccd723de9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430529:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161e00/0xe984082ccd723de9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430534:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161e00/0xe984082ccd723de9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430538:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b161e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143681.430540:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161e00/0xe984082ccd723de9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430546:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161e00/0xe984082ccd723de9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430554:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143681.430556:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143681.430558:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161e00/0xe984082ccd723de9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430562:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161e00/0xe984082ccd723de9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430589:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161600/0xe984082ccd723df0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430593:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161600/0xe984082ccd723df0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430596:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161600/0xe984082ccd723df0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430599:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b161600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143681.430601:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161600/0xe984082ccd723df0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430605:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161600/0xe984082ccd723df0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430610:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f442100) 00010000:00010000:0.0:1746143681.430612:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143681.430614:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161600/0xe984082ccd723df0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430618:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161600/0xe984082ccd723df0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143681.430649:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161c00/0xe984082ccd723de2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0707 expref: 16 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.430660:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161a00/0xe984082ccd723df7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0707 expref: 15 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.430665:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:0.0:1746143681.430668:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143681.430670:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b161a00, rc 0) 00000100:00100000:0.0:1746143681.430705:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28022:x1830963591963264:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1220us (2289us total) trans 8589942189 rc 0/0 00000100:00100000:0.0:1746143681.430711:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8136 00000100:00100000:2.0:1746143681.437376:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1963:x1830963591961984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 39077us (39689us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143681.437387:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3141 00002000:00100000:2.0:1746143681.437402:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f1ee300 x1830963591961984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.437411:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ee300 with x1830963591961984 ext(2097152->3145727) 00002000:00010000:2.0:1746143681.437417:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ee300 00000100:00100000:2.0:1746143681.439113:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963591962752:12345-192.168.202.48@tcp:3:cat.0 Request processed in 36643us (41323us total) trans 0 rc 905216/905216 00000100:00100000:2.0:1746143681.439126:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3144 00002000:00100000:2.0:1746143681.439133:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f1ee680 x1830963591962752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 504/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 905216/905216 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.439162:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ee680 with x1830963591962752 ext(3145728->4194303) 00002000:00010000:2.0:1746143681.439166:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ee680 00000100:00100000:1.0:1746143681.439910:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963591962240:12345-192.168.202.48@tcp:3:cat.0 Request processed in 41609us (42181us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143681.439916:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3142 00002000:00100000:1.0:1746143681.439921:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f1ed500 x1830963591962240/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.439928:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ed500 with x1830963591962240 ext(3145728->4194303) 00002000:00010000:1.0:1746143681.439931:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ed500 00000100:00100000:3.0:1746143681.445010:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591963008:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18408us (19763us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143681.445020:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3145 00002000:00100000:3.0:1746143681.445029:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f1ef480 x1830963591963008/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.445038:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef480 with x1830963591963008 ext(2097152->3145727) 00002000:00010000:3.0:1746143681.445043:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ef480 00000100:00100000:0.0:1746143681.453628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.453671:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.453714:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.453741:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591963392 00000100:00100000:2.0:1746143681.453749:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591963392 00000100:00100000:2.0:1746143681.453791:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591963520 00000100:00100000:2.0:1746143681.453797:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591963520 00000100:00100000:3.0:1746143681.453799:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591963648 00000100:00100000:3.0:1746143681.453802:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591963648 00000100:00100000:2.0:1746143681.453815:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8976 00000100:00100000:2.0:1746143681.453915:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:28019:x1830963591963392:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:3.0:1746143681.453941:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8977 00000100:00100000:3.0:1746143681.453947:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28020:x1830963591963520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.453952:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143681.453953:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143681.453975:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0715 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.453975:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a070e expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.453999:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.453999:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0242400/0xe984082ccd723ce6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a066d expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.454006:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143681.454006:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.454008:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143681.454011:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.454011:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.454012:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.454015:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2691072->3145727] (req 2691072->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 35 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.454036:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.454036:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.454046:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 30 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.454046:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 35 pid: 9527 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746143681.454056:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593629952:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143681.454056:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593629824:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143681.454116:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8978 00000100:00100000:0.0:1746143681.454123:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28022:x1830963591963648:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143681.454130:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143681.454137:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a071c expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.454177:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0382e00/0xe984082ccd723d09 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0682 expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.454183:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0383e00/0xe984082ccd723d64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06cf expref: 25 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.454188:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.454189:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.454191:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1597440->1814527] (req 1597440->1814527) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.454205:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0383e00/0xe984082ccd723d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06cf expref: 25 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.454216:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0383e00/0xe984082ccd723d64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06cf expref: 25 pid: 25369 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746143681.454223:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593630080:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143681.454762:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0242400/0xe984082ccd723ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a066d expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.454770:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0242400/0xe984082ccd723ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a066d expref: 21 pid: 21542 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.454783:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593630208:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143681.454942:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783000 going to sleep for 11 seconds 00010000:00010000:1.0:1746143681.455616:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0382e00/0xe984082ccd723d09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0682 expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.455626:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0382e00/0xe984082ccd723d09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0682 expref: 30 pid: 4582 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746143681.455639:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593630336:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143681.456051:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143681.456052:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143681.459770:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593629952:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143681.459796:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.459809:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f200, rc 0) 00000100:00100000:0.0:1746143681.459885:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f185180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593629824:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143681.459924:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28020:x1830963591963520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5976us (6251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.459931:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8977 00000100:00100000:2.0:1746143681.460106:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.460135:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.460256:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593630208:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143681.460257:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591963776 00000100:00100000:3.0:1746143681.460263:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591963776 00010000:00010000:0.0:1746143681.460275:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2691072->3145727] (req 2691072->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 35 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.460283:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe6d200, rc 0) 00002000:00100000:3.0:1746143681.460293:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3264512->3407871) req@ffff88008f7c2d80 x1830963591963776/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.460301:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c2d80 with x1830963591963776 ext(3264512->3407871) 00000100:00100000:0.0:1746143681.460303:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28019:x1830963591963392:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6482us (6682us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143681.460307:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 31 pid: 12618 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746143681.460308:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8976 00010000:00010000:3.0:1746143681.460320:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 31 pid: 12618 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746143681.460324:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591964032 00002000:00010000:3.0:1746143681.460325:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f7c2d80 00000100:00100000:0.0:1746143681.460326:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591964032 00000100:00100000:3.0:1746143681.460337:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 744 00002000:00100000:0.0:1746143681.460339:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4894719) req@ffff88008f7c1500 x1830963591964032/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143681.460342:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963591963776:12345-192.168.202.48@tcp:4:cat.0 00002000:00100000:0.0:1746143681.460346:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c1500 with x1830963591964032 ext(4194304->4894719) 00010000:00010000:0.0:1746143681.460349:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 35 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746143681.460355:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 35 pid: 9527 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746143681.460363:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7c1500 00000100:00100000:0.0:1746143681.460372:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 745 00000100:00100000:0.0:1746143681.460376:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591964032:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143681.460566:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593630080:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143681.460574:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593630336:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143681.460587:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1597440->1814527] (req 1597440->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.460595:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b160200, rc 0) 00000100:00100000:3.0:1746143681.460608:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28022:x1830963591963648:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6487us (6894us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.460613:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8978 00000100:00100000:0.0:1746143681.465101:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.466098:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.466120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.466168:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591964288 00000100:00100000:0.0:1746143681.466175:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591964288 00010000:00010000:0.0:1746143681.466203:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0242400/0xe984082ccd723ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a066d expref: 22 pid: 21542 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746143681.466222:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591964160 00000100:00100000:0.0:1746143681.466224:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591964160 00010000:00010000:0.0:1746143681.466233:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0383e00/0xe984082ccd723d64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06cf expref: 24 pid: 25369 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746143681.466243:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591964416 00000100:00100000:0.0:1746143681.466244:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591964416 00010000:00010000:0.0:1746143681.466250:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0382e00/0xe984082ccd723d09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0682 expref: 33 pid: 4582 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746143681.466261:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4561 00000100:00100000:0.0:1746143681.466267:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963591964288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143681.466276:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143681.466289:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0242400/0xe984082ccd723ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a066d expref: 22 pid: 21542 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746143681.466302:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0242400/0xe984082ccd723ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a066d expref: 22 pid: 21542 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746143681.466320:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0242400/0xe984082ccd723ce6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a066d expref: 22 pid: 21542 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746143681.466341:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143681.466372:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963591964288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 105us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.466379:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4562 00000100:00100000:0.0:1746143681.466384:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4561 00000100:00100000:3.0:1746143681.466385:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963591964160:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143681.466392:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143681.466404:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0383e00/0xe984082ccd723d64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06cf expref: 24 pid: 25369 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746143681.466405:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4563 00000100:00100000:0.0:1746143681.466409:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963591964416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143681.466412:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0383e00/0xe984082ccd723d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06cf expref: 24 pid: 25369 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746143681.466415:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143681.466420:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0382e00/0xe984082ccd723d09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0682 expref: 33 pid: 4582 timeout: 860 lvb_type: 1 00010000:00010000:3.0:1746143681.466424:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0383e00/0xe984082ccd723d64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06cf expref: 24 pid: 25369 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746143681.466427:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0382e00/0xe984082ccd723d09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0682 expref: 33 pid: 4582 timeout: 860 lvb_type: 1 00010000:00010000:3.0:1746143681.466437:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.466437:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0382e00/0xe984082ccd723d09 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0682 expref: 33 pid: 4582 timeout: 860 lvb_type: 1 00010000:00010000:3.0:1746143681.466439:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.466444:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 23 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.467112:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 23 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.467331:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143681.467350:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963591964416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 940us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143681.467358:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4563 00010000:00010000:3.0:1746143681.467425:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 23 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143681.467436:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593630464:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143681.467480:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143681.467774:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963591963776:12345-192.168.202.48@tcp:4:cat.0 Request processed in 7430us (7668us total) trans 21474839607 rc 0/0 00000100:00100000:2.0:1746143681.467782:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 744 00002000:00100000:2.0:1746143681.467789:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3264512->3407871) req@ffff88008f7c2d80 x1830963591963776/t21474839607(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/448 e 0 to 0 dl 1746143692 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.467798:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c2d80 with x1830963591963776 ext(3264512->3407871) 00010000:00010000:2.0:1746143681.467803:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 32 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.467812:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 32 pid: 12618 timeout: 860 lvb_type: 0 00002000:00010000:2.0:1746143681.467817:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f7c2d80 00000100:00100000:0.0:1746143681.468547:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591964032:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8167us (8408us total) trans 0 rc 700416/700416 00000100:00100000:0.0:1746143681.468553:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 745 00002000:00100000:0.0:1746143681.468558:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4894719) req@ffff88008f7c1500 x1830963591964032/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:H/200/0 rc 700416/700416 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.468564:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c1500 with x1830963591964032 ext(4194304->4894719) 00010000:00010000:0.0:1746143681.468570:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 35 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746143681.468892:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 35 pid: 9527 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746143681.468899:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7c1500 00000100:00100000:0.0:1746143681.470103:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.470197:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593630464:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143681.470212:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143681.470245:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591964160:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3861us (4148us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.470257:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4562 00000100:00100000:1.0:1746143681.470557:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591964672 00000100:00100000:1.0:1746143681.470564:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591964672 00002000:00100000:1.0:1746143681.470590:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34a:0x0] (1597440->1601535) req@ffff8800a0361c00 x1830963591964672/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.470597:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0361c00 with x1830963591964672 ext(1597440->1601535) 00002000:00010000:1.0:1746143681.470601:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0361c00 00000100:00100000:1.0:1746143681.470622:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3146 00000100:00100000:1.0:1746143681.470627:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591964672:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143681.470921:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591964672:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 293us (819us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143681.470927:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3146 00002000:00100000:1.0:1746143681.470932:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34a:0x0] (1597440->1601535) req@ffff8800a0361c00 x1830963591964672/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.470938:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0361c00 with x1830963591964672 ext(1597440->1601535) 00002000:00010000:1.0:1746143681.470940:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0361c00 00000100:00100000:0.0:1746143681.473897:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.473932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.473942:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591964800 00000100:00100000:3.0:1746143681.473949:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591964800 00000100:00100000:0.0:1746143681.473966:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143681.473986:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 32 pid: 12618 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746143681.474017:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4564 00000100:00100000:3.0:1746143681.474024:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963591964800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143681.474035:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143681.474044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143681.474054:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 32 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.474064:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 32 pid: 12618 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.474096:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591964928 00000100:00100000:1.0:1746143681.474099:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591964928 00000100:00100000:1.0:1746143681.474118:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591965056 00000100:00100000:1.0:1746143681.474119:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591965056 00000100:00100000:1.0:1746143681.474128:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591965184 00000100:00100000:1.0:1746143681.474130:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591965184 00000100:00100000:2.0:1746143681.474463:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8979 00000100:00100000:2.0:1746143681.474471:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591964928:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.474487:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.474499:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723e1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0723 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143681.474534:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593630592:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143681.474601:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746143681.474661:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0243e00/0xe984082ccd723d4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3264512->3407871) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06ba expref: 35 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.474677:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.474682:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.474689:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.474696:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.474716:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143681.474723:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593630720:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143681.474744:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d25c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143681.474761:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8980 00000100:00100000:3.0:1746143681.474766:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591965056:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143681.474774:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143681.474782:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094cfbe00/0xe984082ccd723e21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a072a expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.474793:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.474799:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094cfbe00/0xe984082ccd723e21 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a072a expref: 36 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143681.474806:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094cfbe00/0xe984082ccd723e21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a072a expref: 36 pid: 25369 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143681.474809:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8981 00010000:00010000:3.0:1746143681.474814:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cfbe00, rc 0) 00000100:00100000:0.0:1746143681.474818:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591965184:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143681.474825:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143681.474832:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591965056:12345-192.168.202.48@tcp:101:cat.0 Request processed in 65us (874us total) trans 0 rc 301/301 00010000:00010000:0.0:1746143681.474832:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b161000/0xe984082ccd723e28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0731 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143681.474837:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8980 00010000:00010000:0.0:1746143681.474848:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.474849:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.474853:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b161000/0xe984082ccd723e28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0731 expref: 35 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.474863:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b161000/0xe984082ccd723e28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0731 expref: 35 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.474869:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b161000, rc 0) 00000100:00100000:0.0:1746143681.474888:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591965184:12345-192.168.202.48@tcp:101:cat.0 Request processed in 72us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143681.474893:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8981 00000100:00100000:0.0:1746143681.475100:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.475190:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591965440 00000100:00100000:1.0:1746143681.475194:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591965440 00002000:00100000:1.0:1746143681.475214:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34a:0x0] (1810432->1814527) req@ffff8800a0363480 x1830963591965440/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.475222:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0363480 with x1830963591965440 ext(1810432->1814527) 00002000:00010000:1.0:1746143681.475225:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0363480 00000100:00100000:1.0:1746143681.475247:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3147 00000100:00100000:1.0:1746143681.475252:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1962:x1830963591965440:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143681.475367:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1962:x1830963591965440:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 114us (267us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143681.475372:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3147 00002000:00100000:1.0:1746143681.475376:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34a:0x0] (1810432->1814527) req@ffff8800a0363480 x1830963591965440/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.475382:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0363480 with x1830963591965440 ext(1810432->1814527) 00002000:00010000:1.0:1746143681.475385:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0363480 00002000:00010000:2.0:1746143681.477540:0:12618:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime: 1746143680 -> 1746143681 00002000:00010000:2.0:1746143681.477545:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143679 -> 1746143681 00002000:00010000:2.0:1746143681.477547:0:12618:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime: 1746143680 -> 1746143681 00000100:00100000:2.0:1746143681.477563:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593630592:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143681.477585:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723e1a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0723 expref: 34 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.477596:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723e1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0723 expref: 34 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.477615:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cbc600, rc 0) 00000100:00100000:2.0:1746143681.477803:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963591964928:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3331us (3868us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143681.477810:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8979 00000100:00100000:2.0:1746143681.478259:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.478361:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591965568 00000100:00100000:3.0:1746143681.478366:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591965568 00010000:00010000:3.0:1746143681.478386:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 35 pid: 9527 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746143681.478404:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4565 00000100:00100000:3.0:1746143681.478408:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963591965568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143681.478417:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143681.478429:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 35 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.478442:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 35 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.478455:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723d48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06b3 expref: 35 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.478465:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.478467:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.478472:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.478478:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.478503:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143681.478514:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593630848:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143681.478968:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d25cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143681.479029:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593630720:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143681.479040:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.479058:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963591964800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5035us (5168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.479064:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4564 00000100:00100000:0.0:1746143681.480291:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.480330:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591965824 00000100:00100000:1.0:1746143681.480335:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591965824 00000100:00100000:1.0:1746143681.480389:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3269 00000100:00100000:1.0:1746143681.480395:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28022:x1830963591965824:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143681.481779:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28022:x1830963591965824:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 1382us (1487us total) trans 8589942190 rc 0/0 00000100:00100000:1.0:1746143681.481786:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3269 00000100:00100000:3.0:1746143681.482098:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593630848:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143681.482111:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143681.482163:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591965568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3753us (3904us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.482169:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4565 00000100:00100000:0.0:1746143681.482643:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.483005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.483060:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591966080 00000100:00100000:2.0:1746143681.483066:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591966080 00000100:00100000:2.0:1746143681.483092:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8982 00000100:00100000:2.0:1746143681.483099:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963591966080:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.483113:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.483126:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cbd600/0xe984082ccd723e2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0738 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143681.483183:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593630976:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143681.483237:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143681.483279:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591966208 00000100:00100000:1.0:1746143681.483283:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591966208 00002000:00100000:1.0:1746143681.483303:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (2691072->2695167) req@ffff8800a0362d80 x1830963591966208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.483311:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0362d80 with x1830963591966208 ext(2691072->2695167) 00002000:00010000:1.0:1746143681.483314:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0362d80 00000100:00100000:1.0:1746143681.483324:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3148 00000100:00100000:1.0:1746143681.483328:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963591966208:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143681.483454:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963591966208:12345-192.168.202.48@tcp:3:cat.0 Request processed in 124us (448us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143681.483460:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3148 00002000:00100000:1.0:1746143681.483464:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (2691072->2695167) req@ffff8800a0362d80 x1830963591966208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.483470:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0362d80 with x1830963591966208 ext(2691072->2695167) 00002000:00010000:1.0:1746143681.483473:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0362d80 00000100:00100000:0.0:1746143681.483687:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.483995:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591966464 00000100:00100000:2.0:1746143681.483999:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591966464 00002000:00100000:2.0:1746143681.484015:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a0360380 x1830963591966464/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.484023:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360380 with x1830963591966464 ext(2097152->3145727) 00002000:00010000:2.0:1746143681.484026:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0360380 00000100:00100000:2.0:1746143681.484049:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3149 00000100:00100000:2.0:1746143681.484054:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963591966464:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143681.488813:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593630976:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143681.488845:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cbd600/0xe984082ccd723e2f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0738 expref: 33 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.488857:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cbd600/0xe984082ccd723e2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0738 expref: 33 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.488870:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cbd600, rc 0) 00000100:00100000:2.0:1746143681.488902:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963591966080:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5803us (6259us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143681.488908:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8982 00000100:00100000:1.0:1746143681.491496:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.491601:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591966592 00000100:00100000:3.0:1746143681.491609:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591966592 00000100:00100000:3.0:1746143681.491656:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8983 00000100:00100000:3.0:1746143681.491662:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:28019:x1830963591966592:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143681.491678:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143681.491692:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a073f expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.491717:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.491725:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b161000/0xe984082ccd723e28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0731 expref: 33 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143681.491731:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.491732:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.491735:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 33 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.491760:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b161000/0xe984082ccd723e28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0731 expref: 33 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143681.491770:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b161000/0xe984082ccd723e28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0731 expref: 33 pid: 8496 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746143681.491780:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593631104:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143681.491838:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.491849:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 24 pid: 25369 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746143681.491856:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593631232:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143681.491869:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d25cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.498495:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.498576:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.498795:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591966976 00000100:00100000:1.0:1746143681.498802:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591966976 00002000:00100000:1.0:1746143681.498836:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff8800a0360a80 x1830963591966976/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.498844:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360a80 with x1830963591966976 ext(4894720->4898815) 00002000:00010000:1.0:1746143681.498848:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0360a80 00000100:00100000:1.0:1746143681.498866:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3150 00000100:00100000:1.0:1746143681.498871:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591966976:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143681.499021:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591966976:12345-192.168.202.48@tcp:3:cat.0 Request processed in 149us (444us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143681.499027:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3150 00002000:00100000:1.0:1746143681.499032:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff8800a0360a80 x1830963591966976/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.499037:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360a80 with x1830963591966976 ext(4894720->4898815) 00002000:00010000:1.0:1746143681.499039:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0360a80 00000100:00100000:2.0:1746143681.499123:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963591966464:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 15066us (15433us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143681.499129:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3149 00002000:00100000:2.0:1746143681.499136:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a0360380 x1830963591966464/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.499156:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360380 with x1830963591966464 ext(2097152->3145727) 00010000:00010000:2.0:1746143681.499163:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 23 pid: 25369 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.499174:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 23 pid: 25369 timeout: 860 lvb_type: 0 00002000:00010000:2.0:1746143681.499180:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0360380 00000100:00100000:0.0:1746143681.499803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.499860:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591967104 00000100:00100000:1.0:1746143681.499864:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591967104 00000100:00100000:1.0:1746143681.499883:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8984 00000100:00100000:1.0:1746143681.499887:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28020:x1830963591967104:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143681.499895:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.499906:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a64de000/0xe984082ccd723e3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0746 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.499923:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 33 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.499929:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143681.499930:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143681.499933:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a64de000/0xe984082ccd723e3d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0746 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.499955:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 33 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.499972:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 33 pid: 8495 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.499986:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593631360:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143681.500037:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e3480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143681.500435:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591966720 00000100:00100000:2.0:1746143681.500439:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591966720 00010000:00010000:2.0:1746143681.500457:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b161000/0xe984082ccd723e28 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0731 expref: 34 pid: 8496 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.500474:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4566 00000100:00100000:2.0:1746143681.500478:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591966720:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.500486:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.500501:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b161000/0xe984082ccd723e28 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0731 expref: 34 pid: 8496 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.500508:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b161000/0xe984082ccd723e28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0731 expref: 34 pid: 8496 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.500527:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.500562:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591966720:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 83us (2075us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.500568:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4566 00010000:00010000:2.0:1746143681.500601:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b161000/0xe984082ccd723e28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0731 expref: 33 pid: 8496 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.500611:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593631104:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143681.500622:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593631232:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143681.500642:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->2142207] (req 2097152->2142207) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.500650:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d6000, rc 0) 00000100:00100000:2.0:1746143681.500669:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:28019:x1830963591966592:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 9007us (9179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.500679:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8983 00000100:00100000:0.0:1746143681.501759:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.501809:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591967232 00000100:00100000:2.0:1746143681.501814:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591967232 00010000:00010000:2.0:1746143681.501830:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 23 pid: 25369 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.501857:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4567 00000100:00100000:2.0:1746143681.501863:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591967232:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.501871:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.501882:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 23 pid: 25369 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.501890:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 23 pid: 25369 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.501901:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f200/0xe984082ccd723e0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0715 expref: 23 pid: 25369 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.501911:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.501913:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.501918:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.501925:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.501948:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143681.501968:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593631488:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143681.502034:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143681.502923:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593631360:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143681.502943:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a64de000/0xe984082ccd723e3d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0746 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.502954:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64de000, rc 0) 00000100:00100000:1.0:1746143681.503235:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28020:x1830963591967104:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3346us (3432us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.503242:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8984 00000100:00100000:0.0:1746143681.504746:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.504797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.504814:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591967616 00000100:00100000:0.0:1746143681.504819:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591967616 00002000:00100000:0.0:1746143681.504850:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2138112->2142207) req@ffff88012f185180 x1830963591967616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.504867:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185180 with x1830963591967616 ext(2138112->2142207) 00002000:00010000:0.0:1746143681.504872:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185180 00000100:00100000:0.0:1746143681.504888:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591967360 00000100:00100000:0.0:1746143681.504891:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591967360 00000100:00100000:1.0:1746143681.504895:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3151 00002000:00100000:0.0:1746143681.504902:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2691072->3145727) req@ffff880094c13100 x1830963591967360/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.504907:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13100 with x1830963591967360 ext(2691072->3145727) 00010000:00010000:0.0:1746143681.504913:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 34 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746143681.504925:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 34 pid: 8495 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746143681.504930:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c13100 00000100:00100000:2.0:1746143681.504940:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593631488:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143681.504983:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.505013:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591967232:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3150us (3257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.505020:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4567 00000100:00100000:1.0:1746143681.505100:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963591967616:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143681.505257:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 746 00000100:00100000:0.0:1746143681.505263:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591967360:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143681.506235:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963591967616:12345-192.168.202.48@tcp:3:cat.0 Request processed in 1330us (1489us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143681.506241:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3151 00002000:00100000:1.0:1746143681.506248:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2138112->2142207) req@ffff88012f185180 x1830963591967616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.506254:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185180 with x1830963591967616 ext(2138112->2142207) 00002000:00010000:1.0:1746143681.506258:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185180 00000100:00100000:1.0:1746143681.510130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.510498:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591967872 00000100:00100000:0.0:1746143681.510505:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591967872 00000100:00100000:0.0:1746143681.510542:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3270 00000100:00100000:0.0:1746143681.510548:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:28017:x1830963591967872:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1746143681.510725:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:28017:x1830963591967872:12345-192.168.202.48@tcp:35:cat.0 Request processed in 175us (600us total) trans 8589942191 rc 0/0 00000100:00100000:0.0:1746143681.510731:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3270 00000100:00100000:1.0:1746143681.521785:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963591967360:12345-192.168.202.48@tcp:4:cat.0 Request processed in 16512us (16977us total) trans 17179872343 rc 0/0 00000100:00100000:1.0:1746143681.521800:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 746 00002000:00100000:1.0:1746143681.521812:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2691072->3145727) req@ffff880094c13100 x1830963591967360/t17179872343(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/448 e 0 to 0 dl 1746143692 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.521821:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13100 with x1830963591967360 ext(2691072->3145727) 00010000:00010000:1.0:1746143681.521830:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 36 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.521843:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 36 pid: 8495 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746143681.521850:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c13100 00000100:00100000:0.0:1746143681.524900:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.525317:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591968000 00000100:00100000:2.0:1746143681.525325:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591968000 00010000:00010000:2.0:1746143681.525357:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 36 pid: 8495 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.525380:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4568 00000100:00100000:2.0:1746143681.525767:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591968000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.525780:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143681.525797:0:7151:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143680 -> 1746143681 00002000:00010000:2.0:1746143681.525799:0:7151:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143680 -> 1746143681 00002000:00010000:2.0:1746143681.525801:0:7151:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143680 -> 1746143681 00010000:00010000:2.0:1746143681.525806:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 36 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.525817:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 36 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.525835:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe6d200/0xe984082ccd723e05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a070e expref: 36 pid: 8495 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.525860:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.525862:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.525872:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a64de000/0xe984082ccd723e3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0746 expref: 21 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.525879:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a64de000/0xe984082ccd723e3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0746 expref: 21 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.525911:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a64de000/0xe984082ccd723e3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0746 expref: 21 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143681.525922:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593631616:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143681.526007:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143681.529589:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593631616:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143681.529611:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.529648:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963591968000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3883us (4754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.529657:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4568 00000100:00100000:0.0:1746143681.529838:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.530827:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591968256 00000100:00100000:1.0:1746143681.530834:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591968256 00002000:00100000:1.0:1746143681.530869:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880094c12d80 x1830963591968256/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.530878:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12d80 with x1830963591968256 ext(3145728->4194303) 00002000:00010000:1.0:1746143681.530881:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c12d80 00000100:00100000:1.0:1746143681.530896:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3152 00000100:00100000:1.0:1746143681.530902:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591968256:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143681.540563:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591968256:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 9652us (10717us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143681.540573:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3152 00002000:00100000:1.0:1746143681.540583:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880094c12d80 x1830963591968256/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.540598:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12d80 with x1830963591968256 ext(3145728->4194303) 00002000:00010000:1.0:1746143681.540603:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c12d80 00000100:00100000:0.0:1746143681.546523:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.546583:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591968384 00000100:00100000:1.0:1746143681.546590:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591968384 00000100:00100000:1.0:1746143681.546642:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8985 00000100:00100000:1.0:1746143681.546650:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28020:x1830963591968384:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143681.546666:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.546680:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf9d600/0xe984082ccd723e44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a074d expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.546706:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.546713:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143681.546714:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143681.546717:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf9d600/0xe984082ccd723e44 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a074d expref: 23 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.546743:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.546753:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 31 pid: 12618 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.546764:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e626680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593631744:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143681.546846:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e3480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143681.548883:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e626680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593631744:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143681.548905:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf9d600/0xe984082ccd723e44 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a074d expref: 23 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.548920:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf9d600, rc 0) 00000100:00100000:1.0:1746143681.548954:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28020:x1830963591968384:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2305us (2436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.548970:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8985 00000100:00100000:0.0:1746143681.549238:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.550121:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591968512 00000100:00100000:1.0:1746143681.550128:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591968512 00002000:00100000:1.0:1746143681.550174:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2142207) req@ffff880094c11500 x1830963591968512/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.550182:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11500 with x1830963591968512 ext(2097152->2142207) 00010000:00010000:1.0:1746143681.550188:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 32 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.550197:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 32 pid: 12618 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746143681.550202:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c11500 00000100:00100000:1.0:1746143681.550298:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 747 00000100:00100000:1.0:1746143681.550305:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963591968512:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143681.552758:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591968512:12345-192.168.202.48@tcp:4:cat.0 Request processed in 2448us (3516us total) trans 21474839608 rc 0/0 00000100:00100000:1.0:1746143681.552766:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 747 00002000:00100000:1.0:1746143681.552775:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2142207) req@ffff880094c11500 x1830963591968512/t21474839608(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/448 e 0 to 0 dl 1746143692 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.552783:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11500 with x1830963591968512 ext(2097152->2142207) 00010000:00010000:1.0:1746143681.552791:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 34 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.552802:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 34 pid: 12618 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746143681.552808:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c11500 00000100:00100000:0.0:1746143681.555424:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.555490:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591968640 00000100:00100000:2.0:1746143681.555498:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591968640 00010000:00010000:2.0:1746143681.555526:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 34 pid: 12618 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.555558:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4569 00000100:00100000:2.0:1746143681.555565:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591968640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.555577:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143681.555590:0:7151:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143680 -> 1746143681 00002000:00010000:2.0:1746143681.555592:0:7151:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143680 -> 1746143681 00010000:00010000:2.0:1746143681.555597:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 34 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.555607:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 34 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.555626:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6000/0xe984082ccd723e36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2142207) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a073f expref: 34 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.555652:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.555654:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.555660:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf9d600/0xe984082ccd723e44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a074d expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.555668:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf9d600/0xe984082ccd723e44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a074d expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.555695:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf9d600/0xe984082ccd723e44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a074d expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143681.555705:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593631872:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143681.555772:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143681.558448:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593631872:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143681.558466:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.558494:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963591968640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2929us (3076us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.558503:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4569 00010000:00010000:3.0:1746143681.561686:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143681.562061:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.562275:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591968896 00000100:00100000:2.0:1746143681.562284:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591968896 00002000:00100000:2.0:1746143681.562323:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008e626680 x1830963591968896/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.562337:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e626680 with x1830963591968896 ext(3145728->4194303) 00002000:00010000:2.0:1746143681.562342:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e626680 00000100:00100000:2.0:1746143681.562363:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3153 00000100:00100000:2.0:1746143681.562371:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591968896:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143681.573314:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591968896:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 10933us (11247us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143681.573326:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3153 00002000:00100000:3.0:1746143681.573338:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008e626680 x1830963591968896/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.573346:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e626680 with x1830963591968896 ext(3145728->4194303) 00002000:00010000:3.0:1746143681.573352:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e626680 00000100:00100000:0.0:1746143681.580752:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.580824:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591969152 00000100:00100000:3.0:1746143681.580833:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591969152 00002000:00100000:3.0:1746143681.580869:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094c10a80 x1830963591969152/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.580878:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10a80 with x1830963591969152 ext(4194304->4898815) 00002000:00010000:3.0:1746143681.580882:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10a80 00000100:00100000:3.0:1746143681.580912:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3154 00000100:00100000:3.0:1746143681.580919:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963591969152:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143681.590537:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963591969152:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9609us (9782us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143681.590550:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3154 00002000:00100000:3.0:1746143681.590561:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094c10a80 x1830963591969152/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.590570:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10a80 with x1830963591969152 ext(4194304->4898815) 00002000:00010000:3.0:1746143681.590575:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10a80 00000100:00100000:0.0:1746143681.599645:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.599903:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591969408 00000100:00100000:2.0:1746143681.599911:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591969408 00000100:00100000:0.0:1746143681.601569:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3271 00000100:00100000:0.0:1746143681.601583:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28020:x1830963591969408:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1746143681.601790:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28020:x1830963591969408:12345-192.168.202.48@tcp:35:cat.0 Request processed in 211us (2151us total) trans 8589942192 rc 0/0 00000100:00100000:0.0:1746143681.601796:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3271 00000100:00100000:0.0:1746143681.627704:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.628275:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591969664 00000100:00100000:2.0:1746143681.628283:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591969664 00000100:00100000:2.0:1746143681.628333:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8137 00000100:00100000:2.0:1746143681.628340:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28027:x1830963591969664:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143681.628360:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.628376:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbce00/0xe984082ccd723e4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0754 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.628465:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc000/0xe984082ccd723e52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628477:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc000/0xe984082ccd723e52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628486:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc000/0xe984082ccd723e52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628498:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd000/0xe984082ccd723e59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628504:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd000/0xe984082ccd723e59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628512:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd000/0xe984082ccd723e59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628601:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd200/0xe984082ccd723e60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628609:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd200/0xe984082ccd723e60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628615:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd200/0xe984082ccd723e60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143681.628623:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143681.628691:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc000/0xe984082ccd723e52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628696:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc000/0xe984082ccd723e52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628701:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc000/0xe984082ccd723e52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628706:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cbc000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143681.628709:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc000/0xe984082ccd723e52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628714:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc000/0xe984082ccd723e52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628723:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143681.628726:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143681.628729:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc000/0xe984082ccd723e52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628737:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc000/0xe984082ccd723e52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628765:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd000/0xe984082ccd723e59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628769:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd000/0xe984082ccd723e59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628773:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd000/0xe984082ccd723e59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628777:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cbd000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143681.628779:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd000/0xe984082ccd723e59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628783:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd000/0xe984082ccd723e59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628789:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5ab00) 00010000:00010000:2.0:1746143681.628791:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143681.628793:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd000/0xe984082ccd723e59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628797:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd000/0xe984082ccd723e59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.628826:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbce00/0xe984082ccd723e4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0754 expref: 20 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.628835:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd200/0xe984082ccd723e60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0754 expref: 19 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.628845:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143681.628847:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143681.628849:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cbd200, rc 0) 00000100:00100000:2.0:1746143681.628889:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28027:x1830963591969664:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 548us (1192us total) trans 8589942193 rc 0/0 00000100:00100000:2.0:1746143681.628895:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8137 00000100:00100000:0.0:1746143681.631488:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.631571:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591969792 00000100:00100000:2.0:1746143681.631578:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591969792 00000100:00100000:2.0:1746143681.631629:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 532 00000100:00100000:2.0:1746143681.631636:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963591969792:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.631648:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.631668:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd200/0xe984082ccd723e60 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0754 expref: 19 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.631683:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143681.631686:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.631731:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963591969792:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 95us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.631737:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 532 00000100:00100000:0.0:1746143681.637611:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.638550:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591970048 00000100:00100000:2.0:1746143681.638558:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591970048 00000100:00100000:2.0:1746143681.639317:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8138 00000100:00100000:2.0:1746143681.639328:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:28031:x1830963591970048:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.639351:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.639368:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc200/0xe984082ccd723e6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a075b expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.639462:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723e75 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639473:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723e75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639482:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723e75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639493:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723e7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639498:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639503:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639595:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd400/0xe984082ccd723e83 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639604:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd400/0xe984082ccd723e83 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639609:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd400/0xe984082ccd723e83 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:2.0:1746143681.639616:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143681.639685:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723e75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639691:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723e75 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639699:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723e75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639704:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cbd600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143681.639707:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723e75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639712:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723e75 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639721:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143681.639724:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143681.639726:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723e75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639731:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723e75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639740:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639744:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723e7c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639748:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723e7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639752:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cbc600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143681.639754:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723e7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639758:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723e7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639768:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a800) 00010000:00010000:2.0:1746143681.639769:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143681.639771:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723e7c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639775:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723e7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.639806:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc200/0xe984082ccd723e6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a075b expref: 252 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.639816:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd400/0xe984082ccd723e83 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a075b expref: 251 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.639822:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143681.639824:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143681.639826:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cbd400, rc 0) 00000100:00100000:2.0:1746143681.639884:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:28031:x1830963591970048:12345-192.168.202.48@tcp:101:cat.0 Request processed in 557us (2282us total) trans 8589942194 rc 0/0 00000100:00100000:2.0:1746143681.639890:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8138 00000100:00100000:0.0:1746143681.642916:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.642952:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.643064:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.643089:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591970176 00000100:00100000:0.0:1746143681.643096:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591970176 00000100:00100000:0.0:1746143681.643173:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591970304 00000100:00100000:0.0:1746143681.643175:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591970304 00000100:00100000:0.0:1746143681.643190:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591970432 00000100:00100000:0.0:1746143681.643191:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591970432 00000100:00100000:0.0:1746143681.643214:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8986 00000100:00100000:0.0:1746143681.643220:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963591970176:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143681.643235:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143681.643247:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0xe984082ccd723e91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0762 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143681.643291:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593632000:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143681.643363:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143681.643471:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8987 00000100:00100000:1.0:1746143681.643478:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963591970304:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143681.643486:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.643494:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b15f600/0xe984082ccd723e98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0769 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.643505:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.643506:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.643513:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b15f600/0xe984082ccd723e98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0769 expref: 36 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.643524:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b15f600/0xe984082ccd723e98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0769 expref: 36 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.643531:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15f600, rc 0) 00000100:00100000:1.0:1746143681.643557:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591970304:12345-192.168.202.48@tcp:101:cat.0 Request processed in 79us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.643563:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8987 00000100:00100000:1.0:1746143681.643586:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8988 00000100:00100000:1.0:1746143681.643590:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963591970432:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143681.643596:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.643602:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b15f800/0xe984082ccd723e9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0770 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.643610:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.643612:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.643615:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15f800/0xe984082ccd723e9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0770 expref: 36 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.643624:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b15f800/0xe984082ccd723e9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0770 expref: 36 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.643631:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15f800, rc 0) 00000100:00100000:1.0:1746143681.643645:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591970432:12345-192.168.202.48@tcp:101:cat.0 Request processed in 54us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.643649:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8988 00000100:00100000:2.0:1746143681.646197:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593632000:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143681.646226:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0xe984082ccd723e91 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0762 expref: 35 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.646238:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0f000/0xe984082ccd723e91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0762 expref: 35 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.646252:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0f000, rc 0) 00000100:00100000:2.0:1746143681.646292:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963591970176:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3070us (3382us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143681.646299:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8986 00000100:00100000:0.0:1746143681.661251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.661351:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591970560 00000100:00100000:2.0:1746143681.661359:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591970560 00000100:00100000:2.0:1746143681.661397:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8989 00000100:00100000:2.0:1746143681.661404:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:28031:x1830963591970560:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.661420:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.661435:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cbc400/0xe984082ccd723ea6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0777 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.661458:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.661464:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143681.661465:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143681.661468:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cbc400/0xe984082ccd723ea6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0777 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.661491:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.661501:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 22 pid: 12618 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.661515:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593632128:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143681.663888:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.663924:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143681.663946:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593632128:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143681.663974:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cbc400/0xe984082ccd723ea6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0777 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.663987:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cbc400, rc 0) 00000100:00100000:2.0:1746143681.664021:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28031:x1830963591970560:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2617us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.664029:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8989 00000100:00100000:3.0:1746143681.664117:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591970688 00000100:00100000:3.0:1746143681.664122:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591970688 00002000:00100000:3.0:1746143681.664168:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1597440->1814527) req@ffff880094c11180 x1830963591970688/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.664177:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11180 with x1830963591970688 ext(1597440->1814527) 00010000:00010000:3.0:1746143681.664183:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 23 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.664194:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 23 pid: 12618 timeout: 860 lvb_type: 0 00002000:00010000:3.0:1746143681.664199:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c11180 00000100:00100000:3.0:1746143681.664325:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 748 00000100:00100000:3.0:1746143681.664332:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591970688:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143681.669644:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963591970688:12345-192.168.202.48@tcp:4:cat.0 Request processed in 5305us (5754us total) trans 21474839609 rc 0/0 00000100:00100000:3.0:1746143681.669654:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 748 00002000:00100000:3.0:1746143681.669665:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1597440->1814527) req@ffff880094c11180 x1830963591970688/t21474839609(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/448 e 0 to 0 dl 1746143692 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.669679:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11180 with x1830963591970688 ext(1597440->1814527) 00010000:00010000:3.0:1746143681.669687:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 25 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.669701:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 25 pid: 12618 timeout: 860 lvb_type: 0 00002000:00010000:3.0:1746143681.669707:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c11180 00000100:00100000:0.0:1746143681.676762:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.676890:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591970816 00000100:00100000:2.0:1746143681.676897:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591970816 00010000:00010000:2.0:1746143681.676926:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 25 pid: 12618 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.676946:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4570 00000100:00100000:2.0:1746143681.676951:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963591970816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.676974:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.676991:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 25 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.677001:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 25 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.677025:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b160200/0xe984082ccd723e13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1597440->1814527) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a071c expref: 25 pid: 12618 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.677199:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.677201:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.677209:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cbc400/0xe984082ccd723ea6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0777 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.677216:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cbc400/0xe984082ccd723ea6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0777 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.677245:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130cbc400/0xe984082ccd723ea6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0777 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143681.677255:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593632256:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143681.677323:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.681115:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.681290:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593632256:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143681.681310:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.681345:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1963:x1830963591970816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4393us (4590us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.681354:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4570 00000100:00100000:3.0:1746143681.681430:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591971072 00000100:00100000:3.0:1746143681.681436:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591971072 00002000:00100000:3.0:1746143681.681467:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a0400000 x1830963591971072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.681476:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0400000 with x1830963591971072 ext(1048576->2097151) 00002000:00010000:3.0:1746143681.681480:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0400000 00000100:00100000:3.0:1746143681.681495:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3155 00000100:00100000:3.0:1746143681.681501:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963591971072:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143681.691786:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.691853:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591971200 00000100:00100000:3.0:1746143681.691861:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591971200 00000100:00100000:3.0:1746143681.691910:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8990 00000100:00100000:3.0:1746143681.691917:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28027:x1830963591971200:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143681.691933:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143681.691946:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a077e expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.691978:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0382a00/0xe984082ccd723cfb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0689 expref: 36 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143681.691987:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0383000/0xe984082ccd723d6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06d6 expref: 25 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143681.691992:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.691994:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.691996:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1351680->1810431] (req 1351680->1810431) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 25 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.692018:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0383000/0xe984082ccd723d6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06d6 expref: 25 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143681.692028:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0383000/0xe984082ccd723d6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06d6 expref: 25 pid: 25369 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746143681.692037:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593632384:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143681.692100:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0382a00/0xe984082ccd723cfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0689 expref: 36 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143681.692107:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0382a00/0xe984082ccd723cfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0689 expref: 36 pid: 4582 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746143681.692113:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593632512:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143681.692125:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d25c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143681.696647:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963591971072:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15139us (15533us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143681.696660:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3155 00002000:00100000:3.0:1746143681.696669:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a0400000 x1830963591971072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.696677:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0400000 with x1830963591971072 ext(1048576->2097151) 00002000:00010000:3.0:1746143681.696681:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0400000 00000100:00100000:3.0:1746143681.699858:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593632384:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143681.699869:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593632512:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143681.699892:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1351680->1810431] (req 1351680->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 25 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.699906:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d7000, rc 0) 00000100:00100000:3.0:1746143681.699950:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28027:x1830963591971200:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8032us (8169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.699966:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8990 00000100:00100000:2.0:1746143681.700237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.700317:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.700339:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591971584 00000100:00100000:2.0:1746143681.700345:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591971584 00010000:00010000:2.0:1746143681.700367:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0382a00/0xe984082ccd723cfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0689 expref: 35 pid: 4582 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.700386:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4571 00000100:00100000:2.0:1746143681.700392:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963591971584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.700402:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.700419:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0382a00/0xe984082ccd723cfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0689 expref: 35 pid: 4582 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.700427:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0382a00/0xe984082ccd723cfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0689 expref: 35 pid: 4582 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.700444:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0382a00/0xe984082ccd723cfb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0689 expref: 35 pid: 4582 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.700459:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.700477:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591971584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 85us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.700483:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4571 00000100:00100000:2.0:1746143681.700515:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.700529:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591971328 00000100:00100000:2.0:1746143681.700532:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591971328 00010000:00010000:2.0:1746143681.700543:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0383000/0xe984082ccd723d6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06d6 expref: 25 pid: 25369 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.700557:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4572 00000100:00100000:2.0:1746143681.700561:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963591971328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.700568:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.700575:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0383000/0xe984082ccd723d6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06d6 expref: 25 pid: 25369 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.700583:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0383000/0xe984082ccd723d6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06d6 expref: 25 pid: 25369 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.700594:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0383000/0xe984082ccd723d6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06d6 expref: 25 pid: 25369 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.700602:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.700604:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.700610:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.700617:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.700641:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143681.700650:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593632640:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143681.700700:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143681.701153:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591971456 00000100:00100000:3.0:1746143681.701157:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591971456 00000100:00100000:3.0:1746143681.701174:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8991 00000100:00100000:3.0:1746143681.701178:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:28031:x1830963591971456:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143681.701188:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143681.701196:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6600/0xe984082ccd723eb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0785 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.701208:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.701218:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143681.701219:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143681.701221:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6600/0xe984082ccd723eb4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0785 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.701233:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.701241:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746143681.701247:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593632768:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143681.701588:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d25c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143681.703115:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593632640:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143681.703128:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143681.703193:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591971328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2630us (2676us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.703201:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4572 00000100:00100000:0.0:1746143681.706369:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.706569:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591971840 00000100:00100000:3.0:1746143681.706577:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591971840 00002000:00100000:3.0:1746143681.706615:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1351680->1355775) req@ffff8800a0400700 x1830963591971840/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.706624:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0400700 with x1830963591971840 ext(1351680->1355775) 00010000:00010000:3.0:1746143681.706631:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.706647:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 860 lvb_type: 0 00002000:00010000:3.0:1746143681.706653:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0400700 00000100:00100000:2.0:1746143681.707285:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593632768:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143681.707305:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6600/0xe984082ccd723eb4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0785 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.707322:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d6600, rc 0) 00000100:00100000:2.0:1746143681.707363:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28031:x1830963591971456:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6183us (7127us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.707370:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8991 00000100:00100000:3.0:1746143681.708074:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 749 00000100:00100000:3.0:1746143681.708083:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591971840:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143681.708523:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591971840:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 441us (2161us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143681.708529:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 749 00002000:00100000:3.0:1746143681.708534:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1351680->1355775) req@ffff8800a0400700 x1830963591971840/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.708542:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0400700 with x1830963591971840 ext(1351680->1355775) 00010000:00010000:3.0:1746143681.708547:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.708557:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 860 lvb_type: 0 00002000:00010000:3.0:1746143681.708563:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0400700 00000100:00100000:0.0:1746143681.713560:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.713671:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591972096 00000100:00100000:1.0:1746143681.713679:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591972096 00002000:00100000:1.0:1746143681.713714:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1806336->1810431) req@ffff8800a0400a80 x1830963591972096/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.713723:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0400a80 with x1830963591972096 ext(1806336->1810431) 00010000:00010000:1.0:1746143681.713730:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.713746:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746143681.713752:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0400a80 00000100:00100000:1.0:1746143681.713778:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 750 00000100:00100000:1.0:1746143681.713783:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591972096:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143681.713927:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591972096:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 142us (372us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143681.713932:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 750 00002000:00100000:1.0:1746143681.713936:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1806336->1810431) req@ffff8800a0400a80 x1830963591972096/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.713943:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0400a80 with x1830963591972096 ext(1806336->1810431) 00010000:00010000:1.0:1746143681.713947:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.713962:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746143681.713967:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0400a80 00000100:00100000:0.0:1746143681.717450:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.717613:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591972352 00000100:00100000:3.0:1746143681.717621:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591972352 00002000:00100000:3.0:1746143681.717655:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1351680->1810431) req@ffff8800a0400e00 x1830963591972352/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.717663:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0400e00 with x1830963591972352 ext(1351680->1810431) 00010000:00010000:3.0:1746143681.717671:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.717683:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 24 pid: 9527 timeout: 860 lvb_type: 0 00002000:00010000:3.0:1746143681.717689:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0400e00 00000100:00100000:3.0:1746143681.717719:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 751 00000100:00100000:3.0:1746143681.717725:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1963:x1830963591972352:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143681.725966:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.726807:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591972608 00000100:00100000:3.0:1746143681.726817:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591972608 00000100:00100000:3.0:1746143681.726856:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3272 00000100:00100000:3.0:1746143681.726862:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28027:x1830963591972608:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143681.727098:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28027:x1830963591972608:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 234us (1148us total) trans 8589942195 rc 0/0 00000100:00100000:3.0:1746143681.727104:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3272 00000100:00100000:3.0:1746143681.742410:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1963:x1830963591972352:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 24676us (24958us total) trans 21474839610 rc 0/0 00000100:00100000:3.0:1746143681.742420:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 751 00002000:00100000:3.0:1746143681.742430:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1351680->1810431) req@ffff8800a0400e00 x1830963591972352/t21474839610(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/448 e 0 to 0 dl 1746143692 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.742439:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0400e00 with x1830963591972352 ext(1351680->1810431) 00010000:00010000:3.0:1746143681.742447:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 26 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.742465:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 26 pid: 9527 timeout: 860 lvb_type: 0 00002000:00010000:3.0:1746143681.742470:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0400e00 00000100:00100000:0.0:1746143681.746278:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.746842:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591972736 00000100:00100000:3.0:1746143681.746850:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591972736 00010000:00010000:3.0:1746143681.746881:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 26 pid: 9527 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746143681.746920:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4573 00000100:00100000:3.0:1746143681.746928:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0401500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1962:x1830963591972736:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143681.746939:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143681.746965:0:11106:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143680 -> 1746143681 00002000:00010000:3.0:1746143681.746968:0:11106:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143680 -> 1746143681 00010000:00010000:3.0:1746143681.746973:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 26 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.746983:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 26 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.747002:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7000/0xe984082ccd723ead lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1810431) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a077e expref: 26 pid: 9527 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.747029:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.747030:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143681.747037:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6600/0xe984082ccd723eb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0785 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.747045:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6600/0xe984082ccd723eb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0785 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.747073:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6600/0xe984082ccd723eb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0785 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143681.747082:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593632896:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143681.748227:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d25cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.757815:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.757923:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593632896:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143681.757939:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143681.757986:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0401500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1962:x1830963591972736:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 11057us (11713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.757995:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4573 00000100:00100000:1.0:1746143681.758069:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591972992 00000100:00100000:1.0:1746143681.758074:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591972992 00000100:00100000:0.0:1746143681.759220:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.759269:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8139 00000100:00100000:1.0:1746143681.759278:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:28033:x1830963591972992:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143681.759297:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.759312:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6c00/0xe984082ccd723ebb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a078c expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.759399:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6e00/0xe984082ccd723ec2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759410:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6e00/0xe984082ccd723ec2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759418:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6e00/0xe984082ccd723ec2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759430:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd723ec9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759434:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd723ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759438:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd723ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759528:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723ed0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759536:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759541:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143681.759549:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143681.759623:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6e00/0xe984082ccd723ec2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759629:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6e00/0xe984082ccd723ec2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759635:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6e00/0xe984082ccd723ec2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759639:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffb6e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143681.759642:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6e00/0xe984082ccd723ec2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759648:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6e00/0xe984082ccd723ec2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759657:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143681.759659:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143681.759662:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6e00/0xe984082ccd723ec2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.759667:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6e00/0xe984082ccd723ec2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00000100:00100000:3.0:1746143681.760564:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591973248 00000100:00100000:3.0:1746143681.760571:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591973248 00002000:00100000:3.0:1746143681.760605:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a0401c00 x1830963591973248/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.760614:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0401c00 with x1830963591973248 ext(1048576->2097151) 00002000:00010000:3.0:1746143681.760618:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0401c00 00000100:00100000:3.0:1746143681.760775:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3156 00000100:00100000:3.0:1746143681.760782:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963591973248:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143681.762260:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd723ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.762270:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd723ec9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.762276:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd723ec9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.762280:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffb7000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143681.762284:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd723ec9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.762289:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd723ec9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.762304:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74e00) 00010000:00010000:1.0:1746143681.762306:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143681.762309:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd723ec9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.762313:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd723ec9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.762360:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6c00/0xe984082ccd723ebb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a078c expref: 254 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.762370:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a078c expref: 253 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.762376:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143681.762377:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143681.762379:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffb7200, rc 0) 00000100:00100000:1.0:1746143681.764778:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:28033:x1830963591972992:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5493us (6962us total) trans 8589942196 rc 0/0 00000100:00100000:1.0:1746143681.764788:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8139 00000100:00100000:0.0:1746143681.774390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.774439:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.775038:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591973504 00000100:00100000:1.0:1746143681.775045:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591973504 00000100:00100000:1.0:1746143681.775091:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3273 00000100:00100000:1.0:1746143681.775098:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:28033:x1830963591973504:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143681.775287:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:28033:x1830963591973504:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 189us (904us total) trans 8589942197 rc 0/0 00000100:00100000:1.0:1746143681.775294:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3273 00000100:00100000:3.0:1746143681.775309:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963591973248:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14525us (16090us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143681.775320:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3156 00002000:00100000:3.0:1746143681.775327:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a0401c00 x1830963591973248/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.775336:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0401c00 with x1830963591973248 ext(1048576->2097151) 00002000:00010000:3.0:1746143681.775340:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0401c00 00000100:00100000:2.0:1746143681.775857:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591973632 00000100:00100000:2.0:1746143681.775862:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591973632 00000100:00100000:2.0:1746143681.775901:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 533 00000100:00100000:2.0:1746143681.775907:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0402300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:1964:x1830963591973632:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.775916:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.775933:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723ed0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a078c expref: 254 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.775969:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143681.775973:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.775993:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0402300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:1964:x1830963591973632:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 86us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.776271:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 533 00000100:00100000:0.0:1746143681.798879:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.798992:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591973760 00000100:00100000:1.0:1746143681.799000:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591973760 00000100:00100000:1.0:1746143681.799063:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8140 00000100:00100000:1.0:1746143681.799070:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28035:x1830963591973760:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143681.799089:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.799106:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7600/0xe984082ccd723ede lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0793 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.799187:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7800/0xe984082ccd723ee5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.799197:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7800/0xe984082ccd723ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.799206:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7800/0xe984082ccd723ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.799219:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7a00/0xe984082ccd723eec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.799225:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7a00/0xe984082ccd723eec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.799229:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7a00/0xe984082ccd723eec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.799326:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.799334:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0700 expref: 252 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.799340:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143681.799368:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0700 expref: 252 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.799379:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0700 expref: 252 pid: 14764 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.799388:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e624000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593633024:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143681.801982:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.804556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.804591:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.804633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.804695:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591974016 00000100:00100000:2.0:1746143681.804704:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591974016 00000100:00100000:1.0:1746143681.804705:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591974272 00000100:00100000:1.0:1746143681.804708:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591974272 00002000:00100000:1.0:1746143681.804747:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a0402d80 x1830963591974272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.804756:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0402d80 with x1830963591974272 ext(3145728->4194303) 00002000:00010000:1.0:1746143681.804761:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0402d80 00000100:00100000:1.0:1746143681.804779:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591974528 00000100:00100000:1.0:1746143681.804781:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591974528 00002000:00100000:2.0:1746143681.804791:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a0402a00 x1830963591974016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.804791:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a0403100 x1830963591974528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.804798:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0402a00 with x1830963591974016 ext(2097152->3145727) 00002000:00100000:1.0:1746143681.804798:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0403100 with x1830963591974528 ext(2097152->3145727) 00002000:00010000:2.0:1746143681.804800:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0402a00 00002000:00010000:1.0:1746143681.804800:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0403100 00000100:00100000:1.0:1746143681.804814:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3157 00000100:00100000:2.0:1746143681.804818:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3158 00000100:00100000:1.0:1746143681.804820:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963591974272:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143681.804822:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963591974528:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143681.805134:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3159 00000100:00100000:2.0:1746143681.805735:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963591974016:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143681.809655:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.810610:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e624000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593633024:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143681.810631:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143681.811367:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591974784 00000100:00100000:1.0:1746143681.811373:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591974784 00002000:00100000:1.0:1746143681.811405:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008e627100 x1830963591974784/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.811414:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e627100 with x1830963591974784 ext(3145728->4194303) 00002000:00010000:1.0:1746143681.811418:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e627100 00000100:00100000:1.0:1746143681.811437:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3160 00000100:00100000:1.0:1746143681.811444:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963591974784:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143681.815536:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.816376:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591974912 00000100:00100000:2.0:1746143681.816385:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591974912 00010000:00010000:2.0:1746143681.816419:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0700 expref: 253 pid: 14764 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.816447:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4574 00000100:00100000:2.0:1746143681.816455:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:1965:x1830963591974912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.816467:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.816472:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0700 expref: 253 pid: 14764 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.816482:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0700 expref: 253 pid: 14764 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.816499:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4cc00/0xe984082ccd723dd4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0700 expref: 253 pid: 14764 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.816524:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143681.816528:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.816536:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.816542:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.816562:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.816597:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1965:x1830963591974912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 143us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.816603:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4574 00010000:00010000:3.0:1746143681.818074:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818083:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143681.818122:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:3.0:1746143681.818126:0:14764:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143681.818167:0:14764:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818178:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818186:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7800/0xe984082ccd723ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818191:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7800/0xe984082ccd723ee5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818195:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7800/0xe984082ccd723ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818200:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffb7800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.818204:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7800/0xe984082ccd723ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818210:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7800/0xe984082ccd723ee5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818220:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143681.818222:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143681.818225:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7800/0xe984082ccd723ee5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818228:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7800/0xe984082ccd723ee5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818242:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7a00/0xe984082ccd723eec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818247:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7a00/0xe984082ccd723eec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818251:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7a00/0xe984082ccd723eec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818255:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffb7a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.818257:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7a00/0xe984082ccd723eec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818262:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7a00/0xe984082ccd723eec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818267:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74700) 00010000:00010000:3.0:1746143681.818270:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143681.818272:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7a00/0xe984082ccd723eec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818276:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7a00/0xe984082ccd723eec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.818309:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7600/0xe984082ccd723ede lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0793 expref: 12 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.818320:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0793 expref: 11 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.818326:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143681.818328:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143681.818330:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffb7c00, rc 0) 00000100:00100000:3.0:1746143681.818356:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28035:x1830963591973760:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 19287us (19485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143681.818363:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8140 00000100:00100000:0.0:1746143681.823323:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963591974272:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18494us (18722us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143681.823334:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3157 00002000:00100000:0.0:1746143681.823343:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a0402d80 x1830963591974272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.823357:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0402d80 with x1830963591974272 ext(3145728->4194303) 00002000:00010000:0.0:1746143681.823362:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0402d80 00000100:00100000:2.0:1746143681.841598:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591974016:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35857us (37042us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143681.841608:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3159 00002000:00100000:2.0:1746143681.841617:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a0402a00 x1830963591974016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.841626:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0402a00 with x1830963591974016 ext(2097152->3145727) 00002000:00010000:2.0:1746143681.841631:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0402a00 00000100:00100000:1.0:1746143681.845873:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963591974784:12345-192.168.202.48@tcp:3:cat.0 Request processed in 34421us (36216us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143681.845882:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3160 00002000:00100000:1.0:1746143681.845891:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008e627100 x1830963591974784/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.845900:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e627100 with x1830963591974784 ext(3145728->4194303) 00002000:00010000:1.0:1746143681.845905:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e627100 00000100:00100000:3.0:1746143681.849880:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963591974528:12345-192.168.202.48@tcp:3:cat.0 Request processed in 45049us (45238us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143681.849891:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3158 00002000:00100000:3.0:1746143681.849901:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a0403100 x1830963591974528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.849910:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0403100 with x1830963591974528 ext(2097152->3145727) 00002000:00010000:3.0:1746143681.849916:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0403100 00000100:00100000:0.0:1746143681.853783:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.854201:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.854224:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.854251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.854263:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.854298:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.855287:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591975168 00000100:00100000:3.0:1746143681.855295:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591975168 00000100:00100000:3.0:1746143681.855333:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591975424 00000100:00100000:3.0:1746143681.855335:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591975424 00000100:00100000:3.0:1746143681.855347:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591975680 00000100:00100000:3.0:1746143681.855349:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591975680 00000100:00100000:3.0:1746143681.855357:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591975040 00000100:00100000:3.0:1746143681.855359:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591975040 00000100:00100000:3.0:1746143681.855842:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591975296 00000100:00100000:3.0:1746143681.855846:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591975296 00000100:00100000:1.0:1746143681.855878:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591975552 00000100:00100000:1.0:1746143681.855881:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591975552 00000100:00100000:1.0:1746143681.855900:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8992 00000100:00100000:1.0:1746143681.855906:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591975168:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143681.855921:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.855936:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0701400/0xe984082ccd723efa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07a1 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.855963:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.855966:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.855974:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701400/0xe984082ccd723efa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a1 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.855986:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701400/0xe984082ccd723efa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a1 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.855996:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0701400, rc 0) 00000100:00100000:1.0:1746143681.856035:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963591975168:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 129us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.856040:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8992 00000100:00100000:1.0:1746143681.856052:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8993 00000100:00100000:1.0:1746143681.856056:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591975424:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143681.856062:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.856069:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd723f01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07af expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.856077:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.856078:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.856081:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd723f01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07af expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.856089:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd723f01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07af expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.856094:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0701600, rc 0) 00000100:00100000:1.0:1746143681.856104:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963591975424:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 48us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.856111:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8993 00000100:00100000:1.0:1746143681.856117:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8994 00000100:00100000:1.0:1746143681.856120:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591975680:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143681.856124:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.856128:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd723f08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07bd expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.856135:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.856136:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.856154:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd723f08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07bd expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.856163:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd723f08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07bd expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.856168:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0701800, rc 0) 00000100:00100000:1.0:1746143681.856182:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963591975680:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 61us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.856185:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8994 00000100:00100000:1.0:1746143681.856194:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8995 00000100:00100000:1.0:1746143681.856198:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591975040:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143681.856203:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.856208:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd723f0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a079a expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.856216:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.856218:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.856221:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd723f0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a079a expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.856228:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd723f0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a079a expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.856234:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0701a00, rc 0) 00000100:00100000:1.0:1746143681.856248:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963591975040:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 50us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.856251:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8995 00000100:00100000:1.0:1746143681.856260:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8996 00000100:00100000:1.0:1746143681.856264:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591975296:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143681.856269:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.856273:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd723f16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07a8 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.856282:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.856283:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.856287:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd723f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a8 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.856294:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd723f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a8 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.856299:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0701c00, rc 0) 00000100:00100000:1.0:1746143681.856310:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963591975296:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 46us (2046us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.856317:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8996 00000100:00100000:1.0:1746143681.856324:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8997 00000100:00100000:1.0:1746143681.856327:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963591975552:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143681.856331:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.856336:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0701e00/0xe984082ccd723f1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07b6 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.856345:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.856346:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.856350:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0701e00/0xe984082ccd723f1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07b6 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.856357:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0701e00/0xe984082ccd723f1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07b6 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.856363:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0701e00, rc 0) 00000100:00100000:1.0:1746143681.856374:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963591975552:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 46us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.856378:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8997 00000100:00100000:0.0:1746143681.861701:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.862833:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591975936 00000100:00100000:3.0:1746143681.862841:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591975936 00000100:00100000:3.0:1746143681.863491:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8141 00000100:00100000:3.0:1746143681.863500:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28041:x1830963591975936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143681.863519:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143681.863532:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0xe984082ccd723f24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07c4 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.863753:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0xe984082ccd723f2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.863764:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0xe984082ccd723f2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.863772:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0xe984082ccd723f2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.863782:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29c00/0xe984082ccd723f32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.863787:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29c00/0xe984082ccd723f32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.863792:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29c00/0xe984082ccd723f32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.863881:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0xe984082ccd723f39 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.863889:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0xe984082ccd723f39 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.863898:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0xe984082ccd723f39 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143681.863905:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000100:00100000:1.0:1746143681.864115:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.864164:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591976192 00000100:00100000:2.0:1746143681.864168:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591976192 00000100:00100000:2.0:1746143681.864197:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8142 00000100:00100000:2.0:1746143681.864201:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28035:x1830963591976192:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143681.864208:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.864213:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc000/0xe984082ccd723f47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07cb expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.864242:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd800/0xe984082ccd723f4e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.864250:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0793 expref: 12 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.864255:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0xe984082ccd723f39 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.864260:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd800/0xe984082ccd723f4e lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.864271:0:14763:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0xe984082ccd723f39 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143681.864287:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0793 expref: 12 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.864296:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0793 expref: 12 pid: 14764 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.864305:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593633152:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143681.864366:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143681.864874:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143681.864963:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0xe984082ccd723f2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.864969:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0xe984082ccd723f2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.864974:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0xe984082ccd723f2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.864978:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe29a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.864980:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0xe984082ccd723f2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.864985:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0xe984082ccd723f2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.864993:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143681.864996:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143681.864998:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0xe984082ccd723f2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.865002:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0xe984082ccd723f2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.865014:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29c00/0xe984082ccd723f32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.865017:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29c00/0xe984082ccd723f32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.865025:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29c00/0xe984082ccd723f32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.865028:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe29c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143681.865030:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29c00/0xe984082ccd723f32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.865034:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29c00/0xe984082ccd723f32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.865037:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f0f2e00) 00010000:00010000:3.0:1746143681.865039:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143681.865040:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29c00/0xe984082ccd723f32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.865044:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29c00/0xe984082ccd723f32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143681.865070:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0xe984082ccd723f24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07c4 expref: 22 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143681.865079:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0xe984082ccd723f39 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07c4 expref: 21 pid: 14764 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.865085:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0xe984082ccd723f39 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07c4 expref: 21 pid: 14764 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746143681.865090:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe29e00, rc 0) 00000100:00100000:3.0:1746143681.865117:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28041:x1830963591975936:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1618us (3422us total) trans 8589942198 rc 0/0 00000100:00100000:3.0:1746143681.865126:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8141 00000100:00100000:2.0:1746143681.865325:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591976448 00000100:00100000:2.0:1746143681.865329:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591976448 00002000:00100000:2.0:1746143681.865355:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008f4ec000 x1830963591976448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.865363:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ec000 with x1830963591976448 ext(4194304->4898815) 00002000:00010000:2.0:1746143681.865367:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4ec000 00000100:00100000:2.0:1746143681.865379:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3161 00000100:00100000:2.0:1746143681.865384:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591976448:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143681.872786:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593633152:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143681.872805:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd800/0xe984082ccd723f4e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143681.873234:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.877159:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.877176:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.877177:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591976576 00000100:00100000:2.0:1746143681.877186:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591976576 00000100:00100000:1.0:1746143681.877202:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143681.877216:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0793 expref: 13 pid: 14764 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.877237:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591976960 00000100:00100000:2.0:1746143681.877239:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591976960 00000100:00100000:0.0:1746143681.877245:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591976704 00010000:00010000:2.0:1746143681.877247:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0xe984082ccd723f39 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07c4 expref: 21 pid: 14764 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746143681.877252:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591976704 00000100:00100000:2.0:1746143681.877259:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4575 00000100:00100000:2.0:1746143681.877265:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963591976576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143681.877272:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591976832 00000100:00100000:0.0:1746143681.877273:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591976832 00010000:00010000:2.0:1746143681.877276:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.877281:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0793 expref: 13 pid: 14764 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746143681.877283:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8998 00000100:00100000:0.0:1746143681.877287:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1962:x1830963591976704:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.877290:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0793 expref: 13 pid: 14764 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746143681.877300:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.877307:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723ef3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0793 expref: 13 pid: 14764 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746143681.877312:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b15e000/0xe984082ccd723f55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07d2 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.877323:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143681.877327:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd800/0xe984082ccd723f4e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.877330:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.877332:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.877335:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd800/0xe984082ccd723f4e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.877340:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143681.877341:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15e000/0xe984082ccd723f55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d2 expref: 27 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.877356:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b15e000/0xe984082ccd723f55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d2 expref: 27 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.877370:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15e000, rc 0) 00000100:00100000:2.0:1746143681.877375:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963591976576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 109us (4142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.877381:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4575 00000100:00100000:0.0:1746143681.877389:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1962:x1830963591976704:12345-192.168.202.48@tcp:101:cat.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.877392:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4576 00000100:00100000:0.0:1746143681.877394:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8998 00000100:00100000:2.0:1746143681.877396:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963591976960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.877400:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.877404:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0xe984082ccd723f39 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07c4 expref: 21 pid: 14764 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.877411:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0xe984082ccd723f39 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07c4 expref: 21 pid: 14764 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746143681.877416:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8999 00010000:00010000:2.0:1746143681.877421:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29e00/0xe984082ccd723f39 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07c4 expref: 21 pid: 14764 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746143681.877422:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1962:x1830963591976832:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143681.877428:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:0.0:1746143681.877428:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.877431:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd800/0xe984082ccd723f4e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.877434:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b15e400/0xe984082ccd723f5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07d9 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.877436:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd800/0xe984082ccd723f4e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.877442:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd800/0xe984082ccd723f4e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143681.877444:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.877445:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143681.877449:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15e400/0xe984082ccd723f5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d9 expref: 27 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.877455:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143681.877457:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b15e400/0xe984082ccd723f5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d9 expref: 27 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143681.877463:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15e400, rc 0) 00000100:00100000:2.0:1746143681.877465:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963591976960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 69us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.877469:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4576 00000100:00100000:0.0:1746143681.877478:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1962:x1830963591976832:12345-192.168.202.48@tcp:101:cat.0 Request processed in 57us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143681.877482:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8999 00010000:00010000:2.0:1746143681.877484:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd800/0xe984082ccd723f4e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.877491:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd800/0xe984082ccd723f4e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:2.0:1746143681.877511:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143681.877629:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc000/0xe984082ccd723f47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07cb expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.877639:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd800/0xe984082ccd723f4e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07cb expref: 12 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.877645:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143681.877647:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143681.877649:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cbd800, rc 0) 00000100:00100000:2.0:1746143681.877667:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28035:x1830963591976192:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 13466us (13553us total) trans 8589942199 rc 0/0 00000100:00100000:2.0:1746143681.877673:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8142 00000100:00100000:3.0:1746143681.878373:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591976448:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12987us (13498us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143681.878380:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3161 00002000:00100000:3.0:1746143681.878388:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008f4ec000 x1830963591976448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143681.878397:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ec000 with x1830963591976448 ext(4194304->4898815) 00002000:00010000:3.0:1746143681.878400:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4ec000 00000100:00100000:1.0:1746143681.880196:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.880286:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591977216 00000100:00100000:2.0:1746143681.880293:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591977216 00000100:00100000:2.0:1746143681.880338:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8143 00000100:00100000:2.0:1746143681.880344:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28035:x1830963591977216:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143681.880361:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.880364:0:14763:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143681.880440:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd800/0xe984082ccd723f4e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07cb expref: 12 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.880453:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143681.880457:0:14763:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143681.880468:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd200/0xe984082ccd723f6a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07e0 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.880539:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbce00/0xe984082ccd723f71 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.880549:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbce00/0xe984082ccd723f71 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.880556:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbce00/0xe984082ccd723f71 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.880566:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbce00/0xe984082ccd723f71 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.880572:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbce00/0xe984082ccd723f71 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.880577:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbce00/0xe984082ccd723f71 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.880582:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cbce00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143681.880585:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbce00/0xe984082ccd723f71 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.880590:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbce00/0xe984082ccd723f71 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.880596:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143681.880599:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143681.880602:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbce00/0xe984082ccd723f71 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.880606:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbce00/0xe984082ccd723f71 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.880629:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd200/0xe984082ccd723f6a lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07e0 expref: 12 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.880635:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd200/0xe984082ccd723f6a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07e0 expref: 12 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.880641:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cbd200, rc 0) 00000100:00100000:2.0:1746143681.881438:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28035:x1830963591977216:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 1092us (1244us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143681.881444:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8143 00000100:00100000:0.0:1746143681.884056:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.884164:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591977472 00000100:00100000:1.0:1746143681.884171:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591977472 00000100:00100000:1.0:1746143681.884220:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3274 00000100:00100000:1.0:1746143681.884227:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009498cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28035:x1830963591977472:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143681.884396:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009498cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28035:x1830963591977472:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 168us (344us total) trans 8589942200 rc 0/0 00000100:00100000:1.0:1746143681.884402:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3274 00000100:00100000:0.0:1746143681.886228:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.886294:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591977728 00000100:00100000:2.0:1746143681.886300:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591977728 00000100:00100000:2.0:1746143681.886337:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8144 00000100:00100000:2.0:1746143681.886342:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28042:x1830963591977728:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143681.886356:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.886368:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc200/0xe984082ccd723f78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07e7 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.886454:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723f7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886463:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886472:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886482:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723f86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886488:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886492:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886572:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbda00/0xe984082ccd723f8d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886578:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbda00/0xe984082ccd723f8d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886583:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbda00/0xe984082ccd723f8d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:2.0:1746143681.886590:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143681.886647:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886654:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723f7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886658:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723f7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886663:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cbc600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143681.886665:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723f7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886670:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723f7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886678:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143681.886681:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143681.886684:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723f7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886688:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc600/0xe984082ccd723f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886696:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886700:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723f86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886704:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723f86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886707:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cbd600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143681.886709:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723f86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886713:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723f86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886718:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a400) 00010000:00010000:2.0:1746143681.886720:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143681.886721:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723f86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886725:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd600/0xe984082ccd723f86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143681.886752:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbc200/0xe984082ccd723f78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07e7 expref: 23 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.886764:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbda00/0xe984082ccd723f8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07e7 expref: 22 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.886769:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143681.886771:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143681.886773:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cbda00, rc 0) 00000100:00100000:2.0:1746143681.886809:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28042:x1830963591977728:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 466us (585us total) trans 8589942201 rc 0/0 00000100:00100000:2.0:1746143681.886813:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8144 00000100:00100000:0.0:1746143681.892847:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.892905:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.893013:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591978240 00000100:00100000:2.0:1746143681.893021:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591978240 00002000:00100000:2.0:1746143681.893057:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880095389180 x1830963591978240/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.893066:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095389180 with x1830963591978240 ext(1048576->2097151) 00002000:00010000:2.0:1746143681.893070:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095389180 00000100:00100000:2.0:1746143681.893100:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3162 00000100:00100000:2.0:1746143681.893108:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1963:x1830963591978240:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143681.894781:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591978112 00000100:00100000:3.0:1746143681.894788:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591978112 00000100:00100000:3.0:1746143681.894822:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3275 00000100:00100000:3.0:1746143681.894828:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:28031:x1830963591978112:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143681.898684:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:28031:x1830963591978112:12345-192.168.202.48@tcp:35:cat.0 Request processed in 3847us (5837us total) trans 8589942202 rc 0/0 00000100:00100000:3.0:1746143681.898696:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3275 00000100:00100000:2.0:1746143681.900459:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.905582:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591978496 00000100:00100000:0.0:1746143681.905592:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591978496 00002000:00100000:0.0:1746143681.905627:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a0360700 x1830963591978496/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.905636:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360700 with x1830963591978496 ext(1048576->2097151) 00002000:00010000:0.0:1746143681.905640:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0360700 00000100:00100000:0.0:1746143681.905667:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3163 00000100:00100000:0.0:1746143681.905674:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1963:x1830963591978496:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143681.906738:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.906766:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591978624 00000100:00100000:1.0:1746143681.906770:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591978624 00000100:00100000:1.0:1746143681.906796:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9000 00000100:00100000:1.0:1746143681.906801:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28042:x1830963591978624:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143681.906811:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143681.906825:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07ee expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.906846:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a64de000/0xe984082ccd723e3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0746 expref: 23 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.906854:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0701e00/0xe984082ccd723f1d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07b6 expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.906859:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b15f600/0xe984082ccd723e98 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0769 expref: 35 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.906865:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.906866:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.906869:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4190208->4194303] (req 4190208->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.906896:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b15f600/0xe984082ccd723e98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0769 expref: 35 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.906906:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b15f600/0xe984082ccd723e98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0769 expref: 35 pid: 8496 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746143681.906917:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593633280:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143681.907003:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0701e00/0xe984082ccd723f1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07b6 expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143681.907010:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0701e00/0xe984082ccd723f1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07b6 expref: 11 pid: 12618 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746143681.907018:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593633408:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143681.907042:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a64de000/0xe984082ccd723e3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0746 expref: 23 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.907049:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a64de000/0xe984082ccd723e3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0746 expref: 23 pid: 8496 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746143681.907056:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593633536:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143681.907070:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143681.913251:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1963:x1830963591978240:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20134us (20336us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143681.913261:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3162 00002000:00100000:2.0:1746143681.913271:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880095389180 x1830963591978240/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.913281:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095389180 with x1830963591978240 ext(1048576->2097151) 00002000:00010000:2.0:1746143681.913286:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095389180 00000100:00100000:1.0:1746143681.913416:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593633280:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143681.913465:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593633408:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143681.913516:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593633536:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143681.913543:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4190208->4194303] (req 4190208->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143681.913558:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54cb000, rc 0) 00000100:00100000:0.0:1746143681.913591:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28042:x1830963591978624:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6789us (6856us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143681.913597:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9000 00000100:00100000:0.0:1746143681.922781:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.925409:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591978752 00000100:00100000:2.0:1746143681.925420:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591978752 00010000:00010000:2.0:1746143681.925457:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0701e00/0xe984082ccd723f1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07b6 expref: 12 pid: 12618 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746143681.926676:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.927550:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591978880 00000100:00100000:2.0:1746143681.927558:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591978880 00010000:00010000:2.0:1746143681.927580:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a64de000/0xe984082ccd723e3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0746 expref: 23 pid: 8496 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.927606:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4577 00000100:00100000:2.0:1746143681.927612:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095389500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963591978752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.927623:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.927644:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0701e00/0xe984082ccd723f1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07b6 expref: 12 pid: 12618 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.927654:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0701e00/0xe984082ccd723f1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07b6 expref: 12 pid: 12618 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.927671:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0701e00/0xe984082ccd723f1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07b6 expref: 12 pid: 12618 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746143681.927689:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.927726:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095389500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591978752:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 114us (4951us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.927732:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4577 00000100:00100000:2.0:1746143681.927746:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4578 00000100:00100000:2.0:1746143681.927751:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591978880:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143681.927759:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143681.927766:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a64de000/0xe984082ccd723e3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0746 expref: 23 pid: 8496 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.927773:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a64de000/0xe984082ccd723e3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0746 expref: 23 pid: 8496 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.927783:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a64de000/0xe984082ccd723e3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0746 expref: 23 pid: 8496 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746143681.927791:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143681.927805:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591978880:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 54us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.927809:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4578 00000100:00100000:2.0:1746143681.927841:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.928268:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591979008 00000100:00100000:1.0:1746143681.928272:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591979008 00010000:00010000:1.0:1746143681.928288:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b15f600/0xe984082ccd723e98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0769 expref: 36 pid: 8496 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746143681.928308:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4579 00000100:00100000:1.0:1746143681.928313:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591979008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143681.928320:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143681.928327:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b15f600/0xe984082ccd723e98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0769 expref: 36 pid: 8496 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746143681.928336:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b15f600/0xe984082ccd723e98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0769 expref: 36 pid: 8496 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746143681.928347:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b15f600/0xe984082ccd723e98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0769 expref: 36 pid: 8496 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746143681.928371:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.928373:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.928380:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.928387:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.928417:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143681.928427:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593633664:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143681.928477:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.929120:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1963:x1830963591978496:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23445us (28665us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143681.929131:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3163 00002000:00100000:0.0:1746143681.929156:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a0360700 x1830963591978496/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.929165:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360700 with x1830963591978496 ext(1048576->2097151) 00002000:00010000:0.0:1746143681.929168:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0360700 00000100:00100000:0.0:1746143681.933085:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.933136:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593633664:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143681.933185:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591979264 00000100:00100000:2.0:1746143681.933191:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591979264 00010000:00010000:1.0:1746143681.933197:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143681.933239:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963591979008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4924us (5396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.933248:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4579 00002000:00100000:2.0:1746143681.933543:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4190208->4194303) req@ffff880095389880 x1830963591979264/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.933551:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095389880 with x1830963591979264 ext(4190208->4194303) 00002000:00010000:2.0:1746143681.933560:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095389880 00000100:00100000:2.0:1746143681.933579:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3164 00000100:00100000:2.0:1746143681.933589:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591979264:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143681.933715:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591979264:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 129us (638us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143681.933721:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3164 00002000:00100000:2.0:1746143681.933726:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4190208->4194303) req@ffff880095389880 x1830963591979264/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.933732:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095389880 with x1830963591979264 ext(4190208->4194303) 00002000:00010000:2.0:1746143681.933735:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095389880 00000100:00100000:0.0:1746143681.937435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.937502:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591979392 00000100:00100000:2.0:1746143681.937510:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591979392 00000100:00100000:2.0:1746143681.937804:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9001 00000100:00100000:2.0:1746143681.937812:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+27:28042:x1830963591979392:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143681.937829:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143681.937844:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07f5 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.937867:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf9d600/0xe984082ccd723e44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a074d expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.937875:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd723f08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07bd expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.937881:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b15f800/0xe984082ccd723e9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0770 expref: 34 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.937887:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.937889:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143681.937891:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->3170303] (req 3145728->3170303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.937925:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b15f800/0xe984082ccd723e9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0770 expref: 34 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.937935:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b15f800/0xe984082ccd723e9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0770 expref: 34 pid: 8496 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.937945:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593633792:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143681.938068:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd723f08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07bd expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143681.938076:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd723f08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07bd expref: 11 pid: 12618 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.938084:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593633920:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143681.938106:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf9d600/0xe984082ccd723e44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a074d expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.938113:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf9d600/0xe984082ccd723e44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a074d expref: 28 pid: 8496 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746143681.938120:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593634048:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143681.938133:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143681.944171:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.944222:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591979648 00000100:00100000:1.0:1746143681.944229:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591979648 00010000:00010000:1.0:1746143681.944259:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15f800/0xe984082ccd723e9f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0770 expref: 35 pid: 8496 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746143681.944297:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4580 00000100:00100000:1.0:1746143681.944303:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095389f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963591979648:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143681.944314:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143681.944333:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b15f800/0xe984082ccd723e9f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0770 expref: 35 pid: 8496 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746143681.944344:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b15f800/0xe984082ccd723e9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0770 expref: 35 pid: 8496 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746143681.944367:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143681.944414:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095389f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963591979648:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 108us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.944421:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4580 00010000:00010000:2.0:1746143681.945049:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15f800/0xe984082ccd723e9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0770 expref: 34 pid: 8496 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746143681.945079:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593633792:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143681.945093:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593633920:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143681.945100:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593634048:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143681.945124:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->3170303] (req 3145728->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143681.945134:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cbc600, rc 0) 00000100:00100000:2.0:1746143681.945193:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+28:28042:x1830963591979392:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7382us (7765us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143681.945199:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9001 00000100:00100000:0.0:1746143681.947026:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.947062:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.947085:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591979776 00000100:00100000:1.0:1746143681.947093:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591979776 00000100:00100000:0.0:1746143681.947106:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143681.947117:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf9d600/0xe984082ccd723e44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a074d expref: 28 pid: 8496 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746143681.947128:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591980032 00000100:00100000:0.0:1746143681.947131:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591980032 00000100:00100000:1.0:1746143681.947165:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591979520 00000100:00100000:1.0:1746143681.947167:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591979520 00010000:00010000:1.0:1746143681.947178:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd723f08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07bd expref: 12 pid: 12618 timeout: 860 lvb_type: 1 00002000:00100000:0.0:1746143681.947182:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009538a680 x1830963591980032/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143681.947191:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4581 00002000:00100000:0.0:1746143681.947191:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009538a680 with x1830963591980032 ext(2097152->3145727) 00002000:00010000:0.0:1746143681.947195:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009538a680 00000100:00100000:1.0:1746143681.947196:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1965:x1830963591979776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143681.947206:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143681.947209:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3165 00000100:00100000:0.0:1746143681.947214:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009538a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963591980032:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143681.947223:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf9d600/0xe984082ccd723e44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a074d expref: 28 pid: 8496 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.947233:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf9d600/0xe984082ccd723e44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a074d expref: 28 pid: 8496 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.947249:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf9d600/0xe984082ccd723e44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a074d expref: 28 pid: 8496 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746143681.947269:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143681.947294:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963591979776:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 97us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.947300:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4581 00000100:00100000:1.0:1746143681.947336:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4582 00000100:00100000:1.0:1746143681.947340:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009538a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963591979520:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143681.947346:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143681.947352:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd723f08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07bd expref: 12 pid: 12618 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746143681.947360:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd723f08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07bd expref: 12 pid: 12618 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746143681.947370:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd723f08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07bd expref: 12 pid: 12618 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746143681.947377:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.947379:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143681.947384:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.947390:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143681.947414:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143681.947424:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593634176:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143681.947467:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143681.950895:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593634176:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143681.950902:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143681.950915:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143681.950964:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009538a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591979520:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3621us (3900us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143681.950972:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4582 00000100:00100000:2.0:1746143681.951049:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591980288 00000100:00100000:2.0:1746143681.951055:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591980288 00002000:00100000:2.0:1746143681.951087:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3166208->3170303) req@ffff88009538aa00 x1830963591980288/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.951095:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009538aa00 with x1830963591980288 ext(3166208->3170303) 00002000:00010000:2.0:1746143681.951098:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009538aa00 00000100:00100000:2.0:1746143681.951126:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3166 00000100:00100000:2.0:1746143681.951133:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009538aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963591980288:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143681.951259:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009538aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963591980288:12345-192.168.202.48@tcp:3:cat.0 Request processed in 125us (358us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143681.951264:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3166 00002000:00100000:2.0:1746143681.951269:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3166208->3170303) req@ffff88009538aa00 x1830963591980288/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/4536 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.951276:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009538aa00 with x1830963591980288 ext(3166208->3170303) 00002000:00010000:2.0:1746143681.951278:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009538aa00 00000100:00100000:0.0:1746143681.962239:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143681.962842:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591980544 00000100:00100000:3.0:1746143681.962851:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591980544 00000100:00100000:3.0:1746143681.962902:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3276 00000100:00100000:3.0:1746143681.962909:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009538ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28042:x1830963591980544:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143681.963102:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009538ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28042:x1830963591980544:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 192us (871us total) trans 8589942203 rc 0/0 00000100:00100000:3.0:1746143681.963108:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3276 00000100:00100000:2.0:1746143681.963274:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009538a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963591980032:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16059us (16167us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143681.963281:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3165 00002000:00100000:2.0:1746143681.963287:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009538a680 x1830963591980032/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.963295:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009538a680 with x1830963591980032 ext(2097152->3145727) 00002000:00010000:2.0:1746143681.963300:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009538a680 00000100:00100000:0.0:1746143681.973109:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143681.973299:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591980800 00000100:00100000:2.0:1746143681.973307:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591980800 00002000:00100000:2.0:1746143681.973341:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009538b100 x1830963591980800/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143681.973350:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009538b100 with x1830963591980800 ext(2097152->3145727) 00002000:00010000:2.0:1746143681.973355:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009538b100 00000100:00100000:2.0:1746143681.973781:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3167 00000100:00100000:2.0:1746143681.973787:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009538b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963591980800:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143681.986055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143681.986823:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591981056 00000100:00100000:1.0:1746143681.986831:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591981056 00002000:00100000:1.0:1746143681.986865:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4190207) req@ffff880094c12680 x1830963591981056/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143681.986874:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12680 with x1830963591981056 ext(3145728->4190207) 00002000:00010000:1.0:1746143681.986878:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c12680 00000100:00100000:1.0:1746143681.986911:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3168 00000100:00100000:1.0:1746143681.986918:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591981056:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143681.988026:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143681.988937:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591981312 00000100:00100000:0.0:1746143681.988943:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591981312 00002000:00100000:0.0:1746143681.988980:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3170304->4194303) req@ffff88008f4eca80 x1830963591981312/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/0 e 0 to 0 dl 1746143692 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.988988:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4eca80 with x1830963591981312 ext(3170304->4194303) 00002000:00010000:0.0:1746143681.988992:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4eca80 00000100:00100000:0.0:1746143681.989008:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3169 00000100:00100000:0.0:1746143681.989015:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1963:x1830963591981312:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143681.990063:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009538b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1964:x1830963591980800:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16274us (16959us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143681.990070:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3167 00002000:00100000:0.0:1746143681.990077:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009538b100 x1830963591980800/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143681.990085:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009538b100 with x1830963591980800 ext(2097152->3145727) 00002000:00010000:0.0:1746143681.990087:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009538b100 00000100:00100000:0.0:1746143681.996796:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.003307:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591981440 00000100:00100000:2.0:1746143682.003316:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591981440 00000100:00100000:2.0:1746143682.005118:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9002 00000100:00100000:2.0:1746143682.005129:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28033:x1830963591981440:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143682.005152:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.005166:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a07fc expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.005191:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0383200/0xe984082ccd723d10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0690 expref: 36 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.005198:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd723f01 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07af expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.005204:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0243a00/0xe984082ccd723d72 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06dd expref: 23 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.005209:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.005210:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.005213:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1806336->2097151] (req 1806336->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.005237:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0243a00/0xe984082ccd723d72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06dd expref: 23 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.005247:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0243a00/0xe984082ccd723d72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06dd expref: 23 pid: 12618 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746143682.005256:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593634304:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.005339:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd723f01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07af expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.005346:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd723f01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07af expref: 10 pid: 12618 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746143682.005354:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593634432:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.005380:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0383200/0xe984082ccd723d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0690 expref: 36 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.005388:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0383200/0xe984082ccd723d10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0690 expref: 36 pid: 4582 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746143682.005395:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593634560:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.005409:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.006469:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963591981056:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19548us (20417us total) trans 0 rc 1044480/1044480 00000100:00100000:0.0:1746143682.006478:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3168 00002000:00100000:0.0:1746143682.006486:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4190207) req@ffff880094c12680 x1830963591981056/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.006495:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12680 with x1830963591981056 ext(3145728->4190207) 00002000:00010000:0.0:1746143682.006498:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c12680 00000100:00100000:2.0:1746143682.012290:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593634304:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.012301:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593634432:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.012308:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593634560:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.012334:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1806336->2097151] (req 1806336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.012349:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cbc000, rc 0) 00000100:00100000:2.0:1746143682.012387:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:28033:x1830963591981440:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7261us (15598us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.012395:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9002 00000100:00100000:1.0:1746143682.012621:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1963:x1830963591981312:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23605us (24595us total) trans 0 rc 1024000/1024000 00000100:00100000:1.0:1746143682.012628:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3169 00002000:00100000:1.0:1746143682.012636:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3170304->4194303) req@ffff88008f4eca80 x1830963591981312/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:77/0 lens 488/440 e 0 to 0 dl 1746143692 ref 1 fl Complete:/200/0 rc 1024000/1024000 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.012644:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4eca80 with x1830963591981312 ext(3170304->4194303) 00002000:00010000:1.0:1746143682.012649:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4eca80 00000100:00100000:0.0:1746143682.018843:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.018882:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.019521:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.019715:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591981696 00000100:00100000:2.0:1746143682.019722:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591981696 00010000:00010000:2.0:1746143682.019754:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0383200/0xe984082ccd723d10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0690 expref: 36 pid: 4582 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746143682.019778:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591981568 00000100:00100000:2.0:1746143682.019779:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591981568 00010000:00010000:2.0:1746143682.019793:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd723f01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07af expref: 11 pid: 12618 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746143682.019803:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591981824 00000100:00100000:2.0:1746143682.019804:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591981824 00010000:00010000:2.0:1746143682.019811:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0243a00/0xe984082ccd723d72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06dd expref: 22 pid: 12618 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746143682.019824:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4583 00000100:00100000:2.0:1746143682.019830:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009538b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963591981696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143682.019841:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143682.019859:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0383200/0xe984082ccd723d10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0690 expref: 36 pid: 4582 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746143682.019868:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0383200/0xe984082ccd723d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0690 expref: 36 pid: 4582 timeout: 861 lvb_type: 1 00000100:00080000:3.0:1746143682.019907:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143682.019921:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4584 00000100:00100000:3.0:1746143682.019928:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009538bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963591981568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.019934:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143682.019983:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4585 00000100:00100000:0.0:1746143682.019989:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963591981824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143682.019996:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143682.020466:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0383200/0xe984082ccd723d10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0690 expref: 36 pid: 4582 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746143682.020487:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd723f01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07af expref: 11 pid: 12618 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746143682.020494:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd723f01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07af expref: 11 pid: 12618 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746143682.020506:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd723f01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07af expref: 11 pid: 12618 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746143682.020524:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.020559:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009538bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963591981568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 632us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.020565:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4584 00010000:00010000:2.0:1746143682.020923:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143682.020942:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009538b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591981696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1111us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.020948:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4583 00010000:00010000:0.0:1746143682.021050:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0243a00/0xe984082ccd723d72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06dd expref: 22 pid: 12618 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746143682.021064:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0243a00/0xe984082ccd723d72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06dd expref: 22 pid: 12618 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746143682.021076:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0243a00/0xe984082ccd723d72 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06dd expref: 22 pid: 12618 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746143682.021095:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143682.021097:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143682.021103:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.021109:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.022006:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143682.022019:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593634688:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143682.022059:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.022693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.022848:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591981952 00000100:00100000:2.0:1746143682.022854:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591981952 00000100:00100000:2.0:1746143682.022888:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9003 00000100:00100000:2.0:1746143682.022894:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963591981952:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143682.022906:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.022916:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3d6400/0xe984082ccd723fb0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0803 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143682.022942:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593634816:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143682.023002:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7cc0 going to sleep for 11 seconds 00002000:00010000:2.0:1746143682.026172:0:25369:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143680 -> 1746143681 00002000:00010000:2.0:1746143682.026179:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143679 -> 1746143681 00002000:00010000:2.0:1746143682.026180:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143680 -> 1746143681 00000100:00100000:2.0:1746143682.026201:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593634816:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143682.026226:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3d6400/0xe984082ccd723fb0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0803 expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.026237:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d6400/0xe984082ccd723fb0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0803 expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.026258:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d6400, rc 0) 00000100:00100000:2.0:1746143682.026295:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963591981952:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3400us (3604us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143682.026302:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9003 00000100:00100000:2.0:1746143682.027383:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593634688:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143682.027392:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143682.027427:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963591981824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7438us (7906us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.027435:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4585 00000100:00100000:0.0:1746143682.032799:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.032800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.032842:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.032863:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591982208 00000100:00100000:0.0:1746143682.032870:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591982208 00002000:00100000:0.0:1746143682.032909:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1806336->1810431) req@ffff880095389f80 x1830963591982208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.032918:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095389f80 with x1830963591982208 ext(1806336->1810431) 00002000:00010000:0.0:1746143682.032923:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095389f80 00000100:00100000:3.0:1746143682.035664:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591982720 00000100:00100000:3.0:1746143682.035675:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591982720 00002000:00100000:3.0:1746143682.035734:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88013010c000 x1830963591982720/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.035743:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010c000 with x1830963591982720 ext(4194304->4898815) 00002000:00010000:3.0:1746143682.035747:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013010c000 00000100:00100000:3.0:1746143682.035780:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3170 00000100:00100000:3.0:1746143682.035787:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963591982208:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143682.035935:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963591982208:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 148us (3143us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143682.035944:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3170 00002000:00100000:3.0:1746143682.035950:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1806336->1810431) req@ffff880095389f80 x1830963591982208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/4536 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.035967:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095389f80 with x1830963591982208 ext(1806336->1810431) 00002000:00010000:3.0:1746143682.035970:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095389f80 00000100:00100000:3.0:1746143682.035991:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3171 00000100:00100000:3.0:1746143682.035996:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963591982720:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143682.036686:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591982464 00000100:00100000:3.0:1746143682.036690:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591982464 00000100:00080000:3.0:1746143682.036706:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143682.036728:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8145 00000100:00100000:3.0:1746143682.036732:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:28048:x1830963591982464:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143682.036746:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.036760:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723fb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a080a expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.036828:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6c00/0xe984082ccd723fbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.036839:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6c00/0xe984082ccd723fbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.036850:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6c00/0xe984082ccd723fbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.036859:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723fc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.036868:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.036873:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.036965:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7e00/0xe984082ccd723fcc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.036972:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7e00/0xe984082ccd723fcc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.036978:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7e00/0xe984082ccd723fcc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143682.036985:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143682.037049:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6c00/0xe984082ccd723fbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037055:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6c00/0xe984082ccd723fbe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037061:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6c00/0xe984082ccd723fbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037066:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffb6c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143682.037069:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6c00/0xe984082ccd723fbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037074:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6c00/0xe984082ccd723fbe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037083:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143682.037086:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143682.037090:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6c00/0xe984082ccd723fbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037094:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6c00/0xe984082ccd723fbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037107:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037111:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723fc5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037115:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037119:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffb7200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143682.037120:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037124:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723fc5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037129:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f0f2800) 00010000:00010000:3.0:1746143682.037131:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143682.037133:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723fc5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037154:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7200/0xe984082ccd723fc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.037194:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7c00/0xe984082ccd723fb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a080a expref: 256 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.037208:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7e00/0xe984082ccd723fcc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a080a expref: 255 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.037213:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143682.037215:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143682.037217:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffb7e00, rc 0) 00000100:00100000:3.0:1746143682.037235:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:28048:x1830963591982464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 503us (4434us total) trans 8589942204 rc 0/0 00000100:00100000:3.0:1746143682.037240:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8145 00000100:00100000:0.0:1746143682.047213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.047339:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591982848 00000100:00100000:2.0:1746143682.047346:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591982848 00000100:00100000:2.0:1746143682.047380:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9004 00000100:00100000:2.0:1746143682.047387:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28033:x1830963591982848:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143682.047402:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.047415:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0811 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.047438:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.047445:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143682.047447:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143682.047451:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->2809855] (req 2097152->2809855) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.047474:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.047488:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 22 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.047498:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593634944:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143682.047824:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963591982720:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11826us (14981us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143682.047832:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3171 00002000:00100000:3.0:1746143682.047840:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88013010c000 x1830963591982720/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.047848:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010c000 with x1830963591982720 ext(4194304->4898815) 00010000:00010000:3.0:1746143682.047853:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 21 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.047863:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 21 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746143682.047869:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013010c000 00000100:00100000:2.0:1746143682.048335:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.051092:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.051107:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593634944:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143682.051119:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143682.051130:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->2809855] (req 2097152->2809855) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143682.051174:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.051180:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591983232 00000100:00100000:1.0:1746143682.051185:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591983232 00000100:00100000:0.0:1746143682.051187:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591982976 00000100:00100000:0.0:1746143682.051190:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591982976 00000100:00100000:0.0:1746143682.051215:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9005 00000100:00100000:1.0:1746143682.051220:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9006 00000100:00100000:0.0:1746143682.051221:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963591982976:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143682.051226:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591983232:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143682.051235:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143682.051235:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143682.051246:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a62bb200/0xe984082ccd723fe8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a081f expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.051246:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b15e800/0xe984082ccd723fe1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0818 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143682.051281:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013010d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593635200:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143682.051286:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593635072:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143682.051587:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d7200, rc 0) 00000100:00100000:3.0:1746143682.051601:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591983104 00000100:00100000:3.0:1746143682.051604:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591983104 00002000:00100000:3.0:1746143682.051627:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4190208->4194303) req@ffff88013010c700 x1830963591983104/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 4584/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.051634:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010c700 with x1830963591983104 ext(4190208->4194303) 00010000:00010000:3.0:1746143682.051639:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 21 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.051649:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 21 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746143682.051655:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013010c700 00000100:00100000:0.0:1746143682.051744:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143682.051748:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143682.051848:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 752 00000100:00100000:3.0:1746143682.051853:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963591983104:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143682.052892:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963591983104:12345-192.168.202.48@tcp:4:cat.0 Request processed in 1037us (1808us total) trans 17179872344 rc 0/0 00000100:00100000:3.0:1746143682.052899:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 752 00002000:00100000:3.0:1746143682.052904:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4190208->4194303) req@ffff88013010c700 x1830963591983104/t17179872344(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 4584/448 e 0 to 0 dl 1746143693 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.052910:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010c700 with x1830963591983104 ext(4190208->4194303) 00010000:00010000:3.0:1746143682.052914:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 23 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.053056:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:28033:x1830963591982848:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5667us (5848us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.053062:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9004 00010000:00010000:3.0:1746143682.053289:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 23 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746143682.053297:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013010c700 00000100:00100000:0.0:1746143682.053458:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.053517:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.054122:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591983360 00000100:00100000:2.0:1746143682.054127:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591983360 00000100:00100000:2.0:1746143682.054174:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591983488 00000100:00100000:2.0:1746143682.054176:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591983488 00000100:00100000:2.0:1746143682.054190:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9007 00000100:00100000:2.0:1746143682.054196:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963591983360:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143682.054205:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.054214:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3d6000/0xe984082ccd723fef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0826 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143682.054256:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593635328:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143682.054300:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143682.054347:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9008 00000100:00100000:3.0:1746143682.054353:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963591983488:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143682.054359:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.054365:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723ff6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a082d expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143682.054385:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593635456:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143682.054406:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d25c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143682.054826:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593635072:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143682.054850:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a62bb200/0xe984082ccd723fe8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a081f expref: 35 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143682.054859:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a62bb200/0xe984082ccd723fe8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a081f expref: 35 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143682.054879:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a62bb200, rc 0) 00000100:00100000:1.0:1746143682.054898:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591983232:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3672us (3778us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143682.054903:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9006 00000100:00100000:0.0:1746143682.058392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.058829:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013010d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593635200:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143682.058855:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b15e800/0xe984082ccd723fe1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0818 expref: 37 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.058872:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b15e800/0xe984082ccd723fe1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0818 expref: 37 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.058883:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15e800, rc 0) 00000100:00100000:3.0:1746143682.058917:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591983616 00000100:00100000:3.0:1746143682.058923:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591983616 00000100:00100000:2.0:1746143682.058932:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963591982976:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7711us (7757us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143682.058938:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9005 00010000:00010000:3.0:1746143682.058945:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 27 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.058977:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4586 00000100:00100000:3.0:1746143682.058982:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963591983616:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.058993:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143682.059002:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 27 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.059011:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 27 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.059028:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.059029:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.059035:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.059043:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.059069:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143682.059079:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593635584:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143682.059123:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143682.061196:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593635328:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143682.061335:0:21542:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff880094762d80 x1830963593635456) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 27 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.061355:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54cb000/0xe984082ccd723f9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4190208->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07ee expref: 27 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.061365:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593635456:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143682.061388:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723ff6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a082d expref: 26 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.061397:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff4da00/0xe984082ccd723ff6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a082d expref: 26 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.061397:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3d6000/0xe984082ccd723fef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0826 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.061405:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d6000/0xe984082ccd723fef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0826 expref: 25 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.061412:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d6000, rc 0) 00000100:00100000:2.0:1746143682.061451:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963591983360:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7254us (7992us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143682.061458:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9007 00010000:00010000:3.0:1746143682.061752:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff4da00, rc 0) 00000100:00100000:3.0:1746143682.061926:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591983488:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7572us (8407us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143682.061932:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9008 00000100:00100000:3.0:1746143682.061966:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593635584:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143682.061976:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.061992:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963591983616:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3010us (3606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.061998:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4586 00000100:00100000:2.0:1746143682.067230:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.067314:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591983744 00000100:00100000:3.0:1746143682.067321:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591983744 00000100:00100000:3.0:1746143682.067360:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9009 00000100:00100000:3.0:1746143682.067367:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28041:x1830963591983744:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143682.067381:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.067394:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ffb7200/0xe984082ccd723ffd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0834 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.067420:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.067425:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143682.067426:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143682.067428:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffb7200/0xe984082ccd723ffd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [4894720->5242879] (req 4894720->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0834 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.067455:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.067463:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 35 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.067473:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593635712:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143682.067529:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.067964:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.068033:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591984000 00000100:00100000:3.0:1746143682.068037:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591984000 00002000:00100000:3.0:1746143682.068059:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2805760->2809855) req@ffff88013010df80 x1830963591984000/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.068071:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010df80 with x1830963591984000 ext(2805760->2809855) 00010000:00010000:3.0:1746143682.068077:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 36 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.068085:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 36 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746143682.068091:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013010df80 00000100:00100000:3.0:1746143682.068112:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 753 00000100:00100000:3.0:1746143682.068117:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963591984000:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143682.069610:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963591984000:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 1488us (1642us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143682.069621:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 753 00002000:00100000:3.0:1746143682.069628:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2805760->2809855) req@ffff88013010df80 x1830963591984000/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/4536 e 0 to 0 dl 1746143693 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.069634:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010df80 with x1830963591984000 ext(2805760->2809855) 00010000:00010000:3.0:1746143682.069640:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 36 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.069650:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 36 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746143682.069655:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013010df80 00000100:00100000:3.0:1746143682.070136:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593635712:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.070168:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ffb7200/0xe984082ccd723ffd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [4894720->5242879] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0834 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.070179:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffb7200, rc 0) 00000100:00100000:3.0:1746143682.070204:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28041:x1830963591983744:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2838us (2980us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.070210:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9009 00000100:00100000:0.0:1746143682.070781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.071083:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591984256 00000100:00100000:3.0:1746143682.071088:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591984256 00002000:00100000:3.0:1746143682.071112:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1806335) req@ffff88013010e300 x1830963591984256/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.071119:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010e300 with x1830963591984256 ext(1048576->1806335) 00002000:00010000:3.0:1746143682.071123:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013010e300 00000100:00100000:3.0:1746143682.071271:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3172 00000100:00100000:3.0:1746143682.071278:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591984256:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143682.072595:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.072647:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591984768 00000100:00100000:1.0:1746143682.072651:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591984768 00000100:00100000:1.0:1746143682.072686:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3277 00000100:00100000:1.0:1746143682.072691:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:28033:x1830963591984768:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143682.072851:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:28033:x1830963591984768:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 158us (257us total) trans 8589942205 rc 0/0 00000100:00100000:1.0:1746143682.072856:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3277 00000100:00100000:0.0:1746143682.075331:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.075599:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591984512 00000100:00100000:2.0:1746143682.075606:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591984512 00002000:00100000:2.0:1746143682.075635:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->2809855) req@ffff88013010ea00 x1830963591984512/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.075643:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010ea00 with x1830963591984512 ext(2097152->2809855) 00010000:00010000:2.0:1746143682.075650:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 38 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.075662:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 38 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:2.0:1746143682.075668:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013010ea00 00000100:00100000:2.0:1746143682.075682:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 754 00000100:00100000:2.0:1746143682.075687:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963591984512:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143682.081886:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963591984256:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10599us (11097us total) trans 0 rc 757760/757760 00000100:00100000:3.0:1746143682.081895:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3172 00002000:00100000:3.0:1746143682.081904:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1806335) req@ffff88013010e300 x1830963591984256/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 757760/757760 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.081912:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010e300 with x1830963591984256 ext(1048576->1806335) 00002000:00010000:3.0:1746143682.081917:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013010e300 00000100:00100000:3.0:1746143682.090416:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963591984512:12345-192.168.202.48@tcp:4:cat.0 Request processed in 14719us (15081us total) trans 17179872345 rc 0/0 00000100:00100000:3.0:1746143682.090427:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 754 00002000:00100000:3.0:1746143682.090436:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->2809855) req@ffff88013010ea00 x1830963591984512/t17179872345(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/448 e 0 to 0 dl 1746143693 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.090445:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010ea00 with x1830963591984512 ext(2097152->2809855) 00010000:00010000:3.0:1746143682.090453:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 38 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.090468:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 38 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746143682.090474:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013010ea00 00000100:00100000:0.0:1746143682.096211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.096258:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.096394:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591985024 00000100:00100000:3.0:1746143682.096402:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591985024 00010000:00010000:3.0:1746143682.096432:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 38 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.096454:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4587 00000100:00100000:3.0:1746143682.096460:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963591985024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.096470:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143682.096488:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 38 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.096498:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 38 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.096515:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7200/0xe984082ccd723fda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0811 expref: 38 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.096531:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.096533:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.096538:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffb7200/0xe984082ccd723ffd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0834 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.096546:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffb7200/0xe984082ccd723ffd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0834 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.096570:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffb7200/0xe984082ccd723ffd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0834 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143682.096581:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593635840:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143682.096641:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d25c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143682.096709:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591984896 00000100:00100000:2.0:1746143682.096712:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591984896 00000100:00100000:2.0:1746143682.096740:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9010 00000100:00100000:2.0:1746143682.096744:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:28048:x1830963591984896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143682.096756:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.096765:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130cc9200/0xe984082ccd724004 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a083b expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.096776:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.096777:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.096781:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130cc9200/0xe984082ccd724004 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a083b expref: 39 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.096790:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130cc9200/0xe984082ccd724004 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a083b expref: 39 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.096797:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cc9200, rc 0) 00000100:00100000:2.0:1746143682.096816:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:28048:x1830963591984896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 72us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.096822:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9010 00000100:00100000:0.0:1746143682.102833:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.102934:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593635840:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143682.102959:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.102994:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963591985024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6534us (6789us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.103002:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4587 00000100:00100000:2.0:1746143682.103166:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591985152 00000100:00100000:2.0:1746143682.103172:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591985152 00000100:00100000:2.0:1746143682.103199:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9011 00000100:00100000:2.0:1746143682.103205:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1962:x1830963591985152:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143682.103220:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.103233:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130cc9400/0xe984082ccd72400b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0842 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143682.103270:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593635968:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143682.104040:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.104185:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.104285:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591985408 00000100:00100000:3.0:1746143682.104291:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591985408 00002000:00100000:3.0:1746143682.104314:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2809856->3145727) req@ffff88013010f800 x1830963591985408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.104322:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010f800 with x1830963591985408 ext(2809856->3145727) 00002000:00010000:3.0:1746143682.104325:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013010f800 00000100:00100000:3.0:1746143682.104349:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3173 00000100:00100000:3.0:1746143682.104353:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963591985408:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143682.107930:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593635968:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143682.107966:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130cc9400/0xe984082ccd72400b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0842 expref: 24 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.107978:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cc9400/0xe984082ccd72400b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0842 expref: 24 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.108001:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cc9400, rc 0) 00000100:00100000:2.0:1746143682.108036:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1962:x1830963591985152:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4829us (5210us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143682.108042:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9011 00000100:00100000:3.0:1746143682.108277:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963591985408:12345-192.168.202.48@tcp:3:cat.0 Request processed in 3922us (4093us total) trans 0 rc 335872/335872 00000100:00100000:3.0:1746143682.108284:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3173 00002000:00100000:3.0:1746143682.108291:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2809856->3145727) req@ffff88013010f800 x1830963591985408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 335872/335872 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.108299:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010f800 with x1830963591985408 ext(2809856->3145727) 00002000:00010000:3.0:1746143682.108303:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013010f800 00000100:00100000:0.0:1746143682.112080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.112620:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591985536 00000100:00100000:2.0:1746143682.112627:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591985536 00000100:00100000:2.0:1746143682.112661:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9012 00000100:00100000:2.0:1746143682.112668:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:28048:x1830963591985536:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143682.112681:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.112694:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cc9600/0xe984082ccd724012 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0849 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.112720:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.112727:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143682.112729:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143682.112732:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cc9600/0xe984082ccd724012 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0849 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.112756:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.112766:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 26 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.112775:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593636096:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.112853:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143682.113760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.114019:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591985792 00000100:00100000:3.0:1746143682.114024:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591985792 00002000:00100000:3.0:1746143682.114049:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff8800a0361880 x1830963591985792/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.114063:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0361880 with x1830963591985792 ext(4894720->4898815) 00002000:00010000:3.0:1746143682.114066:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0361880 00000100:00100000:3.0:1746143682.114088:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3174 00000100:00100000:3.0:1746143682.114094:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963591985792:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143682.114159:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.114194:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591985920 00000100:00100000:1.0:1746143682.114197:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591985920 00002000:00100000:1.0:1746143682.114213:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3170303) req@ffff88013010c380 x1830963591985920/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.114219:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010c380 with x1830963591985920 ext(3145728->3170303) 00010000:00010000:1.0:1746143682.114225:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 27 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746143682.114236:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 27 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:1.0:1746143682.114241:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013010c380 00000100:00100000:1.0:1746143682.114254:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 755 00000100:00100000:1.0:1746143682.114259:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1962:x1830963591985920:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143682.114651:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593636096:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.114669:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cc9600/0xe984082ccd724012 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0849 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.114680:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cc9600, rc 0) 00000100:00100000:2.0:1746143682.114709:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28048:x1830963591985536:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2041us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.114715:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9012 00000100:00100000:1.0:1746143682.115155:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1962:x1830963591985920:12345-192.168.202.48@tcp:4:cat.0 Request processed in 878us (979us total) trans 21474839611 rc 0/0 00000100:00100000:1.0:1746143682.115161:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 755 00002000:00100000:1.0:1746143682.115166:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3170303) req@ffff88013010c380 x1830963591985920/t21474839611(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/448 e 0 to 0 dl 1746143693 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.115172:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010c380 with x1830963591985920 ext(3145728->3170303) 00010000:00010000:1.0:1746143682.115177:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 29 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746143682.115187:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 29 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:1.0:1746143682.115193:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013010c380 00000100:00100000:3.0:1746143682.118164:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963591985792:12345-192.168.202.48@tcp:3:cat.0 Request processed in 4061us (4396us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143682.118174:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3174 00002000:00100000:3.0:1746143682.118184:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff8800a0361880 x1830963591985792/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/4536 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.118192:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0361880 with x1830963591985792 ext(4894720->4898815) 00002000:00010000:3.0:1746143682.118196:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0361880 00000100:00100000:0.0:1746143682.121918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.122053:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591986048 00000100:00100000:3.0:1746143682.122061:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591986048 00010000:00010000:3.0:1746143682.123903:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 29 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.123939:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4588 00000100:00100000:3.0:1746143682.123948:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1964:x1830963591986048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.123970:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143682.123988:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 29 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.123998:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 29 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.124018:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cbc600/0xe984082ccd723fa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07f5 expref: 29 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.124051:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.124053:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.124059:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cc9600/0xe984082ccd724012 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0849 expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.124067:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cc9600/0xe984082ccd724012 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0849 expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.124095:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130cc9600/0xe984082ccd724012 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0849 expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143682.124106:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593636224:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143682.124200:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d25c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143682.124800:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.124852:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591986304 00000100:00100000:0.0:1746143682.124857:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591986304 00000100:00100000:0.0:1746143682.124893:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3278 00000100:00100000:0.0:1746143682.124898:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28041:x1830963591986304:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1746143682.125050:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28041:x1830963591986304:12345-192.168.202.48@tcp:35:cat.0 Request processed in 150us (249us total) trans 8589942206 rc 0/0 00000100:00100000:0.0:1746143682.125056:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3278 00000100:00080000:3.0:1746143682.125357:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143682.126906:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593636224:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143682.126920:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.130254:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1964:x1830963591986048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6298us (8331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.130264:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4588 00000100:00100000:0.0:1746143682.144224:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.144258:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.144289:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.144368:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591986560 00000100:00100000:2.0:1746143682.144376:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591986560 00002000:00100000:2.0:1746143682.144414:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88013010ca80 x1830963591986560/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.144422:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010ca80 with x1830963591986560 ext(2097152->3145727) 00002000:00010000:2.0:1746143682.144427:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013010ca80 00000100:00100000:2.0:1746143682.144439:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591986688 00000100:00100000:2.0:1746143682.144441:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591986688 00002000:00100000:2.0:1746143682.144450:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88013010ce00 x1830963591986688/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.144455:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010ce00 with x1830963591986688 ext(3145728->4194303) 00002000:00010000:2.0:1746143682.144458:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013010ce00 00000100:00100000:2.0:1746143682.144465:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591987072 00000100:00100000:2.0:1746143682.144467:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591987072 00002000:00100000:2.0:1746143682.144476:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88013010d500 x1830963591987072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.144481:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010d500 with x1830963591987072 ext(3145728->4194303) 00002000:00010000:2.0:1746143682.144484:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013010d500 00000100:00100000:2.0:1746143682.144493:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3175 00000100:00100000:2.0:1746143682.144498:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963591986560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143682.146681:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3176 00000100:00100000:3.0:1746143682.146691:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963591986688:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143682.147787:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3177 00000100:00100000:3.0:1746143682.147796:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963591987072:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143682.163621:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963591986560:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19114us (19396us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143682.163634:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3175 00002000:00100000:2.0:1746143682.163643:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88013010ca80 x1830963591986560/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.163652:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010ca80 with x1830963591986560 ext(2097152->3145727) 00002000:00010000:2.0:1746143682.163657:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013010ca80 00000100:00100000:3.0:1746143682.172856:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963591986688:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26160us (28590us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143682.172866:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3176 00002000:00100000:3.0:1746143682.172876:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88013010ce00 x1830963591986688/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.172885:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010ce00 with x1830963591986688 ext(3145728->4194303) 00002000:00010000:3.0:1746143682.172890:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013010ce00 00000100:00100000:3.0:1746143682.176270:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963591987072:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28468us (31973us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143682.176279:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3177 00002000:00100000:3.0:1746143682.176288:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88013010d500 x1830963591987072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.176297:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010d500 with x1830963591987072 ext(3145728->4194303) 00002000:00010000:3.0:1746143682.176302:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013010d500 00000100:00100000:0.0:1746143682.193225:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.193315:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591987328 00000100:00100000:3.0:1746143682.193324:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591987328 00002000:00100000:3.0:1746143682.193361:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88013010d880 x1830963591987328/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.193370:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010d880 with x1830963591987328 ext(4194304->4898815) 00002000:00010000:3.0:1746143682.193375:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013010d880 00000100:00100000:3.0:1746143682.193392:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3178 00000100:00100000:3.0:1746143682.193399:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963591987328:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143682.202876:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963591987328:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9468us (9649us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143682.202886:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3178 00002000:00100000:3.0:1746143682.202896:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88013010d880 x1830963591987328/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.202904:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013010d880 with x1830963591987328 ext(4194304->4898815) 00002000:00010000:3.0:1746143682.202910:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013010d880 00000100:00100000:0.0:1746143682.203862:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.204153:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591987584 00000100:00100000:3.0:1746143682.204160:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591987584 00000100:00100000:3.0:1746143682.204199:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8146 00000100:00100000:3.0:1746143682.204205:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28052:x1830963591987584:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143682.204225:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.204239:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7800/0xe984082ccd724019 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0850 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.204311:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.204323:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbda00/0xe984082ccd723f8d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07e7 expref: 25 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.204330:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7e00/0xe984082ccd723fcc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a080a expref: 255 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.204335:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.204356:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7e00/0xe984082ccd723fcc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a080a expref: 255 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.204366:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7e00/0xe984082ccd723fcc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a080a expref: 255 pid: 14764 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.204376:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593636352:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.205769:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbda00/0xe984082ccd723f8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07e7 expref: 25 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.205778:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbda00/0xe984082ccd723f8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07e7 expref: 25 pid: 14763 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.205788:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593636480:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143682.206612:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.214134:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.214280:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593636352:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143682.214289:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593636480:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.214310:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:1.0:1746143682.215190:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.215351:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591987712 00000100:00100000:0.0:1746143682.215358:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591987712 00010000:00010000:0.0:1746143682.215385:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7e00/0xe984082ccd723fcc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a080a expref: 256 pid: 14764 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.216594:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591987840 00000100:00100000:2.0:1746143682.216599:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591987840 00010000:00010000:2.0:1746143682.216617:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbda00/0xe984082ccd723f8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07e7 expref: 26 pid: 14763 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.216636:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4589 00000100:00100000:2.0:1746143682.216642:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:1964:x1830963591987712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143682.216652:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143682.216657:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7e00/0xe984082ccd723fcc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a080a expref: 256 pid: 14764 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.216666:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7e00/0xe984082ccd723fcc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a080a expref: 256 pid: 14764 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.216681:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7e00/0xe984082ccd723fcc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a080a expref: 256 pid: 14764 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.216697:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143682.216701:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143682.216708:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143682.216713:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143682.216752:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1964:x1830963591987712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 109us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.216757:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4589 00000100:00100000:2.0:1746143682.216776:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4590 00000100:00100000:2.0:1746143682.216781:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963591987840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143682.216786:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143682.216790:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbda00/0xe984082ccd723f8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07e7 expref: 26 pid: 14763 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.216797:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbda00/0xe984082ccd723f8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07e7 expref: 26 pid: 14763 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.216805:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbda00/0xe984082ccd723f8d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07e7 expref: 26 pid: 14763 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.216812:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143682.216815:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143682.216819:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143682.216824:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143682.216845:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143682.216860:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963591987840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 79us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.216869:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4590 00010000:00010000:2.0:1746143682.216888:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143682.216893:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:2.0:1746143682.216908:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143682.217030:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7800/0xe984082ccd724019 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0850 expref: 26 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.217040:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0850 expref: 25 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.217045:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143682.217047:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143682.217049:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffb7400, rc 0) 00000100:00100000:2.0:1746143682.217070:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28052:x1830963591987584:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 12865us (13211us total) trans 8589942207 rc 0/0 00000100:00100000:2.0:1746143682.217075:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8146 00000100:00100000:3.0:1746143682.219158:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.219836:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591988096 00000100:00100000:2.0:1746143682.219843:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591988096 00000100:00100000:2.0:1746143682.219882:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3279 00000100:00100000:2.0:1746143682.219888:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:28048:x1830963591988096:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143682.220420:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:28048:x1830963591988096:12345-192.168.202.48@tcp:35:cat.0 Request processed in 530us (1267us total) trans 8589942208 rc 0/0 00000100:00100000:2.0:1746143682.220427:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3279 00000100:00100000:0.0:1746143682.257434:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.257588:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591988352 00000100:00100000:2.0:1746143682.257596:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591988352 00000100:00100000:2.0:1746143682.257634:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8147 00000100:00100000:2.0:1746143682.257640:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013010ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28056:x1830963591988352:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143682.257660:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.258119:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095729c00/0xe984082ccd72402e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0857 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.258906:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6a00/0xe984082ccd724035 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.258918:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6a00/0xe984082ccd724035 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.258928:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6a00/0xe984082ccd724035 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.258941:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7600/0xe984082ccd72403c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.258946:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7600/0xe984082ccd72403c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.258962:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7600/0xe984082ccd72403c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259057:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd724043 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259065:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd724043 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259070:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd724043 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143682.259077:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143682.259164:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6a00/0xe984082ccd724035 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259170:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6a00/0xe984082ccd724035 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259175:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6a00/0xe984082ccd724035 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259180:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffb6a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143682.259183:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6a00/0xe984082ccd724035 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259188:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6a00/0xe984082ccd724035 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259198:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143682.259200:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143682.259204:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6a00/0xe984082ccd724035 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259212:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6a00/0xe984082ccd724035 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259235:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7600/0xe984082ccd72403c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259238:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7600/0xe984082ccd72403c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259242:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7600/0xe984082ccd72403c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259246:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffb7600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143682.259248:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7600/0xe984082ccd72403c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259252:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7600/0xe984082ccd72403c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259257:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f0f2200) 00010000:00010000:3.0:1746143682.259259:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143682.259261:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7600/0xe984082ccd72403c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259265:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7600/0xe984082ccd72403c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.259297:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095729c00/0xe984082ccd72402e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0857 expref: 28 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.259308:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd724043 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0857 expref: 27 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.259313:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143682.259315:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143682.259317:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffb7000, rc 0) 00000100:00100000:3.0:1746143682.259372:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013010ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+27:28056:x1830963591988352:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1731us (1945us total) trans 8589942209 rc 0/0 00000100:00100000:3.0:1746143682.259378:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8147 00000100:00100000:0.0:1746143682.262091:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.262185:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591988608 00000100:00100000:1.0:1746143682.262194:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591988608 00000100:00100000:1.0:1746143682.262245:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 534 00000100:00100000:1.0:1746143682.262253:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1963:x1830963591988608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143682.262266:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143682.262284:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd724043 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0857 expref: 27 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143682.262315:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143682.262319:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143682.262349:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1963:x1830963591988608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143682.262355:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 534 00000100:00100000:0.0:1746143682.264025:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.264068:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591988480 00000100:00100000:2.0:1746143682.264072:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591988480 00000100:00100000:2.0:1746143682.264113:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9013 00000100:00100000:2.0:1746143682.264119:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1962:x1830963591988480:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143682.264133:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.264163:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095729a00/0xe984082ccd724051 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a085e expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143682.264206:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593636608:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143682.264285:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143682.264575:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.264637:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591988736 00000100:00100000:0.0:1746143682.264641:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591988736 00000100:00100000:0.0:1746143682.264661:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9014 00000100:00100000:0.0:1746143682.264666:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1963:x1830963591988736:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143682.264673:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143682.264681:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b15ea00/0xe984082ccd724058 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0865 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.264693:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143682.264694:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143682.264700:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15ea00/0xe984082ccd724058 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0865 expref: 29 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.264912:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b15ea00/0xe984082ccd724058 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0865 expref: 29 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.264923:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b15ea00, rc 0) 00000100:00100000:0.0:1746143682.265405:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1963:x1830963591988736:12345-192.168.202.48@tcp:101:cat.0 Request processed in 737us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143682.265411:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9014 00000100:00100000:2.0:1746143682.268174:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593636608:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143682.268201:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095729a00/0xe984082ccd724051 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a085e expref: 24 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.268214:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095729a00/0xe984082ccd724051 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a085e expref: 24 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.268362:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095729a00, rc 0) 00000100:00100000:2.0:1746143682.268540:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1962:x1830963591988480:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4419us (4518us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143682.268547:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9013 00000100:00100000:0.0:1746143682.277572:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.277661:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591988864 00000100:00100000:2.0:1746143682.277668:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591988864 00000100:00100000:2.0:1746143682.277715:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9015 00000100:00100000:2.0:1746143682.277721:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28056:x1830963591988864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143682.277736:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.277751:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095729800/0xe984082ccd72405f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a086c expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.277776:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 37 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.277782:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143682.277784:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143682.277786:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095729800/0xe984082ccd72405f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a086c expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.277811:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 37 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.277821:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 37 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.277831:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593636736:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.277913:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143682.282999:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593636736:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.283026:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095729800/0xe984082ccd72405f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a086c expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.283038:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095729800, rc 0) 00000100:00100000:2.0:1746143682.283087:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28056:x1830963591988864:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5366us (5521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.283095:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9015 00000100:00100000:0.0:1746143682.283772:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.283880:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591988992 00000100:00100000:3.0:1746143682.283886:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591988992 00002000:00100000:3.0:1746143682.283914:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1806336->2097151) req@ffff88009538a300 x1830963591988992/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.283922:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009538a300 with x1830963591988992 ext(1806336->2097151) 00010000:00010000:3.0:1746143682.283928:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 38 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.283938:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 38 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746143682.283943:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009538a300 00000100:00100000:3.0:1746143682.283973:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 756 00000100:00100000:3.0:1746143682.283979:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009538a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963591988992:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143682.294206:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009538a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963591988992:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10217us (10425us total) trans 17179872346 rc 0/0 00000100:00100000:3.0:1746143682.294221:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 756 00002000:00100000:3.0:1746143682.294233:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1806336->2097151) req@ffff88009538a300 x1830963591988992/t17179872346(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/448 e 0 to 0 dl 1746143693 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.294242:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009538a300 with x1830963591988992 ext(1806336->2097151) 00010000:00010000:3.0:1746143682.294251:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 40 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.294265:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 40 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746143682.294271:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009538a300 00000100:00100000:0.0:1746143682.300609:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.300719:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591989120 00000100:00100000:3.0:1746143682.300727:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591989120 00010000:00010000:3.0:1746143682.300759:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 40 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.300798:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4591 00000100:00100000:3.0:1746143682.300804:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009538bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963591989120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.300817:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143682.300835:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 40 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.300844:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 40 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.300866:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cbc000/0xe984082ccd723fa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07fc expref: 40 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.300897:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.300899:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.300906:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095729800/0xe984082ccd72405f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a086c expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.300913:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095729800/0xe984082ccd72405f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a086c expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.300941:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095729800/0xe984082ccd72405f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a086c expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143682.300960:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593636864:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143682.301038:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143682.309771:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593636864:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143682.309794:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.310097:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009538bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1963:x1830963591989120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9290us (9491us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.310108:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4591 00000100:00100000:0.0:1746143682.311212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.314517:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591989376 00000100:00100000:3.0:1746143682.314530:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591989376 00002000:00100000:3.0:1746143682.314573:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009538b800 x1830963591989376/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.314588:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009538b800 with x1830963591989376 ext(1048576->2097151) 00002000:00010000:3.0:1746143682.314593:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009538b800 00000100:00100000:3.0:1746143682.314635:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3179 00000100:00100000:3.0:1746143682.314642:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009538b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1962:x1830963591989376:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143682.321472:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.321752:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591989632 00000100:00100000:3.0:1746143682.321760:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591989632 00000100:00100000:3.0:1746143682.321811:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8148 00000100:00100000:3.0:1746143682.321817:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:28058:x1830963591989632:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143682.321839:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.321860:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6000/0xe984082ccd724066 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0873 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.321971:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6600/0xe984082ccd72406d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.321982:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6600/0xe984082ccd72406d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.321991:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6600/0xe984082ccd72406d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322002:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6800/0xe984082ccd724074 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322008:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6800/0xe984082ccd724074 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322012:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6800/0xe984082ccd724074 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322105:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd72407b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322113:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd72407b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322118:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd72407b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143682.322125:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143682.322221:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6600/0xe984082ccd72406d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322227:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6600/0xe984082ccd72406d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322233:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6600/0xe984082ccd72406d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322238:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffb6600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143682.322241:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6600/0xe984082ccd72406d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322247:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6600/0xe984082ccd72406d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322256:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143682.322259:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143682.322262:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6600/0xe984082ccd72406d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322267:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6600/0xe984082ccd72406d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322296:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6800/0xe984082ccd724074 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322300:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6800/0xe984082ccd724074 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322304:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6800/0xe984082ccd724074 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322307:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffb6800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143682.322309:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6800/0xe984082ccd724074 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322313:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6800/0xe984082ccd724074 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322318:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f0f2800) 00010000:00010000:3.0:1746143682.322319:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143682.322321:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6800/0xe984082ccd724074 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322325:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6800/0xe984082ccd724074 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.322352:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb6000/0xe984082ccd724066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0873 expref: 259 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.322361:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd72407b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0873 expref: 258 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.322366:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143682.322368:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143682.322370:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffb7000, rc 0) 00000100:00100000:3.0:1746143682.322411:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:28058:x1830963591989632:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 595us (949us total) trans 8589942210 rc 0/0 00000100:00100000:3.0:1746143682.322416:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8148 00000100:00100000:0.0:1746143682.330328:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.330439:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591989760 00000100:00100000:2.0:1746143682.330447:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591989760 00000100:00100000:3.0:1746143682.330768:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009538b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1962:x1830963591989376:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16125us (19558us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143682.330778:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3179 00002000:00100000:3.0:1746143682.330787:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009538b800 x1830963591989376/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.330795:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009538b800 with x1830963591989376 ext(1048576->2097151) 00002000:00010000:3.0:1746143682.330800:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009538b800 00000100:00100000:2.0:1746143682.335583:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 535 00000100:00100000:2.0:1746143682.335598:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095388000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:1965:x1830963591989760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143682.335612:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143682.335633:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7000/0xe984082ccd72407b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0873 expref: 258 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.335660:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143682.335663:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143682.335707:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095388000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:1965:x1830963591989760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 116us (5388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.335713:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 535 00000100:00100000:0.0:1746143682.346438:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.347542:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.347571:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.347868:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591990016 00000100:00100000:3.0:1746143682.347876:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591990016 00002000:00100000:3.0:1746143682.347915:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880095389c00 x1830963591990016/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.347924:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095389c00 with x1830963591990016 ext(2097152->3145727) 00002000:00010000:3.0:1746143682.347929:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095389c00 00000100:00100000:3.0:1746143682.347965:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591990272 00000100:00100000:3.0:1746143682.347968:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591990272 00002000:00100000:3.0:1746143682.347984:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009538b480 x1830963591990272/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.347991:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009538b480 with x1830963591990272 ext(3145728->4194303) 00002000:00010000:3.0:1746143682.347996:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009538b480 00000100:00100000:3.0:1746143682.348004:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591990528 00000100:00100000:3.0:1746143682.348006:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591990528 00002000:00100000:3.0:1746143682.348024:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880095389500 x1830963591990528/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.348034:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095389500 with x1830963591990528 ext(2097152->3145727) 00002000:00010000:3.0:1746143682.348040:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095389500 00000100:00100000:3.0:1746143682.348054:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3180 00000100:00100000:3.0:1746143682.348063:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963591990016:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143682.348336:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3181 00000100:00100000:1.0:1746143682.348342:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3182 00000100:00100000:2.0:1746143682.348343:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963591990272:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143682.348350:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1965:x1830963591990528:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143682.351630:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.351809:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591990784 00000100:00100000:2.0:1746143682.351816:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591990784 00000100:00100000:2.0:1746143682.352091:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9016 00000100:00100000:2.0:1746143682.352099:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28058:x1830963591990784:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143682.352114:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.352128:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a087a expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.352163:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6600/0xe984082ccd723eb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0785 expref: 36 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.352171:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b15e400/0xe984082ccd723f5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d9 expref: 30 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.352177:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd723f16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a8 expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.352182:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.352184:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.352186:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [1830912->2097151] (req 1830912->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.352209:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd723f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a8 expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.352224:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd723f16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a8 expref: 10 pid: 12618 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746143682.352236:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593636992:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.352310:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b15e400/0xe984082ccd723f5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d9 expref: 30 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.352319:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b15e400/0xe984082ccd723f5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d9 expref: 30 pid: 8496 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746143682.352326:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593637120:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.352350:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6600/0xe984082ccd723eb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0785 expref: 36 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.352357:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6600/0xe984082ccd723eb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0785 expref: 36 pid: 9527 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.352363:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593637248:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.352377:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143682.352466:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.352483:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591990912 00000100:00100000:1.0:1746143682.352487:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591990912 00002000:00100000:1.0:1746143682.352511:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f4ee680 x1830963591990912/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.352520:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ee680 with x1830963591990912 ext(3145728->4194303) 00002000:00010000:1.0:1746143682.352524:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ee680 00000100:00100000:1.0:1746143682.352543:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3183 00000100:00100000:1.0:1746143682.352589:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1964:x1830963591990912:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143682.363429:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593636992:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.363440:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593637120:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.363448:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593637248:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.363475:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [1830912->2097151] (req 1830912->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.363490:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095729000, rc 0) 00000100:00100000:2.0:1746143682.363541:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:28058:x1830963591990784:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 11441us (11915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.363549:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9016 00000100:00100000:0.0:1746143682.367131:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.367173:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.367217:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.367569:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591991168 00000100:00100000:3.0:1746143682.367578:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591991168 00010000:00010000:3.0:1746143682.367610:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15e400/0xe984082ccd723f5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d9 expref: 33 pid: 8496 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746143682.368048:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591991040 00000100:00100000:3.0:1746143682.368052:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591991040 00010000:00010000:3.0:1746143682.368072:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd723f16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a8 expref: 11 pid: 12618 timeout: 861 lvb_type: 1 00000100:00080000:0.0:1746143682.368509:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143682.368699:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591991296 00000100:00100000:1.0:1746143682.368703:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591991296 00000100:00100000:3.0:1746143682.368707:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4592 00000100:00100000:3.0:1746143682.368715:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+33:1965:x1830963591991168:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.368727:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143682.368728:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6600/0xe984082ccd723eb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0785 expref: 36 pid: 9527 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.368746:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b15e400/0xe984082ccd723f5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d9 expref: 33 pid: 8496 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746143682.368753:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4593 00010000:00010000:3.0:1746143682.368756:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b15e400/0xe984082ccd723f5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d9 expref: 33 pid: 8496 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746143682.368760:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963591991040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.368774:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15e400/0xe984082ccd723f5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d9 expref: 33 pid: 8496 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746143682.368774:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143682.368789:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd723f16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a8 expref: 11 pid: 12618 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746143682.368791:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143682.368798:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd723f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a8 expref: 11 pid: 12618 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746143682.368809:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd723f16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a8 expref: 11 pid: 12618 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746143682.368821:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.368830:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1965:x1830963591991168:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 115us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.368835:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4592 00000100:00100000:1.0:1746143682.368840:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963591991040:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 81us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143682.368845:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4593 00000100:00100000:3.0:1746143682.368849:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4594 00000100:00100000:3.0:1746143682.368854:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591991296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.369375:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143682.369384:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6600/0xe984082ccd723eb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0785 expref: 36 pid: 9527 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.369393:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6600/0xe984082ccd723eb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0785 expref: 36 pid: 9527 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.369404:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6600/0xe984082ccd723eb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0785 expref: 36 pid: 9527 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.369411:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.369413:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.369419:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.369426:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.369450:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143682.369461:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593637376:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143682.369512:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143682.371571:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1965:x1830963591990528:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23215us (23991us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143682.371583:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3182 00002000:00100000:1.0:1746143682.371594:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880095389500 x1830963591990528/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.371603:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095389500 with x1830963591990528 ext(2097152->3145727) 00002000:00010000:1.0:1746143682.371608:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095389500 00000100:00100000:2.0:1746143682.375259:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963591990272:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26908us (27711us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143682.375268:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3181 00002000:00100000:2.0:1746143682.375278:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009538b480 x1830963591990272/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.375286:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009538b480 with x1830963591990272 ext(3145728->4194303) 00002000:00010000:2.0:1746143682.375290:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009538b480 00000100:00100000:0.0:1746143682.377283:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.377352:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591991552 00000100:00100000:2.0:1746143682.377359:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591991552 00002000:00100000:2.0:1746143682.377390:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1830912->1835007) req@ffff88009bfe1c00 x1830963591991552/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.377399:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1c00 with x1830963591991552 ext(1830912->1835007) 00002000:00010000:2.0:1746143682.377403:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe1c00 00000100:00100000:2.0:1746143682.377435:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3184 00000100:00100000:2.0:1746143682.377450:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591991552:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143682.377509:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593637376:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143682.377527:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.377561:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591991296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8706us (10343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.377568:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963591991552:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 126us (290us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143682.377570:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4594 00000100:00100000:2.0:1746143682.377574:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3184 00002000:00100000:2.0:1746143682.377578:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1830912->1835007) req@ffff88009bfe1c00 x1830963591991552/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/4536 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.377584:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1c00 with x1830963591991552 ext(1830912->1835007) 00002000:00010000:2.0:1746143682.377587:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe1c00 00000100:00100000:2.0:1746143682.377797:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963591990016:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29734us (31366us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143682.377805:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3180 00002000:00100000:2.0:1746143682.377810:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880095389c00 x1830963591990016/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.377815:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095389c00 with x1830963591990016 ext(2097152->3145727) 00002000:00010000:2.0:1746143682.377818:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095389c00 00000100:00100000:1.0:1746143682.380090:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1964:x1830963591990912:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27535us (27617us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143682.380099:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3183 00002000:00100000:1.0:1746143682.380106:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f4ee680 x1830963591990912/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.380115:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ee680 with x1830963591990912 ext(3145728->4194303) 00002000:00010000:1.0:1746143682.380119:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ee680 00000100:00100000:0.0:1746143682.381490:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.382748:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591991680 00000100:00100000:2.0:1746143682.382756:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591991680 00000100:00100000:2.0:1746143682.382795:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9017 00000100:00100000:2.0:1746143682.382802:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:28058:x1830963591991680:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143682.382817:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.382836:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0881 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.382859:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095729800/0xe984082ccd72405f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a086c expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.382869:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.382871:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.382874:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->1138687] (req 1048576->1138687) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 40 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.382898:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095729800/0xe984082ccd72405f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a086c expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.382908:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095729800/0xe984082ccd72405f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a086c expref: 23 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.382921:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593637504:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.383005:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143682.386010:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593637504:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.386033:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->1138687] (req 1048576->1138687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 40 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.386047:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095728800, rc 0) 00000100:00100000:2.0:1746143682.386094:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:28058:x1830963591991680:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3292us (4607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.386101:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9017 00000100:00100000:0.0:1746143682.394321:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.394365:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.394409:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.394468:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591991936 00000100:00100000:1.0:1746143682.394476:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591991936 00000100:00100000:2.0:1746143682.394490:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591992064 00000100:00100000:2.0:1746143682.394494:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591992064 00000100:00100000:1.0:1746143682.394528:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9018 00000100:00100000:1.0:1746143682.394536:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1965:x1830963591991936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143682.394551:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143682.394554:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591991808 00000100:00100000:3.0:1746143682.394558:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591991808 00010000:00010000:1.0:1746143682.394565:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c59c600/0xe984082ccd724097 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0888 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.394577:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095729800/0xe984082ccd72405f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a086c expref: 25 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.394596:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4595 00000100:00100000:3.0:1746143682.394602:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963591991808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.394612:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143682.394612:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593637632:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143682.394631:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095729800/0xe984082ccd72405f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a086c expref: 25 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.394641:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095729800/0xe984082ccd72405f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a086c expref: 25 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.394658:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095729800/0xe984082ccd72405f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a086c expref: 25 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746143682.394670:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143682.394678:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.394680:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.394686:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.394695:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.395315:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143682.395327:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593637760:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143682.395617:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6bb40 going to sleep for 11 seconds 00002000:00010000:1.0:1746143682.396302:0:21542:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime: 1746143681 -> 1746143682 00002000:00010000:1.0:1746143682.396306:0:21542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime: 1746143679 -> 1746143681 00002000:00010000:1.0:1746143682.396307:0:21542:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime: 1746143681 -> 1746143682 00000100:00100000:1.0:1746143682.396322:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593637632:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143682.396342:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c59c600/0xe984082ccd724097 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0888 expref: 29 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143682.396352:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c59c600/0xe984082ccd724097 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0888 expref: 29 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143682.396378:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c59c600, rc 0) 00000100:00100000:1.0:1746143682.396401:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1965:x1830963591991936:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1866us (2035us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143682.396408:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9018 00000100:00100000:2.0:1746143682.397067:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9019 00000100:00100000:2.0:1746143682.397076:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963591992064:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143682.397088:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.397098:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72409e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a088f expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143682.397130:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593637888:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143682.397176:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143682.397532:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593637760:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143682.397543:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.397560:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963591991808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2959us (3249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.397566:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4595 00000100:00100000:0.0:1746143682.400464:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.400631:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591992320 00000100:00100000:1.0:1746143682.400638:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591992320 00002000:00100000:1.0:1746143682.400674:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1134592->1138687) req@ffff8800949f1f80 x1830963591992320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.400683:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1f80 with x1830963591992320 ext(1134592->1138687) 00002000:00010000:1.0:1746143682.400687:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f1f80 00000100:00100000:1.0:1746143682.400706:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3185 00000100:00100000:1.0:1746143682.400713:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963591992320:12345-192.168.202.48@tcp:3:multiop.0 00002000:00010000:2.0:1746143682.400781:0:15784:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143681 -> 1746143682 00002000:00010000:2.0:1746143682.400784:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143681 -> 1746143682 00000100:00100000:2.0:1746143682.400793:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593637888:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143682.400818:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72409e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a088f expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.400828:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72409e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a088f expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.400840:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095728e00, rc 0) 00000100:00100000:1.0:1746143682.400846:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963591992320:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 133us (389us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143682.400853:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3185 00002000:00100000:1.0:1746143682.400857:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1134592->1138687) req@ffff8800949f1f80 x1830963591992320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/4536 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.400864:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1f80 with x1830963591992320 ext(1134592->1138687) 00002000:00010000:1.0:1746143682.400867:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f1f80 00000100:00100000:2.0:1746143682.400875:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591992064:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3802us (6465us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143682.400881:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9019 00000100:00100000:0.0:1746143682.408133:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.408318:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591992576 00000100:00100000:2.0:1746143682.408325:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591992576 00000100:00100000:2.0:1746143682.408373:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3280 00000100:00100000:2.0:1746143682.408381:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009498f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:28058:x1830963591992576:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143682.409563:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009498f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:28058:x1830963591992576:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 1180us (1435us total) trans 8589942211 rc 0/0 00000100:00100000:2.0:1746143682.409571:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3280 00000100:00100000:3.0:1746143682.410372:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.410698:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591992832 00000100:00100000:0.0:1746143682.410704:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591992832 00002000:00100000:0.0:1746143682.410741:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4894719) req@ffff880094763480 x1830963591992832/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.410749:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763480 with x1830963591992832 ext(4194304->4894719) 00002000:00010000:0.0:1746143682.410753:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094763480 00000100:00100000:0.0:1746143682.410783:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3186 00000100:00100000:0.0:1746143682.410789:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591992832:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143682.420110:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.420404:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591992960 00000100:00100000:2.0:1746143682.420413:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591992960 00000100:00100000:2.0:1746143682.420446:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9020 00000100:00100000:2.0:1746143682.420452:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+28:28052:x1830963591992960:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143682.420466:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.420479:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0896 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.420500:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cc9600/0xe984082ccd724012 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0849 expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.420509:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b15ea00/0xe984082ccd724058 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0865 expref: 29 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.420514:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.420520:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.420524:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.420547:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b15ea00/0xe984082ccd724058 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0865 expref: 29 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.420556:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b15ea00/0xe984082ccd724058 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0865 expref: 29 pid: 21542 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746143682.420566:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593638016:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.420644:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130cc9600/0xe984082ccd724012 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0849 expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.420651:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130cc9600/0xe984082ccd724012 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0849 expref: 34 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.420659:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593638144:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.420677:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143682.421307:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591992832:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10515us (10933us total) trans 0 rc 700416/700416 00000100:00100000:1.0:1746143682.421316:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3186 00002000:00100000:1.0:1746143682.421325:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4894719) req@ffff880094763480 x1830963591992832/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 700416/700416 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.421337:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763480 with x1830963591992832 ext(4194304->4894719) 00002000:00010000:1.0:1746143682.421343:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094763480 00000100:00100000:0.0:1746143682.425510:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.425598:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591993088 00000100:00100000:3.0:1746143682.425606:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591993088 00010000:00010000:3.0:1746143682.425637:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15ea00/0xe984082ccd724058 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0865 expref: 30 pid: 21542 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746143682.425660:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4596 00000100:00100000:3.0:1746143682.425667:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1964:x1830963591993088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.425679:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143682.425699:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b15ea00/0xe984082ccd724058 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0865 expref: 30 pid: 21542 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746143682.425709:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b15ea00/0xe984082ccd724058 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0865 expref: 30 pid: 21542 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746143682.425727:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.425778:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1964:x1830963591993088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 110us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.425784:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4596 00010000:00010000:2.0:1746143682.425870:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15ea00/0xe984082ccd724058 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0865 expref: 29 pid: 21542 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746143682.425891:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593638016:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.425900:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593638144:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.425919:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2658304->3145727] (req 2658304->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.425928:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095728c00, rc 0) 00000100:00100000:2.0:1746143682.425962:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+28:28052:x1830963591992960:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5495us (5846us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.425969:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9020 00000100:00100000:0.0:1746143682.428958:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.428996:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.429041:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.429099:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591993216 00000100:00100000:1.0:1746143682.429106:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591993216 00000100:00100000:3.0:1746143682.429116:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591993472 00000100:00100000:3.0:1746143682.429120:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591993472 00000100:00100000:1.0:1746143682.429136:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591993344 00000100:00100000:1.0:1746143682.429156:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591993344 00000100:00100000:3.0:1746143682.429163:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9021 00000100:00100000:3.0:1746143682.429170:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1964:x1830963591993216:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143682.429175:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9022 00000100:00100000:1.0:1746143682.429180:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1964:x1830963591993472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143682.429185:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143682.429192:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.429198:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ffb7600/0xe984082ccd7240ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a089d expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143682.429200:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c59ce00/0xe984082ccd7240b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08ab expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143682.429216:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143682.429224:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c59ce00/0xe984082ccd7240b3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08ab expref: 31 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143682.429232:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c59ce00/0xe984082ccd7240b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08ab expref: 31 pid: 21542 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143682.429239:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593638272:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143682.429298:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6bb40 going to sleep for 11 seconds 00010000:00010000:1.0:1746143682.429405:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c59ce00, rc 0) 00000100:00100000:1.0:1746143682.429428:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1964:x1830963591993472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 247us (431us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143682.429434:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9022 00000100:00100000:1.0:1746143682.429447:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9023 00000100:00100000:1.0:1746143682.429452:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591993344:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143682.429459:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143682.429467:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c59d000/0xe984082ccd7240ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08a4 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143682.429488:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593638400:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143682.430095:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.436081:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593638400:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143682.436107:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c59d000/0xe984082ccd7240ba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08a4 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.436120:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c59d000/0xe984082ccd7240ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08a4 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.436134:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c59d000, rc 0) 00000100:00100000:0.0:1746143682.436187:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963591993344:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6733us (7144us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143682.436194:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9023 00000100:00100000:3.0:1746143682.437056:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593638272:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143682.437075:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ffb7600/0xe984082ccd7240ac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a089d expref: 29 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.437088:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffb7600/0xe984082ccd7240ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a089d expref: 29 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.437100:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffb7600, rc 0) 00000100:00100000:3.0:1746143682.437122:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1964:x1830963591993216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7952us (8181us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143682.437127:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9021 00000100:00100000:0.0:1746143682.441483:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.441590:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591993600 00000100:00100000:0.0:1746143682.441598:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591993600 00010000:00010000:0.0:1746143682.441626:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130cc9600/0xe984082ccd724012 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0849 expref: 35 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746143682.441648:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4597 00000100:00100000:0.0:1746143682.441654:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963591993600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143682.441664:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143682.441681:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130cc9600/0xe984082ccd724012 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0849 expref: 35 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746143682.441690:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130cc9600/0xe984082ccd724012 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0849 expref: 35 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746143682.441706:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cc9600/0xe984082ccd724012 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0849 expref: 35 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746143682.441716:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143682.441717:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143682.441722:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.441733:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.441757:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143682.441772:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593638528:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143682.441821:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.446605:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.446625:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591993856 00000100:00100000:0.0:1746143682.446627:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.446632:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591993856 00000100:00100000:0.0:1746143682.446654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.446671:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591993728 00000100:00100000:3.0:1746143682.446673:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591993728 00000100:00100000:0.0:1746143682.446683:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.446695:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591993984 00000100:00100000:3.0:1746143682.446697:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591993984 00000100:00100000:0.0:1746143682.446701:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9024 00000100:00100000:0.0:1746143682.446710:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591993856:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143682.446713:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9025 00000100:00100000:3.0:1746143682.446717:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1965:x1830963591993728:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143682.446723:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.446725:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.446736:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ffb6800/0xe984082ccd7240c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08b2 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.446736:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd7240c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08b9 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143682.446773:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593638656:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143682.446773:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593638784:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143682.446833:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.446838:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593638528:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143682.446847:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9026 00010000:00010000:0.0:1746143682.446851:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.446852:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1965:x1830963591993984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143682.446858:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.446864:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ffb7c00/0xe984082ccd7240cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08c0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143682.446867:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591993600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5213us (5390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143682.446874:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4597 00000100:00100000:3.0:1746143682.446882:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593638912:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143682.446899:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143682.447028:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591994240 00000100:00100000:1.0:1746143682.447033:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591994240 00002000:00100000:1.0:1746143682.447058:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2658304->2662399) req@ffff88009cdc2d80 x1830963591994240/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.447067:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2d80 with x1830963591994240 ext(2658304->2662399) 00002000:00010000:1.0:1746143682.447070:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc2d80 00000100:00100000:1.0:1746143682.447083:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3187 00000100:00100000:1.0:1746143682.447088:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1964:x1830963591994240:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143682.447673:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1964:x1830963591994240:12345-192.168.202.48@tcp:3:cat.0 Request processed in 584us (1016us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143682.447679:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3187 00002000:00100000:1.0:1746143682.447685:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2658304->2662399) req@ffff88009cdc2d80 x1830963591994240/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/4536 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.447691:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2d80 with x1830963591994240 ext(2658304->2662399) 00002000:00010000:1.0:1746143682.447694:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc2d80 00000100:00100000:3.0:1746143682.447719:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143682.452431:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593638656:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143682.452431:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593638784:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143682.452457:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ffb6800/0xe984082ccd7240c8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08b2 expref: 31 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143682.452457:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd7240c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08b9 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143682.452468:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd7240c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08b9 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.452469:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffb6800/0xe984082ccd7240c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08b2 expref: 31 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.452477:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffb6800, rc 0) 00010000:00010000:1.0:1746143682.452477:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54ecc00, rc 0) 00000100:00100000:3.0:1746143682.452512:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1965:x1830963591993728:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5793us (5883us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143682.452512:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591993856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5804us (5912us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143682.452519:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9025 00000100:00100000:1.0:1746143682.452726:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9024 00002000:00010000:3.0:1746143682.458222:0:8496:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime: 1746143681 -> 1746143682 00002000:00010000:3.0:1746143682.460099:0:8496:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143681 -> 1746143682 00002000:00010000:3.0:1746143682.460104:0:8496:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime: 1746143681 -> 1746143682 00000100:00100000:3.0:1746143682.460127:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593638912:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143682.460172:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ffb7c00/0xe984082ccd7240cf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c0 expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.460185:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffb7c00/0xe984082ccd7240cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c0 expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.460200:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffb7c00, rc 0) 00000100:00100000:3.0:1746143682.460244:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1965:x1830963591993984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 13391us (13559us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143682.460252:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9026 00000100:00100000:1.0:1746143682.481011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.481039:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.481063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.481274:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591994880 00000100:00100000:3.0:1746143682.481282:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591994880 00000100:00100000:3.0:1746143682.481316:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9027 00000100:00100000:3.0:1746143682.481323:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28052:x1830963591994880:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143682.481337:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.481353:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08c7 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.481375:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffb7200/0xe984082ccd723ffd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0834 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.481383:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cc9200/0xe984082ccd724004 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a083b expref: 39 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.481389:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.481391:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.481394:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3547135] (req 3145728->3547135) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.481418:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130cc9200/0xe984082ccd724004 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a083b expref: 39 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.481433:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130cc9200/0xe984082ccd724004 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a083b expref: 39 pid: 21542 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.481444:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593639040:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.481505:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffb7200/0xe984082ccd723ffd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0834 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.481512:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ffb7200/0xe984082ccd723ffd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0834 expref: 24 pid: 21542 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.481519:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593639168:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143682.481534:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e1cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.482005:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591994752 00000100:00100000:0.0:1746143682.482010:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591994752 00000100:00100000:0.0:1746143682.482035:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8149 00000100:00100000:0.0:1746143682.482040:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:28062:x1830963591994752:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143682.482052:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143682.482062:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ece00/0xe984082ccd7240dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08ce expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.482173:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54eca00/0xe984082ccd7240e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482182:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54eca00/0xe984082ccd7240e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482191:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54eca00/0xe984082ccd7240e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482200:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec200/0xe984082ccd7240eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482206:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec200/0xe984082ccd7240eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482211:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec200/0xe984082ccd7240eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482298:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec000/0xe984082ccd7240f2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482306:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec000/0xe984082ccd7240f2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482312:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec000/0xe984082ccd7240f2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:0.0:1746143682.482319:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143682.482385:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54eca00/0xe984082ccd7240e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482391:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54eca00/0xe984082ccd7240e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482397:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54eca00/0xe984082ccd7240e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482402:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54eca00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143682.482405:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54eca00/0xe984082ccd7240e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482411:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54eca00/0xe984082ccd7240e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482420:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143682.482422:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143682.482425:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54eca00/0xe984082ccd7240e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482430:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54eca00/0xe984082ccd7240e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482450:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec200/0xe984082ccd7240eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482455:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec200/0xe984082ccd7240eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482459:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec200/0xe984082ccd7240eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482463:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54ec200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143682.482465:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec200/0xe984082ccd7240eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482470:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec200/0xe984082ccd7240eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482479:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bf78600) 00010000:00010000:0.0:1746143682.482481:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143682.482483:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec200/0xe984082ccd7240eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482488:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec200/0xe984082ccd7240eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.482523:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ece00/0xe984082ccd7240dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08ce expref: 261 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.482533:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec000/0xe984082ccd7240f2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08ce expref: 260 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.482538:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:0.0:1746143682.482541:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143682.482542:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54ec000, rc 0) 00000100:00100000:0.0:1746143682.482568:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:28062:x1830963591994752:12345-192.168.202.48@tcp:101:cat.0 Request processed in 528us (1566us total) trans 8589942212 rc 0/0 00000100:00100000:0.0:1746143682.482574:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8149 00000100:00100000:1.0:1746143682.483227:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591994496 00000100:00100000:1.0:1746143682.483232:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591994496 00000100:00100000:1.0:1746143682.483257:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3281 00000100:00100000:1.0:1746143682.483262:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+26:28056:x1830963591994496:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143682.483349:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+27:28056:x1830963591994496:12345-192.168.202.48@tcp:35:cat.0 Request processed in 86us (2307us total) trans 8589942213 rc 0/0 00000100:00100000:1.0:1746143682.483355:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3281 00000100:00100000:0.0:1746143682.488320:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593639040:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143682.488330:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593639168:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143682.488354:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3547135] (req 3145728->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.488369:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2121e00, rc 0) 00000100:00100000:0.0:1746143682.488402:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28052:x1830963591994880:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7079us (7337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143682.488409:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9027 00000100:00100000:0.0:1746143682.492323:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.492409:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591995008 00000100:00100000:1.0:1746143682.492416:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591995008 00000100:00100000:1.0:1746143682.492454:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 536 00000100:00100000:1.0:1746143682.492461:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:1963:x1830963591995008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143682.492472:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143682.492493:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54ec000/0xe984082ccd7240f2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08ce expref: 260 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143682.492515:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143682.492519:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143682.492554:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1963:x1830963591995008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143682.492560:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 536 00000100:00100000:1.0:1746143682.492890:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.492939:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591995136 00000100:00100000:0.0:1746143682.492942:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591995136 00010000:00010000:0.0:1746143682.492967:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130cc9200/0xe984082ccd724004 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a083b expref: 40 pid: 21542 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746143682.492991:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4598 00000100:00100000:0.0:1746143682.492997:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963591995136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143682.493004:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143682.493025:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130cc9200/0xe984082ccd724004 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a083b expref: 40 pid: 21542 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746143682.493034:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130cc9200/0xe984082ccd724004 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a083b expref: 40 pid: 21542 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746143682.493047:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cc9200/0xe984082ccd724004 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a083b expref: 40 pid: 21542 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746143682.493059:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143682.493078:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963591995136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143682.493083:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4598 00000100:00100000:1.0:1746143682.498633:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.498656:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.498693:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.498714:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591995520 00000100:00100000:1.0:1746143682.498721:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591995520 00010000:00010000:1.0:1746143682.498747:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffb7200/0xe984082ccd723ffd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0834 expref: 24 pid: 21542 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746143682.498769:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4599 00000100:00100000:1.0:1746143682.498775:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963591995520:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143682.498786:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143682.498802:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffb7200/0xe984082ccd723ffd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0834 expref: 24 pid: 21542 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746143682.498818:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffb7200/0xe984082ccd723ffd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0834 expref: 24 pid: 21542 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746143682.498836:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffb7200/0xe984082ccd723ffd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0834 expref: 24 pid: 21542 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746143682.498849:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143682.498851:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143682.498856:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143682.498864:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143682.498889:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143682.498899:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593639296:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143682.498962:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143682.500122:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591995264 00000100:00100000:3.0:1746143682.500127:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591995264 00000100:00100000:1.0:1746143682.501280:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591995392 00000100:00100000:1.0:1746143682.501286:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591995392 00000100:00100000:2.0:1746143682.502416:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9028 00000100:00100000:2.0:1746143682.502427:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963591995264:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143682.502443:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.502456:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095728600/0xe984082ccd724100 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08d5 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143682.502498:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593639424:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143682.502563:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143682.502789:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9029 00000100:00100000:1.0:1746143682.502796:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591995392:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143682.502804:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143682.502813:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c59ce00/0xe984082ccd724107 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08dc expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143682.502838:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593639552:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143682.502859:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0edd80 going to sleep for 11 seconds 00002000:00010000:2.0:1746143682.507635:0:25369:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime: 1746143681 -> 1746143682 00002000:00010000:2.0:1746143682.507640:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime: 1746143681 -> 1746143682 00002000:00010000:2.0:1746143682.507642:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime: 1746143681 -> 1746143682 00000100:00100000:2.0:1746143682.507662:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593639424:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143682.507685:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095728600/0xe984082ccd724100 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08d5 expref: 40 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.507702:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095728600/0xe984082ccd724100 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08d5 expref: 40 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143682.507710:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095728600, rc 0) 00000100:00100000:2.0:1746143682.507745:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963591995264:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5321us (9118us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143682.507752:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9028 00000100:00100000:0.0:1746143682.507846:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593639296:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143682.507856:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143682.507874:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591995520:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9099us (9180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143682.507881:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4599 00000100:00100000:1.0:1746143682.510440:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593639552:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143682.510466:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c59ce00/0xe984082ccd724107 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08dc expref: 35 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143682.510478:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c59ce00/0xe984082ccd724107 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08dc expref: 35 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143682.510487:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c59ce00, rc 0) 00000100:00100000:1.0:1746143682.512060:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963591995392:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9257us (13396us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143682.512069:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9029 00000100:00100000:0.0:1746143682.517902:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.517925:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591995776 00000100:00100000:0.0:1746143682.517932:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591995776 00002000:00100000:0.0:1746143682.517979:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3543040->3547135) req@ffff88009cdc3480 x1830963591995776/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.517988:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3480 with x1830963591995776 ext(3543040->3547135) 00002000:00010000:0.0:1746143682.517993:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3480 00000100:00100000:0.0:1746143682.518009:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3188 00000100:00100000:0.0:1746143682.518016:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963591995776:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143682.518161:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963591995776:12345-192.168.202.48@tcp:3:cat.0 Request processed in 144us (264us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143682.518167:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3188 00002000:00100000:0.0:1746143682.518172:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3543040->3547135) req@ffff88009cdc3480 x1830963591995776/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/4536 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.518179:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3480 with x1830963591995776 ext(3543040->3547135) 00002000:00010000:0.0:1746143682.518181:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3480 00000100:00100000:1.0:1746143682.537310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.537382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.537403:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591996032 00000100:00100000:1.0:1746143682.537410:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591996032 00002000:00100000:1.0:1746143682.537446:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1830911) req@ffff88008f4edf80 x1830963591996032/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.537455:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4edf80 with x1830963591996032 ext(1048576->1830911) 00002000:00010000:1.0:1746143682.537459:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4edf80 00000100:00100000:1.0:1746143682.537472:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591996288 00000100:00100000:1.0:1746143682.537474:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591996288 00002000:00100000:1.0:1746143682.537485:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1138688->2097151) req@ffff88008f4ec380 x1830963591996288/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.537497:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ec380 with x1830963591996288 ext(1138688->2097151) 00002000:00010000:1.0:1746143682.537500:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4ec380 00000100:00100000:1.0:1746143682.537510:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3189 00000100:00100000:1.0:1746143682.537517:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591996032:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143682.540692:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3190 00000100:00100000:2.0:1746143682.540704:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963591996288:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143682.552997:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963591996032:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15472us (15685us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746143682.553008:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3189 00002000:00100000:2.0:1746143682.553018:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1830911) req@ffff88008f4edf80 x1830963591996032/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.553026:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4edf80 with x1830963591996032 ext(1048576->1830911) 00002000:00010000:2.0:1746143682.553032:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4edf80 00000100:00100000:2.0:1746143682.555859:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963591996288:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15150us (18469us total) trans 0 rc 958464/958464 00000100:00100000:2.0:1746143682.555870:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3190 00002000:00100000:2.0:1746143682.555880:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1138688->2097151) req@ffff88008f4ec380 x1830963591996288/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 958464/958464 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.555889:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ec380 with x1830963591996288 ext(1138688->2097151) 00002000:00010000:2.0:1746143682.555895:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4ec380 00010000:00010000:3.0:1746143682.563503:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1746143682.566302:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839604 is committed 00000001:00080000:3.0:1746143682.566339:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839551 is committed 00000001:00080000:3.0:1746143682.566349:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839550 is committed 00000001:00080000:3.0:1746143682.566355:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839611 is committed 00000001:00080000:3.0:1746143682.566361:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839608 is committed 00000001:00080000:3.0:1746143682.566366:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839605 is committed 00000001:00080000:3.0:1746143682.566376:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839587 is committed 00000001:00080000:3.0:1746143682.566409:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839589 is committed 00000100:00100000:0.0:1746143682.567703:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.568362:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.568437:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591996544 00000100:00100000:2.0:1746143682.568445:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591996544 00000100:00100000:2.0:1746143682.568473:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591996416 00000100:00100000:2.0:1746143682.568475:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591996416 00000100:00100000:2.0:1746143682.568500:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9030 00000100:00100000:2.0:1746143682.568506:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963591996544:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143682.568520:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.568534:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095729a00/0xe984082ccd72410e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08ea expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143682.568574:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593639680:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143682.568648:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4ba000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143682.568757:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9031 00000100:00100000:3.0:1746143682.568763:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963591996416:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143682.568774:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.568782:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a21fd000/0xe984082ccd724115 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08e3 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143682.568806:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593639808:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143682.568830:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b180 going to sleep for 11 seconds 00002000:00010000:0.0:1746143682.572071:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4139 00000100:00100000:0.0:1746143682.572084:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593639680:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143682.572109:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095729a00/0xe984082ccd72410e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08ea expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.572125:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095729a00/0xe984082ccd72410e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08ea expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.572133:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095729a00, rc 0) 00000100:00100000:0.0:1746143682.572185:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963591996544:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3678us (4486us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143682.572192:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9030 00000100:00100000:3.0:1746143682.572401:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593639808:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143682.572418:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a21fd000/0xe984082ccd724115 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08e3 expref: 40 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.572426:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fd000/0xe984082ccd724115 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08e3 expref: 40 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.572433:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21fd000, rc 0) 00000100:00100000:3.0:1746143682.572453:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963591996416:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3690us (4092us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143682.572458:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9031 00000100:00100000:3.0:1746143682.581051:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.581117:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591996672 00000100:00100000:0.0:1746143682.581124:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591996672 00000100:00100000:0.0:1746143682.581182:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9032 00000100:00100000:0.0:1746143682.581188:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:28062:x1830963591996672:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143682.581203:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143682.581221:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd72411c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08f1 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.581245:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.581251:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143682.581253:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143682.581256:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd72411c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f1 expref: 40 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.581281:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.581295:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 22 pid: 4581 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746143682.581305:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f891c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593639936:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143682.581371:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143682.583674:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f891c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593639936:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.583700:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd72411c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f1 expref: 40 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.583713:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54ecc00, rc 0) 00000100:00100000:0.0:1746143682.583798:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.583855:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:28062:x1830963591996672:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2665us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.583863:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9032 00000100:00100000:2.0:1746143682.583898:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591996800 00000100:00100000:2.0:1746143682.583902:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591996800 00002000:00100000:2.0:1746143682.583933:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3547135) req@ffff88008f891c00 x1830963591996800/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.583941:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f891c00 with x1830963591996800 ext(3145728->3547135) 00010000:00010000:2.0:1746143682.583956:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 23 pid: 4581 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.583966:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 23 pid: 4581 timeout: 861 lvb_type: 0 00002000:00010000:2.0:1746143682.583971:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f891c00 00000100:00100000:2.0:1746143682.583985:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 757 00000100:00100000:2.0:1746143682.583990:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963591996800:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143682.590513:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963591996800:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6513us (6706us total) trans 17179872347 rc 0/0 00000100:00100000:2.0:1746143682.590523:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 757 00002000:00100000:2.0:1746143682.590534:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3547135) req@ffff88008f891c00 x1830963591996800/t17179872347(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/448 e 0 to 0 dl 1746143693 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.590542:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f891c00 with x1830963591996800 ext(3145728->3547135) 00010000:00010000:2.0:1746143682.590552:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 25 pid: 4581 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.590566:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 25 pid: 4581 timeout: 861 lvb_type: 0 00002000:00010000:2.0:1746143682.590572:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f891c00 00000100:00100000:0.0:1746143682.592781:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.592869:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591996928 00000100:00100000:2.0:1746143682.592876:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591996928 00010000:00010000:2.0:1746143682.592906:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 25 pid: 4581 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.593289:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4600 00000100:00100000:2.0:1746143682.593297:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963591996928:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143682.593310:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143682.593328:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 25 pid: 4581 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.593338:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 25 pid: 4581 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.593356:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a2121e00/0xe984082ccd7240d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3547135) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08c7 expref: 25 pid: 4581 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.593386:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.593388:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.593394:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd72411c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f1 expref: 39 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.593401:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd72411c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f1 expref: 39 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.593429:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd72411c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f1 expref: 39 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143682.593439:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593640064:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143682.593500:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4ba840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143682.597444:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593640064:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143682.597462:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143682.597496:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963591996928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4200us (4720us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.597504:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4600 00000100:00100000:0.0:1746143682.597753:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.597794:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591997184 00000100:00100000:3.0:1746143682.597800:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591997184 00002000:00100000:3.0:1746143682.598008:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a5d82a00 x1830963591997184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.598017:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830963591997184 ext(2097152->3145727) 00002000:00010000:3.0:1746143682.598021:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82a00 00000100:00100000:3.0:1746143682.598036:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3191 00000100:00100000:3.0:1746143682.598043:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963591997184:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143682.606882:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963591997184:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8832us (9122us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143682.606893:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3191 00002000:00100000:3.0:1746143682.606902:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a5d82a00 x1830963591997184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.606911:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830963591997184 ext(2097152->3145727) 00002000:00010000:3.0:1746143682.606916:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82a00 00000100:00100000:0.0:1746143682.615640:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.615742:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591997312 00000100:00100000:2.0:1746143682.615749:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591997312 00000100:00100000:2.0:1746143682.616248:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9033 00000100:00100000:2.0:1746143682.616257:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:28062:x1830963591997312:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143682.616272:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.616286:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095729200/0xe984082ccd724123 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08f8 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.616310:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 7 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.616316:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143682.616318:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143682.616321:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095729200/0xe984082ccd724123 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f8 expref: 17 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.616344:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 7 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.616354:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 7 pid: 15784 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.616364:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593640192:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.616450:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4ba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.619234:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593640192:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143682.619259:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095729200/0xe984082ccd724123 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f8 expref: 17 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.619273:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095729200, rc 0) 00000100:00100000:0.0:1746143682.619319:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:28062:x1830963591997312:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3063us (3684us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143682.619327:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9033 00000100:00100000:0.0:1746143682.619711:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.619774:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591997440 00000100:00100000:3.0:1746143682.619780:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591997440 00002000:00100000:3.0:1746143682.619811:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2658304->3145727) req@ffff88008f531f80 x1830963591997440/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.619818:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f531f80 with x1830963591997440 ext(2658304->3145727) 00010000:00010000:3.0:1746143682.619825:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 8 pid: 15784 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.619835:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 8 pid: 15784 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746143682.619841:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f531f80 00000100:00100000:3.0:1746143682.619867:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 758 00000100:00100000:3.0:1746143682.619873:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1964:x1830963591997440:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143682.630659:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963591997440:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10779us (10942us total) trans 21474839612 rc 0/0 00000100:00100000:3.0:1746143682.630673:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 758 00002000:00100000:3.0:1746143682.630682:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2658304->3145727) req@ffff88008f531f80 x1830963591997440/t21474839612(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/448 e 0 to 0 dl 1746143693 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.630689:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f531f80 with x1830963591997440 ext(2658304->3145727) 00010000:00010000:3.0:1746143682.630697:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 10 pid: 15784 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.630709:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 10 pid: 15784 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746143682.630716:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f531f80 00000100:00100000:0.0:1746143682.639957:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.640260:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591997568 00000100:00100000:2.0:1746143682.640269:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591997568 00010000:00010000:2.0:1746143682.640299:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 10 pid: 15784 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.640336:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4601 00000100:00100000:2.0:1746143682.640343:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963591997568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143682.640355:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143682.640375:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 10 pid: 15784 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.640387:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 10 pid: 15784 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.640405:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7240a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0896 expref: 10 pid: 15784 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.640435:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.640437:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.640444:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095729200/0xe984082ccd724123 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f8 expref: 16 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.640451:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095729200/0xe984082ccd724123 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f8 expref: 16 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.640479:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095729200/0xe984082ccd724123 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f8 expref: 16 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143682.640490:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593640320:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143682.640562:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4ba840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143682.648490:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593640320:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143682.648508:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143682.648544:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963591997568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8200us (8602us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.648553:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4601 00000100:00100000:0.0:1746143682.654079:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.654338:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591997824 00000100:00100000:1.0:1746143682.654346:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591997824 00000100:00100000:1.0:1746143682.654382:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8150 00000100:00100000:1.0:1746143682.654388:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:28066:x1830963591997824:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143682.654406:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143682.654422:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59c400/0xe984082ccd72412a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a08ff expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143682.654510:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59c600/0xe984082ccd724131 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.654522:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59c600/0xe984082ccd724131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.654531:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59c600/0xe984082ccd724131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.654541:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59d600/0xe984082ccd724138 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.654547:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59d600/0xe984082ccd724138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.654552:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59d600/0xe984082ccd724138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661172:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59cc00/0xe984082ccd72413f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661189:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59cc00/0xe984082ccd72413f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661199:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59cc00/0xe984082ccd72413f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143682.661210:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143682.661296:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59c600/0xe984082ccd724131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661302:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59c600/0xe984082ccd724131 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661307:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59c600/0xe984082ccd724131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661313:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c59c600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143682.661316:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59c600/0xe984082ccd724131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661322:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59c600/0xe984082ccd724131 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661332:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143682.661334:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143682.661337:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59c600/0xe984082ccd724131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661342:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59c600/0xe984082ccd724131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661361:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59d600/0xe984082ccd724138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661366:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59d600/0xe984082ccd724138 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661370:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59d600/0xe984082ccd724138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661373:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c59d600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143682.661375:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59d600/0xe984082ccd724138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661379:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59d600/0xe984082ccd724138 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661384:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74100) 00010000:00010000:1.0:1746143682.661386:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143682.661388:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59d600/0xe984082ccd724138 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661392:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59d600/0xe984082ccd724138 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143682.661435:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59c400/0xe984082ccd72412a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08ff expref: 262 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143682.661445:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59cc00/0xe984082ccd72413f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08ff expref: 261 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143682.661451:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143682.661453:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143682.661455:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c59cc00, rc 0) 00000100:00100000:1.0:1746143682.661504:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:28066:x1830963591997824:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7115us (7431us total) trans 8589942214 rc 0/0 00000100:00100000:1.0:1746143682.661511:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8150 00000100:00100000:1.0:1746143682.665772:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.665794:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.665806:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.665836:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.665874:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591998080 00000100:00100000:0.0:1746143682.665882:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591998080 00002000:00100000:0.0:1746143682.665914:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f4ec700 x1830963591998080/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.665927:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ec700 with x1830963591998080 ext(2097152->3145727) 00002000:00010000:0.0:1746143682.665932:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ec700 00000100:00100000:0.0:1746143682.665942:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591998336 00000100:00100000:0.0:1746143682.665944:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591998336 00002000:00100000:0.0:1746143682.665961:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f4ed180 x1830963591998336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.665966:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ed180 with x1830963591998336 ext(3145728->4194303) 00002000:00010000:0.0:1746143682.665968:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ed180 00000100:00100000:0.0:1746143682.665974:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591998592 00000100:00100000:0.0:1746143682.665975:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591998592 00002000:00100000:0.0:1746143682.665983:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f4edc00 x1830963591998592/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.665988:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4edc00 with x1830963591998592 ext(3145728->4194303) 00002000:00010000:0.0:1746143682.665991:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4edc00 00000100:00100000:0.0:1746143682.665998:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3192 00000100:00100000:0.0:1746143682.666003:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963591998080:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143682.667964:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3193 00000100:00100000:1.0:1746143682.667975:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963591998336:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143682.669326:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3194 00000100:00100000:1.0:1746143682.669335:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963591998592:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143682.669855:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591998720 00000100:00100000:2.0:1746143682.669861:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591998720 00000100:00100000:2.0:1746143682.669897:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 537 00000100:00100000:2.0:1746143682.669903:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:1965:x1830963591998720:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143682.669911:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143682.669929:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c59cc00/0xe984082ccd72413f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08ff expref: 261 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.669956:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143682.669959:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143682.670392:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:1965:x1830963591998720:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 88us (4154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.670398:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 537 00000100:00100000:1.0:1746143682.701036:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963591998336:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33055us (35230us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143682.701047:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3193 00002000:00100000:1.0:1746143682.701059:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f4ed180 x1830963591998336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.701068:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ed180 with x1830963591998336 ext(3145728->4194303) 00002000:00010000:1.0:1746143682.701074:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ed180 00000100:00100000:0.0:1746143682.713741:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963591998080:12345-192.168.202.48@tcp:3:cat.0 Request processed in 47726us (47965us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143682.713751:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3192 00002000:00100000:0.0:1746143682.713761:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f4ec700 x1830963591998080/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.713770:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ec700 with x1830963591998080 ext(2097152->3145727) 00002000:00010000:0.0:1746143682.713775:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ec700 00000100:00100000:0.0:1746143682.723167:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.723191:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591998848 00000100:00100000:0.0:1746143682.723198:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591998848 00000100:00100000:0.0:1746143682.723240:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8151 00000100:00100000:0.0:1746143682.723247:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28067:x1830963591998848:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143682.723264:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143682.723278:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8b400/0xe984082ccd72414d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0906 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.723325:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8b000/0xe984082ccd724154 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.723336:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8b000/0xe984082ccd724154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.723344:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8b000/0xe984082ccd724154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.723354:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0xe984082ccd72415b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.723360:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0xe984082ccd72415b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.723364:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0xe984082ccd72415b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.723447:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.723456:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0850 expref: 26 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.723465:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143682.723488:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0850 expref: 26 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.723498:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0850 expref: 26 pid: 14763 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746143682.723508:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593640448:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143682.723579:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00080000:0.0:1746143682.723590:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143682.727260:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.727302:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593640448:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143682.727326:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143682.731330:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591999104 00000100:00100000:1.0:1746143682.731340:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591999104 00000100:00100000:1.0:1746143682.731379:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3282 00000100:00100000:1.0:1746143682.731386:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+27:7695:x1830963591999104:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143682.733758:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+28:7695:x1830963591999104:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 2363us (6496us total) trans 8589942215 rc 0/0 00000100:00100000:1.0:1746143682.733768:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3282 00000100:00100000:1.0:1746143682.734077:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963591998592:12345-192.168.202.48@tcp:3:cat.0 Request processed in 64743us (68268us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143682.734084:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3194 00002000:00100000:1.0:1746143682.734093:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f4edc00 x1830963591998592/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.734102:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4edc00 with x1830963591998592 ext(3145728->4194303) 00002000:00010000:1.0:1746143682.734106:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4edc00 00000100:00100000:0.0:1746143682.755412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.757384:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591999232 00000100:00100000:2.0:1746143682.757393:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591999232 00010000:00010000:2.0:1746143682.757426:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0850 expref: 28 pid: 14763 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.757453:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4602 00000100:00100000:2.0:1746143682.757460:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1962:x1830963591999232:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143682.757470:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143682.757475:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0850 expref: 28 pid: 14763 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.757484:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0850 expref: 28 pid: 14763 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.757502:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffb7400/0xe984082ccd724020 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0850 expref: 28 pid: 14763 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.757516:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143682.757520:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757527:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757532:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757549:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143682.757587:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1962:x1830963591999232:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 128us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.757593:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4602 00010000:00010000:2.0:1746143682.757775:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757784:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143682.757821:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:2.0:1746143682.757824:0:14764:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143682.757837:0:14764:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757844:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757852:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8b000/0xe984082ccd724154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757856:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8b000/0xe984082ccd724154 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757861:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8b000/0xe984082ccd724154 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757865:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a8b000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143682.757868:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8b000/0xe984082ccd724154 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757874:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8b000/0xe984082ccd724154 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757882:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143682.757884:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143682.757886:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8b000/0xe984082ccd724154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757890:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8b000/0xe984082ccd724154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757899:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0xe984082ccd72415b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757904:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0xe984082ccd72415b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757907:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0xe984082ccd72415b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.757911:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a8ae00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143682.757913:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0xe984082ccd72415b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.760072:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0xe984082ccd72415b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.760091:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f694300) 00010000:00010000:2.0:1746143682.760093:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143682.760096:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0xe984082ccd72415b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.760102:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ae00/0xe984082ccd72415b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.760169:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8b400/0xe984082ccd72414d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0906 expref: 14 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.760182:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0906 expref: 13 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.760187:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143682.760190:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143682.760192:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a8ac00, rc 0) 00000100:00100000:2.0:1746143682.761206:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28067:x1830963591998848:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 37957us (38043us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.761214:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8151 00000100:00100000:0.0:1746143682.765291:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.765320:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591999360 00000100:00100000:0.0:1746143682.765327:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591999360 00000100:00100000:0.0:1746143682.765361:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9034 00000100:00100000:0.0:1746143682.765368:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1962:x1830963591999360:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143682.765382:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143682.765409:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0xe984082ccd724169 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a090d expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143682.765455:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593640576:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143682.765512:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.768328:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.768357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.768377:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591999744 00000100:00100000:0.0:1746143682.768383:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591999744 00000100:00100000:0.0:1746143682.768417:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9035 00000100:00100000:0.0:1746143682.768423:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963591999744:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143682.768438:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143682.768450:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a800/0xe984082ccd724170 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0914 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143682.768489:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593640704:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143682.768540:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143682.769448:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591999616 00000100:00100000:1.0:1746143682.769452:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591999616 00002000:00100000:1.0:1746143682.769480:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880099c0fc50 x1830963591999616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.769488:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099c0fc50 with x1830963591999616 ext(4194304->4898815) 00002000:00010000:1.0:1746143682.769492:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099c0fc50 00000100:00100000:1.0:1746143682.769505:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3195 00000100:00100000:1.0:1746143682.769511:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963591999616:12345-192.168.202.48@tcp:3:cat.0 00002000:00010000:0.0:1746143682.770432:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143681 -> 1746143682 00002000:00010000:0.0:1746143682.770442:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2079 -> 2081 00000100:00100000:0.0:1746143682.770448:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593640704:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143682.770473:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a800/0xe984082ccd724170 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0914 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.770484:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a8a800/0xe984082ccd724170 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0914 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.770492:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a8a800, rc 0) 00000100:00100000:0.0:1746143682.770524:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963591999744:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 2100us (2166us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143682.770530:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9035 00000100:00100000:0.0:1746143682.778717:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.778737:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.778755:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963591999872 00000100:00100000:0.0:1746143682.778762:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963591999872 00000100:00100000:0.0:1746143682.778789:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592000000 00000100:00100000:0.0:1746143682.778791:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592000000 00000100:00100000:0.0:1746143682.778803:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9036 00000100:00100000:0.0:1746143682.778810:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963591999872:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143682.778824:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143682.778837:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd724177 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a091b expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.778854:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143682.778856:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143682.778862:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd724177 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a091b expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.778874:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd724177 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a091b expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.778883:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dc1c00, rc 0) 00000100:00100000:0.0:1746143682.778916:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963591999872:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 106us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143682.778920:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9036 00000100:00100000:0.0:1746143682.778934:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9037 00000100:00100000:0.0:1746143682.778938:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592000000:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143682.778955:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143682.778962:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129dc0200/0xe984082ccd72417e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0922 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.778971:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143682.778973:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143682.778976:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129dc0200/0xe984082ccd72417e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0922 expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.778984:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129dc0200/0xe984082ccd72417e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0922 expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.778990:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dc0200, rc 0) 00000100:00100000:0.0:1746143682.779005:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963592000000:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 66us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143682.779009:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9037 00002000:00010000:0.0:1746143682.779047:0:8496:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime: 1746143681 -> 1746143682 00000100:00100000:0.0:1746143682.779062:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593640576:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143682.779084:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0xe984082ccd724169 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a090d expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.779091:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a8a200/0xe984082ccd724169 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a090d expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143682.779099:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a8a200, rc 0) 00000100:00100000:0.0:1746143682.779112:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963591999360:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 13746us (13830us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143682.779117:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9034 00000100:00100000:0.0:1746143682.790786:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.791023:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592000256 00000100:00100000:2.0:1746143682.791032:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592000256 00000100:00100000:2.0:1746143682.791071:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8152 00000100:00100000:2.0:1746143682.791078:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28067:x1830963592000256:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143682.791095:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.791114:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095729c00/0xe984082ccd724185 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0929 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.791215:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095729400/0xe984082ccd72418c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.791228:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0906 expref: 14 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.791235:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095729400/0xe984082ccd72418c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143682.791260:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0906 expref: 14 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.791270:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0906 expref: 14 pid: 14764 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.791280:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593640832:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.791345:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4ba840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143682.793244:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963591999616:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23728us (24918us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143682.793253:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3195 00002000:00100000:1.0:1746143682.793262:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880099c0fc50 x1830963591999616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.793274:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099c0fc50 with x1830963591999616 ext(4194304->4898815) 00002000:00010000:1.0:1746143682.793278:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099c0fc50 00000100:00100000:3.0:1746143682.797560:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.797587:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592000512 00000100:00100000:3.0:1746143682.797594:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592000512 00000100:00100000:3.0:1746143682.797629:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8153 00000100:00100000:3.0:1746143682.797637:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+27:28072:x1830963592000512:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143682.797655:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.797669:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd724193 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0930 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.797753:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37400/0xe984082ccd72419a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.797764:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37400/0xe984082ccd72419a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.797773:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37400/0xe984082ccd72419a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.797784:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7241a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.797789:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7241a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.797794:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7241a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.797881:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa600/0xe984082ccd7241a8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.797888:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa600/0xe984082ccd7241a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.797893:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa600/0xe984082ccd7241a8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143682.797900:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143682.799024:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37400/0xe984082ccd72419a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799033:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37400/0xe984082ccd72419a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799038:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37400/0xe984082ccd72419a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799043:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c37400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143682.799046:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37400/0xe984082ccd72419a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799051:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37400/0xe984082ccd72419a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799061:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143682.799063:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143682.799066:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37400/0xe984082ccd72419a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799070:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37400/0xe984082ccd72419a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799081:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7241a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799085:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7241a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799089:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7241a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799092:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c37a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143682.799094:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7241a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799098:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7241a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799102:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d03c300) 00010000:00010000:3.0:1746143682.799104:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143682.799105:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7241a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799109:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c37a00/0xe984082ccd7241a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143682.799151:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd724193 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0930 expref: 30 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.799162:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa600/0xe984082ccd7241a8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0930 expref: 29 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.799167:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143682.799169:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143682.799171:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfa600, rc 0) 00000100:00100000:3.0:1746143682.799211:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+29:28072:x1830963592000512:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1574us (1658us total) trans 8589942216 rc 0/0 00000100:00100000:3.0:1746143682.799217:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8153 00000100:00100000:2.0:1746143682.801710:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593640832:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.801731:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095729400/0xe984082ccd72418c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143682.808962:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.809431:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592000640 00000100:00100000:3.0:1746143682.809438:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592000640 00010000:00010000:3.0:1746143682.809465:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0906 expref: 15 pid: 14764 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.809485:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4603 00000100:00100000:3.0:1746143682.809491:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1965:x1830963592000640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.809501:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143682.809505:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0906 expref: 15 pid: 14764 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.809514:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0906 expref: 15 pid: 14764 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.809531:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a8ac00/0xe984082ccd724162 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0906 expref: 15 pid: 14764 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.809545:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143682.809550:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095729400/0xe984082ccd72418c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.809557:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095729400/0xe984082ccd72418c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.809562:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095729400/0xe984082ccd72418c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.809577:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.809606:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1965:x1830963592000640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 116us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.809611:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4603 00010000:00010000:3.0:1746143682.809631:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095729400/0xe984082ccd72418c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.809636:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095729400/0xe984082ccd72418c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143682.809651:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143682.809755:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095729c00/0xe984082ccd724185 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0929 expref: 15 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.809766:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095729400/0xe984082ccd72418c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0929 expref: 14 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.809771:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143682.809773:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143682.809775:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095729400, rc 0) 00000100:00100000:3.0:1746143682.809798:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:28067:x1830963592000256:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 18720us (19019us total) trans 8589942217 rc 0/0 00000100:00100000:3.0:1746143682.809803:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8152 00000100:00100000:1.0:1746143682.814488:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.814577:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.814621:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.814637:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.814650:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.814656:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592000768 00000100:00100000:2.0:1746143682.814664:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592000768 00000100:00100000:1.0:1746143682.814669:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.814684:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.814701:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592001024 00000100:00100000:2.0:1746143682.814704:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 538 00000100:00100000:1.0:1746143682.814704:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592001024 00000100:00100000:2.0:1746143682.814711:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1964:x1830963592000768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143682.814723:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143682.814724:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3283 00000100:00100000:1.0:1746143682.814729:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:28062:x1830963592001024:12345-192.168.202.48@tcp:35:cat.0 00010000:00010000:2.0:1746143682.814743:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa600/0xe984082ccd7241a8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0930 expref: 29 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.814756:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143682.814760:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143682.814789:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1964:x1830963592000768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 79us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.814795:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 538 00000100:00100000:1.0:1746143682.814875:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:28062:x1830963592001024:12345-192.168.202.48@tcp:35:cat.0 Request processed in 146us (252us total) trans 8589942218 rc 0/0 00000100:00100000:1.0:1746143682.814881:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3283 00000100:00100000:1.0:1746143682.814897:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592001152 00000100:00100000:1.0:1746143682.814900:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592001152 00000100:00100000:1.0:1746143682.814915:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592001280 00000100:00100000:1.0:1746143682.814916:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592001280 00000100:00100000:1.0:1746143682.814925:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592001408 00000100:00100000:1.0:1746143682.814927:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592001408 00000100:00100000:1.0:1746143682.814934:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592001536 00000100:00100000:1.0:1746143682.814936:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592001536 00000100:00100000:1.0:1746143682.814958:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9038 00000100:00100000:1.0:1746143682.814963:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592001152:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143682.814972:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143682.814983:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009331f800/0xe984082ccd7241bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0937 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143682.815019:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593640960:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143682.815056:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143682.815105:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9039 00000100:00100000:1.0:1746143682.815110:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963592001280:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143682.815117:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143682.815125:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592001792 00010000:00010000:1.0:1746143682.815125:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009331e800/0xe984082ccd7241c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a093e expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143682.815129:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592001792 00000100:00100000:3.0:1746143682.815164:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8154 00000100:00100000:1.0:1746143682.815166:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593641088:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143682.815169:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+28:28071:x1830963592001792:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143682.815178:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.815186:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfae00/0xe984082ccd7241cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0953 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143682.815187:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0edcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143682.815214:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9040 00000100:00100000:1.0:1746143682.815219:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963592001408:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143682.815225:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143682.815230:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6170e00/0xe984082ccd7241d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0945 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143682.815241:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143682.815243:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.815249:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd7241d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143682.815249:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6170e00/0xe984082ccd7241d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0945 expref: 27 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.815257:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd7241d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143682.815260:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6170e00/0xe984082ccd7241d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0945 expref: 27 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.815264:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd7241d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143682.815269:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6170e00, rc 0) 00010000:00010000:3.0:1746143682.815273:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd7241e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815278:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd7241e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815282:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd7241e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143682.815287:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592001408:12345-192.168.202.48@tcp:101:cat.0 Request processed in 67us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143682.815291:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9040 00000100:00100000:1.0:1746143682.815301:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9041 00000100:00100000:1.0:1746143682.815306:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592001536:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143682.815311:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143682.815317:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6170400/0xe984082ccd7241e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a094c expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143682.815326:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143682.815327:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143682.815330:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6170400/0xe984082ccd7241e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a094c expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143682.815339:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6170400/0xe984082ccd7241e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a094c expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143682.815345:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6170400, rc 0) 00010000:00010000:3.0:1746143682.815352:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb600/0xe984082ccd7241ee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143682.815358:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592001536:12345-192.168.202.48@tcp:101:cat.0 Request processed in 52us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143682.815362:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9041 00010000:00010000:3.0:1746143682.815363:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb600/0xe984082ccd7241ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815368:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb600/0xe984082ccd7241ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143682.815375:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143682.815416:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd7241d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815421:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd7241d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815426:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd7241d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815430:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bfac00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143682.815433:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd7241d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815438:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd7241d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815445:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143682.815447:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143682.815450:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd7241d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815453:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd7241d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815459:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd7241e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815466:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd7241e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815470:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd7241e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815473:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bfa200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143682.815475:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd7241e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815478:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd7241e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815483:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9dd00) 00010000:00010000:3.0:1746143682.815484:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143682.815486:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd7241e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815490:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd7241e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143682.815514:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfae00/0xe984082ccd7241cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0953 expref: 31 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.815522:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb600/0xe984082ccd7241ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0953 expref: 30 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.815527:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143682.815529:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143682.815531:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfb600, rc 0) 00000100:00100000:3.0:1746143682.815554:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+30:28071:x1830963592001792:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 385us (1074us total) trans 8589942219 rc 0/0 00000100:00100000:3.0:1746143682.815559:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8154 00000100:00100000:3.0:1746143682.825431:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.825466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.825589:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593640960:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143682.825614:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009331f800/0xe984082ccd7241bd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0937 expref: 11 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.825627:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009331f800/0xe984082ccd7241bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0937 expref: 11 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.825635:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009331f800, rc 0) 00000100:00100000:3.0:1746143682.825671:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592001152:12345-192.168.202.48@tcp:101:cat.0 Request processed in 10708us (11032us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143682.825679:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9038 00000100:00100000:3.0:1746143682.825705:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592002176 00000100:00100000:3.0:1746143682.825710:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592002176 00000100:00100000:3.0:1746143682.825733:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8155 00000100:00100000:3.0:1746143682.825738:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:28067:x1830963592002176:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143682.825754:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.825757:0:21713:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143682.825771:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095729400/0xe984082ccd72418c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0929 expref: 14 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.825781:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143682.825784:0:21713:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143682.825793:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb400/0xe984082ccd7241fc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a095a expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.825860:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd724203 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143682.825870:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd724203 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143682.825878:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd724203 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143682.825886:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd724203 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143682.825890:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd724203 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143682.825894:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd724203 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143682.825899:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bfaa00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143682.825902:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd724203 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143682.825907:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd724203 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143682.825912:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143682.825914:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143682.825916:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd724203 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143682.825920:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd724203 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143682.825939:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb400/0xe984082ccd7241fc lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a095a expref: 14 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.825956:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb400/0xe984082ccd7241fc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a095a expref: 14 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.825962:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfb400, rc 0) 00000100:00100000:3.0:1746143682.825977:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28067:x1830963592002176:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 240us (553us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143682.825982:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8155 00000100:00100000:3.0:1746143682.826047:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592001920 00000100:00100000:3.0:1746143682.826050:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592001920 00000100:00100000:3.0:1746143682.826070:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 539 00000100:00100000:3.0:1746143682.826074:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1965:x1830963592001920:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.826080:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143682.826091:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb600/0xe984082ccd7241ee lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0953 expref: 30 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.826098:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143682.826100:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.826115:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1965:x1830963592001920:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 40us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.826119:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 539 00000100:00100000:1.0:1746143682.831952:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593641088:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143682.831979:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009331e800/0xe984082ccd7241c4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a093e expref: 26 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143682.831993:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009331e800/0xe984082ccd7241c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a093e expref: 26 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143682.832000:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009331e800, rc 0) 00000100:00100000:1.0:1746143682.832044:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963592001280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 16933us (17392us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143682.832051:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9039 00000100:00100000:0.0:1746143682.833212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.833291:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592002432 00000100:00100000:1.0:1746143682.833297:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592002432 00000100:00100000:1.0:1746143682.833328:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3284 00000100:00100000:1.0:1746143682.833335:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28067:x1830963592002432:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143682.833864:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:28067:x1830963592002432:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 529us (654us total) trans 8589942220 rc 0/0 00000100:00100000:1.0:1746143682.833870:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3284 00000100:00100000:3.0:1746143682.860369:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.862687:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592002560 00000100:00100000:0.0:1746143682.862697:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592002560 00000100:00100000:0.0:1746143682.862773:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9042 00000100:00100000:0.0:1746143682.862780:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28072:x1830963592002560:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143682.862796:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143682.862810:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095729800/0xe984082ccd72420a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0961 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.862838:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.862844:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143682.862846:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143682.862849:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095729800/0xe984082ccd72420a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0961 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.862874:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.863498:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 16 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746143682.863511:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593641216:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143682.863638:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.863682:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.863781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.863921:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592002688 00000100:00100000:3.0:1746143682.863925:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592002688 00000100:00100000:3.0:1746143682.863953:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592002816 00000100:00100000:3.0:1746143682.863955:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592002816 00000100:00100000:3.0:1746143682.863968:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9043 00000100:00100000:3.0:1746143682.863973:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:28066:x1830963592002688:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143682.863980:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.863987:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a096f expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.864001:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095729200/0xe984082ccd724123 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f8 expref: 18 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.864007:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6170400/0xe984082ccd7241e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a094c expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.864013:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129dc0200/0xe984082ccd72417e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0922 expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.864016:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.864018:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.864020:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2351104->3145727] (req 2351104->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.864034:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129dc0200/0xe984082ccd72417e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0922 expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.864040:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129dc0200/0xe984082ccd72417e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0922 expref: 7 pid: 4581 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746143682.864052:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593641344:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.864081:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6170400/0xe984082ccd7241e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a094c expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.864087:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6170400/0xe984082ccd7241e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a094c expref: 11 pid: 25369 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746143682.864095:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593641472:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.864113:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095729200/0xe984082ccd724123 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f8 expref: 18 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.864119:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095729200/0xe984082ccd724123 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f8 expref: 18 pid: 8496 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.864125:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593641600:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143682.864134:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143682.864209:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9044 00000100:00100000:3.0:1746143682.864214:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28071:x1830963592002816:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143682.864221:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.864230:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0968 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.864242:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd72411c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f1 expref: 39 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.864248:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6170e00/0xe984082ccd7241d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0945 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.864254:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd724177 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a091b expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.864258:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.864260:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.864262:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3866624->4194303] (req 3866624->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.864275:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd724177 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a091b expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.864281:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd724177 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a091b expref: 10 pid: 4581 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746143682.864288:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593641728:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.864326:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6170e00/0xe984082ccd7241d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0945 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143682.864332:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6170e00/0xe984082ccd7241d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0945 expref: 26 pid: 25369 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746143682.864339:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593641856:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.864358:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd72411c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f1 expref: 39 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.864365:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd72411c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f1 expref: 39 pid: 8496 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.864371:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593641984:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143682.864382:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143682.870037:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593641216:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143682.870068:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095729800/0xe984082ccd72420a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0961 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143682.870084:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095729800, rc 0) 00000100:00100000:1.0:1746143682.870156:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28072:x1830963592002560:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7375us (9791us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143682.870163:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9042 00000100:00100000:0.0:1746143682.870937:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.870964:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.870976:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.870994:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.871005:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.871033:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.871051:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592003200 00000100:00100000:0.0:1746143682.871055:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592003200 00010000:00010000:0.0:1746143682.871078:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6170400/0xe984082ccd7241e7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a094c expref: 11 pid: 25369 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746143682.871096:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592003072 00000100:00100000:0.0:1746143682.871098:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592003072 00010000:00010000:0.0:1746143682.871107:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129dc0200/0xe984082ccd72417e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0922 expref: 8 pid: 4581 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746143682.871115:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592003584 00000100:00100000:0.0:1746143682.871117:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592003584 00010000:00010000:0.0:1746143682.871123:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095729200/0xe984082ccd724123 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f8 expref: 19 pid: 8496 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746143682.871130:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592003328 00000100:00100000:0.0:1746143682.871132:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592003328 00010000:00010000:0.0:1746143682.871159:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd724177 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a091b expref: 11 pid: 4581 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746143682.871173:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592003456 00000100:00100000:0.0:1746143682.871174:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592003456 00010000:00010000:0.0:1746143682.871183:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6170e00/0xe984082ccd7241d2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0945 expref: 27 pid: 25369 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746143682.871193:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4604 00000100:00100000:0.0:1746143682.871199:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592003200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143682.871209:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143682.871227:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6170400/0xe984082ccd7241e7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a094c expref: 11 pid: 25369 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746143682.871235:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6170400/0xe984082ccd7241e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a094c expref: 11 pid: 25369 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746143682.871252:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143682.871274:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592003200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 74us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143682.871279:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4604 00000100:00100000:0.0:1746143682.871289:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4605 00000100:00100000:0.0:1746143682.871294:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963592003072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143682.871300:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143682.871306:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129dc0200/0xe984082ccd72417e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0922 expref: 8 pid: 4581 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746143682.871318:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129dc0200/0xe984082ccd72417e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0922 expref: 8 pid: 4581 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746143682.871326:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143682.871336:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963592003072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 43us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143682.871341:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4605 00000100:00100000:0.0:1746143682.871348:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4606 00000100:00100000:0.0:1746143682.871351:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963592003584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143682.871356:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143682.871361:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095729200/0xe984082ccd724123 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f8 expref: 19 pid: 8496 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746143682.871367:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095729200/0xe984082ccd724123 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f8 expref: 19 pid: 8496 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746143682.871377:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143682.871379:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143682.871384:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.871392:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143682.871415:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143682.871425:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593642112:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143682.871470:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.871484:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4607 00000100:00100000:0.0:1746143682.871490:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592003328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143682.871497:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143682.871508:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd724177 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a091b expref: 11 pid: 4581 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746143682.871515:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd724177 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a091b expref: 11 pid: 4581 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746143682.871526:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143682.871538:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592003328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143682.871543:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4607 00000100:00100000:0.0:1746143682.871552:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4608 00000100:00100000:0.0:1746143682.871555:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592003456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143682.871562:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143682.871568:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6170e00/0xe984082ccd7241d2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0945 expref: 27 pid: 25369 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746143682.871575:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6170e00/0xe984082ccd7241d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0945 expref: 27 pid: 25369 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746143682.871588:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143682.871600:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592003456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 44us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143682.871604:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4608 00000100:00100000:1.0:1746143682.871988:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592002944 00000100:00100000:1.0:1746143682.871992:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592002944 00002000:00100000:1.0:1746143682.872016:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1830912->2097151) req@ffff88009ff6f480 x1830963592002944/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.872024:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f480 with x1830963592002944 ext(1830912->2097151) 00010000:00010000:1.0:1746143682.872030:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 20 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746143682.872039:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 20 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:1.0:1746143682.872044:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff6f480 00000100:00100000:1.0:1746143682.872057:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 759 00000100:00100000:1.0:1746143682.872062:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592002944:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143682.872436:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.872483:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592003712 00000100:00100000:2.0:1746143682.872487:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592003712 00010000:00010000:2.0:1746143682.872501:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd72411c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f1 expref: 40 pid: 8496 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.872528:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4609 00000100:00100000:2.0:1746143682.872533:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963592003712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143682.872539:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143682.872548:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd72411c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f1 expref: 40 pid: 8496 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.872557:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd72411c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f1 expref: 40 pid: 8496 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.872568:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.872569:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.872573:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.872580:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.872599:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143682.872607:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593642240:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143682.872643:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4ba840 going to sleep for 11 seconds 00010000:00010000:3.0:1746143682.873058:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd724177 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a091b expref: 10 pid: 4581 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746143682.873069:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593641728:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.873078:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6170e00/0xe984082ccd7241d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0945 expref: 26 pid: 25369 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746143682.873086:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593641856:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.873094:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54ecc00/0xe984082ccd72411c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f1 expref: 40 pid: 8496 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.873102:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593641984:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.873121:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.873128:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7b6e00, rc 0) 00000100:00100000:0.0:1746143682.873411:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593642112:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143682.873421:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143682.873436:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963592003584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2084us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143682.873441:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4606 00000100:00100000:3.0:1746143682.876775:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28071:x1830963592002816:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 12551us (12984us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.876786:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9044 00010000:00010000:3.0:1746143682.876844:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129dc0200/0xe984082ccd72417e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0922 expref: 7 pid: 4581 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746143682.876858:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593641344:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.876868:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6170400/0xe984082ccd7241e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a094c expref: 10 pid: 25369 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746143682.876876:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593641472:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.876886:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095729200/0xe984082ccd724123 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a08f8 expref: 20 pid: 8496 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.876892:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593641600:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.876914:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.876923:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfaa00, rc 0) 00000100:00100000:3.0:1746143682.876965:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:28066:x1830963592002688:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 12991us (13283us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.876970:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9043 00000100:00100000:3.0:1746143682.878486:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593642240:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143682.878501:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.878523:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963592003712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5989us (6088us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.878535:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4609 00000100:00100000:3.0:1746143682.886370:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.887112:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592003968 00000100:00100000:0.0:1746143682.887121:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592003968 00002000:00100000:0.0:1746143682.887176:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2351104->2355199) req@ffff88009b851500 x1830963592003968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.887186:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b851500 with x1830963592003968 ext(2351104->2355199) 00002000:00010000:0.0:1746143682.887191:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b851500 00000100:00100000:2.0:1746143682.887279:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.888028:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592004224 00000100:00100000:0.0:1746143682.888033:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592004224 00002000:00100000:0.0:1746143682.888051:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3866624->3870719) req@ffff8800a0363b80 x1830963592004224/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.888060:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0363b80 with x1830963592004224 ext(3866624->3870719) 00002000:00010000:0.0:1746143682.888063:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0363b80 00000100:00100000:0.0:1746143682.888078:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3196 00000100:00100000:0.0:1746143682.888085:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592003968:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143682.888457:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592003968:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 372us (2092us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143682.888464:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3196 00002000:00100000:0.0:1746143682.888470:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2351104->2355199) req@ffff88009b851500 x1830963592003968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/4536 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.888477:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b851500 with x1830963592003968 ext(2351104->2355199) 00002000:00010000:0.0:1746143682.888479:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b851500 00000100:00100000:0.0:1746143682.888493:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3197 00000100:00100000:0.0:1746143682.888498:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963592004224:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143682.888604:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963592004224:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 104us (1324us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143682.888610:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3197 00002000:00100000:0.0:1746143682.888615:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3866624->3870719) req@ffff8800a0363b80 x1830963592004224/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/4536 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.888622:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0363b80 with x1830963592004224 ext(3866624->3870719) 00002000:00010000:0.0:1746143682.888624:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0363b80 00000100:00100000:1.0:1746143682.892523:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592002944:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 20454us (21520us total) trans 21474839613 rc 0/0 00000100:00100000:1.0:1746143682.892533:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 759 00002000:00100000:1.0:1746143682.892541:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1830912->2097151) req@ffff88009ff6f480 x1830963592002944/t21474839613(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/448 e 0 to 0 dl 1746143693 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.892549:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f480 with x1830963592002944 ext(1830912->2097151) 00010000:00010000:1.0:1746143682.892558:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 19 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746143682.892570:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 19 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:1.0:1746143682.892581:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff6f480 00000001:00080000:0.0:1746143682.892718:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872343 is committed 00000001:00080000:0.0:1746143682.892729:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872336 is committed 00000001:00080000:0.0:1746143682.892759:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872337 is committed 00000001:00080000:0.0:1746143682.892797:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872347 is committed 00000001:00080000:0.0:1746143682.892804:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872345 is committed 00000001:00080000:0.0:1746143682.892828:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872346 is committed 00000001:00080000:0.0:1746143682.892844:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872340 is committed 00000001:00080000:0.0:1746143682.892850:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872322 is committed 00000100:00100000:0.0:1746143682.897391:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.897639:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592004352 00000100:00100000:3.0:1746143682.897646:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592004352 00000100:00100000:3.0:1746143682.897690:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9045 00000100:00100000:3.0:1746143682.897697:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28071:x1830963592004352:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143682.897710:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143682.897726:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0976 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.897748:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.897755:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143682.897756:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143682.897760:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->3190783] (req 3145728->3190783) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.897783:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.897793:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 18 pid: 21542 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.897804:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b853480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593642368:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143682.897880:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143682.899044:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.899097:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592004480 00000100:00100000:0.0:1746143682.899101:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592004480 00010000:00010000:0.0:1746143682.899120:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 19 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.899183:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4610 00000100:00100000:2.0:1746143682.899192:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963592004480:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143682.899201:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143682.899221:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 19 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.899232:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 19 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.899253:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095729000/0xe984082ccd724089 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1830912->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a087a expref: 19 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.899263:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.899264:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143682.899269:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095729800/0xe984082ccd72420a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0961 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.899275:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095729800/0xe984082ccd72420a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0961 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.899298:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095729800/0xe984082ccd72420a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0961 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143682.899306:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593642496:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143682.899341:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4ba000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.906230:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.906302:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592004608 00000100:00100000:2.0:1746143682.906311:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592004608 00000100:00100000:2.0:1746143682.906355:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9046 00000100:00100000:2.0:1746143682.906362:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:28066:x1830963592004608:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143682.906377:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.906392:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a097d expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.906415:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 6 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.906426:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143682.906427:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143682.906430:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->3260415] (req 3145728->3260415) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.906453:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 6 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.906462:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 6 pid: 8497 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.906472:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593642624:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.906552:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4ba840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143682.907882:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593642496:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143682.907898:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143682.907924:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963592004480:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8733us (8881us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.907932:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4610 00000100:00100000:3.0:1746143682.911439:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b853480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593642368:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143682.911479:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->3190783] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.911494:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caac600, rc 0) 00000100:00100000:0.0:1746143682.911869:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.911908:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.911925:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592004864 00000100:00100000:0.0:1746143682.911925:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592004736 00000100:00100000:1.0:1746143682.911930:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592004864 00000100:00100000:0.0:1746143682.911930:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592004736 00002000:00100000:1.0:1746143682.911971:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3866624->4194303) req@ffff88009ff6ce00 x1830963592004864/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143682.911971:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2351104->3145727) req@ffff88009ff6ea00 x1830963592004736/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.911979:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ce00 with x1830963592004864 ext(3866624->4194303) 00002000:00100000:0.0:1746143682.911979:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ea00 with x1830963592004736 ext(2351104->3145727) 00000100:00100000:3.0:1746143682.911983:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28071:x1830963592004352:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 14285us (14597us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143682.911986:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 7 pid: 8497 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746143682.911986:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 18 pid: 21542 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.911991:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9045 00010000:00010000:1.0:1746143682.911996:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 7 pid: 8497 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746143682.911996:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 18 pid: 21542 timeout: 861 lvb_type: 0 00002000:00010000:1.0:1746143682.912002:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6ce00 00002000:00010000:0.0:1746143682.912002:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff6ea00 00000100:00100000:1.0:1746143682.912015:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 760 00000100:00100000:1.0:1746143682.912022:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+7:1964:x1830963592004864:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:2.0:1746143682.912060:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593642624:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.912076:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->3260415] (req 3145728->3260415) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.912085:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133d200, rc 0) 00000100:00100000:2.0:1746143682.912100:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28066:x1830963592004608:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5739us (5878us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.912106:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9046 00000100:00100000:0.0:1746143682.913099:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 761 00000100:00100000:0.0:1746143682.913106:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963592004736:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143682.921846:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.922556:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592005120 00000100:00100000:2.0:1746143682.922565:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592005120 00002000:00100000:2.0:1746143682.922603:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009ff6ed80 x1830963592005120/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.922612:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ed80 with x1830963592005120 ext(1048576->2097151) 00002000:00010000:2.0:1746143682.922618:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6ed80 00000100:00100000:2.0:1746143682.922636:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3198 00000100:00100000:2.0:1746143682.922644:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592005120:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143682.926830:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963592004864:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 14801us (14953us total) trans 17179872348 rc 0/0 00000100:00100000:1.0:1746143682.926840:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 760 00002000:00100000:1.0:1746143682.926850:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3866624->4194303) req@ffff88009ff6ce00 x1830963592004864/t17179872348(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/448 e 0 to 0 dl 1746143693 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.926859:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ce00 with x1830963592004864 ext(3866624->4194303) 00010000:00010000:1.0:1746143682.926868:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 9 pid: 8497 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746143682.926884:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 9 pid: 8497 timeout: 861 lvb_type: 0 00002000:00010000:1.0:1746143682.926891:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6ce00 00000100:00100000:3.0:1746143682.935375:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592005120:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12722us (13526us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143682.935386:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3198 00002000:00100000:3.0:1746143682.935396:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009ff6ed80 x1830963592005120/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.935405:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ed80 with x1830963592005120 ext(1048576->2097151) 00002000:00010000:3.0:1746143682.935410:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6ed80 00000100:00100000:0.0:1746143682.937133:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.937199:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592005248 00000100:00100000:3.0:1746143682.937206:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592005248 00010000:00010000:3.0:1746143682.937234:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 9 pid: 8497 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.937267:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4611 00000100:00100000:3.0:1746143682.937273:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1962:x1830963592005248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.937284:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143682.937304:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 9 pid: 8497 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.937314:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 9 pid: 8497 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.937336:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd724218 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0968 expref: 9 pid: 8497 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.937358:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.937360:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.937366:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.937373:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.937404:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143682.937417:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b853480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593642752:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143682.937489:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143682.938598:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b853480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593642752:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143682.938612:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.938637:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1962:x1830963592005248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1364us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.938644:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4611 00000100:00100000:0.0:1746143682.941446:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.943922:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963592004736:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 30808us (32005us total) trans 21474839614 rc 0/0 00000100:00100000:3.0:1746143682.943932:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 761 00002000:00100000:3.0:1746143682.943952:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2351104->3145727) req@ffff88009ff6ea00 x1830963592004736/t21474839614(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/448 e 0 to 0 dl 1746143693 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.943961:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ea00 with x1830963592004736 ext(2351104->3145727) 00010000:00010000:3.0:1746143682.943970:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 20 pid: 21542 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.943984:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 20 pid: 21542 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746143682.943990:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff6ea00 00000100:00100000:3.0:1746143682.944010:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592005504 00000100:00100000:3.0:1746143682.944016:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592005504 00002000:00100000:3.0:1746143682.944041:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3256320->3260415) req@ffff88009ff6fb80 x1830963592005504/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.944047:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6fb80 with x1830963592005504 ext(3256320->3260415) 00002000:00010000:3.0:1746143682.944050:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6fb80 00000100:00100000:3.0:1746143682.945911:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3199 00000100:00100000:3.0:1746143682.945927:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592005504:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143682.946190:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592005504:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 268us (4750us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143682.946197:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3199 00002000:00100000:3.0:1746143682.946204:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3256320->3260415) req@ffff88009ff6fb80 x1830963592005504/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/4536 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143682.946219:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6fb80 with x1830963592005504 ext(3256320->3260415) 00002000:00010000:3.0:1746143682.946223:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6fb80 00000100:00100000:0.0:1746143682.947208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.947255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.947392:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592005760 00000100:00100000:3.0:1746143682.947399:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592005760 00010000:00010000:3.0:1746143682.947420:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 20 pid: 21542 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.947439:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4612 00000100:00100000:3.0:1746143682.947444:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963592005760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.947453:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143682.947467:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 20 pid: 21542 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.947476:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 20 pid: 21542 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.947493:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bfaa00/0xe984082ccd724211 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2351104->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a096f expref: 20 pid: 21542 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.947518:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.947520:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.947527:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 10 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.947534:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 10 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.947567:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 10 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143682.947578:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b853480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593642880:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143682.947612:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592005632 00000100:00100000:2.0:1746143682.947615:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592005632 00000100:00100000:3.0:1746143682.947640:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143682.947962:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9047 00000100:00100000:2.0:1746143682.947969:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28072:x1830963592005632:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143682.947979:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143682.947990:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd72422d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0984 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.948006:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 19 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.948011:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143682.948012:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143682.948014:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd72422d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0984 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.948030:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 19 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.948039:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 19 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746143682.948047:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593643008:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143682.948085:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4ba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143682.953254:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.953288:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b853480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593642880:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143682.953306:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143682.953444:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592006016 00000100:00100000:1.0:1746143682.953450:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592006016 00002000:00100000:1.0:1746143682.953490:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3186688->3190783) req@ffff880094c0e680 x1830963592006016/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.953500:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0e680 with x1830963592006016 ext(3186688->3190783) 00002000:00010000:1.0:1746143682.953504:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0e680 00000100:00100000:1.0:1746143682.953533:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3200 00000100:00100000:1.0:1746143682.953539:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592006016:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143682.953925:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143682.953982:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.954171:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592006272 00000100:00100000:2.0:1746143682.954175:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592006272 00000100:00100000:2.0:1746143682.954202:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3285 00000100:00100000:2.0:1746143682.954207:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:28066:x1830963592006272:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143682.954354:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:28066:x1830963592006272:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 146us (428us total) trans 8589942221 rc 0/0 00000100:00100000:2.0:1746143682.954359:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3285 00000100:00100000:2.0:1746143682.954387:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593643008:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143682.954404:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd72422d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0984 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143682.954416:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffb6c00, rc 0) 00000100:00100000:2.0:1746143682.954432:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28072:x1830963592005632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6464us (7228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.954438:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9047 00000100:00100000:2.0:1746143682.954455:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592006400 00000100:00100000:2.0:1746143682.954457:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592006400 00002000:00100000:2.0:1746143682.954472:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1138687) req@ffff880094c0ed80 x1830963592006400/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.954483:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ed80 with x1830963592006400 ext(1048576->1138687) 00010000:00010000:2.0:1746143682.954488:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 20 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.954499:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 20 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:2.0:1746143682.954504:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0ed80 00000100:00100000:3.0:1746143682.954519:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963592005760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7073us (7263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143682.954521:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 762 00000100:00100000:2.0:1746143682.954526:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592006400:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143682.954527:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4612 00000100:00100000:1.0:1746143682.954600:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592006016:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 1060us (1352us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143682.954607:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3200 00002000:00100000:1.0:1746143682.954612:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3186688->3190783) req@ffff880094c0e680 x1830963592006016/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/4536 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143682.954619:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0e680 with x1830963592006016 ext(3186688->3190783) 00002000:00010000:1.0:1746143682.954622:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0e680 00000100:00100000:0.0:1746143682.957955:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143682.959197:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592006656 00000100:00100000:1.0:1746143682.959206:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592006656 00000100:00100000:1.0:1746143682.959987:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3286 00000100:00100000:1.0:1746143682.960000:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+29:28071:x1830963592006656:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143682.960128:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592006400:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 5598us (6143us total) trans 17179872349 rc 0/0 00000100:00100000:2.0:1746143682.960137:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 762 00002000:00100000:2.0:1746143682.960161:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1138687) req@ffff880094c0ed80 x1830963592006400/t17179872349(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:78/0 lens 488/448 e 0 to 0 dl 1746143693 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.960169:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ed80 with x1830963592006400 ext(1048576->1138687) 00010000:00010000:2.0:1746143682.960177:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 22 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746143682.960189:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 22 pid: 25369 timeout: 861 lvb_type: 0 00002000:00010000:2.0:1746143682.960195:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0ed80 00000100:00100000:1.0:1746143682.960280:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+30:28071:x1830963592006656:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 284us (2341us total) trans 8589942222 rc 0/0 00000100:00100000:1.0:1746143682.960285:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3286 00000100:00100000:0.0:1746143682.968898:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143682.969008:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592006784 00000100:00100000:3.0:1746143682.969015:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592006784 00010000:00010000:3.0:1746143682.969045:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 22 pid: 25369 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746143682.969067:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4613 00000100:00100000:3.0:1746143682.969074:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592006784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143682.969085:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143682.969104:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 22 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.969114:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 22 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.969136:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd724090 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0881 expref: 22 pid: 25369 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746143682.970818:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.970823:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143682.970836:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd72422d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0984 expref: 8 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.970848:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd72422d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0984 expref: 8 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143682.970893:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd72422d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0984 expref: 8 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143682.970906:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b853480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593643136:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143682.971973:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143682.974720:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b853480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593643136:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143682.974739:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143682.974772:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592006784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5698us (5881us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143682.974781:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4613 00000100:00100000:0.0:1746143682.979662:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143682.979828:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592007040 00000100:00100000:2.0:1746143682.979837:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592007040 00002000:00100000:2.0:1746143682.979878:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094c0c380 x1830963592007040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/0 e 0 to 0 dl 1746143693 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.979888:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c380 with x1830963592007040 ext(1048576->2097151) 00002000:00010000:2.0:1746143682.979893:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0c380 00000100:00100000:2.0:1746143682.979923:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3201 00000100:00100000:2.0:1746143682.979930:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963592007040:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143682.994255:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963592007040:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 14316us (14591us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143682.994266:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3201 00002000:00100000:2.0:1746143682.994277:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094c0c380 x1830963592007040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:78/0 lens 488/440 e 0 to 0 dl 1746143693 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143682.994286:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c380 with x1830963592007040 ext(1048576->2097151) 00002000:00010000:2.0:1746143682.994291:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0c380 00000100:00100000:0.0:1746143683.003021:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.003100:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592007168 00000100:00100000:2.0:1746143683.003107:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592007168 00000100:00100000:2.0:1746143683.003179:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9048 00000100:00100000:2.0:1746143683.003186:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28072:x1830963592007168:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143683.003201:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.003214:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd724234 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a098b expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.003241:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.003251:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143683.003253:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143683.003257:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd724234 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a098b expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.003279:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.003287:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 20 pid: 8497 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.003296:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593643264:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143683.003377:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4ba840 going to sleep for 11 seconds 00000100:00080000:0.0:1746143683.003418:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143683.005798:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593643264:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143683.005822:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd724234 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a098b expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.005837:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094677e00, rc 0) 00000100:00100000:2.0:1746143683.005880:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28072:x1830963592007168:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2694us (2867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.005888:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9048 00000100:00100000:0.0:1746143683.006073:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.006318:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592007296 00000100:00100000:2.0:1746143683.006323:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592007296 00002000:00100000:2.0:1746143683.006371:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3260415) req@ffff880094c0c700 x1830963592007296/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.006385:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c700 with x1830963592007296 ext(3145728->3260415) 00010000:00010000:2.0:1746143683.006391:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 21 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.006401:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 21 pid: 8497 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746143683.006407:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0c700 00000100:00100000:2.0:1746143683.006429:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 763 00000100:00100000:2.0:1746143683.006436:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592007296:12345-192.168.202.48@tcp:4:multiop.0 00000100:00080000:0.0:1746143683.006763:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143683.009683:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592007296:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 3241us (3603us total) trans 17179872350 rc 0/0 00000100:00100000:2.0:1746143683.009692:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 763 00002000:00100000:2.0:1746143683.009701:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3260415) req@ffff880094c0c700 x1830963592007296/t17179872350(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/448 e 0 to 0 dl 1746143694 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.009709:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c700 with x1830963592007296 ext(3145728->3260415) 00010000:00010000:2.0:1746143683.009718:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.009729:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746143683.009735:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0c700 00000100:00100000:0.0:1746143683.012537:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.013478:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592007424 00000100:00100000:3.0:1746143683.013486:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592007424 00010000:00010000:3.0:1746143683.013515:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746143683.013582:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4614 00000100:00100000:3.0:1746143683.013589:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592007424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143683.013600:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143683.013617:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.013628:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.013645:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724226 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3260415) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a097d expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.014308:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.014312:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.014321:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd724234 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a098b expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.014329:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd724234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a098b expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.014363:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd724234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a098b expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143683.014375:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b853480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593643392:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143683.014877:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143683.023842:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.025224:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b853480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593643392:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143683.025242:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143683.025396:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592007808 00000100:00100000:2.0:1746143683.025403:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592007808 00002000:00100000:2.0:1746143683.025439:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094c0f800 x1830963592007808/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.025447:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0f800 with x1830963592007808 ext(2097152->3145727) 00002000:00010000:2.0:1746143683.025451:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0f800 00000100:00100000:3.0:1746143683.026397:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592007424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12805us (13864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.026406:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4614 00000100:00100000:2.0:1746143683.026576:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3202 00000100:00100000:2.0:1746143683.026583:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592007808:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143683.028180:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.028198:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.028224:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.028255:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592007936 00000100:00100000:3.0:1746143683.028261:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592007936 00002000:00100000:3.0:1746143683.028291:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009b853480 x1830963592007936/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.028300:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b853480 with x1830963592007936 ext(3145728->4194303) 00002000:00010000:3.0:1746143683.028304:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b853480 00000100:00100000:3.0:1746143683.028313:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592008320 00000100:00100000:3.0:1746143683.028315:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592008320 00000100:00080000:3.0:1746143683.028327:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1746143683.028336:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3190784->4194303) req@ffff880094763100 x1830963592008320/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.028342:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763100 with x1830963592008320 ext(3190784->4194303) 00002000:00010000:3.0:1746143683.028344:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094763100 00000100:00100000:3.0:1746143683.028353:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592008192 00000100:00100000:3.0:1746143683.028354:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592008192 00002000:00100000:3.0:1746143683.028362:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880094762a00 x1830963592008192/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.028367:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094762a00 with x1830963592008192 ext(2097152->3145727) 00002000:00010000:3.0:1746143683.028369:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094762a00 00000100:00100000:3.0:1746143683.028378:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3203 00000100:00100000:3.0:1746143683.028382:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592007936:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143683.030249:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3204 00000100:00100000:3.0:1746143683.030263:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592008320:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143683.031415:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3205 00000100:00100000:3.0:1746143683.031422:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592008192:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143683.047365:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592007936:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18973us (19180us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143683.047376:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3203 00002000:00100000:2.0:1746143683.047386:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009b853480 x1830963592007936/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.047394:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b853480 with x1830963592007936 ext(3145728->4194303) 00002000:00010000:2.0:1746143683.047400:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b853480 00000100:00100000:3.0:1746143683.064549:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592008320:12345-192.168.202.48@tcp:3:cat.0 Request processed in 34281us (36341us total) trans 0 rc 1003520/1003520 00000100:00100000:3.0:1746143683.064559:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3204 00002000:00100000:3.0:1746143683.064567:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3190784->4194303) req@ffff880094763100 x1830963592008320/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1003520/1003520 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.064576:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763100 with x1830963592008320 ext(3190784->4194303) 00002000:00010000:3.0:1746143683.064581:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094763100 00000100:00100000:0.0:1746143683.066743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.067222:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592008704 00000100:00100000:3.0:1746143683.067229:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592008704 00000100:00100000:3.0:1746143683.067472:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8156 00000100:00100000:3.0:1746143683.067479:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:28080:x1830963592008704:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143683.067497:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.067510:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd72423b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0992 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.068907:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145e00/0xe984082ccd724242 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.068925:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145e00/0xe984082ccd724242 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.068935:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145e00/0xe984082ccd724242 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.068956:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd724249 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.068962:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd724249 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.068966:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd724249 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069052:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144e00/0xe984082ccd724250 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069059:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144e00/0xe984082ccd724250 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069065:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144e00/0xe984082ccd724250 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143683.069071:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143683.069135:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145e00/0xe984082ccd724242 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069155:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145e00/0xe984082ccd724242 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069160:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145e00/0xe984082ccd724242 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069167:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b145e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.069171:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145e00/0xe984082ccd724242 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069176:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145e00/0xe984082ccd724242 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069183:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143683.069185:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.069187:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145e00/0xe984082ccd724242 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069191:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145e00/0xe984082ccd724242 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069208:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd724249 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069212:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd724249 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069216:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd724249 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069219:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b145000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.069221:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd724249 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069225:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd724249 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069229:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9d800) 00010000:00010000:3.0:1746143683.069230:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.069232:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd724249 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069236:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd724249 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.069266:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd72423b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0992 expref: 265 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.069276:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144e00/0xe984082ccd724250 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0992 expref: 264 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.069281:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143683.069282:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143683.069284:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b144e00, rc 0) 00000100:00100000:3.0:1746143683.069331:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:28080:x1830963592008704:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1851us (2593us total) trans 8589942223 rc 0/0 00000100:00100000:3.0:1746143683.069338:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8156 00000100:00100000:3.0:1746143683.069606:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592008192:12345-192.168.202.48@tcp:3:cat.0 Request processed in 38184us (41380us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143683.069613:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3205 00002000:00100000:3.0:1746143683.069620:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880094762a00 x1830963592008192/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.069628:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094762a00 with x1830963592008192 ext(2097152->3145727) 00002000:00010000:3.0:1746143683.069632:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094762a00 00000100:00100000:2.0:1746143683.071733:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592007808:12345-192.168.202.48@tcp:3:cat.0 Request processed in 45144us (47891us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143683.071742:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3202 00002000:00100000:2.0:1746143683.071750:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094c0f800 x1830963592007808/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.071758:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0f800 with x1830963592007808 ext(2097152->3145727) 00002000:00010000:2.0:1746143683.071762:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0f800 00000100:00100000:0.0:1746143683.072491:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.072541:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592008832 00000100:00100000:2.0:1746143683.072547:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592008832 00000100:00100000:2.0:1746143683.072591:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9049 00000100:00100000:2.0:1746143683.072596:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592008832:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143683.072611:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.072624:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094676c00/0xe984082ccd72425e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0999 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.072641:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.072642:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.072650:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094676c00/0xe984082ccd72425e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0999 expref: 20 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143683.072664:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094676c00/0xe984082ccd72425e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0999 expref: 20 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143683.072673:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094676c00, rc 0) 00000100:00100000:2.0:1746143683.072828:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592008832:12345-192.168.202.48@tcp:101:cat.0 Request processed in 230us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.072833:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9049 00000100:00080000:3.0:1746143683.072935:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143683.073567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.073591:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.073713:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.074035:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592008960 00000100:00100000:1.0:1746143683.074040:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592008960 00000100:00100000:1.0:1746143683.074072:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592009088 00000100:00100000:1.0:1746143683.074075:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592009088 00000100:00100000:1.0:1746143683.074085:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592009216 00000100:00100000:1.0:1746143683.074087:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592009216 00000100:00100000:1.0:1746143683.074097:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9050 00000100:00100000:1.0:1746143683.074102:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592008960:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143683.074111:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143683.074123:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5793200/0xe984082ccd724265 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09a0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.074159:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.074161:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.074167:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5793200/0xe984082ccd724265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a0 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143683.074178:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5793200/0xe984082ccd724265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a0 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143683.074186:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5793200, rc 0) 00000100:00100000:1.0:1746143683.074211:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592008960:12345-192.168.202.48@tcp:101:cat.0 Request processed in 109us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143683.074216:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9050 00000100:00100000:1.0:1746143683.074229:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9051 00000100:00100000:1.0:1746143683.074234:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592009088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143683.074239:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143683.074245:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09a7 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.074253:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.074255:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.074258:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a7 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143683.074265:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a7 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143683.074272:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5792a00, rc 0) 00000100:00100000:1.0:1746143683.074284:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592009088:12345-192.168.202.48@tcp:101:cat.0 Request processed in 51us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143683.074289:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9051 00000100:00100000:1.0:1746143683.074298:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9052 00000100:00100000:1.0:1746143683.074302:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592009216:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143683.074307:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143683.074314:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5793400/0xe984082ccd724273 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09ae expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143683.074345:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593643520:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143683.074398:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143683.080574:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593643520:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143683.080604:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5793400/0xe984082ccd724273 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ae expref: 21 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143683.080615:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5793400/0xe984082ccd724273 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ae expref: 21 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143683.080640:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5793400, rc 0) 00000100:00100000:1.0:1746143683.080675:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592009216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6371us (6960us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143683.080682:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9052 00000100:00100000:0.0:1746143683.089793:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.089963:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592009472 00000100:00100000:2.0:1746143683.089971:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592009472 00002000:00100000:2.0:1746143683.090009:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094c0d180 x1830963592009472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.090018:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d180 with x1830963592009472 ext(4194304->4898815) 00002000:00010000:2.0:1746143683.090023:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0d180 00000100:00100000:2.0:1746143683.090056:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3206 00000100:00100000:2.0:1746143683.090063:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1962:x1830963592009472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143683.099465:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.099567:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592009728 00000100:00100000:3.0:1746143683.099575:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592009728 00002000:00100000:3.0:1746143683.099612:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880094c0d880 x1830963592009728/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.099621:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d880 with x1830963592009728 ext(1048576->2097151) 00002000:00010000:3.0:1746143683.099626:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0d880 00000100:00100000:3.0:1746143683.099644:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3207 00000100:00100000:3.0:1746143683.099650:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592009728:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143683.101003:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1962:x1830963592009472:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10934us (11212us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143683.101014:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3206 00002000:00100000:2.0:1746143683.101022:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094c0d180 x1830963592009472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.101029:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d180 with x1830963592009472 ext(4194304->4898815) 00002000:00010000:2.0:1746143683.101033:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0d180 00000100:00100000:0.0:1746143683.105073:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.110841:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.113513:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592009984 00000100:00100000:3.0:1746143683.113525:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592009984 00000100:00100000:1.0:1746143683.113569:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.113578:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8157 00000100:00100000:3.0:1746143683.113585:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+30:28082:x1830963592009984:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:1.0:1746143683.113594:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592010496 00000100:00100000:1.0:1746143683.113597:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592010496 00010000:00010000:3.0:1746143683.113609:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143683.113626:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3287 00000100:00100000:1.0:1746143683.113632:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+31:28072:x1830963592010496:12345-192.168.202.48@tcp:35:cat.0 00010000:00010000:3.0:1746143683.113644:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145600/0xe984082ccd72427a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09b5 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.113729:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd724281 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.113740:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd724281 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.113749:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd724281 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.113758:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd724288 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.113762:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd724288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.113767:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd724288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143683.113810:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+33:28072:x1830963592010496:12345-192.168.202.48@tcp:35:cat.0 Request processed in 177us (245us total) trans 8589942224 rc 0/0 00000100:00100000:1.0:1746143683.113817:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3287 00000100:00100000:1.0:1746143683.113980:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592010240 00000100:00100000:1.0:1746143683.113984:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592010240 00002000:00100000:1.0:1746143683.114003:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094c0c000 x1830963592010240/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.114011:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c000 with x1830963592010240 ext(1048576->2097151) 00002000:00010000:1.0:1746143683.114015:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0c000 00000100:00100000:1.0:1746143683.114025:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3208 00000100:00100000:1.0:1746143683.114030:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592010240:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:3.0:1746143683.114748:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd72428f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114757:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd72428f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114764:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd72428f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143683.114771:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143683.114817:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd724281 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114822:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd724281 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114826:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd724281 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114831:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b145a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.114834:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd724281 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114839:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd724281 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114847:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143683.114849:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.114852:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd724281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114855:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd724281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114868:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd724288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114872:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd724288 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114875:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd724288 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114878:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b144c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.114880:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd724288 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114884:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd724288 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114888:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9d000) 00010000:00010000:3.0:1746143683.114890:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.114892:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd724288 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114895:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd724288 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.114920:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145600/0xe984082ccd72427a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09b5 expref: 34 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.114929:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd72428f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09b5 expref: 33 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.114935:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143683.114937:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143683.114939:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b145000, rc 0) 00000100:00100000:3.0:1746143683.114973:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+33:28082:x1830963592009984:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1389us (9907us total) trans 8589942225 rc 0/0 00000100:00100000:3.0:1746143683.114978:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8157 00000100:00100000:2.0:1746143683.115156:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592009728:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15505us (15698us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143683.115163:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3207 00002000:00100000:2.0:1746143683.115168:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880094c0d880 x1830963592009728/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.115175:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d880 with x1830963592009728 ext(1048576->2097151) 00002000:00010000:2.0:1746143683.115178:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0d880 00000100:00100000:1.0:1746143683.127574:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592010240:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13534us (16731us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143683.127585:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3208 00002000:00100000:1.0:1746143683.127595:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094c0c000 x1830963592010240/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.127603:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c000 with x1830963592010240 ext(1048576->2097151) 00002000:00010000:1.0:1746143683.127608:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0c000 00000100:00100000:0.0:1746143683.138872:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.139010:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592010624 00000100:00100000:1.0:1746143683.139017:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592010624 00000100:00100000:1.0:1746143683.139066:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9053 00000100:00100000:1.0:1746143683.139073:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28082:x1830963592010624:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143683.139088:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143683.139102:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09bc expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.139125:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd724234 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a098b expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.139132:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a7 expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143683.139164:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.139166:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.139169:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3293183] (req 3145728->3293183) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.139198:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a7 expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143683.139209:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a7 expref: 23 pid: 21542 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746143683.139219:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593643648:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143683.139297:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd724234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a098b expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.139305:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd724234 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a098b expref: 11 pid: 8497 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746143683.139313:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593643776:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143683.139329:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143683.146594:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593643648:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143683.146606:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593643776:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143683.146636:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3293183] (req 3145728->3293183) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.146651:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1e00, rc 0) 00000100:00100000:1.0:1746143683.146689:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28082:x1830963592010624:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7616us (7824us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143683.146700:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9053 00000100:00100000:0.0:1746143683.148305:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.148665:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592010880 00000100:00100000:1.0:1746143683.148673:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592010880 00002000:00100000:1.0:1746143683.148711:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f1ece00 x1830963592010880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.148719:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ece00 with x1830963592010880 ext(2097152->3145727) 00010000:00010000:1.0:1746143683.148728:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a7 expref: 24 pid: 21542 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746143683.148738:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a7 expref: 24 pid: 21542 timeout: 862 lvb_type: 1 00002000:00010000:1.0:1746143683.148745:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f1ece00 00000100:00100000:1.0:1746143683.148777:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 764 00000100:00100000:1.0:1746143683.148784:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592010880:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143683.149355:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593643904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746143683.149396:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143683.149471:0:8498:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593643904 00000100:00100000:2.0:1746143683.149474:0:8498:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593643904 00000100:00100000:2.0:1746143683.149501:0:8498:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1746143683.149506:0:8498:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830963593643904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746143683.149526:0:8498:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 274661376 pending 5111808 free 3852468224 avail 3850371072 00000100:00100000:2.0:1746143683.149553:0:8498:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830963593643904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.149558:0:8498:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1746143683.149614:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839605 gen 2 00000004:00080000:3.0:1746143683.149618:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093502300, transno 21474839552 00000004:00080000:3.0:1746143683.149630:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093501500, transno 21474839553 00000004:00080000:3.0:1746143683.149633:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093500e00, transno 21474839554 00000004:00080000:3.0:1746143683.149635:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093501180, transno 21474839555 00000004:00080000:3.0:1746143683.149636:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093503b80, transno 21474839556 00000004:00080000:3.0:1746143683.149638:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093500000, transno 21474839557 00000004:00080000:3.0:1746143683.149640:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093502680, transno 21474839558 00000004:00080000:3.0:1746143683.149642:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093503800, transno 21474839559 00000004:00080000:3.0:1746143683.149643:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f9500, transno 21474839560 00000004:00080000:3.0:1746143683.149645:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dc380, transno 21474839561 00000004:00080000:3.0:1746143683.149647:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930de300, transno 21474839562 00000004:00080000:3.0:1746143683.149649:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930de680, transno 21474839563 00000004:00080000:3.0:1746143683.149651:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f9180, transno 21474839564 00000004:00080000:3.0:1746143683.149652:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dea00, transno 21474839565 00000004:00080000:3.0:1746143683.149654:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dc700, transno 21474839566 00000004:00080000:3.0:1746143683.149655:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dd880, transno 21474839567 00000004:00080000:3.0:1746143683.149657:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800908f0700, transno 21474839579 00000004:00080000:3.0:1746143683.149659:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800908f1f80, transno 21474839580 00000004:00080000:3.0:1746143683.149660:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800908f3480, transno 21474839581 00000004:00080000:3.0:1746143683.149662:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800908f0a80, transno 21474839582 00000004:00080000:3.0:1746143683.149665:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800908f2a00, transno 21474839583 00000004:00080000:3.0:1746143683.149667:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800908f2300, transno 21474839584 00000004:00080000:3.0:1746143683.149668:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800908f0e00, transno 21474839585 00000004:00080000:3.0:1746143683.149670:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800908f1880, transno 21474839586 00000004:00080000:3.0:1746143683.149672:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b852a00, transno 21474839590 00000004:00080000:3.0:1746143683.149673:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b852300, transno 21474839591 00000004:00080000:3.0:1746143683.149675:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b850e00, transno 21474839592 00000004:00080000:3.0:1746143683.149677:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b850a80, transno 21474839593 00000004:00080000:3.0:1746143683.149679:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b850700, transno 21474839594 00000004:00080000:3.0:1746143683.149680:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b851180, transno 21474839595 00000004:00080000:3.0:1746143683.149682:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094760700, transno 21474839596 00000004:00080000:3.0:1746143683.149684:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b852d80, transno 21474839597 00000004:00080000:3.0:1746143683.149686:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094763800, transno 21474839598 00000004:00080000:3.0:1746143683.149688:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d2a00, transno 21474839599 00000004:00080000:3.0:1746143683.149689:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094762300, transno 21474839600 00000004:00080000:3.0:1746143683.149691:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f532d80, transno 21474839601 00000004:00080000:3.0:1746143683.149694:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095098e00, transno 21474839602 00000004:00080000:3.0:1746143683.149695:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f00380, transno 21474839603 00000004:00080000:3.0:1746143683.149697:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba44700, transno 21474839604 00000004:00080000:3.0:1746143683.149699:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f02680, transno 21474839605 00000100:00100000:3.0:1746143683.149706:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593643904:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1746143683.149725:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1746143683.155371:0:14800:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 40 done 00000100:00100000:0.0:1746143683.161011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.161073:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592011008 00000100:00100000:3.0:1746143683.161081:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592011008 00010000:00010000:3.0:1746143683.161112:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd724234 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a098b expref: 11 pid: 8497 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746143683.161173:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4615 00000100:00100000:3.0:1746143683.161181:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592011008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143683.161194:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143683.161211:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd724234 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a098b expref: 11 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.161221:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd724234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a098b expref: 11 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.161241:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd724234 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a098b expref: 11 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.161716:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143683.162285:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592011008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1103us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.162292:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4615 00000100:00100000:0.0:1746143683.164524:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592010880:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15733us (16217us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143683.164533:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 764 00002000:00100000:0.0:1746143683.164544:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f1ece00 x1830963592010880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143683.164553:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ece00 with x1830963592010880 ext(2097152->3145727) 00010000:00010000:0.0:1746143683.164561:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a7 expref: 24 pid: 21542 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746143683.164574:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a7 expref: 24 pid: 21542 timeout: 862 lvb_type: 1 00002000:00010000:0.0:1746143683.164580:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f1ece00 00000100:00100000:1.0:1746143683.166379:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b20e2be-dc58-49ff-81b7-9c0574412294:3292:1830963593644032:0@lo:400:kworker.0 00000100:00100000:1.0:1746143683.166428:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143683.166481:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143683.166486:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1830963593644160:0@lo:400:kworker.0 00000100:00100000:1.0:1746143683.166506:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143683.166536:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593644160 00000100:00100000:1.0:1746143683.166541:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593644160 00000100:00100000:1.0:1746143683.166580:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1746143683.166587:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1830963593644160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143683.166624:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1830963593644160:12345-0@lo:400:kworker.0 Request processed in 38us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143683.166630:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1746143683.166660:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1830963593644160:0@lo:400:kworker.0 00000100:00080000:1.0:1746143683.166684:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143683.166784:0:14761:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593644032 00000100:00100000:3.0:1746143683.166788:0:14761:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593644032 00000100:00100000:3.0:1746143683.166817:0:14761:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1746143683.166822:0:14761:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3292:x1830963593644032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143683.166852:0:14761:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3292:x1830963593644032:12345-0@lo:400:kworker.0 Request processed in 30us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.166857:0:14761:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1746143683.166876:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593644416:0@lo:400:kworker.0 00000100:00100000:3.0:1746143683.166902:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143683.166925:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746143683.166930:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1830963593644288:0@lo:400:kworker.0 00000100:00100000:3.0:1746143683.166953:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143683.166968:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593644288 00000100:00100000:3.0:1746143683.166970:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593644288 00000100:00080000:3.0:1746143683.166978:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143683.166992:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1746143683.166996:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830963593644288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143683.167019:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830963593644288:12345-0@lo:400:kworker.0 Request processed in 22us (65us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.167023:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1746143683.167041:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1830963593644288:0@lo:400:kworker.0 00000100:00100000:0.0:1746143683.167087:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143683.167094:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830963593644544:0@lo:400:kworker.0 00000100:00100000:0.0:1746143683.167113:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143683.167160:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593644416 00000100:00100000:2.0:1746143683.167163:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593644416 00000100:00100000:2.0:1746143683.167185:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1746143683.167189:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3295:x1830963593644416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143683.167213:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3295:x1830963593644416:12345-0@lo:400:kworker.0 Request processed in 24us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.167217:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00080000:3.0:1746143683.167954:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143683.167971:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872340 gen 2 00000004:00080000:3.0:1746143683.167976:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef4e00, transno 17179872283 00000004:00080000:3.0:1746143683.167991:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef4700, transno 17179872284 00000004:00080000:3.0:1746143683.167993:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef6a00, transno 17179872285 00000004:00080000:3.0:1746143683.167995:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef4380, transno 17179872286 00000004:00080000:3.0:1746143683.167997:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef7800, transno 17179872287 00000004:00080000:3.0:1746143683.167999:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef5880, transno 17179872288 00000004:00080000:3.0:1746143683.168001:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef5f80, transno 17179872289 00000004:00080000:3.0:1746143683.168003:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef6300, transno 17179872290 00000004:00080000:3.0:1746143683.168005:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bef7100, transno 17179872291 00000004:00080000:3.0:1746143683.168007:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a56680, transno 17179872292 00000004:00080000:3.0:1746143683.168009:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a57b80, transno 17179872293 00000004:00080000:3.0:1746143683.168011:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a54000, transno 17179872294 00000004:00080000:3.0:1746143683.168013:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a57800, transno 17179872295 00000004:00080000:3.0:1746143683.168015:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093501f80, transno 17179872296 00000004:00080000:3.0:1746143683.168017:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a55880, transno 17179872297 00000004:00080000:3.0:1746143683.168019:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a55180, transno 17179872298 00000004:00080000:3.0:1746143683.168021:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a55c00, transno 17179872299 00000004:00080000:3.0:1746143683.168023:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a57100, transno 17179872300 00000004:00080000:3.0:1746143683.168026:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800908f0380, transno 17179872311 00000004:00080000:3.0:1746143683.168028:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e1f80, transno 17179872312 00000004:00080000:3.0:1746143683.168030:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800908f3800, transno 17179872313 00000004:00080000:3.0:1746143683.168032:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e0a80, transno 17179872314 00000004:00080000:3.0:1746143683.168034:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e1500, transno 17179872315 00000004:00080000:3.0:1746143683.168036:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63e680, transno 17179872316 00000004:00080000:3.0:1746143683.168038:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e3800, transno 17179872317 00000004:00080000:3.0:1746143683.168040:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63ea00, transno 17179872318 00000004:00080000:3.0:1746143683.168042:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba47800, transno 17179872319 00000004:00080000:3.0:1746143683.168044:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba44e00, transno 17179872323 00000004:00080000:3.0:1746143683.168046:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131e9c700, transno 17179872324 00000004:00080000:3.0:1746143683.168049:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131e9d880, transno 17179872325 00000004:00080000:3.0:1746143683.168050:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131e9dc00, transno 17179872326 00000004:00080000:3.0:1746143683.168052:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba47100, transno 17179872327 00000004:00080000:3.0:1746143683.168053:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131e9d500, transno 17179872328 00000004:00080000:3.0:1746143683.168055:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131e9df80, transno 17179872329 00000004:00080000:3.0:1746143683.168057:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131e9d180, transno 17179872330 00000004:00080000:3.0:1746143683.168059:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f890380, transno 17179872331 00000004:00080000:3.0:1746143683.168061:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094304380, transno 17179872332 00000004:00080000:3.0:1746143683.168063:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136919880, transno 17179872333 00000004:00080000:3.0:1746143683.168064:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090765c00, transno 17179872334 00000004:00080000:3.0:1746143683.168066:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013691bb80, transno 17179872335 00000004:00080000:3.0:1746143683.168068:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090767b80, transno 17179872336 00000004:00080000:3.0:1746143683.168069:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094304e00, transno 17179872337 00000004:00080000:3.0:1746143683.168071:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090767800, transno 17179872338 00000004:00080000:3.0:1746143683.168072:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094304700, transno 17179872339 00000004:00080000:3.0:1746143683.168074:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136919f80, transno 17179872340 00000100:00100000:3.0:1746143683.168079:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593644416:0@lo:400:kworker.0 00000100:00100000:3.0:1746143683.168097:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593644544 00000100:00100000:3.0:1746143683.168099:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593644544 00000100:00100000:3.0:1746143683.168125:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1746143683.168130:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963593644544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143683.168180:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963593644544:12345-0@lo:400:kworker.0 Request processed in 49us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.168184:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1746143683.168441:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b20e2be-dc58-49ff-81b7-9c0574412294:3292:1830963593644032:0@lo:400:kworker.0 00000004:00080000:0.0:1746143683.170327:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 45 done 00000100:00100000:0.0:1746143683.170370:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830963593644544:0@lo:400:kworker.0 00000100:00100000:0.0:1746143683.170925:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.170980:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592011136 00000100:00100000:2.0:1746143683.170985:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592011136 00000100:00100000:2.0:1746143683.171021:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9054 00000100:00100000:2.0:1746143683.171026:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28080:x1830963592011136:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143683.171038:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.171051:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d53a800/0xe984082ccd7242a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09c3 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.171072:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 10 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.171078:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143683.171080:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143683.171082:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d53a800/0xe984082ccd7242a4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09c3 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.171103:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 10 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.171112:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 10 pid: 21542 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.171120:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593644672:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143683.171211:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d25cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143683.175687:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593644672:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143683.175719:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d53a800/0xe984082ccd7242a4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09c3 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.175735:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d53a800, rc 0) 00000100:00100000:2.0:1746143683.176637:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28080:x1830963592011136:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5608us (5712us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.176645:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9054 00000100:00100000:0.0:1746143683.176767:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.177068:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592011392 00000100:00100000:2.0:1746143683.177074:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592011392 00002000:00100000:2.0:1746143683.177106:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2969600->3190783) req@ffff88008f1eed80 x1830963592011392/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.177114:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eed80 with x1830963592011392 ext(2969600->3190783) 00010000:00010000:2.0:1746143683.177120:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 11 pid: 21542 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746143683.177310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.177353:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592011264 00000100:00100000:1.0:1746143683.177357:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592011264 00010000:00010000:1.0:1746143683.177374:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a7 expref: 24 pid: 21542 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746143683.177405:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4616 00000100:00100000:1.0:1746143683.177412:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592011264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143683.177422:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143683.177439:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a7 expref: 24 pid: 21542 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746143683.177559:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a7 expref: 24 pid: 21542 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746143683.177577:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5792a00/0xe984082ccd72426c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a7 expref: 24 pid: 21542 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746143683.177599:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.177600:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.177606:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.177617:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.177640:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143683.177649:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593644800:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143683.177701:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143683.177876:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 11 pid: 21542 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746143683.177883:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1eed80 00000100:00100000:0.0:1746143683.184212:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593644928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143683.184291:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143683.184531:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.184584:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.184642:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593644800:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143683.184658:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143683.184927:0:8499:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593644928 00000100:00100000:2.0:1746143683.184932:0:8499:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593644928 00000100:00100000:2.0:1746143683.184971:0:8499:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1746143683.184976:0:8499:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1830963593644928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746143683.184994:0:8499:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 315293696 pending 5111808 free 3849322496 avail 3847225344 00000100:00100000:2.0:1746143683.185027:0:8499:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1830963593644928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.185032:0:8499:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1746143683.185049:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592011904 00000100:00100000:2.0:1746143683.185051:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592011904 00000100:00100000:2.0:1746143683.185066:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8158 00000100:00100000:2.0:1746143683.185069:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:28086:x1830963592011904:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143683.185081:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.185093:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b600/0xe984082ccd7242ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09ca expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.185176:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.185188:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144e00/0xe984082ccd724250 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0992 expref: 265 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.185195:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd72428f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09b5 expref: 32 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.185200:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.185217:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd72428f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09b5 expref: 32 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.185225:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd72428f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09b5 expref: 32 pid: 14764 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.185232:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593645056:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143683.185283:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592011264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7871us (7973us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143683.185290:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4616 00000100:00100000:3.0:1746143683.185349:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592011648 00000100:00100000:3.0:1746143683.185353:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592011648 00000100:00100000:1.0:1746143683.185372:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 765 00002000:00100000:3.0:1746143683.185373:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3289088->3293183) req@ffff88008f1edc00 x1830963592011648/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143683.185378:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592011392:12345-192.168.202.48@tcp:4:multiop.0 00002000:00100000:3.0:1746143683.185381:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1edc00 with x1830963592011648 ext(3289088->3293183) 00002000:00010000:3.0:1746143683.185384:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1edc00 00000100:00100000:3.0:1746143683.185395:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3209 00000100:00100000:3.0:1746143683.185399:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592011648:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:2.0:1746143683.186002:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144e00/0xe984082ccd724250 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0992 expref: 265 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.186010:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144e00/0xe984082ccd724250 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0992 expref: 265 pid: 14764 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.186017:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593645184:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143683.186035:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d25cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143683.186167:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592011648:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 766us (1582us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143683.186173:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3209 00002000:00100000:3.0:1746143683.186178:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3289088->3293183) req@ffff88008f1edc00 x1830963592011648/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/4536 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.186184:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1edc00 with x1830963592011648 ext(3289088->3293183) 00002000:00010000:3.0:1746143683.186187:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1edc00 00000100:00100000:2.0:1746143683.186292:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593644928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746143683.190521:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592011392:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 5135us (13747us total) trans 21474839615 rc 0/0 00000100:00100000:1.0:1746143683.190532:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 765 00002000:00100000:1.0:1746143683.190542:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2969600->3190783) req@ffff88008f1eed80 x1830963592011392/t21474839615(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/448 e 0 to 0 dl 1746143694 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.190550:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eed80 with x1830963592011392 ext(2969600->3190783) 00010000:00010000:1.0:1746143683.190558:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 13 pid: 21542 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.190570:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 13 pid: 21542 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746143683.190577:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1eed80 00000100:00100000:0.0:1746143683.190717:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.190738:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.190757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.190829:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593645056:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143683.190839:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593645184:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143683.190858:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:2.0:1746143683.190948:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592012416 00000100:00100000:2.0:1746143683.190953:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592012416 00010000:00010000:2.0:1746143683.190974:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144e00/0xe984082ccd724250 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0992 expref: 266 pid: 14764 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.190990:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592012288 00000100:00100000:2.0:1746143683.190992:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592012288 00010000:00010000:2.0:1746143683.191000:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd72428f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09b5 expref: 33 pid: 14764 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.191011:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4617 00000100:00100000:2.0:1746143683.191017:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:1965:x1830963592012416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143683.191027:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143683.191031:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144e00/0xe984082ccd724250 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0992 expref: 266 pid: 14764 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.191038:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144e00/0xe984082ccd724250 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0992 expref: 266 pid: 14764 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.191058:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144e00/0xe984082ccd724250 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0992 expref: 266 pid: 14764 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.191073:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143683.191076:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.191083:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.191087:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143683.191130:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:1965:x1830963592012416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 112us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.191135:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4617 00000100:00100000:2.0:1746143683.191187:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4618 00000100:00100000:2.0:1746143683.191192:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+33:1965:x1830963592012288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143683.191198:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143683.191202:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd72428f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09b5 expref: 33 pid: 14764 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.191208:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd72428f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09b5 expref: 33 pid: 14764 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.191218:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd72428f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09b5 expref: 33 pid: 14764 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.191225:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143683.191228:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.191233:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.191238:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.191251:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143683.191265:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1965:x1830963592012288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 73us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.191270:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4618 00010000:00010000:3.0:1746143683.191456:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.191462:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143683.191477:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143683.191564:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b600/0xe984082ccd7242ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ca expref: 266 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.191584:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ca expref: 265 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.191589:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143683.191591:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143683.191593:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d53b400, rc 0) 00000100:00100000:3.0:1746143683.191619:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:28086:x1830963592011904:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6549us (7090us total) trans 8589942226 rc 0/0 00000100:00100000:3.0:1746143683.191624:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8158 00000100:00100000:1.0:1746143683.191640:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592012160 00000100:00100000:1.0:1746143683.191643:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592012160 00000100:00100000:1.0:1746143683.191662:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3288 00000100:00100000:1.0:1746143683.191667:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+32:28082:x1830963592012160:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143683.191759:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+33:28082:x1830963592012160:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 91us (1043us total) trans 8589942227 rc 0/0 00000100:00100000:1.0:1746143683.191765:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3288 00000100:00100000:0.0:1746143683.196236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.196342:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592012672 00000100:00100000:2.0:1746143683.196350:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592012672 00000100:00100000:2.0:1746143683.196388:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9055 00000100:00100000:2.0:1746143683.196395:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28086:x1830963592012672:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143683.196410:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.196425:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09d1 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.196447:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cbc400/0xe984082ccd723ea6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0777 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.196455:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b15e000/0xe984082ccd723f55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d2 expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143683.196461:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701400/0xe984082ccd723efa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a1 expref: 6 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143683.196470:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.196472:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.196475:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [1282048->1392639] (req 1282048->1392639) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.196496:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0701400/0xe984082ccd723efa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a1 expref: 6 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143683.196505:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701400/0xe984082ccd723efa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a1 expref: 6 pid: 12618 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746143683.196513:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593645312:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143683.196587:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b15e000/0xe984082ccd723f55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d2 expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143683.196594:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b15e000/0xe984082ccd723f55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d2 expref: 12 pid: 8496 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746143683.196601:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593645440:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143683.196621:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130cbc400/0xe984082ccd723ea6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0777 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.196627:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130cbc400/0xe984082ccd723ea6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0777 expref: 22 pid: 9527 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.196638:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593645568:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143683.196651:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143683.197119:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.197191:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592012544 00000100:00100000:1.0:1746143683.197196:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592012544 00010000:00010000:1.0:1746143683.197209:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 13 pid: 21542 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746143683.197235:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4619 00000100:00100000:1.0:1746143683.197240:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592012544:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143683.197248:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143683.197266:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 13 pid: 21542 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.197275:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 13 pid: 21542 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.197294:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caac600/0xe984082ccd72421f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0976 expref: 13 pid: 21542 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.197304:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.197305:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.197310:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d53a800/0xe984082ccd7242a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09c3 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.197316:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d53a800/0xe984082ccd7242a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09c3 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.197336:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d53a800/0xe984082ccd7242a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09c3 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143683.197344:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593645696:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143683.197395:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143683.201115:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.201124:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593645696:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143683.201158:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143683.201192:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592012544:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3951us (4073us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.201201:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593645312:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143683.201201:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4619 00000100:00100000:2.0:1746143683.201209:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593645440:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143683.201215:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593645568:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143683.201241:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [1282048->1392639] (req 1282048->1392639) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.201253:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d7a00, rc 0) 00000100:00100000:2.0:1746143683.201272:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28086:x1830963592012672:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4878us (5043us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.201277:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9055 00000100:00100000:1.0:1746143683.202165:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592012800 00000100:00100000:1.0:1746143683.202171:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592012800 00010000:00010000:1.0:1746143683.202189:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b15e000/0xe984082ccd723f55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d2 expref: 12 pid: 8496 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746143683.202211:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4620 00000100:00100000:1.0:1746143683.202217:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592012800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143683.202226:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143683.202241:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b15e000/0xe984082ccd723f55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d2 expref: 12 pid: 8496 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746143683.202250:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b15e000/0xe984082ccd723f55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d2 expref: 12 pid: 8496 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746143683.202265:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b15e000/0xe984082ccd723f55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07d2 expref: 12 pid: 8496 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746143683.202275:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143683.202290:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592012800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 74us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143683.202295:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4620 00000100:00100000:0.0:1746143683.202602:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.202696:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592012928 00000100:00100000:3.0:1746143683.202700:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592012928 00010000:00010000:3.0:1746143683.202716:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701400/0xe984082ccd723efa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a1 expref: 7 pid: 12618 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746143683.202730:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4621 00000100:00100000:3.0:1746143683.202735:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963592012928:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143683.202743:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143683.202750:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0701400/0xe984082ccd723efa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a1 expref: 7 pid: 12618 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746143683.202757:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0701400/0xe984082ccd723efa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a1 expref: 7 pid: 12618 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746143683.202768:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701400/0xe984082ccd723efa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a07a1 expref: 7 pid: 12618 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746143683.202778:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143683.202798:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1963:x1830963592012928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 63us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.202802:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4621 00000100:00100000:0.0:1746143683.203123:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.203283:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592013056 00000100:00100000:1.0:1746143683.203287:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592013056 00010000:00010000:1.0:1746143683.203300:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130cbc400/0xe984082ccd723ea6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0777 expref: 22 pid: 9527 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746143683.203313:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4622 00000100:00100000:1.0:1746143683.203318:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592013056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143683.203324:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143683.203332:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130cbc400/0xe984082ccd723ea6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0777 expref: 22 pid: 9527 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.203341:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130cbc400/0xe984082ccd723ea6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0777 expref: 22 pid: 9527 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.203352:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cbc400/0xe984082ccd723ea6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0777 expref: 22 pid: 9527 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.203360:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.203361:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.203367:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.203374:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.203399:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143683.203408:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593645824:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143683.203454:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143683.204451:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.205471:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592013312 00000100:00100000:1.0:1746143683.205478:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592013312 00002000:00100000:1.0:1746143683.205512:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f1ef100 x1830963592013312/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.205521:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef100 with x1830963592013312 ext(2097152->3145727) 00002000:00010000:1.0:1746143683.205526:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ef100 00000100:00100000:1.0:1746143683.205554:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3210 00000100:00100000:1.0:1746143683.205560:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592013312:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143683.212285:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593645824:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143683.212302:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143683.212336:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592013056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9017us (9212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143683.212346:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4622 00000100:00100000:2.0:1746143683.213131:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.213189:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592013568 00000100:00100000:3.0:1746143683.213195:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592013568 00002000:00100000:3.0:1746143683.213225:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1388544->1392639) req@ffff8800a0360a80 x1830963592013568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.213233:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360a80 with x1830963592013568 ext(1388544->1392639) 00002000:00010000:3.0:1746143683.213237:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0360a80 00000100:00100000:3.0:1746143683.213250:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3211 00000100:00100000:3.0:1746143683.213256:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592013568:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143683.213436:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592013568:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 178us (305us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143683.213442:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3211 00002000:00100000:3.0:1746143683.213447:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1388544->1392639) req@ffff8800a0360a80 x1830963592013568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/4536 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.213453:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360a80 with x1830963592013568 ext(1388544->1392639) 00002000:00010000:3.0:1746143683.213456:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0360a80 00000100:00100000:1.0:1746143683.213966:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592013312:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 8404us (9517us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143683.213972:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3210 00002000:00100000:1.0:1746143683.213976:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f1ef100 x1830963592013312/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.213983:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef100 with x1830963592013312 ext(2097152->3145727) 00002000:00010000:1.0:1746143683.213986:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ef100 00000100:00100000:0.0:1746143683.217984:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.218337:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592013696 00000100:00100000:2.0:1746143683.218345:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592013696 00000100:00100000:2.0:1746143683.218394:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9056 00000100:00100000:2.0:1746143683.218401:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28080:x1830963592013696:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143683.218417:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.218431:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930c4000/0xe984082ccd7242c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09d8 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.218454:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.218466:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143683.218467:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143683.218470:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930c4000/0xe984082ccd7242c7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d8 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.218493:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.218502:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 9 pid: 21542 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.218512:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593645952:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143683.219324:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143683.222309:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.222463:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592013824 00000100:00100000:1.0:1746143683.222475:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592013824 00002000:00100000:1.0:1746143683.222511:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3293183) req@ffff88009bfe3480 x1830963592013824/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.222520:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3480 with x1830963592013824 ext(3145728->3293183) 00010000:00010000:1.0:1746143683.222529:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 10 pid: 21542 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.222541:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 10 pid: 21542 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746143683.222548:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe3480 00000100:00100000:1.0:1746143683.222658:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 766 00000100:00100000:1.0:1746143683.222666:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963592013824:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:2.0:1746143683.223161:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593645952:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143683.223182:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930c4000/0xe984082ccd7242c7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d8 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.223194:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930c4000, rc 0) 00000100:00100000:2.0:1746143683.223217:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28080:x1830963592013696:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4817us (5239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.223223:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9056 00000100:00100000:1.0:1746143683.226308:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592013824:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 3636us (3999us total) trans 17179872351 rc 0/0 00000100:00100000:1.0:1746143683.226318:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 766 00002000:00100000:1.0:1746143683.226326:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3293183) req@ffff88009bfe3480 x1830963592013824/t17179872351(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/448 e 0 to 0 dl 1746143694 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.226333:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3480 with x1830963592013824 ext(3145728->3293183) 00010000:00010000:1.0:1746143683.226341:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 12 pid: 21542 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.226353:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 12 pid: 21542 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746143683.226358:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe3480 00000100:00100000:0.0:1746143683.229004:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.229100:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592013952 00000100:00100000:1.0:1746143683.229106:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592013952 00010000:00010000:1.0:1746143683.229253:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 12 pid: 21542 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746143683.229288:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4623 00000100:00100000:1.0:1746143683.229295:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592013952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143683.229310:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143683.229327:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 12 pid: 21542 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.229337:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 12 pid: 21542 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.229356:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800957e1e00/0xe984082ccd72429d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09bc expref: 12 pid: 21542 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.230359:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.230362:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.230370:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930c4000/0xe984082ccd7242c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d8 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.230378:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930c4000/0xe984082ccd7242c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d8 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.230409:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800930c4000/0xe984082ccd7242c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d8 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143683.230420:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593646080:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143683.230504:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143683.232857:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593646080:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143683.232875:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143683.232906:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592013952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3612us (3908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143683.232916:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4623 00000100:00100000:0.0:1746143683.236051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.236160:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.236535:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592014336 00000100:00100000:1.0:1746143683.236543:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592014336 00002000:00100000:1.0:1746143683.236580:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009bfe3b80 x1830963592014336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.236589:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3b80 with x1830963592014336 ext(3145728->4194303) 00002000:00010000:1.0:1746143683.236594:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3b80 00000100:00100000:1.0:1746143683.236619:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592014464 00000100:00100000:1.0:1746143683.236621:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592014464 00000100:00100000:3.0:1746143683.236629:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3212 00002000:00100000:1.0:1746143683.236632:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009bfe2300 x1830963592014464/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.236638:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2300 with x1830963592014464 ext(3145728->4194303) 00002000:00010000:1.0:1746143683.236641:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe2300 00000100:00100000:3.0:1746143683.236642:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592014336:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143683.236651:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3213 00000100:00100000:1.0:1746143683.236655:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592014464:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143683.247735:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592014336:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 11090us (11684us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143683.247746:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3212 00002000:00100000:3.0:1746143683.247755:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009bfe3b80 x1830963592014336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.247764:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3b80 with x1830963592014336 ext(3145728->4194303) 00002000:00010000:3.0:1746143683.247769:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3b80 00000100:00100000:1.0:1746143683.251459:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592014464:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 14794us (15310us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143683.251471:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3213 00002000:00100000:1.0:1746143683.251480:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009bfe2300 x1830963592014464/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.251489:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2300 with x1830963592014464 ext(3145728->4194303) 00002000:00010000:1.0:1746143683.251494:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe2300 00000100:00100000:2.0:1746143683.265242:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.265269:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.265342:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592014976 00000100:00100000:1.0:1746143683.265351:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592014976 00002000:00100000:1.0:1746143683.265509:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a0361180 x1830963592014976/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.265518:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0361180 with x1830963592014976 ext(4194304->4898815) 00002000:00010000:1.0:1746143683.265522:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0361180 00000100:00100000:1.0:1746143683.265551:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3214 00000100:00100000:1.0:1746143683.265559:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592014976:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143683.266219:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592014720 00000100:00100000:3.0:1746143683.266227:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592014720 00000100:00100000:3.0:1746143683.266261:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8159 00000100:00100000:3.0:1746143683.266266:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+33:28091:x1830963592014720:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143683.266282:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.266302:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144200/0xe984082ccd7242ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09df expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.266392:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145200/0xe984082ccd7242d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266403:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145200/0xe984082ccd7242d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266416:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145200/0xe984082ccd7242d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266427:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd7242dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266432:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd7242dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266437:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd7242dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266522:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd7242e3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266530:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd7242e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266536:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd7242e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143683.266542:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143683.266604:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145200/0xe984082ccd7242d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266610:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145200/0xe984082ccd7242d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266615:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145200/0xe984082ccd7242d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266619:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b145200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.266622:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145200/0xe984082ccd7242d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266628:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145200/0xe984082ccd7242d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266637:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143683.266638:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.266641:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145200/0xe984082ccd7242d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266645:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145200/0xe984082ccd7242d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266657:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd7242dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266661:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd7242dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266665:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd7242dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266668:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b144c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.266670:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd7242dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266674:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd7242dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266679:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9d000) 00010000:00010000:3.0:1746143683.266680:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.266682:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd7242dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266685:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144c00/0xe984082ccd7242dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.266715:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144200/0xe984082ccd7242ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09df expref: 36 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.266724:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd7242e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09df expref: 35 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.266729:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143683.266730:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143683.266732:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b145a00, rc 0) 00000100:00100000:3.0:1746143683.266772:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+35:28091:x1830963592014720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 505us (1502us total) trans 8589942228 rc 0/0 00000100:00100000:3.0:1746143683.266778:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8159 00000100:00100000:0.0:1746143683.277676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.277715:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.277750:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592015104 00000100:00100000:2.0:1746143683.277759:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592015104 00000100:00100000:0.0:1746143683.277814:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.278297:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592015232 00000100:00100000:2.0:1746143683.278301:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592015232 00000100:00100000:2.0:1746143683.278316:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592015360 00000100:00100000:2.0:1746143683.278318:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592015360 00000100:00100000:2.0:1746143683.278508:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9057 00000100:00100000:2.0:1746143683.278516:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592015104:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143683.278520:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9058 00000100:00100000:1.0:1746143683.278526:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592015232:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143683.278531:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143683.278532:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.278546:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009135ba00/0xe984082ccd7242f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09e6 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.278546:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09c00/0xe984082ccd7242f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09ed expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.278564:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.278565:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.278573:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09c00/0xe984082ccd7242f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ed expref: 12 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143683.278585:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09c00/0xe984082ccd7242f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ed expref: 12 pid: 21542 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143683.278588:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593646208:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143683.278595:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f09c00, rc 0) 00000100:00100000:1.0:1746143683.278631:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592015232:12345-192.168.202.48@tcp:101:cat.0 Request processed in 104us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143683.278634:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9059 00000100:00100000:1.0:1746143683.278638:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9058 00000100:00100000:0.0:1746143683.278640:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592015360:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143683.278645:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143683.278652:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a962c00/0xe984082ccd7242ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09f4 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143683.278661:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143683.278662:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143683.278666:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a962c00/0xe984082ccd7242ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09f4 expref: 14 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143683.278676:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a962c00/0xe984082ccd7242ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09f4 expref: 14 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143683.278687:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a962c00, rc 0) 00000100:00100000:0.0:1746143683.278914:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592015360:12345-192.168.202.48@tcp:101:cat.0 Request processed in 273us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143683.278919:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9059 00000100:00100000:2.0:1746143683.279277:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143683.283272:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.283342:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592015488 00000100:00100000:1.0:1746143683.283350:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592015488 00000100:00100000:2.0:1746143683.284025:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592014976:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18465us (18788us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143683.284034:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3214 00002000:00100000:2.0:1746143683.284042:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a0361180 x1830963592014976/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.284050:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0361180 with x1830963592014976 ext(4194304->4898815) 00002000:00010000:2.0:1746143683.284054:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0361180 00000100:00100000:1.0:1746143683.284112:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 540 00000100:00100000:1.0:1746143683.284119:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1964:x1830963592015488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143683.284132:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143683.284168:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd7242e3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09df expref: 35 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.284183:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143683.284187:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143683.284206:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+34:1964:x1830963592015488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 88us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143683.284211:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 540 00002000:00010000:3.0:1746143683.284314:0:8497:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime: 1746143681 -> 1746143682 00002000:00010000:3.0:1746143683.284318:0:8497:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143681 -> 1746143683 00002000:00010000:3.0:1746143683.284320:0:8497:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime: 1746143681 -> 1746143682 00000100:00100000:3.0:1746143683.284335:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593646208:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143683.284358:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009135ba00/0xe984082ccd7242f8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09e6 expref: 13 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.284368:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009135ba00/0xe984082ccd7242f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09e6 expref: 13 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.284380:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009135ba00, rc 0) 00000100:00100000:3.0:1746143683.284399:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592015104:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5885us (6732us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143683.284405:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9057 00000100:00100000:0.0:1746143683.293737:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.293806:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592015616 00000100:00100000:3.0:1746143683.293813:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592015616 00000100:00100000:3.0:1746143683.293865:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9060 00000100:00100000:3.0:1746143683.293871:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28091:x1830963592015616:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143683.293888:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.293901:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd724306 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a09fb expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.293925:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.293931:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143683.293933:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143683.293936:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd724306 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09fb expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.293970:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.293980:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 20 pid: 8497 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746143683.293989:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593646336:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143683.294066:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143683.295842:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593646336:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143683.295863:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd724306 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09fb expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.295880:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b145000, rc 0) 00000100:00100000:3.0:1746143683.296355:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28091:x1830963592015616:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2482us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.296362:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9060 00000100:00100000:0.0:1746143683.299062:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.300222:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.300296:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592016000 00000100:00100000:2.0:1746143683.300308:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592016000 00002000:00100000:2.0:1746143683.300354:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1282048->1392639) req@ffff88009bfe0700 x1830963592016000/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.300362:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0700 with x1830963592016000 ext(1282048->1392639) 00010000:00010000:2.0:1746143683.300370:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 21 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.300386:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 21 pid: 8497 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746143683.300393:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe0700 00000100:00100000:2.0:1746143683.300429:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 767 00000100:00100000:2.0:1746143683.300437:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592016000:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143683.300650:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592015872 00000100:00100000:1.0:1746143683.300655:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592015872 00000100:00100000:1.0:1746143683.300681:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3289 00000100:00100000:1.0:1746143683.300687:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:28080:x1830963592015872:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143683.301102:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:28080:x1830963592015872:12345-192.168.202.48@tcp:35:cat.0 Request processed in 142us (1772us total) trans 8589942229 rc 0/0 00000100:00100000:1.0:1746143683.301110:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3289 00000100:00100000:2.0:1746143683.302991:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592016000:12345-192.168.202.48@tcp:4:cat.0 Request processed in 2550us (2766us total) trans 21474839616 rc 0/0 00000100:00100000:2.0:1746143683.302999:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 767 00002000:00100000:2.0:1746143683.303007:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1282048->1392639) req@ffff88009bfe0700 x1830963592016000/t21474839616(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/448 e 0 to 0 dl 1746143694 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.303016:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0700 with x1830963592016000 ext(1282048->1392639) 00010000:00010000:2.0:1746143683.303024:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.303036:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746143683.303043:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe0700 00000100:00100000:0.0:1746143683.304662:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.304841:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592016128 00000100:00100000:3.0:1746143683.304848:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592016128 00010000:00010000:3.0:1746143683.304873:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746143683.304907:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4624 00000100:00100000:3.0:1746143683.304913:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592016128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143683.304925:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143683.304950:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.304961:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.304979:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d7a00/0xe984082ccd7242c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1392639) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d1 expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.305006:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.305007:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.305014:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd724306 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09fb expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.305025:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd724306 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09fb expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.305050:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd724306 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09fb expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143683.305060:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593646464:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143683.305126:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143683.308805:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593646464:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143683.308823:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143683.308868:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592016128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3951us (4206us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.308878:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4624 00000100:00100000:0.0:1746143683.313084:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.313879:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592016384 00000100:00100000:2.0:1746143683.313888:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592016384 00002000:00100000:2.0:1746143683.314328:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88009bfe1c00 x1830963592016384/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.314338:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1c00 with x1830963592016384 ext(1048576->2097151) 00002000:00010000:2.0:1746143683.314343:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe1c00 00000100:00100000:2.0:1746143683.314370:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3215 00000100:00100000:2.0:1746143683.314376:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592016384:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143683.327277:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.327369:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592016640 00000100:00100000:2.0:1746143683.327377:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592016640 00000100:00100000:2.0:1746143683.327419:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8160 00000100:00100000:2.0:1746143683.327426:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+34:28094:x1830963592016640:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143683.327445:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.327458:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93e600/0xe984082ccd72430d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a02 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.327534:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fe00/0xe984082ccd724314 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.327548:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fe00/0xe984082ccd724314 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.327556:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fe00/0xe984082ccd724314 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.327566:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fc00/0xe984082ccd72431b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.327570:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fc00/0xe984082ccd72431b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.327574:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fc00/0xe984082ccd72431b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:3.0:1746143683.327599:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592016384:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13222us (14521us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143683.327607:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3215 00002000:00100000:3.0:1746143683.327614:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88009bfe1c00 x1830963592016384/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.327622:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1c00 with x1830963592016384 ext(1048576->2097151) 00002000:00010000:3.0:1746143683.327626:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe1c00 00010000:00010000:2.0:1746143683.327853:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724322 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.327865:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724322 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.327870:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724322 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143683.327877:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143683.327954:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fe00/0xe984082ccd724314 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.327961:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fe00/0xe984082ccd724314 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.327965:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fe00/0xe984082ccd724314 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.327970:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c93fe00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143683.327973:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fe00/0xe984082ccd724314 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.327978:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fe00/0xe984082ccd724314 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.327986:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143683.327989:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143683.327992:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fe00/0xe984082ccd724314 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.327996:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fe00/0xe984082ccd724314 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.328008:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fc00/0xe984082ccd72431b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.328015:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fc00/0xe984082ccd72431b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.328019:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fc00/0xe984082ccd72431b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.328023:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c93fc00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143683.328025:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fc00/0xe984082ccd72431b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.328029:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fc00/0xe984082ccd72431b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.328033:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5ab00) 00010000:00010000:2.0:1746143683.328034:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143683.328036:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fc00/0xe984082ccd72431b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.328040:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93fc00/0xe984082ccd72431b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143683.328067:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c93e600/0xe984082ccd72430d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a02 expref: 37 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.328076:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724322 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a02 expref: 36 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.328081:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143683.328083:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143683.328084:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5c200, rc 0) 00000100:00100000:2.0:1746143683.328568:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+36:28094:x1830963592016640:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1141us (1296us total) trans 8589942230 rc 0/0 00000100:00100000:2.0:1746143683.328574:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8160 00000100:00100000:0.0:1746143683.336667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.336736:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592016768 00000100:00100000:3.0:1746143683.336743:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592016768 00000100:00100000:3.0:1746143683.336801:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 541 00000100:00100000:3.0:1746143683.336809:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+36:1964:x1830963592016768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143683.336821:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143683.336842:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724322 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a02 expref: 36 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.336871:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143683.336875:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143683.336925:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1964:x1830963592016768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 117us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.336932:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 541 00000100:00100000:0.0:1746143683.362543:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.362582:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.362620:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.362699:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592017024 00000100:00100000:2.0:1746143683.362699:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592017280 00000100:00100000:3.0:1746143683.362707:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592017024 00000100:00100000:2.0:1746143683.362707:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592017280 00002000:00100000:3.0:1746143683.362743:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800949f3480 x1830963592017024/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.362743:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800949f0380 x1830963592017280/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.362751:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3480 with x1830963592017024 ext(2097152->3145727) 00002000:00100000:2.0:1746143683.362751:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0380 with x1830963592017280 ext(3145728->4194303) 00002000:00010000:3.0:1746143683.362755:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f3480 00002000:00010000:2.0:1746143683.362755:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f0380 00000100:00100000:3.0:1746143683.362769:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592017536 00000100:00100000:3.0:1746143683.362771:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592017536 00002000:00100000:3.0:1746143683.362781:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800949f2300 x1830963592017536/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143683.362786:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3216 00002000:00100000:3.0:1746143683.362787:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f2300 with x1830963592017536 ext(2097152->3145727) 00002000:00010000:3.0:1746143683.362790:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f2300 00000100:00100000:2.0:1746143683.362792:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592017024:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143683.362804:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3217 00000100:00100000:3.0:1746143683.362809:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592017280:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143683.362845:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3218 00000100:00100000:2.0:1746143683.366182:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592017536:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143683.375042:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.375111:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592017792 00000100:00100000:2.0:1746143683.375118:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592017792 00002000:00100000:2.0:1746143683.375179:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800949f1500 x1830963592017792/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.375188:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1500 with x1830963592017792 ext(3145728->4194303) 00002000:00010000:2.0:1746143683.375192:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1500 00000100:00100000:2.0:1746143683.375209:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3219 00000100:00100000:2.0:1746143683.375215:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592017792:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143683.381760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.382213:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592017280:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19401us (19628us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143683.382225:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3217 00002000:00100000:3.0:1746143683.382235:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800949f0380 x1830963592017280/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.382243:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0380 with x1830963592017280 ext(3145728->4194303) 00002000:00010000:3.0:1746143683.382248:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f0380 00000100:00100000:3.0:1746143683.382281:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592018048 00000100:00100000:3.0:1746143683.382288:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592018048 00000100:00100000:3.0:1746143683.382314:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8161 00000100:00100000:3.0:1746143683.382319:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:28096:x1830963592018048:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143683.382334:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.382348:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9600/0xe984082ccd724330 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a09 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.382425:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd724337 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382436:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd724337 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382444:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd724337 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382454:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8a00/0xe984082ccd72433e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382460:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8a00/0xe984082ccd72433e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382465:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8a00/0xe984082ccd72433e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382546:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724345 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382554:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724345 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382560:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724345 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143683.382566:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143683.382627:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd724337 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382633:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd724337 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382638:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd724337 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382643:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01a8c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.382652:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd724337 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382658:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd724337 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382667:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143683.382669:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.382672:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd724337 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382677:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd724337 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382694:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8a00/0xe984082ccd72433e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382698:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8a00/0xe984082ccd72433e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382703:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8a00/0xe984082ccd72433e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382706:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01a8a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.382708:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8a00/0xe984082ccd72433e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382713:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8a00/0xe984082ccd72433e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382717:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9d000) 00010000:00010000:3.0:1746143683.382719:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.382721:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8a00/0xe984082ccd72433e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382725:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8a00/0xe984082ccd72433e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143683.382772:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9600/0xe984082ccd724330 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a09 expref: 269 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.382781:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724345 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a09 expref: 268 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.382787:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143683.382789:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143683.382791:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a8800, rc 0) 00000100:00100000:3.0:1746143683.382809:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:28096:x1830963592018048:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 490us (1056us total) trans 8589942231 rc 0/0 00000100:00100000:3.0:1746143683.382814:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8161 00000100:00100000:3.0:1746143683.391057:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592017024:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28255us (28511us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143683.391071:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3216 00002000:00100000:3.0:1746143683.391081:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800949f3480 x1830963592017024/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.391090:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3480 with x1830963592017024 ext(2097152->3145727) 00002000:00010000:3.0:1746143683.391095:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f3480 00000100:00100000:2.0:1746143683.393340:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592017536:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30484us (30713us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143683.393349:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3218 00002000:00100000:2.0:1746143683.393357:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800949f2300 x1830963592017536/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.393364:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f2300 with x1830963592017536 ext(2097152->3145727) 00002000:00010000:2.0:1746143683.393368:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f2300 00000100:00100000:0.0:1746143683.397421:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.397597:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.397851:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592018176 00000100:00100000:1.0:1746143683.397859:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592018176 00000100:00100000:1.0:1746143683.397918:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 542 00000100:00100000:1.0:1746143683.397926:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:1962:x1830963592018176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143683.397955:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143683.397980:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724345 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a09 expref: 268 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.398005:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143683.398008:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143683.398046:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:1962:x1830963592018176:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 120us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143683.398052:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 542 00000100:00100000:1.0:1746143683.398072:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592018432 00000100:00100000:1.0:1746143683.398075:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592018432 00000100:00100000:1.0:1746143683.398091:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3290 00000100:00100000:1.0:1746143683.398096:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:28096:x1830963592018432:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143683.398268:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:28096:x1830963592018432:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 171us (671us total) trans 8589942232 rc 0/0 00000100:00100000:1.0:1746143683.398273:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3290 00000100:00100000:2.0:1746143683.401179:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592017792:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25952us (26133us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143683.401189:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3219 00002000:00100000:2.0:1746143683.401201:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800949f1500 x1830963592017792/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.401210:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1500 with x1830963592017792 ext(3145728->4194303) 00002000:00010000:2.0:1746143683.401215:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1500 00000100:00100000:0.0:1746143683.415084:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.415165:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592018688 00000100:00100000:2.0:1746143683.415173:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592018688 00002000:00100000:2.0:1746143683.415210:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800949f0700 x1830963592018688/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.415219:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0700 with x1830963592018688 ext(4194304->4898815) 00002000:00010000:2.0:1746143683.415223:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f0700 00000100:00100000:2.0:1746143683.415239:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3220 00000100:00100000:2.0:1746143683.415245:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592018688:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143683.425530:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592018688:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10274us (10441us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143683.425541:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3220 00002000:00100000:2.0:1746143683.425554:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800949f0700 x1830963592018688/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.425562:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0700 with x1830963592018688 ext(4194304->4898815) 00002000:00010000:2.0:1746143683.425569:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f0700 00000100:00100000:0.0:1746143683.426757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.426877:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592018944 00000100:00100000:3.0:1746143683.426886:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592018944 00000100:00100000:3.0:1746143683.426933:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8162 00000100:00100000:3.0:1746143683.426952:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:28099:x1830963592018944:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143683.426972:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.426987:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8a00/0xe984082ccd724353 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a10 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.427073:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd72435a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427084:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd72435a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427094:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd72435a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427108:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9000/0xe984082ccd724361 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427112:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9000/0xe984082ccd724361 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427117:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9000/0xe984082ccd724361 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427229:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724368 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427237:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724368 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427243:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724368 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143683.427250:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143683.427313:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd72435a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427319:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd72435a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427323:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd72435a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427329:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01a8c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.427332:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd72435a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427337:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd72435a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427347:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143683.427350:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.427353:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd72435a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427357:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8c00/0xe984082ccd72435a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427384:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9000/0xe984082ccd724361 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427389:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9000/0xe984082ccd724361 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427392:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9000/0xe984082ccd724361 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427396:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01a9000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.427398:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9000/0xe984082ccd724361 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427403:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9000/0xe984082ccd724361 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427409:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9d000) 00010000:00010000:3.0:1746143683.427411:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.427413:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9000/0xe984082ccd724361 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427417:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9000/0xe984082ccd724361 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.427446:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8a00/0xe984082ccd724353 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a10 expref: 271 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.427456:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724368 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a10 expref: 270 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.427462:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143683.427464:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143683.427466:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a8e00, rc 0) 00000100:00100000:3.0:1746143683.429389:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+270:28099:x1830963592018944:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2443us (2632us total) trans 8589942233 rc 0/0 00000100:00100000:3.0:1746143683.429397:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8162 00000100:00100000:0.0:1746143683.440800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.441522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.441589:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.441789:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592019328 00000100:00100000:3.0:1746143683.441799:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592019328 00000100:00100000:3.0:1746143683.441854:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 543 00000100:00100000:3.0:1746143683.441864:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+270:1965:x1830963592019328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143683.441879:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143683.441905:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724368 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a10 expref: 270 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.441926:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143683.441930:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143683.441992:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+269:1965:x1830963592019328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 128us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.442000:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 543 00000100:00100000:2.0:1746143683.442180:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592019456 00000100:00100000:2.0:1746143683.442184:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592019456 00000100:00100000:2.0:1746143683.442207:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9061 00000100:00100000:2.0:1746143683.442212:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592019456:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143683.442225:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.442237:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724376 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a17 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.442251:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.442253:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.442259:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a17 expref: 23 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143683.442271:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a17 expref: 23 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143683.442280:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5c200, rc 0) 00000100:00100000:2.0:1746143683.442301:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592019456:12345-192.168.202.48@tcp:101:cat.0 Request processed in 89us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.442306:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9061 00000100:00100000:1.0:1746143683.442494:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592019200 00000100:00100000:1.0:1746143683.442498:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592019200 00000100:00100000:1.0:1746143683.442520:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3291 00000100:00100000:1.0:1746143683.442525:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+35:28091:x1830963592019200:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143683.442673:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+36:28091:x1830963592019200:12345-192.168.202.48@tcp:35:cat.0 Request processed in 147us (1881us total) trans 8589942234 rc 0/0 00000100:00100000:1.0:1746143683.442679:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3291 00000100:00100000:2.0:1746143683.450035:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.450123:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592019712 00000100:00100000:0.0:1746143683.450132:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592019712 00002000:00100000:0.0:1746143683.450207:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a0363480 x1830963592019712/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143683.450216:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0363480 with x1830963592019712 ext(1048576->2097151) 00002000:00010000:0.0:1746143683.450221:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0363480 00000100:00100000:0.0:1746143683.450265:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3221 00000100:00100000:0.0:1746143683.450274:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592019712:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143683.466411:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.466637:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592019840 00000100:00100000:3.0:1746143683.466645:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592019840 00000100:00100000:3.0:1746143683.466693:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9062 00000100:00100000:3.0:1746143683.466700:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28094:x1830963592019840:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143683.466716:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.466731:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a1e expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.466754:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930c4000/0xe984082ccd7242c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d8 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.466761:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09c00/0xe984082ccd7242f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ed expref: 13 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.466767:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.466768:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.466772:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.466793:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09c00/0xe984082ccd7242f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ed expref: 13 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.466802:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09c00/0xe984082ccd7242f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ed expref: 13 pid: 21542 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746143683.466812:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593646592:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143683.466893:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930c4000/0xe984082ccd7242c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d8 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.466901:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930c4000/0xe984082ccd7242c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d8 expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746143683.466912:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593646720:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143683.466928:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143683.473282:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592019712:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23002us (23247us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143683.473293:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3221 00000100:00100000:3.0:1746143683.473304:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593646592:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143683.473313:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593646720:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143683.473336:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.473351:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b144200, rc 0) 00000100:00100000:3.0:1746143683.473370:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28094:x1830963592019840:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6671us (6967us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.473376:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9062 00002000:00100000:1.0:1746143683.474796:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a0363480 x1830963592019712/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.474810:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0363480 with x1830963592019712 ext(1048576->2097151) 00002000:00010000:1.0:1746143683.474816:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0363480 00000100:00100000:0.0:1746143683.481048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.481566:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.481652:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592019968 00000100:00100000:3.0:1746143683.481661:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592019968 00010000:00010000:3.0:1746143683.481693:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09c00/0xe984082ccd7242f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ed expref: 13 pid: 21542 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746143683.481716:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592020096 00000100:00100000:3.0:1746143683.481718:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592020096 00010000:00010000:3.0:1746143683.481727:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930c4000/0xe984082ccd7242c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d8 expref: 24 pid: 8497 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746143683.481743:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4625 00000100:00100000:3.0:1746143683.481749:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592019968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143683.481761:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143683.481780:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09c00/0xe984082ccd7242f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ed expref: 13 pid: 21542 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746143683.481791:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09c00/0xe984082ccd7242f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ed expref: 13 pid: 21542 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746143683.481810:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09c00/0xe984082ccd7242f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ed expref: 13 pid: 21542 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746143683.481846:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143683.481884:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592019968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 134us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.481890:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4625 00000100:00100000:3.0:1746143683.481904:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4626 00000100:00100000:3.0:1746143683.481909:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592020096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143683.481915:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143683.481923:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930c4000/0xe984082ccd7242c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d8 expref: 24 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.481932:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930c4000/0xe984082ccd7242c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d8 expref: 24 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.481954:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930c4000/0xe984082ccd7242c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09d8 expref: 24 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.481964:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.481966:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.481973:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 11 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.481981:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 11 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.482009:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 11 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143683.482020:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593646848:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143683.482077:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143683.483695:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593646848:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143683.483710:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143683.483738:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592020096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1828us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.483747:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4626 00000100:00100000:0.0:1746143683.485700:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.485747:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592020352 00000100:00100000:1.0:1746143683.485753:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592020352 00002000:00100000:1.0:1746143683.485793:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3010560->3014655) req@ffff88009cdc1180 x1830963592020352/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.485802:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1180 with x1830963592020352 ext(3010560->3014655) 00002000:00010000:1.0:1746143683.485807:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc1180 00000100:00100000:1.0:1746143683.486176:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3222 00000100:00100000:1.0:1746143683.486184:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592020352:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143683.486389:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592020352:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 204us (693us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143683.486395:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3222 00002000:00100000:1.0:1746143683.486400:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3010560->3014655) req@ffff88009cdc1180 x1830963592020352/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/4536 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.486406:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1180 with x1830963592020352 ext(3010560->3014655) 00002000:00010000:1.0:1746143683.486408:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc1180 00000100:00100000:0.0:1746143683.490846:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.491037:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592020480 00000100:00100000:3.0:1746143683.491045:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592020480 00000100:00100000:3.0:1746143683.491099:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9063 00000100:00100000:3.0:1746143683.491105:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28094:x1830963592020480:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143683.491121:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.491170:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a25 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.491194:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d53a800/0xe984082ccd7242a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09c3 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.491205:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a962c00/0xe984082ccd7242ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09f4 expref: 14 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.491211:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.491213:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.491216:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2703359] (req 2097152->2703359) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 14 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.491240:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a962c00/0xe984082ccd7242ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09f4 expref: 14 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.491250:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a962c00/0xe984082ccd7242ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09f4 expref: 14 pid: 4581 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746143683.491260:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593646976:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143683.491345:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d53a800/0xe984082ccd7242a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09c3 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.491353:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d53a800/0xe984082ccd7242a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09c3 expref: 22 pid: 8497 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746143683.491361:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593647104:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143683.491377:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143683.492897:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593646976:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143683.492908:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593647104:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143683.492925:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2703359] (req 2097152->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 14 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.492936:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b145a00, rc 0) 00000100:00100000:3.0:1746143683.494698:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28094:x1830963592020480:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3587us (3854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.494706:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9063 00000100:00100000:0.0:1746143683.495865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.495958:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592020608 00000100:00100000:2.0:1746143683.495965:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592020608 00000100:00100000:2.0:1746143683.495994:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9064 00000100:00100000:2.0:1746143683.495999:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28099:x1830963592020608:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143683.496014:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.496029:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a2c expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.496051:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 11 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.496057:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143683.496059:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143683.496061:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.496084:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 11 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.496093:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 11 pid: 6929 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.496102:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593647232:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143683.496167:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143683.498522:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.499232:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592020736 00000100:00100000:3.0:1746143683.499242:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592020736 00010000:00010000:3.0:1746143683.499274:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d53a800/0xe984082ccd7242a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09c3 expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746143683.499729:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4627 00000100:00100000:3.0:1746143683.499739:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592020736:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143683.499755:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143683.499781:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d53a800/0xe984082ccd7242a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09c3 expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.499792:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d53a800/0xe984082ccd7242a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09c3 expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.499813:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d53a800/0xe984082ccd7242a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09c3 expref: 23 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.499857:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143683.499907:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592020736:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 168us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.499914:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4627 00000100:00100000:2.0:1746143683.500756:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593647232:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143683.500777:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.500787:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5ce00, rc 0) 00000100:00100000:2.0:1746143683.500809:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28099:x1830963592020608:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4810us (4947us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.500815:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9064 00000100:00100000:0.0:1746143683.500882:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.500981:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.501313:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592020864 00000100:00100000:2.0:1746143683.501320:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592020864 00010000:00010000:2.0:1746143683.501342:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a962c00/0xe984082ccd7242ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09f4 expref: 14 pid: 4581 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746143683.501366:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4628 00000100:00100000:2.0:1746143683.501374:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592020864:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143683.501385:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143683.501401:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a962c00/0xe984082ccd7242ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09f4 expref: 14 pid: 4581 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746143683.501410:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a962c00/0xe984082ccd7242ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09f4 expref: 14 pid: 4581 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746143683.501425:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a962c00/0xe984082ccd7242ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09f4 expref: 14 pid: 4581 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746143683.501466:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.501469:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.501476:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.501485:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.501515:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143683.501532:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593647360:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143683.501603:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c829c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143683.501622:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592020992 00000100:00100000:2.0:1746143683.501626:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592020992 00002000:00100000:2.0:1746143683.501657:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3010560->3145727) req@ffff88009cdc0700 x1830963592020992/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.501666:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0700 with x1830963592020992 ext(3010560->3145727) 00010000:00010000:2.0:1746143683.501671:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 12 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.501682:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 12 pid: 6929 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746143683.501687:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cdc0700 00000100:00100000:2.0:1746143683.501704:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 768 00000100:00100000:2.0:1746143683.501712:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592020992:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:2.0:1746143683.505171:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592020992:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 3455us (4186us total) trans 17179872352 rc 0/0 00000100:00100000:2.0:1746143683.505181:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 768 00002000:00100000:2.0:1746143683.505190:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3010560->3145727) req@ffff88009cdc0700 x1830963592020992/t17179872352(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/448 e 0 to 0 dl 1746143694 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.505198:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0700 with x1830963592020992 ext(3010560->3145727) 00010000:00010000:2.0:1746143683.505206:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 14 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.505219:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 14 pid: 6929 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746143683.505226:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cdc0700 00000100:00100000:2.0:1746143683.506535:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593647360:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143683.506552:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143683.506578:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592020864:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5205us (5696us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.506586:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4628 00000100:00100000:0.0:1746143683.509673:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.509767:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592021120 00000100:00100000:2.0:1746143683.509774:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592021120 00010000:00010000:2.0:1746143683.509803:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 14 pid: 6929 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.511994:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4629 00000100:00100000:2.0:1746143683.512007:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592021120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143683.512020:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143683.512038:0:7151:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143682 -> 1746143683 00002000:00010000:2.0:1746143683.512041:0:7151:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143682 -> 1746143683 00010000:00010000:2.0:1746143683.512046:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 14 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.512058:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 14 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.512080:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b144200/0xe984082ccd72437d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a1e expref: 14 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.512092:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.512094:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.512099:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.512106:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.512137:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143683.512166:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593647488:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143683.512242:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143683.513205:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.513727:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592021376 00000100:00100000:3.0:1746143683.513735:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592021376 00002000:00100000:3.0:1746143683.513766:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2699264->2703359) req@ffff88009cdc2300 x1830963592021376/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.513775:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2300 with x1830963592021376 ext(2699264->2703359) 00002000:00010000:3.0:1746143683.513778:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc2300 00000100:00100000:3.0:1746143683.513796:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3223 00000100:00100000:3.0:1746143683.513802:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592021376:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143683.513926:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592021376:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 124us (724us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143683.513932:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3223 00002000:00100000:3.0:1746143683.513947:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2699264->2703359) req@ffff88009cdc2300 x1830963592021376/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/4536 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.513952:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2300 with x1830963592021376 ext(2699264->2703359) 00002000:00010000:3.0:1746143683.513955:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc2300 00000100:00100000:2.0:1746143683.514989:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593647488:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143683.515004:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143683.515036:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592021120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3034us (5369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.515043:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4629 00000100:00100000:0.0:1746143683.518017:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.518135:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.518326:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592021632 00000100:00100000:1.0:1746143683.518333:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592021632 00000100:00100000:1.0:1746143683.518370:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3292 00000100:00100000:1.0:1746143683.518376:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+36:28094:x1830963592021632:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143683.518660:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+37:28094:x1830963592021632:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 279us (693us total) trans 8589942235 rc 0/0 00000100:00100000:1.0:1746143683.518670:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3292 00000100:00100000:2.0:1746143683.518824:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592021888 00000100:00100000:2.0:1746143683.518830:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592021888 00002000:00100000:2.0:1746143683.518861:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009cdc3800 x1830963592021888/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.518875:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3800 with x1830963592021888 ext(2097152->3145727) 00002000:00010000:2.0:1746143683.518881:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3800 00000100:00100000:2.0:1746143683.518900:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3224 00000100:00100000:2.0:1746143683.518906:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592021888:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143683.530267:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592021888:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11348us (12118us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143683.530279:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3224 00002000:00100000:2.0:1746143683.530292:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009cdc3800 x1830963592021888/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.530301:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3800 with x1830963592021888 ext(2097152->3145727) 00002000:00010000:2.0:1746143683.530307:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3800 00000100:00100000:0.0:1746143683.535881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.536566:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592022016 00000100:00100000:2.0:1746143683.536576:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592022016 00000100:00100000:2.0:1746143683.537445:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9065 00000100:00100000:2.0:1746143683.537458:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28099:x1830963592022016:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143683.537476:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.537494:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c93fc00/0xe984082ccd724392 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a33 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.537524:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 12 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.537531:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143683.537533:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143683.537538:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c93fc00/0xe984082ccd724392 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a33 expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.537568:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 12 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.537579:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 12 pid: 6929 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.537591:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593647616:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143683.538088:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143683.541243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.541873:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593647616:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143683.541903:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c93fc00/0xe984082ccd724392 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a33 expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.541921:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c93fc00, rc 0) 00000100:00100000:3.0:1746143683.542201:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592022144 00000100:00100000:3.0:1746143683.542210:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592022144 00002000:00100000:3.0:1746143683.542249:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2703359) req@ffff88009cdc2a00 x1830963592022144/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.542258:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2a00 with x1830963592022144 ext(2097152->2703359) 00010000:00010000:3.0:1746143683.542265:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 13 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.542282:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 13 pid: 6929 timeout: 862 lvb_type: 0 00002000:00010000:3.0:1746143683.542289:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc2a00 00000100:00100000:3.0:1746143683.542312:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 769 00000100:00100000:3.0:1746143683.542321:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592022144:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:2.0:1746143683.544215:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28099:x1830963592022016:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6755us (8338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.544221:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9065 00000100:00100000:3.0:1746143683.558181:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592022144:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 15851us (16933us total) trans 21474839617 rc 0/0 00000100:00100000:3.0:1746143683.558192:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 769 00002000:00100000:3.0:1746143683.558202:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2703359) req@ffff88009cdc2a00 x1830963592022144/t21474839617(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/448 e 0 to 0 dl 1746143694 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.558210:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2a00 with x1830963592022144 ext(2097152->2703359) 00010000:00010000:3.0:1746143683.558219:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 15 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.558233:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 15 pid: 6929 timeout: 862 lvb_type: 0 00002000:00010000:3.0:1746143683.558240:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc2a00 00000100:00100000:0.0:1746143683.561853:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.562014:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592022272 00000100:00100000:2.0:1746143683.562025:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592022272 00010000:00010000:2.0:1746143683.562063:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 15 pid: 6929 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.562113:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4630 00000100:00100000:2.0:1746143683.562122:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1962:x1830963592022272:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143683.562161:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143683.562180:0:7151:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143682 -> 1746143683 00002000:00010000:2.0:1746143683.562184:0:7151:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143682 -> 1746143683 00010000:00010000:2.0:1746143683.562190:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 15 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.562202:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 15 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.562221:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b145a00/0xe984082ccd724384 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2703359) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a25 expref: 15 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.562713:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.562716:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.562725:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c93fc00/0xe984082ccd724392 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a33 expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.562733:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c93fc00/0xe984082ccd724392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a33 expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.562767:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c93fc00/0xe984082ccd724392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a33 expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143683.562780:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593647744:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143683.562890:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f000 going to sleep for 11 seconds 00010000:00010000:2.0:1746143683.565327:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143683.572286:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593647744:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143683.572304:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143683.572350:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592022272:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10229us (10506us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.572359:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4630 00000100:00100000:0.0:1746143683.576214:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.576252:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.576907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.576932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.576988:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592022656 00000100:00100000:2.0:1746143683.576996:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592022656 00000100:00100000:2.0:1746143683.577007:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592022528 00000100:00100000:2.0:1746143683.577009:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592022528 00002000:00100000:2.0:1746143683.577042:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009cdc3b80 x1830963592022528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.577051:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3b80 with x1830963592022528 ext(2097152->3145727) 00002000:00010000:2.0:1746143683.577055:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc3b80 00000100:00100000:2.0:1746143683.577068:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592023168 00000100:00100000:2.0:1746143683.577070:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592023168 00002000:00100000:2.0:1746143683.577078:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009cdc3480 x1830963592023168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.577083:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3480 with x1830963592023168 ext(3145728->4194303) 00002000:00010000:2.0:1746143683.577085:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3480 00000100:00100000:2.0:1746143683.577091:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592022912 00000100:00100000:2.0:1746143683.577092:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592022912 00002000:00100000:2.0:1746143683.577097:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009cdc0380 x1830963592022912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.577102:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0380 with x1830963592022912 ext(3145728->4194303) 00002000:00010000:2.0:1746143683.577104:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc0380 00000100:00100000:2.0:1746143683.577127:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3225 00000100:00100000:2.0:1746143683.577134:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592022528:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143683.578187:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9066 00000100:00100000:2.0:1746143683.578193:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28096:x1830963592022656:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143683.578203:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.578217:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a3a expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.578237:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.578244:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.578246:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.578248:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3354624->4194303] (req 3354624->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.578274:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.578285:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 26 pid: 6929 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.578295:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593647872:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143683.578349:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143683.578415:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 770 00000100:00100000:1.0:1746143683.578422:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592023168:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143683.579012:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3227 00000100:00100000:3.0:1746143683.579019:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592022912:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143683.594166:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592022528:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17005us (17933us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143683.594175:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3225 00002000:00100000:2.0:1746143683.594184:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009cdc3b80 x1830963592022528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.594193:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3b80 with x1830963592022528 ext(2097152->3145727) 00002000:00010000:2.0:1746143683.594198:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc3b80 00000100:00100000:1.0:1746143683.602290:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592023168:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 23860us (25375us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143683.602301:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 770 00002000:00100000:1.0:1746143683.602312:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009cdc3480 x1830963592023168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.602322:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3480 with x1830963592023168 ext(3145728->4194303) 00010000:00010000:1.0:1746143683.602331:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 26 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.602344:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 26 pid: 6929 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746143683.602351:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cdc3480 00000100:00100000:2.0:1746143683.602458:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593647872:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143683.602479:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3354624->4194303] (req 3354624->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.602491:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c904400, rc 0) 00000100:00100000:2.0:1746143683.602511:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28096:x1830963592022656:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 24318us (26257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.602517:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9066 00000100:00100000:0.0:1746143683.603577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.603639:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592023296 00000100:00100000:2.0:1746143683.603645:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592023296 00000100:00100000:3.0:1746143683.604061:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592022912:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 25041us (27127us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143683.604071:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3227 00002000:00100000:3.0:1746143683.604077:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009cdc0380 x1830963592022912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.604085:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0380 with x1830963592022912 ext(3145728->4194303) 00002000:00010000:3.0:1746143683.604089:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc0380 00000100:00100000:2.0:1746143683.604137:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9067 00000100:00100000:2.0:1746143683.604159:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28099:x1830963592023296:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143683.604170:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.604182:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800950abe00/0xe984082ccd7243a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a41 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.604198:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.604202:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3354624->4194303] (req 3354624->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.604208:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143683.604211:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800950abe00/0xe984082ccd7243a0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a41 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.604240:0:8497:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3354624->4194303] (req 3354624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.604249:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800950abe00/0xe984082ccd7243a0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a41 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.604256:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950abe00, rc 0) 00000100:00100000:2.0:1746143683.604272:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28099:x1830963592023296:12345-192.168.202.48@tcp:101:cat.0 Request processed in 116us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.604277:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9067 00000100:00100000:0.0:1746143683.606464:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.606616:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592023424 00000100:00100000:2.0:1746143683.606622:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592023424 00010000:00010000:2.0:1746143683.606650:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 26 pid: 6929 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.606683:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4631 00000100:00100000:2.0:1746143683.606689:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592023424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143683.606699:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143683.606716:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 26 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.606726:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 26 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.606743:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd72438b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a2c expref: 26 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.606771:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.606772:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.606778:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.606784:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.606810:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.606820:0:7151:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 25 pid: 8497 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.606830:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593648128:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143683.606897:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143683.608249:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.608328:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.608353:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593648128:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143683.608367:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143683.608378:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592023680 00000100:00100000:3.0:1746143683.608382:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592023680 00000100:00100000:2.0:1746143683.608390:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592023424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1702us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.608397:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4631 00000100:00100000:3.0:1746143683.608418:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8163 00000100:00100000:3.0:1746143683.608424:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+37:28105:x1830963592023680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143683.608442:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.608454:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd7243a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a48 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.608545:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4800/0xe984082ccd7243ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608555:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4800/0xe984082ccd7243ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608564:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4800/0xe984082ccd7243ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608573:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5600/0xe984082ccd7243b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608579:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5600/0xe984082ccd7243b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608584:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5600/0xe984082ccd7243b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608685:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd7243bc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608693:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd7243bc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608699:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd7243bc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143683.608706:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143683.608778:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4800/0xe984082ccd7243ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608784:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4800/0xe984082ccd7243ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608789:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4800/0xe984082ccd7243ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608794:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57f4800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.608797:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4800/0xe984082ccd7243ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608804:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4800/0xe984082ccd7243ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608812:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143683.608815:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.608818:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4800/0xe984082ccd7243ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608822:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4800/0xe984082ccd7243ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608840:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5600/0xe984082ccd7243b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608844:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5600/0xe984082ccd7243b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608848:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5600/0xe984082ccd7243b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608852:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57f5600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.608854:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5600/0xe984082ccd7243b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608858:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5600/0xe984082ccd7243b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608863:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9d000) 00010000:00010000:3.0:1746143683.608864:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.608867:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5600/0xe984082ccd7243b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608871:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5600/0xe984082ccd7243b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.608898:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd7243a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a48 expref: 40 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.608907:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd7243bc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a48 expref: 39 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.608913:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143683.608915:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143683.608917:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f5800, rc 0) 00000100:00100000:3.0:1746143683.608956:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+39:28105:x1830963592023680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 532us (735us total) trans 8589942236 rc 0/0 00000100:00100000:3.0:1746143683.608962:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8163 00000100:00100000:3.0:1746143683.608978:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592023936 00000100:00100000:3.0:1746143683.608981:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592023936 00002000:00100000:3.0:1746143683.609001:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3354624->3358719) req@ffff8800a5d81c00 x1830963592023936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.609009:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81c00 with x1830963592023936 ext(3354624->3358719) 00010000:00010000:3.0:1746143683.609077:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 25 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.609087:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 25 pid: 8497 timeout: 862 lvb_type: 0 00002000:00010000:3.0:1746143683.609093:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d81c00 00000100:00100000:0.0:1746143683.610222:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.610230:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 771 00000100:00100000:3.0:1746143683.610237:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592023936:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143683.610338:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592024064 00000100:00100000:2.0:1746143683.610342:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592024064 00000100:00100000:2.0:1746143683.610419:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 544 00000100:00100000:2.0:1746143683.610425:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+39:1963:x1830963592024064:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143683.610435:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143683.610450:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd7243bc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a48 expref: 39 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.610461:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143683.610464:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143683.610601:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+38:1963:x1830963592024064:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 176us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.610607:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 544 00000100:00100000:3.0:1746143683.610668:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592023936:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 431us (2339us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143683.610674:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 771 00002000:00100000:3.0:1746143683.610679:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3354624->3358719) req@ffff8800a5d81c00 x1830963592023936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/4536 e 0 to 0 dl 1746143694 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.610686:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81c00 with x1830963592023936 ext(3354624->3358719) 00010000:00010000:3.0:1746143683.610692:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 25 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.610702:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 25 pid: 8497 timeout: 862 lvb_type: 0 00002000:00010000:3.0:1746143683.610707:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d81c00 00000100:00100000:0.0:1746143683.614969:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.615016:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.615093:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592024192 00000100:00100000:2.0:1746143683.615100:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592024192 00000100:00100000:2.0:1746143683.615161:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592024320 00000100:00100000:2.0:1746143683.615164:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592024320 00000100:00100000:2.0:1746143683.615180:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9068 00000100:00100000:2.0:1746143683.615187:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592024192:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143683.615203:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.615218:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c93fe00/0xe984082ccd7243ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a4f expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143683.615268:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593648256:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143683.615272:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9069 00000100:00100000:3.0:1746143683.615280:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592024320:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143683.615289:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.615298:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5400/0xe984082ccd7243d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a56 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.615310:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.615312:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.615318:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5400/0xe984082ccd7243d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a56 expref: 15 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.615329:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5400/0xe984082ccd7243d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a56 expref: 15 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.615337:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f5400, rc 0) 00000100:00100000:2.0:1746143683.615341:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143683.615359:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592024320:12345-192.168.202.48@tcp:101:cat.0 Request processed in 80us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.615364:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9069 00000100:00100000:0.0:1746143683.619445:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.619513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.619554:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592024576 00000100:00100000:3.0:1746143683.619562:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592024576 00000100:00100000:1.0:1746143683.619571:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592024704 00000100:00100000:1.0:1746143683.619575:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592024704 00002000:00100000:3.0:1746143683.619607:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3354624->4194303) req@ffff8800a5d82d80 x1830963592024576/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143683.619610:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9070 00002000:00100000:3.0:1746143683.619616:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830963592024576 ext(3354624->4194303) 00000100:00100000:1.0:1746143683.619616:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28096:x1830963592024704:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143683.619625:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 25 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746143683.619630:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.619636:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 25 pid: 8497 timeout: 862 lvb_type: 0 00002000:00010000:3.0:1746143683.619642:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d82d80 00010000:00010000:1.0:1746143683.619642:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a5d expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143683.619661:0:6929:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime: 1746143682 -> 1746143683 00000100:00100000:3.0:1746143683.619662:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 772 00000100:00100000:3.0:1746143683.619667:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592024576:12345-192.168.202.48@tcp:4:multiop.0 00010000:00010000:1.0:1746143683.619667:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c93fc00/0xe984082ccd724392 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a33 expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.619674:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5400/0xe984082ccd7243d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a56 expref: 14 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143683.619677:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593648256:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143683.619679:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.619680:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.619683:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->3215359] (req 3145728->3215359) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.619699:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c93fe00/0xe984082ccd7243ca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a4f expref: 14 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143683.619704:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5400/0xe984082ccd7243d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a56 expref: 14 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143683.619712:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c93fe00/0xe984082ccd7243ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a4f expref: 14 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143683.619712:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5400/0xe984082ccd7243d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a56 expref: 14 pid: 4582 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746143683.619720:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c93fe00, rc 0) 00000100:00100000:1.0:1746143683.619722:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593648384:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143683.619752:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592024192:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4566us (4790us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143683.619758:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9068 00010000:00010000:1.0:1746143683.619773:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c93fc00/0xe984082ccd724392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a33 expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.619780:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c93fc00/0xe984082ccd724392 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a33 expref: 24 pid: 6929 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746143683.619788:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593648512:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143683.619805:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143683.626738:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.626738:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593648384:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143683.626748:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593648512:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143683.626775:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->3215359] (req 3145728->3215359) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.626789:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a087b000, rc 0) 00000100:00100000:3.0:1746143683.626824:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592024832 00000100:00100000:1.0:1746143683.626824:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28096:x1830963592024704:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7207us (7310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.626830:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592024832 00000100:00100000:1.0:1746143683.626831:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9070 00010000:00010000:3.0:1746143683.626854:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5400/0xe984082ccd7243d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a56 expref: 15 pid: 4582 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746143683.626881:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4632 00000100:00100000:3.0:1746143683.626888:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592024832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143683.626899:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143683.626917:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5400/0xe984082ccd7243d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a56 expref: 15 pid: 4582 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746143683.626926:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5400/0xe984082ccd7243d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a56 expref: 15 pid: 4582 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746143683.626961:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5400/0xe984082ccd7243d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a56 expref: 15 pid: 4582 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746143683.626986:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143683.628727:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592024832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1833us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.628737:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4632 00000100:00100000:2.0:1746143683.629474:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.630091:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592024960 00000100:00100000:3.0:1746143683.630099:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592024960 00010000:00010000:3.0:1746143683.630128:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c93fc00/0xe984082ccd724392 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a33 expref: 24 pid: 6929 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746143683.630182:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4633 00000100:00100000:3.0:1746143683.630188:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963592024960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143683.630198:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143683.630214:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c93fc00/0xe984082ccd724392 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a33 expref: 24 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.630224:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c93fc00/0xe984082ccd724392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a33 expref: 24 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.630244:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c93fc00/0xe984082ccd724392 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a33 expref: 24 pid: 6929 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.630256:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.630258:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.630263:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3215359) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.630270:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3215359) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.630298:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3215359) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143683.630309:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593648640:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143683.630362:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143683.643248:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592024576:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 23571us (23800us total) trans 17179872353 rc 0/0 00000100:00100000:3.0:1746143683.643260:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 772 00002000:00100000:3.0:1746143683.643270:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3354624->4194303) req@ffff8800a5d82d80 x1830963592024576/t17179872353(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/448 e 0 to 0 dl 1746143694 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.643279:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830963592024576 ext(3354624->4194303) 00010000:00010000:3.0:1746143683.643288:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 27 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.643301:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 27 pid: 8497 timeout: 862 lvb_type: 0 00002000:00010000:3.0:1746143683.643307:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d82d80 00000100:00100000:2.0:1746143683.644503:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593648640:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143683.644524:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143683.644568:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592024960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 14379us (15094us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.644576:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4633 00000100:00100000:1.0:1746143683.646153:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.646206:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.646313:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592025344 00000100:00100000:3.0:1746143683.646319:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592025344 00002000:00100000:3.0:1746143683.646353:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3211264->3215359) req@ffff88008f4edf80 x1830963592025344/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.646362:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4edf80 with x1830963592025344 ext(3211264->3215359) 00002000:00010000:3.0:1746143683.646366:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4edf80 00000100:00100000:1.0:1746143683.646407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.647072:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3228 00000100:00100000:3.0:1746143683.647080:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592025344:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143683.647241:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592025344:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 161us (1106us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143683.647247:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3228 00002000:00100000:3.0:1746143683.647252:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3211264->3215359) req@ffff88008f4edf80 x1830963592025344/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/4536 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.647259:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4edf80 with x1830963592025344 ext(3211264->3215359) 00002000:00010000:3.0:1746143683.647261:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4edf80 00000100:00100000:2.0:1746143683.647638:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592025088 00000100:00100000:2.0:1746143683.647644:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592025088 00000100:00100000:2.0:1746143683.647666:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592025472 00000100:00100000:2.0:1746143683.647668:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592025472 00000100:00100000:2.0:1746143683.647681:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9071 00000100:00100000:2.0:1746143683.647686:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592025088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143683.647695:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143683.647708:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd7243df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a64 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143683.647745:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593648768:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143683.647807:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143683.647897:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9072 00000100:00100000:0.0:1746143683.647904:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592025472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143683.647910:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143683.647918:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ef3ec00/0xe984082ccd7243e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a6b expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143683.647951:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593648896:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143683.647970:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143683.648038:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.648363:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592025728 00000100:00100000:2.0:1746143683.648366:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592025728 00010000:00010000:2.0:1746143683.648382:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 27 pid: 8497 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.648406:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4634 00000100:00100000:2.0:1746143683.648735:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592025728:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143683.648744:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143683.648761:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 27 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.648772:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 27 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.648787:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.648789:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143683.648795:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800950abe00/0xe984082ccd7243a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a41 expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.648802:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800950abe00/0xe984082ccd7243a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a41 expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.648822:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800950abe00/0xe984082ccd7243a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a41 expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143683.648831:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593649024:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143683.649418:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565fcc0 going to sleep for 11 seconds 00002000:00010000:1.0:1746143683.654477:0:4581:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143682 -> 1746143683 00000100:00100000:1.0:1746143683.654504:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593648896:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143683.654536:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ef3ec00/0xe984082ccd7243e6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a6b expref: 15 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143683.654548:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ef3ec00/0xe984082ccd7243e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a6b expref: 15 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143683.654670:0:6929:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff8800a0360380 x1830963593648768) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 27 pid: 8497 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.654692:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c904400/0xe984082ccd724399 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3354624->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a3a expref: 27 pid: 8497 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746143683.654706:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593648768:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143683.654725:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd7243df lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a64 expref: 14 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143683.654734:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd7243df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a64 expref: 14 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143683.654741:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5806600, rc 0) 00000100:00100000:2.0:1746143683.654785:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592025088:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7097us (8577us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143683.654793:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9071 00010000:00010000:1.0:1746143683.656513:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef3ec00, rc 0) 00000100:00100000:1.0:1746143683.656557:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592025472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8651us (10146us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143683.656568:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9072 00000100:00100000:2.0:1746143683.658659:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593649024:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143683.658680:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143683.658709:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592025728:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9976us (10670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.658719:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4634 00000100:00100000:0.0:1746143683.662575:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.662977:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.663022:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.663393:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592026112 00000100:00100000:1.0:1746143683.663401:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592026112 00000100:00100000:1.0:1746143683.663441:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9073 00000100:00100000:1.0:1746143683.663447:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28105:x1830963592026112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143683.663463:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143683.663477:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a087bc00/0xe984082ccd7243ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a72 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.663497:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.663499:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143683.663505:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a087bc00/0xe984082ccd7243ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a72 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.663517:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a087bc00/0xe984082ccd7243ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a72 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.663525:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a087bc00, rc 0) 00000100:00100000:1.0:1746143683.663561:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28105:x1830963592026112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 113us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143683.663567:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9073 00000100:00100000:2.0:1746143683.664263:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592026240 00000100:00100000:2.0:1746143683.664268:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592026240 00002000:00100000:2.0:1746143683.664296:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3215360->4194303) req@ffff8800a5d81180 x1830963592026240/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.664304:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81180 with x1830963592026240 ext(3215360->4194303) 00002000:00010000:2.0:1746143683.664308:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d81180 00000100:00100000:2.0:1746143683.664325:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592026368 00000100:00100000:2.0:1746143683.664327:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592026368 00002000:00100000:2.0:1746143683.664338:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a5d82a00 x1830963592026368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.664343:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830963592026368 ext(3145728->4194303) 00002000:00010000:2.0:1746143683.664346:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82a00 00000100:00100000:2.0:1746143683.664362:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3229 00000100:00100000:2.0:1746143683.664367:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592026240:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143683.664472:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3230 00000100:00100000:3.0:1746143683.664485:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592026368:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143683.671806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.671889:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592026624 00000100:00100000:2.0:1746143683.671897:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592026624 00002000:00100000:2.0:1746143683.671932:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a5d83100 x1830963592026624/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.671953:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83100 with x1830963592026624 ext(2097152->3145727) 00002000:00010000:2.0:1746143683.671958:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d83100 00000100:00100000:2.0:1746143683.671989:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3231 00000100:00100000:2.0:1746143683.671996:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592026624:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143683.678885:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592026240:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 14509us (15900us total) trans 0 rc 978944/978944 00000100:00100000:2.0:1746143683.678896:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3229 00002000:00100000:2.0:1746143683.678906:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3215360->4194303) req@ffff8800a5d81180 x1830963592026240/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 978944/978944 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.678915:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81180 with x1830963592026240 ext(3215360->4194303) 00002000:00010000:2.0:1746143683.678920:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d81180 00000100:00100000:3.0:1746143683.683995:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592026368:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 19507us (20964us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143683.684006:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3230 00002000:00100000:3.0:1746143683.684017:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a5d82a00 x1830963592026368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.684025:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830963592026368 ext(3145728->4194303) 00002000:00010000:3.0:1746143683.684030:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82a00 00000100:00100000:2.0:1746143683.684366:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592026624:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12369us (12567us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143683.684373:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3231 00002000:00100000:2.0:1746143683.684378:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a5d83100 x1830963592026624/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.684385:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83100 with x1830963592026624 ext(2097152->3145727) 00002000:00010000:2.0:1746143683.684388:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d83100 00000100:00100000:0.0:1746143683.692362:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.692431:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592026880 00000100:00100000:2.0:1746143683.692440:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592026880 00002000:00100000:2.0:1746143683.692482:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a5d83800 x1830963592026880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.692491:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83800 with x1830963592026880 ext(4194304->4898815) 00002000:00010000:2.0:1746143683.692495:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d83800 00000100:00100000:2.0:1746143683.692526:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3232 00000100:00100000:2.0:1746143683.692534:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592026880:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143683.696933:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.698244:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592027008 00000100:00100000:3.0:1746143683.698254:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592027008 00000100:00100000:3.0:1746143683.698306:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9074 00000100:00100000:3.0:1746143683.698313:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28105:x1830963592027008:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143683.698329:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.698342:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd7243f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a79 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.698366:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3215359) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.698373:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143683.698374:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143683.698377:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd7243f4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a79 expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.698400:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3215359) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.698409:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3215359) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 22 pid: 4581 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746143683.698420:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593649152:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143683.698504:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da590c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143683.700761:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593649152:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143683.700787:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd7243f4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a79 expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.700809:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a630f600, rc 0) 00000100:00100000:3.0:1746143683.700853:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28105:x1830963592027008:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2540us (3926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.700860:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9074 00000100:00100000:0.0:1746143683.702882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.702989:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592027136 00000100:00100000:2.0:1746143683.702995:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592027136 00002000:00100000:2.0:1746143683.703026:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3215359) req@ffff8800a5d80a80 x1830963592027136/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.703035:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80a80 with x1830963592027136 ext(3145728->3215359) 00010000:00010000:2.0:1746143683.703043:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3215359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 23 pid: 4581 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.703056:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3215359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 23 pid: 4581 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746143683.703063:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d80a80 00000100:00100000:2.0:1746143683.703088:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 773 00000100:00100000:2.0:1746143683.703094:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592027136:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143683.703800:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592026880:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11265us (11444us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143683.703807:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3232 00002000:00100000:3.0:1746143683.703812:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a5d83800 x1830963592026880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.703819:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83800 with x1830963592026880 ext(4194304->4898815) 00002000:00010000:3.0:1746143683.703822:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d83800 00000100:00100000:2.0:1746143683.709171:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592027136:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6037us (6254us total) trans 21474839618 rc 0/0 00000100:00100000:2.0:1746143683.709183:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 773 00002000:00100000:2.0:1746143683.709193:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3215359) req@ffff8800a5d80a80 x1830963592027136/t21474839618(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/448 e 0 to 0 dl 1746143694 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.709202:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80a80 with x1830963592027136 ext(3145728->3215359) 00010000:00010000:2.0:1746143683.709211:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3215359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 25 pid: 4581 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746143683.709224:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3215359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 25 pid: 4581 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746143683.709231:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d80a80 00000100:00100000:0.0:1746143683.711163:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.711316:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592027264 00000100:00100000:3.0:1746143683.711324:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592027264 00000100:00100000:3.0:1746143683.711368:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9075 00000100:00100000:3.0:1746143683.711374:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592027264:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143683.711390:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.711405:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a630e600/0xe984082ccd7243fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a80 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143683.711448:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593649280:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143683.712176:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da590c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143683.713905:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593649280:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143683.713928:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a630e600/0xe984082ccd7243fb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a80 expref: 26 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.713951:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a630e600/0xe984082ccd7243fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a80 expref: 26 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.713999:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a630e600, rc 0) 00000100:00100000:3.0:1746143683.714090:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592027264:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2714us (2930us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143683.714097:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9075 00000100:00100000:0.0:1746143683.717202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.718193:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592027520 00000100:00100000:3.0:1746143683.718201:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592027520 00000100:00100000:3.0:1746143683.718302:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9076 00000100:00100000:3.0:1746143683.718308:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592027520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143683.718323:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.718336:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a630f800/0xe984082ccd724402 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a87 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143683.718378:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593649408:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143683.718461:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da590c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143683.719914:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143683.720065:0:6929:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff880094760e00 x1830963593649408) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3215359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 26 pid: 4581 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.720094:0:6929:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3215359) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 26 pid: 4581 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746143683.720110:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a087b000/0xe984082ccd7243d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3215359) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a5d expref: 26 pid: 4581 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746143683.720125:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593649408:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143683.720161:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.720163:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.720168:0:6929:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd7243f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a79 expref: 14 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.720175:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd7243f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a79 expref: 14 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.720200:0:6929:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd7243f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a79 expref: 14 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143683.720209:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593649536:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143683.720267:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da590c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143683.720369:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592027392 00000100:00100000:2.0:1746143683.720374:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592027392 00000100:00100000:2.0:1746143683.720408:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 545 00000100:00100000:2.0:1746143683.720414:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592027392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143683.720422:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143683.720424:0:7151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie e984082ccd7243d8) 00010000:00010000:2.0:1746143683.720425:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143683.720443:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592027392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 30us (535us total) trans 0 rc 116/116 00000100:00100000:2.0:1746143683.720449:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 545 00000100:00100000:3.0:1746143683.725258:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593649536:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143683.725288:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a630f800/0xe984082ccd724402 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a87 expref: 25 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.725303:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a630f800/0xe984082ccd724402 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a87 expref: 25 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.725314:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a630f800, rc 0) 00000100:00100000:3.0:1746143683.726682:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963592027520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8367us (9482us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143683.726695:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9076 00000100:00100000:0.0:1746143683.734294:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.734332:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.734368:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.734529:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592028032 00000100:00100000:3.0:1746143683.734536:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592028032 00000100:00100000:2.0:1746143683.734577:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592027904 00000100:00100000:2.0:1746143683.734579:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592027904 00000100:00100000:0.0:1746143683.735211:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592028160 00000100:00100000:0.0:1746143683.735215:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592028160 00002000:00100000:3.0:1746143683.735912:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f533100 x1830963592028032/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.735923:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f533100 with x1830963592028032 ext(2097152->3145727) 00002000:00010000:3.0:1746143683.735927:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f533100 00000100:00100000:3.0:1746143683.735957:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3233 00000100:00100000:3.0:1746143683.735963:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592028032:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:0.0:1746143683.736373:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f530a80 x1830963592028160/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143683.736380:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f530a80 with x1830963592028160 ext(3145728->4194303) 00002000:00010000:0.0:1746143683.736382:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f530a80 00000100:00100000:0.0:1746143683.736394:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3234 00000100:00100000:0.0:1746143683.736398:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592028160:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143683.738635:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3293 00000100:00100000:2.0:1746143683.738647:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+269:28099:x1830963592027904:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143683.738804:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+270:28099:x1830963592027904:12345-192.168.202.48@tcp:35:cat.0 Request processed in 161us (4516us total) trans 8589942237 rc 0/0 00000100:00100000:2.0:1746143683.738810:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3293 00000100:00100000:1.0:1746143683.739487:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.741112:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592028544 00000100:00100000:0.0:1746143683.741122:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592028544 00002000:00100000:0.0:1746143683.741187:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f4ef800 x1830963592028544/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143683.741196:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ef800 with x1830963592028544 ext(3145728->4194303) 00002000:00010000:0.0:1746143683.741200:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4ef800 00000100:00100000:0.0:1746143683.741232:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3235 00000100:00100000:0.0:1746143683.741239:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592028544:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143683.754179:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592028160:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17772us (19803us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143683.754189:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3234 00002000:00100000:2.0:1746143683.754198:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f530a80 x1830963592028160/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.754207:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f530a80 with x1830963592028160 ext(3145728->4194303) 00002000:00010000:2.0:1746143683.754212:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f530a80 00000100:00100000:3.0:1746143683.762744:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592028032:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26772us (28402us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143683.762754:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3233 00002000:00100000:3.0:1746143683.762764:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f533100 x1830963592028032/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143683.762772:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f533100 with x1830963592028032 ext(2097152->3145727) 00002000:00010000:3.0:1746143683.762777:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f533100 00000100:00100000:1.0:1746143683.764928:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592028544:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23683us (25435us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143683.764946:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3235 00002000:00100000:1.0:1746143683.764954:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f4ef800 x1830963592028544/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.764963:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ef800 with x1830963592028544 ext(3145728->4194303) 00002000:00010000:1.0:1746143683.764968:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4ef800 00000100:00100000:0.0:1746143683.771801:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.771895:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592028800 00000100:00100000:1.0:1746143683.771904:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592028800 00002000:00100000:1.0:1746143683.771952:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008f533480 x1830963592028800/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.771962:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f533480 with x1830963592028800 ext(4194304->4898815) 00002000:00010000:1.0:1746143683.771967:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f533480 00000100:00100000:1.0:1746143683.771996:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3236 00000100:00100000:1.0:1746143683.772003:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592028800:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143683.778856:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592028800:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6846us (7057us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143683.778866:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3236 00002000:00100000:1.0:1746143683.778876:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008f533480 x1830963592028800/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.778885:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f533480 with x1830963592028800 ext(4194304->4898815) 00002000:00010000:1.0:1746143683.778890:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f533480 00000100:00100000:0.0:1746143683.785504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.788226:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592029056 00000100:00100000:2.0:1746143683.788240:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592029056 00000100:00100000:2.0:1746143683.788309:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3294 00000100:00100000:2.0:1746143683.788317:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+38:28105:x1830963592029056:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143683.788529:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+39:28105:x1830963592029056:12345-192.168.202.48@tcp:35:cat.0 Request processed in 212us (3031us total) trans 8589942238 rc 0/0 00000100:00100000:2.0:1746143683.788538:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3294 00000100:00100000:0.0:1746143683.789170:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.789294:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592029312 00000100:00100000:1.0:1746143683.789298:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592029312 00000100:00100000:1.0:1746143683.790668:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8164 00000100:00100000:1.0:1746143683.790679:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+39:28109:x1830963592029312:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143683.790692:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143683.790707:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095179200/0xe984082ccd724409 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a8e expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.790787:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724410 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.790798:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724410 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.790807:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724410 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.790817:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd724417 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.790822:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd724417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.790827:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd724417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.790906:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095178a00/0xe984082ccd72441e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.790914:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095178a00/0xe984082ccd72441e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.790919:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095178a00/0xe984082ccd72441e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143683.790926:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143683.790992:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724410 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.790999:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724410 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.791005:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724410 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.791011:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095178200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143683.791014:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724410 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.791019:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724410 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.791027:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143683.791030:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143683.791033:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724410 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.791037:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724410 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.791707:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd724417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.791714:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd724417 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.791718:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd724417 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.791722:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095179a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143683.791724:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd724417 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.791729:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd724417 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.791740:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74200) 00010000:00010000:1.0:1746143683.791741:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143683.791743:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd724417 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.791747:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd724417 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.791779:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095179200/0xe984082ccd724409 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a8e expref: 42 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.791789:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095178a00/0xe984082ccd72441e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a8e expref: 41 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.791794:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143683.791796:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143683.791798:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095178a00, rc 0) 00000100:00100000:1.0:1746143683.791911:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+41:28109:x1830963592029312:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1234us (2741us total) trans 8589942239 rc 0/0 00000100:00100000:1.0:1746143683.791918:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8164 00000100:00100000:0.0:1746143683.797115:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.797121:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.797180:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592029696 00000100:00100000:0.0:1746143683.797188:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592029696 00000100:00100000:0.0:1746143683.797243:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 546 00000100:00100000:1.0:1746143683.797244:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592029568 00000100:00100000:1.0:1746143683.797248:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592029568 00000100:00100000:0.0:1746143683.797250:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+41:1963:x1830963592029696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143683.797263:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143683.797282:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095178a00/0xe984082ccd72441e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a8e expref: 41 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143683.797428:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:0.0:1746143683.797432:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143683.797445:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8165 00000100:00100000:3.0:1746143683.797453:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+270:28111:x1830963592029568:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:0.0:1746143683.797467:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+40:1963:x1830963592029696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 218us (347us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143683.797469:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143683.797473:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 546 00010000:00010000:3.0:1746143683.797481:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630fa00/0xe984082ccd72442c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a95 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.797563:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f000/0xe984082ccd724433 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797577:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f000/0xe984082ccd724433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797585:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f000/0xe984082ccd724433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797595:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630ea00/0xe984082ccd72443a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797600:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630ea00/0xe984082ccd72443a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797604:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630ea00/0xe984082ccd72443a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797684:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f800/0xe984082ccd724441 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797690:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f800/0xe984082ccd724441 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797695:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f800/0xe984082ccd724441 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143683.797702:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143683.797772:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f000/0xe984082ccd724433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797778:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f000/0xe984082ccd724433 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797783:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f000/0xe984082ccd724433 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797791:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a630f000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.797794:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f000/0xe984082ccd724433 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797799:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f000/0xe984082ccd724433 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797805:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143683.797808:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.797810:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f000/0xe984082ccd724433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797814:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f000/0xe984082ccd724433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797836:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630ea00/0xe984082ccd72443a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797841:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630ea00/0xe984082ccd72443a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797845:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630ea00/0xe984082ccd72443a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797849:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a630ea00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143683.797851:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630ea00/0xe984082ccd72443a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797856:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630ea00/0xe984082ccd72443a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797861:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9dd00) 00010000:00010000:3.0:1746143683.797863:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143683.797865:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630ea00/0xe984082ccd72443a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797870:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630ea00/0xe984082ccd72443a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143683.797896:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630fa00/0xe984082ccd72442c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a95 expref: 273 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.797905:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f800/0xe984082ccd724441 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a95 expref: 272 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.797910:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143683.797912:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143683.797914:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a630f800, rc 0) 00000100:00100000:3.0:1746143683.797948:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+272:28111:x1830963592029568:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 484us (828us total) trans 8589942240 rc 0/0 00000100:00100000:3.0:1746143683.797953:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8165 00000100:00100000:0.0:1746143683.803678:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.803729:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.805117:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592030080 00000100:00100000:2.0:1746143683.805126:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592030080 00000100:00100000:2.0:1746143683.805211:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 547 00000100:00100000:2.0:1746143683.805218:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+272:1963:x1830963592030080:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143683.805230:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143683.805250:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f800/0xe984082ccd724441 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a95 expref: 272 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.805267:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143683.805271:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143683.805511:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+271:1963:x1830963592030080:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 293us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.805517:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 547 00000100:00100000:3.0:1746143683.806473:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592029952 00000100:00100000:3.0:1746143683.806478:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592029952 00000100:00100000:3.0:1746143683.806968:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3295 00000100:00100000:3.0:1746143683.806975:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+271:28111:x1830963592029952:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143683.807205:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+272:28111:x1830963592029952:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 230us (3534us total) trans 8589942241 rc 0/0 00000100:00100000:3.0:1746143683.807211:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3295 00000100:00100000:0.0:1746143683.917121:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143683.917255:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592030336 00000100:00100000:1.0:1746143683.917262:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592030336 00000100:00100000:1.0:1746143683.917315:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8166 00000100:00100000:1.0:1746143683.917322:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+272:28116:x1830963592030336:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143683.917343:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143683.917358:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095178a00/0xe984082ccd72444f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0a9c expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.917448:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095179200/0xe984082ccd724456 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917460:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095179200/0xe984082ccd724456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917470:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095179200/0xe984082ccd724456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917482:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd72445d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917487:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd72445d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917492:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd72445d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917582:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724464 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917590:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724464 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917596:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724464 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143683.917603:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143683.917669:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095179200/0xe984082ccd724456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917675:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095179200/0xe984082ccd724456 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917683:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095179200/0xe984082ccd724456 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917688:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095179200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143683.917691:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095179200/0xe984082ccd724456 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917696:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095179200/0xe984082ccd724456 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917707:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143683.917709:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143683.917713:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095179200/0xe984082ccd724456 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917717:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095179200/0xe984082ccd724456 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917730:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd72445d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917735:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd72445d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917740:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd72445d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917743:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095179a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143683.917746:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd72445d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917750:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd72445d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917759:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74100) 00010000:00010000:1.0:1746143683.917761:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143683.917763:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd72445d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917767:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095179a00/0xe984082ccd72445d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143683.917797:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095178a00/0xe984082ccd72444f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a9c expref: 275 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.917807:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724464 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a9c expref: 274 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143683.917813:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143683.917815:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143683.917816:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095178200, rc 0) 00000100:00100000:1.0:1746143683.917855:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+274:28116:x1830963592030336:12345-192.168.202.48@tcp:101:cat.0 Request processed in 534us (741us total) trans 8589942242 rc 0/0 00000100:00100000:1.0:1746143683.917861:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8166 00000100:00100000:0.0:1746143683.922083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.922131:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.922538:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592030592 00000100:00100000:3.0:1746143683.922549:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592030592 00000100:00100000:3.0:1746143683.922652:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9077 00000100:00100000:3.0:1746143683.922660:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592030592:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143683.922678:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.922691:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a630e600/0xe984082ccd724472 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0aa3 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.922709:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.922711:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.922718:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a630e600/0xe984082ccd724472 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aa3 expref: 25 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.922731:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a630e600/0xe984082ccd724472 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aa3 expref: 25 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.922741:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a630e600, rc 0) 00000100:00100000:3.0:1746143683.923210:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592030592:12345-192.168.202.48@tcp:101:cat.0 Request processed in 549us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143683.923216:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9077 00000100:00100000:2.0:1746143683.923594:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592030464 00000100:00100000:2.0:1746143683.923599:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592030464 00000100:00100000:2.0:1746143683.924799:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 548 00000100:00100000:2.0:1746143683.924808:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+274:1964:x1830963592030464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143683.924819:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143683.924840:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095178200/0xe984082ccd724464 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a9c expref: 274 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143683.925451:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143683.925456:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143683.926796:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+273:1964:x1830963592030464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1984us (4713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143683.926807:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 548 00000100:00100000:0.0:1746143683.981117:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.981177:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143683.981216:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143683.981303:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592030848 00000100:00100000:2.0:1746143683.981310:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592030848 00002000:00100000:2.0:1746143683.981347:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f531f80 x1830963592030848/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.981355:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f531f80 with x1830963592030848 ext(2097152->3145727) 00002000:00010000:2.0:1746143683.981361:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f531f80 00000100:00100000:2.0:1746143683.981375:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592031104 00000100:00100000:2.0:1746143683.981377:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592031104 00002000:00100000:2.0:1746143683.981388:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008e627b80 x1830963592031104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.981394:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e627b80 with x1830963592031104 ext(2097152->3145727) 00002000:00010000:2.0:1746143683.981397:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e627b80 00000100:00100000:2.0:1746143683.981405:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592031360 00000100:00100000:2.0:1746143683.981406:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592031360 00002000:00100000:2.0:1746143683.981413:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008e625880 x1830963592031360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/0 e 0 to 0 dl 1746143694 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143683.981419:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e625880 with x1830963592031360 ext(3145728->4194303) 00002000:00010000:2.0:1746143683.981421:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e625880 00000100:00100000:2.0:1746143683.981430:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3237 00000100:00100000:2.0:1746143683.981436:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592030848:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143683.981688:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3238 00000100:00100000:3.0:1746143683.981698:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592031104:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143683.982615:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3239 00000100:00100000:2.0:1746143683.982621:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592031360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143683.991075:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143683.991913:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592031488 00000100:00100000:3.0:1746143683.991921:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592031488 00000100:00100000:3.0:1746143683.991962:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9078 00000100:00100000:3.0:1746143683.991969:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28109:x1830963592031488:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143683.991984:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143683.991998:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0aaa expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.992019:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd724306 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09fb expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.992027:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724376 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a17 expref: 28 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.992033:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.992034:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143683.992036:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1802240->2097151] (req 1802240->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.992058:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a17 expref: 28 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143683.992067:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a17 expref: 28 pid: 8497 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143683.992076:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593649664:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143683.994398:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd724306 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09fb expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143683.994413:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd724306 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09fb expref: 16 pid: 8497 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143683.994425:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593649792:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143683.997631:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592030848:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16188us (16515us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143683.997642:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3237 00002000:00100000:0.0:1746143683.997652:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f531f80 x1830963592030848/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143683.997660:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f531f80 with x1830963592030848 ext(2097152->3145727) 00002000:00010000:0.0:1746143683.997666:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f531f80 00000100:00100000:1.0:1746143683.997986:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592031104:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16288us (16807us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143683.997992:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3238 00002000:00100000:1.0:1746143683.997998:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008e627b80 x1830963592031104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143683.998004:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e627b80 with x1830963592031104 ext(2097152->3145727) 00002000:00010000:1.0:1746143683.998008:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e627b80 00000100:00100000:3.0:1746143683.999175:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143684.006413:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592031360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23781us (25185us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143684.006426:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3239 00002000:00100000:2.0:1746143684.006438:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008e625880 x1830963592031360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:79/0 lens 488/440 e 0 to 0 dl 1746143694 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.006446:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e625880 with x1830963592031360 ext(3145728->4194303) 00002000:00010000:2.0:1746143684.006452:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e625880 00000100:00100000:1.0:1746143684.008240:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593649664:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143684.012601:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.013314:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.013372:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593649792:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143684.013400:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1802240->2097151] (req 1802240->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.013416:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a25400, rc 0) 00000100:00100000:0.0:1746143684.013453:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28109:x1830963592031488:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 21483us (22385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143684.013461:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9078 00000100:00100000:2.0:1746143684.013632:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592031616 00000100:00100000:2.0:1746143684.013638:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592031616 00010000:00010000:2.0:1746143684.013662:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a17 expref: 25 pid: 8497 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746143684.013682:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592031744 00000100:00100000:2.0:1746143684.013684:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592031744 00010000:00010000:2.0:1746143684.013692:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd724306 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09fb expref: 16 pid: 8497 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.013705:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4635 00000100:00100000:2.0:1746143684.013711:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592031616:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.013720:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.013740:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a17 expref: 25 pid: 8497 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.013749:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a17 expref: 25 pid: 8497 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.013768:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd724376 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a17 expref: 25 pid: 8497 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.013786:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.013804:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592031616:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 93us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.013809:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4635 00000100:00100000:2.0:1746143684.013821:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4636 00000100:00100000:2.0:1746143684.013825:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963592031744:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.013830:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.013837:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd724306 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09fb expref: 16 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.013845:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd724306 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09fb expref: 16 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.013855:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b145000/0xe984082ccd724306 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09fb expref: 16 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.013862:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.013864:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.013869:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.013876:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.013899:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143684.013909:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593649920:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143684.013956:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143684.035394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.035430:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592031872 00000100:00100000:2.0:1746143684.035431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.035438:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592031872 00000100:00100000:0.0:1746143684.035472:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9079 00000100:00100000:0.0:1746143684.035478:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592031872:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143684.035485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143684.035491:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143684.035499:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592032128 00000100:00100000:2.0:1746143684.035502:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592032128 00010000:00010000:0.0:1746143684.035503:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f8e5000/0xe984082ccd724480 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ab1 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143684.035528:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1802240->1806335) req@ffff8800a0360e00 x1830963592032128/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.035536:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360e00 with x1830963592032128 ext(1802240->1806335) 00002000:00010000:2.0:1746143684.035540:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0360e00 00000100:00100000:2.0:1746143684.035552:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3240 00000100:00100000:0.0:1746143684.035552:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593650048:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143684.035557:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592032128:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143684.035627:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.035631:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592032384 00000100:00100000:3.0:1746143684.035635:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592032384 00000100:00100000:3.0:1746143684.035665:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8167 00000100:00100000:3.0:1746143684.035671:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+40:28119:x1830963592032384:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143684.035683:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.035692:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25e00/0xe984082ccd724487 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ab8 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.035769:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25000/0xe984082ccd72448e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.035780:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25000/0xe984082ccd72448e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.035790:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25000/0xe984082ccd72448e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.035801:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25a00/0xe984082ccd724495 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.035807:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25a00/0xe984082ccd724495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.035812:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25a00/0xe984082ccd724495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.035899:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd72449c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.035907:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd72449c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.035913:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd72449c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143684.035921:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143684.036011:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25000/0xe984082ccd72448e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036018:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25000/0xe984082ccd72448e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036022:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25000/0xe984082ccd72448e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036027:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a25000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143684.036030:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25000/0xe984082ccd72448e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036036:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25000/0xe984082ccd72448e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036045:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143684.036048:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143684.036051:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25000/0xe984082ccd72448e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036055:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25000/0xe984082ccd72448e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036067:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25a00/0xe984082ccd724495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036072:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25a00/0xe984082ccd724495 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036077:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25a00/0xe984082ccd724495 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036081:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a25a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143684.036083:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25a00/0xe984082ccd724495 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036089:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25a00/0xe984082ccd724495 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036094:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9d800) 00010000:00010000:3.0:1746143684.036101:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143684.036103:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25a00/0xe984082ccd724495 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036108:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25a00/0xe984082ccd724495 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.036134:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25e00/0xe984082ccd724487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ab8 expref: 43 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.036165:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd72449c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ab8 expref: 42 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.036170:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.036172:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143684.036174:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a24600, rc 0) 00000100:00100000:2.0:1746143684.036350:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592032128:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 792us (863us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143684.036356:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3240 00002000:00100000:2.0:1746143684.036361:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1802240->1806335) req@ffff8800a0360e00 x1830963592032128/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/4536 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.036368:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360e00 with x1830963592032128 ext(1802240->1806335) 00002000:00010000:2.0:1746143684.036371:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0360e00 00000100:00100000:2.0:1746143684.036423:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593649920:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143684.036434:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.036449:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592031744:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 22623us (23136us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.036457:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4636 00000100:00080000:2.0:1746143684.036501:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143684.036553:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+42:28119:x1830963592032384:12345-192.168.202.48@tcp:101:cat.0 Request processed in 882us (1121us total) trans 8589942243 rc 0/0 00000100:00100000:3.0:1746143684.036559:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8167 00002000:00010000:2.0:1746143684.040451:0:4581:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime: 1746143682 -> 1746143683 00002000:00010000:2.0:1746143684.040456:0:4581:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime: 1746143682 -> 1746143683 00000100:00100000:2.0:1746143684.040474:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593650048:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143684.040501:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f8e5000/0xe984082ccd724480 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ab1 expref: 25 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143684.040511:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f8e5000/0xe984082ccd724480 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ab1 expref: 25 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143684.040535:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8e5000, rc 0) 00000100:00100000:2.0:1746143684.040582:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592031872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5103us (5194us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143684.040590:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9079 00000100:00100000:0.0:1746143684.049999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.053924:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592032512 00000100:00100000:2.0:1746143684.053943:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592032512 00000100:00100000:3.0:1746143684.057033:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 549 00000100:00100000:3.0:1746143684.057054:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+42:1965:x1830963592032512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.057069:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.057094:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd72449c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ab8 expref: 42 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.057131:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.057134:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.057192:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+41:1965:x1830963592032512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 145us (7198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.057197:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 549 00000100:00100000:1.0:1746143684.057636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.057666:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.057681:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.057710:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.057730:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592033024 00000100:00100000:1.0:1746143684.057735:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592033024 00002000:00100000:1.0:1746143684.057762:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1802239) req@ffff88008f4ec380 x1830963592033024/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.057770:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ec380 with x1830963592033024 ext(1048576->1802239) 00002000:00010000:1.0:1746143684.057774:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ec380 00000100:00100000:1.0:1746143684.057786:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3241 00000100:00100000:1.0:1746143684.057791:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963592033024:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143684.058670:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592032640 00000100:00100000:1.0:1746143684.058675:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592032640 00000100:00100000:1.0:1746143684.058691:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592032768 00000100:00100000:1.0:1746143684.058693:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592032768 00000100:00100000:1.0:1746143684.058701:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592033152 00000100:00100000:1.0:1746143684.058703:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592033152 00000100:00100000:1.0:1746143684.058715:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9080 00000100:00100000:1.0:1746143684.058720:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28109:x1830963592032640:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143684.058729:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.058741:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0abf expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.058763:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095729800/0xe984082ccd72420a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0961 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.058771:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094676c00/0xe984082ccd72425e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0999 expref: 24 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.058777:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.058779:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.058782:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->1589247] (req 1048576->1589247) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.058803:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094676c00/0xe984082ccd72425e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0999 expref: 24 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.058813:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094676c00/0xe984082ccd72425e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0999 expref: 24 pid: 8497 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746143684.058823:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593650176:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143684.058884:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095729800/0xe984082ccd72420a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0961 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.058892:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095729800/0xe984082ccd72420a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0961 expref: 18 pid: 4581 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.058900:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593650304:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143684.058916:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.058931:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9081 00000100:00100000:1.0:1746143684.058947:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592032768:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143684.058954:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.058960:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d59ec00/0xe984082ccd7244b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ac6 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143684.060479:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9082 00000100:00100000:0.0:1746143684.060489:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28111:x1830963592033152:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143684.060499:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143684.060509:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0acd expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.060528:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800950abe00/0xe984082ccd7243a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a41 expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.060540:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a087bc00/0xe984082ccd7243ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a72 expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.060546:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.060547:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.060550:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.060567:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a087bc00/0xe984082ccd7243ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a72 expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.060581:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a087bc00/0xe984082ccd7243ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a72 expref: 13 pid: 4581 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746143684.060589:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593650432:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143684.060640:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800950abe00/0xe984082ccd7243a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a41 expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.060648:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800950abe00/0xe984082ccd7243a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a41 expref: 27 pid: 8497 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746143684.060655:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e624e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593650560:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143684.060668:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.060781:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593650688:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143684.060802:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.066787:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593650176:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143684.066798:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593650304:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143684.066824:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->1589247] (req 1048576->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.066838:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c25b200, rc 0) 00000100:00100000:1.0:1746143684.066874:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28109:x1830963592032640:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8153us (9238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.066882:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9080 00000100:00100000:1.0:1746143684.066928:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593650688:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143684.066954:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d59ec00/0xe984082ccd7244b1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ac6 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.066962:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d59ec00/0xe984082ccd7244b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ac6 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.067234:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d59ec00, rc 0) 00000100:00100000:1.0:1746143684.067386:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592032768:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8438us (9718us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143684.067391:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9081 00000100:00100000:2.0:1746143684.067645:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e624700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593650432:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.067654:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e624e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593650560:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143684.067672:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.067681:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8e5000, rc 0) 00000100:00100000:2.0:1746143684.067714:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:28111:x1830963592033152:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7227us (10003us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.067720:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9082 00000100:00100000:0.0:1746143684.071183:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.071276:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592033408 00000100:00100000:3.0:1746143684.071283:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592033408 00010000:00010000:3.0:1746143684.071313:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095729800/0xe984082ccd72420a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0961 expref: 18 pid: 4581 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.071340:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4637 00000100:00100000:3.0:1746143684.071347:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e625180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592033408:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.071358:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.071376:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095729800/0xe984082ccd72420a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0961 expref: 18 pid: 4581 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.071385:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095729800/0xe984082ccd72420a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0961 expref: 18 pid: 4581 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.071403:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095729800/0xe984082ccd72420a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0961 expref: 18 pid: 4581 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.071420:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.071454:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e625180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592033408:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 108us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.071893:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592033024:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14101us (14210us total) trans 0 rc 753664/753664 00000100:00100000:1.0:1746143684.071901:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3241 00002000:00100000:1.0:1746143684.071910:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1802239) req@ffff88008f4ec380 x1830963592033024/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.071918:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ec380 with x1830963592033024 ext(1048576->1802239) 00002000:00010000:1.0:1746143684.071922:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ec380 00000100:00100000:3.0:1746143684.072575:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4637 00000100:00100000:0.0:1746143684.072827:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.072948:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592033536 00000100:00100000:3.0:1746143684.072952:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592033536 00010000:00010000:3.0:1746143684.072968:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800950abe00/0xe984082ccd7243a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a41 expref: 27 pid: 8497 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.073367:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4638 00000100:00100000:3.0:1746143684.073374:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e625500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592033536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.073384:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.073400:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800950abe00/0xe984082ccd7243a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a41 expref: 27 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.073408:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800950abe00/0xe984082ccd7243a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a41 expref: 27 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.073424:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800950abe00/0xe984082ccd7243a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a41 expref: 27 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.073435:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.074042:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e625500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592033536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 666us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.074048:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4638 00000100:00100000:0.0:1746143684.076196:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.076601:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592033280 00000100:00100000:3.0:1746143684.076609:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592033280 00010000:00010000:3.0:1746143684.076641:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094676c00/0xe984082ccd72425e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0999 expref: 24 pid: 8497 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.076679:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4639 00000100:00100000:3.0:1746143684.076687:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592033280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.076697:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.076715:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094676c00/0xe984082ccd72425e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0999 expref: 24 pid: 8497 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746143684.076724:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094676c00/0xe984082ccd72425e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0999 expref: 24 pid: 8497 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746143684.076743:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094676c00/0xe984082ccd72425e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0999 expref: 24 pid: 8497 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746143684.076760:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.076761:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.076767:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 14 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.076774:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 14 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.076802:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 14 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.076812:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593650816:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143684.076883:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143684.076980:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.077042:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592033664 00000100:00100000:2.0:1746143684.077046:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592033664 00010000:00010000:2.0:1746143684.077059:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a087bc00/0xe984082ccd7243ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a72 expref: 14 pid: 4581 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.077075:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4640 00000100:00100000:2.0:1746143684.077080:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592033664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.077086:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.077098:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a087bc00/0xe984082ccd7243ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a72 expref: 14 pid: 4581 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.077106:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a087bc00/0xe984082ccd7243ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a72 expref: 14 pid: 4581 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.077118:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a087bc00/0xe984082ccd7243ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a72 expref: 14 pid: 4581 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.077129:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.077131:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.077134:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.077162:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.077178:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143684.077185:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593650944:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143684.077214:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.077411:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.077494:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592033792 00000100:00100000:1.0:1746143684.077497:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592033792 00000100:00100000:1.0:1746143684.077521:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9083 00000100:00100000:1.0:1746143684.077526:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28116:x1830963592033792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143684.077537:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.077546:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd7244bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ad4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.077561:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.077567:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143684.077569:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143684.077571:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd7244bf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4894720->5242879] (req 4894720->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ad4 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.077586:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.077596:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 27 pid: 6929 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.077604:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593651072:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143684.077627:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.077790:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.077876:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592033920 00000100:00100000:0.0:1746143684.077880:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592033920 00000100:00100000:0.0:1746143684.077909:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9084 00000100:00100000:0.0:1746143684.077915:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28119:x1830963592033920:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143684.077922:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143684.077930:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4c00/0xe984082ccd7244c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0adb expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.077953:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.077959:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143684.077960:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143684.077962:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4c00/0xe984082ccd7244c6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0adb expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.077977:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.077984:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 16 pid: 4582 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746143684.077991:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e625c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593651200:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143684.078014:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143684.080790:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593650944:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143684.080809:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143684.080877:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592033664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3795us (3896us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143684.080885:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4640 00000100:00100000:3.0:1746143684.082059:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593650816:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143684.082071:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.082104:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592033280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5417us (5920us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.082111:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4639 00000100:00100000:0.0:1746143684.082334:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e625c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593651200:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143684.082351:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4c00/0xe984082ccd7244c6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0adb expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.082365:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8e4c00, rc 0) 00000100:00100000:0.0:1746143684.082384:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28119:x1830963592033920:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4469us (4595us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143684.082390:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9084 00000100:00100000:1.0:1746143684.082445:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593651072:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143684.082461:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd7244bf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [4894720->5242879] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ad4 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143684.082523:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143684.082594:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d59f000, rc 0) 00000100:00100000:1.0:1746143684.082612:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:28116:x1830963592033792:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5086us (5202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.082918:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592034176 00000100:00100000:3.0:1746143684.082924:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592034176 00002000:00100000:3.0:1746143684.082961:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2805760->2809855) req@ffff8800a0360380 x1830963592034176/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143684.082970:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360380 with x1830963592034176 ext(2805760->2809855) 00010000:00010000:3.0:1746143684.082975:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 28 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.082985:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 28 pid: 6929 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746143684.082991:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0360380 00000100:00100000:3.0:1746143684.083006:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 774 00000100:00100000:3.0:1746143684.083012:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592034176:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143684.083136:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592034176:12345-192.168.202.48@tcp:3:cat.0 Request processed in 124us (614us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143684.083158:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 774 00002000:00100000:3.0:1746143684.083163:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2805760->2809855) req@ffff8800a0360380 x1830963592034176/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/4536 e 0 to 0 dl 1746143695 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143684.083170:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360380 with x1830963592034176 ext(2805760->2809855) 00010000:00010000:3.0:1746143684.083175:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 28 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.083183:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 28 pid: 6929 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746143684.083188:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0360380 00000100:00100000:1.0:1746143684.083476:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9083 00000100:00100000:0.0:1746143684.087713:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.088714:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592034432 00000100:00100000:3.0:1746143684.088723:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592034432 00002000:00100000:3.0:1746143684.088763:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1585152->1589247) req@ffff88008e625c00 x1830963592034432/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143684.088771:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e625c00 with x1830963592034432 ext(1585152->1589247) 00010000:00010000:3.0:1746143684.088779:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 16 pid: 4582 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.088791:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 16 pid: 4582 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746143684.088797:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e625c00 00000100:00100000:3.0:1746143684.088826:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 775 00000100:00100000:3.0:1746143684.088833:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592034432:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143684.089013:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592034432:12345-192.168.202.48@tcp:3:cat.0 Request processed in 180us (1306us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143684.089019:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 775 00002000:00100000:3.0:1746143684.089024:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1585152->1589247) req@ffff88008e625c00 x1830963592034432/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/4536 e 0 to 0 dl 1746143695 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143684.089036:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e625c00 with x1830963592034432 ext(1585152->1589247) 00010000:00010000:3.0:1746143684.089039:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 16 pid: 4582 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.089047:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 16 pid: 4582 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746143684.089051:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e625c00 00000100:00100000:0.0:1746143684.091958:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.092749:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592034688 00000100:00100000:2.0:1746143684.092757:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592034688 00002000:00100000:2.0:1746143684.092794:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2805760->3145727) req@ffff88008e624a80 x1830963592034688/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.092802:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624a80 with x1830963592034688 ext(2805760->3145727) 00010000:00010000:2.0:1746143684.092811:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 27 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.092821:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 27 pid: 6929 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746143684.092827:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e624a80 00000100:00100000:2.0:1746143684.092854:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 776 00000100:00100000:2.0:1746143684.092860:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592034688:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143684.095325:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.095948:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592035328 00000100:00100000:1.0:1746143684.095955:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592035328 00000100:00100000:1.0:1746143684.096006:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3296 00000100:00100000:1.0:1746143684.096014:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+41:28109:x1830963592035328:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143684.096214:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+42:28109:x1830963592035328:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 200us (894us total) trans 8589942244 rc 0/0 00000100:00100000:1.0:1746143684.096220:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3296 00000100:00100000:1.0:1746143684.097233:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.097250:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592034816 00000100:00100000:1.0:1746143684.097254:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592034816 00000100:00100000:1.0:1746143684.097278:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9085 00000100:00100000:1.0:1746143684.097282:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28111:x1830963592034816:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143684.097291:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.097306:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ae2 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.097328:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd7243f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a79 expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.097336:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a630e600/0xe984082ccd724472 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aa3 expref: 24 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.097342:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.097344:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.097346:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2781183] (req 2097152->2781183) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 24 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.097370:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a630e600/0xe984082ccd724472 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aa3 expref: 24 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.097380:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a630e600/0xe984082ccd724472 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aa3 expref: 24 pid: 6929 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746143684.097396:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593651328:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143684.098458:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd7243f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a79 expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.098467:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd7243f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a79 expref: 15 pid: 6929 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.098476:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593651456:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.098581:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.099804:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143684.100977:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592035072 00000100:00100000:0.0:1746143684.100985:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592035072 00002000:00100000:0.0:1746143684.101021:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1589247) req@ffff8800a0360700 x1830963592035072/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143684.101030:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360700 with x1830963592035072 ext(1048576->1589247) 00010000:00010000:0.0:1746143684.101038:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 16 pid: 4582 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.101048:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 16 pid: 4582 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746143684.101059:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0360700 00000100:00100000:0.0:1746143684.101093:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 777 00000100:00100000:0.0:1746143684.101100:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592035072:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143684.102681:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593651328:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.104968:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592034688:12345-192.168.202.48@tcp:4:cat.0 Request processed in 12101us (13010us total) trans 17179872354 rc 0/0 00000100:00100000:2.0:1746143684.104979:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 776 00002000:00100000:2.0:1746143684.104990:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2805760->3145727) req@ffff88008e624a80 x1830963592034688/t17179872354(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/448 e 0 to 0 dl 1746143695 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.105003:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624a80 with x1830963592034688 ext(2805760->3145727) 00010000:00010000:2.0:1746143684.105011:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.105023:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746143684.105029:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e624a80 00000100:00100000:1.0:1746143684.107498:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593651456:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143684.107526:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2781183] (req 2097152->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 24 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.107542:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d59f800, rc 0) 00000100:00100000:1.0:1746143684.107996:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28111:x1830963592034816:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 10711us (10763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.108004:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9085 00000100:00100000:0.0:1746143684.109525:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.109558:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.109581:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592035584 00000100:00100000:3.0:1746143684.109588:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592035584 00000100:00100000:0.0:1746143684.109588:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143684.109619:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd7243f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a79 expref: 18 pid: 6929 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.109642:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4641 00000100:00100000:3.0:1746143684.109649:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592035584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.109660:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.109677:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd7243f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a79 expref: 18 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.109690:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd7243f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a79 expref: 18 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.109708:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd7243f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0a79 expref: 18 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.109723:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.109753:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592035584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 105us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.109759:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4641 00000100:00100000:3.0:1746143684.109771:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592035456 00000100:00100000:3.0:1746143684.109773:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592035456 00010000:00010000:3.0:1746143684.109782:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a630e600/0xe984082ccd724472 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aa3 expref: 24 pid: 6929 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.109794:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592035712 00000100:00100000:3.0:1746143684.109796:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592035712 00010000:00010000:3.0:1746143684.109804:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746143684.109814:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4642 00000100:00100000:3.0:1746143684.109817:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4643 00000100:00100000:3.0:1746143684.109820:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592035712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143684.109820:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963592035456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.109826:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143684.109826:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143684.109835:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a630e600/0xe984082ccd724472 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aa3 expref: 24 pid: 6929 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746143684.109836:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.109842:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a630e600/0xe984082ccd724472 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aa3 expref: 24 pid: 6929 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746143684.109843:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.109853:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f8e5000/0xe984082ccd7244b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0acd expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.109853:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a630e600/0xe984082ccd724472 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aa3 expref: 24 pid: 6929 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746143684.109861:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.109863:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.109863:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.109864:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.109869:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd7244bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ad4 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.109869:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 23 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.109876:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd7244bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ad4 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.109876:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 23 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.109901:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd7244bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ad4 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.109901:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 23 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.109910:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593651712:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143684.109910:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e626300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593651584:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143684.109960:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.110269:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143684.113316:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592035072:12345-192.168.202.48@tcp:4:cat.0 Request processed in 12210us (14729us total) trans 21474839619 rc 0/0 00000100:00100000:0.0:1746143684.113326:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 777 00002000:00100000:0.0:1746143684.113336:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1589247) req@ffff8800a0360700 x1830963592035072/t21474839619(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/448 e 0 to 0 dl 1746143695 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143684.113344:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0360700 with x1830963592035072 ext(1048576->1589247) 00010000:00010000:0.0:1746143684.113353:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 17 pid: 4582 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.113366:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 17 pid: 4582 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746143684.113372:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0360700 00000100:00100000:1.0:1746143684.113788:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e626300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593651584:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143684.113803:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143684.113825:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592035456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4005us (4266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.113835:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4642 00000100:00100000:3.0:1746143684.114180:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.114758:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593651712:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143684.114769:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.114788:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592035712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4967us (5199us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.114794:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4643 00000100:00100000:1.0:1746143684.114960:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592035840 00000100:00100000:1.0:1746143684.114967:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592035840 00000100:00100000:2.0:1746143684.116088:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9086 00000100:00100000:2.0:1746143684.116098:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592035840:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143684.116113:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143684.116129:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800950d1400/0xe984082ccd7244d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ae9 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143684.116184:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593651840:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143684.116244:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.117415:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.118366:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592035968 00000100:00100000:1.0:1746143684.118372:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592035968 00000100:00100000:1.0:1746143684.118398:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9087 00000100:00100000:1.0:1746143684.118403:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592035968:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143684.118414:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.118425:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d59e200/0xe984082ccd7244db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0af0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.118458:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593651968:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143684.118500:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.119169:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143684.120086:0:15784:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff88008f4ed500 x1830963593651968) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 16 pid: 4582 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746143684.120110:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143682 -> 1746143683 00002000:00010000:0.0:1746143684.120112:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143682 -> 1746143683 00010000:00010000:0.0:1746143684.120121:0:15784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 16 pid: 4582 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.120153:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd7244aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1589247) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0abf expref: 16 pid: 4582 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746143684.120167:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593651968:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143684.120184:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.120186:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.120192:0:15784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4c00/0xe984082ccd7244c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0adb expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.120198:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4c00/0xe984082ccd7244c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0adb expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.120223:0:15784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4c00/0xe984082ccd7244c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0adb expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143684.120232:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593652096:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143684.120279:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.120485:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593651840:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143684.120501:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800950d1400/0xe984082ccd7244d4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae9 expref: 26 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.120510:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800950d1400/0xe984082ccd7244d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae9 expref: 26 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.120517:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950d1400, rc 0) 00000100:00100000:3.0:1746143684.120538:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592035840:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4443us (6358us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143684.120545:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9086 00000100:00100000:2.0:1746143684.120864:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592036096 00000100:00100000:2.0:1746143684.120869:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592036096 00000100:00100000:2.0:1746143684.121202:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 550 00000100:00100000:2.0:1746143684.121208:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592036096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.121217:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.121219:0:11106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie e984082ccd7244aa) 00010000:00010000:2.0:1746143684.121220:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.121245:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592036096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 37us (2077us total) trans 0 rc 116/116 00000100:00100000:2.0:1746143684.121249:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 550 00000100:00100000:0.0:1746143684.124914:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e626a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593652096:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143684.124956:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d59e200/0xe984082ccd7244db lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0af0 expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143684.124971:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d59e200/0xe984082ccd7244db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0af0 expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143684.124994:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d59e200, rc 0) 00000100:00100000:0.0:1746143684.125036:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592035968:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6631us (7621us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143684.125043:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9087 00000100:00100000:0.0:1746143684.125320:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.125631:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592036352 00000100:00100000:1.0:1746143684.125638:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592036352 00002000:00100000:1.0:1746143684.125668:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88008e626a00 x1830963592036352/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.125676:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e626a00 with x1830963592036352 ext(1048576->2097151) 00002000:00010000:1.0:1746143684.125680:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e626a00 00000100:00100000:1.0:1746143684.125839:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3242 00000100:00100000:1.0:1746143684.125845:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592036352:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143684.127150:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.127200:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592036608 00000100:00100000:2.0:1746143684.127205:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592036608 00002000:00100000:2.0:1746143684.127225:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff88008e625180 x1830963592036608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.127232:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e625180 with x1830963592036608 ext(4894720->4898815) 00002000:00010000:2.0:1746143684.127235:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e625180 00000100:00100000:2.0:1746143684.127246:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3243 00000100:00100000:2.0:1746143684.127250:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592036608:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143684.127334:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592036608:12345-192.168.202.48@tcp:3:cat.0 Request processed in 83us (198us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143684.127339:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3243 00002000:00100000:2.0:1746143684.127343:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff88008e625180 x1830963592036608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/4536 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.127349:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e625180 with x1830963592036608 ext(4894720->4898815) 00002000:00010000:2.0:1746143684.127351:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e625180 00000100:00100000:0.0:1746143684.130162:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.130687:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592036864 00000100:00100000:2.0:1746143684.130696:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592036864 00002000:00100000:2.0:1746143684.130731:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2777088->2781183) req@ffff88008e625500 x1830963592036864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.130746:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e625500 with x1830963592036864 ext(2777088->2781183) 00002000:00010000:2.0:1746143684.130750:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e625500 00000100:00100000:2.0:1746143684.130769:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3244 00000100:00100000:2.0:1746143684.130776:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592036864:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143684.132392:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592036864:12345-192.168.202.48@tcp:3:cat.0 Request processed in 1610us (2230us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143684.132403:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3244 00002000:00100000:2.0:1746143684.132416:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2777088->2781183) req@ffff88008e625500 x1830963592036864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/4536 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.132424:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e625500 with x1830963592036864 ext(2777088->2781183) 00002000:00010000:2.0:1746143684.132428:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e625500 00000100:00100000:0.0:1746143684.135404:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.136074:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592037120 00000100:00100000:3.0:1746143684.136083:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592037120 00000100:00100000:3.0:1746143684.136868:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3297 00000100:00100000:3.0:1746143684.136877:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+273:28116:x1830963592037120:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143684.137062:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+274:28116:x1830963592037120:12345-192.168.202.48@tcp:35:cat.0 Request processed in 186us (1665us total) trans 8589942245 rc 0/0 00000100:00100000:3.0:1746143684.137068:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3297 00000100:00100000:1.0:1746143684.137698:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592036352:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11851us (12376us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143684.137705:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3242 00002000:00100000:1.0:1746143684.137714:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88008e626a00 x1830963592036352/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.137723:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e626a00 with x1830963592036352 ext(1048576->2097151) 00002000:00010000:1.0:1746143684.137728:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e626a00 00000100:00080000:2.0:1746143684.137949:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143684.145678:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.145730:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.145871:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592037248 00000100:00100000:3.0:1746143684.145879:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592037248 00000100:00100000:3.0:1746143684.145914:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592037376 00000100:00100000:3.0:1746143684.145917:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592037376 00000100:00100000:3.0:1746143684.145941:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9088 00000100:00100000:3.0:1746143684.145948:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592037248:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143684.145965:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.145980:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e3b200/0xe984082ccd7244e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0af7 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.145998:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.145999:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143684.146051:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9089 00000100:00100000:1.0:1746143684.146059:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963592037376:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143684.146067:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.146075:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d59ec00/0xe984082ccd7244e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0afe expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.146111:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593652224:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143684.146190:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0600 going to sleep for 11 seconds 00010000:00010000:3.0:1746143684.146373:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e3b200/0xe984082ccd7244e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0af7 expref: 14 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.146389:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e3b200/0xe984082ccd7244e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0af7 expref: 14 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.146397:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e3b200, rc 0) 00000100:00100000:3.0:1746143684.146421:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592037248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 473us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.146427:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9088 00000100:00100000:1.0:1746143684.150507:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593652224:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143684.150536:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d59ec00/0xe984082ccd7244e9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0afe expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.150548:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d59ec00/0xe984082ccd7244e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0afe expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.150981:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d59ec00, rc 0) 00000100:00100000:1.0:1746143684.151345:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963592037376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5285us (5617us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143684.151353:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9089 00000100:00100000:0.0:1746143684.157996:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.158459:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592037632 00000100:00100000:1.0:1746143684.158467:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592037632 00002000:00100000:1.0:1746143684.158504:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008e626300 x1830963592037632/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.158513:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e626300 with x1830963592037632 ext(2097152->3145727) 00002000:00010000:1.0:1746143684.158517:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e626300 00000100:00100000:1.0:1746143684.158544:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3245 00000100:00100000:1.0:1746143684.158552:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592037632:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143684.174739:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592037632:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16178us (16742us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143684.174751:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3245 00002000:00100000:1.0:1746143684.174761:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008e626300 x1830963592037632/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.174769:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e626300 with x1830963592037632 ext(2097152->3145727) 00002000:00010000:1.0:1746143684.174774:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e626300 00000100:00100000:0.0:1746143684.178990:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.179095:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592037760 00000100:00100000:1.0:1746143684.179103:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592037760 00000100:00100000:2.0:1746143684.179788:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9090 00000100:00100000:2.0:1746143684.179796:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28119:x1830963592037760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143684.179812:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143684.179825:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd7244f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b05 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.179847:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.179853:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143684.179854:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143684.179857:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd7244f0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b05 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.179880:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.179889:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 22 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.179898:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593652352:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.179970:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143684.181436:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593652352:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143684.181457:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd7244f0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b05 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.181469:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950d1000, rc 0) 00000100:00100000:2.0:1746143684.181503:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28119:x1830963592037760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1708us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.181509:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9090 00000100:00100000:0.0:1746143684.187515:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.187702:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592037888 00000100:00100000:1.0:1746143684.187709:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592037888 00002000:00100000:1.0:1746143684.187743:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2781183) req@ffff88008e624700 x1830963592037888/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.187751:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624700 with x1830963592037888 ext(2097152->2781183) 00010000:00010000:1.0:1746143684.187759:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 23 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.187769:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 23 pid: 15784 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746143684.187780:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e624700 00000100:00100000:1.0:1746143684.187803:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 778 00000100:00100000:1.0:1746143684.187809:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592037888:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143684.196925:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592037888:12345-192.168.202.48@tcp:4:cat.0 Request processed in 9106us (9408us total) trans 21474839620 rc 0/0 00000100:00100000:0.0:1746143684.196945:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 778 00002000:00100000:0.0:1746143684.196955:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2781183) req@ffff88008e624700 x1830963592037888/t21474839620(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/448 e 0 to 0 dl 1746143695 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143684.196964:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624700 with x1830963592037888 ext(2097152->2781183) 00010000:00010000:0.0:1746143684.196974:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 25 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.196990:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 25 pid: 15784 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746143684.197002:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e624700 00000100:00100000:0.0:1746143684.199941:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.200090:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592038016 00000100:00100000:1.0:1746143684.200098:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592038016 00010000:00010000:1.0:1746143684.200128:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 25 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.200188:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4644 00000100:00100000:1.0:1746143684.200196:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592038016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143684.200209:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143684.200228:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 25 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.200238:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 25 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.200257:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d59f800/0xe984082ccd7244cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2781183) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ae2 expref: 25 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.200286:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.200288:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.200295:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd7244f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b05 expref: 16 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.200307:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd7244f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b05 expref: 16 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.200334:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd7244f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b05 expref: 16 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.200345:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593652480:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143684.200417:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.204682:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593652480:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143684.204702:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143684.204736:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592038016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4541us (4811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.204745:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4644 00000100:00100000:0.0:1746143684.223761:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.223797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.224501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.225464:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592038528 00000100:00100000:2.0:1746143684.225473:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592038528 00002000:00100000:2.0:1746143684.225516:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880091716d80 x1830963592038528/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.225524:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091716d80 with x1830963592038528 ext(3145728->4194303) 00002000:00010000:2.0:1746143684.225529:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091716d80 00000100:00100000:1.0:1746143684.225614:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592038784 00000100:00100000:1.0:1746143684.225618:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592038784 00002000:00100000:1.0:1746143684.225634:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880091715f80 x1830963592038784/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.225640:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091715f80 with x1830963592038784 ext(3145728->4194303) 00002000:00010000:1.0:1746143684.225643:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091715f80 00000100:00100000:1.0:1746143684.225654:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592038272 00000100:00100000:1.0:1746143684.225656:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592038272 00002000:00100000:1.0:1746143684.225664:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880091714000 x1830963592038272/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.225670:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091714000 with x1830963592038272 ext(2097152->3145727) 00002000:00010000:1.0:1746143684.225673:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091714000 00000100:00100000:1.0:1746143684.225688:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3246 00000100:00100000:1.0:1746143684.225694:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592038528:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143684.226974:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3247 00000100:00100000:1.0:1746143684.226982:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592038784:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143684.228183:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3248 00000100:00100000:3.0:1746143684.228192:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592038272:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143684.239107:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592038528:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13403us (15345us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143684.239117:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3246 00002000:00100000:1.0:1746143684.239127:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880091716d80 x1830963592038528/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.239136:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091716d80 with x1830963592038528 ext(3145728->4194303) 00002000:00010000:1.0:1746143684.239155:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091716d80 00000100:00100000:3.0:1746143684.247581:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592038272:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19382us (23071us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143684.247591:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3248 00002000:00100000:3.0:1746143684.247601:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880091714000 x1830963592038272/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143684.247610:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091714000 with x1830963592038272 ext(2097152->3145727) 00002000:00010000:3.0:1746143684.247614:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091714000 00000100:00100000:1.0:1746143684.254088:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592038784:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27100us (30283us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143684.254099:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3247 00002000:00100000:1.0:1746143684.254108:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880091715f80 x1830963592038784/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.254117:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091715f80 with x1830963592038784 ext(3145728->4194303) 00002000:00010000:1.0:1746143684.254121:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091715f80 00000100:00100000:0.0:1746143684.261445:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.261524:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592039040 00000100:00100000:1.0:1746143684.261531:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592039040 00002000:00100000:1.0:1746143684.261566:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880091715500 x1830963592039040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.261576:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091715500 with x1830963592039040 ext(4194304->4898815) 00002000:00010000:1.0:1746143684.261580:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091715500 00000100:00100000:1.0:1746143684.261762:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3249 00000100:00100000:1.0:1746143684.261770:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592039040:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143684.267921:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592039040:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6143us (6473us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143684.267944:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3249 00002000:00100000:1.0:1746143684.267954:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880091715500 x1830963592039040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.267962:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091715500 with x1830963592039040 ext(4194304->4898815) 00002000:00010000:1.0:1746143684.267970:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091715500 00000100:00100000:0.0:1746143684.273479:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.273724:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592039296 00000100:00100000:1.0:1746143684.273733:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592039296 00000100:00100000:1.0:1746143684.273783:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3298 00000100:00100000:1.0:1746143684.273791:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+42:28119:x1830963592039296:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143684.274503:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+43:28119:x1830963592039296:12345-192.168.202.48@tcp:35:cat.0 Request processed in 710us (1028us total) trans 8589942246 rc 0/0 00000100:00100000:1.0:1746143684.274509:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3298 00000100:00100000:0.0:1746143684.288954:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.289052:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592039552 00000100:00100000:3.0:1746143684.289059:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592039552 00000100:00100000:3.0:1746143684.289098:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8168 00000100:00100000:3.0:1746143684.289105:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+274:28124:x1830963592039552:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143684.289127:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.289166:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd7244f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b0c expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.289258:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7244fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289269:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7244fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289278:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7244fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289291:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd724505 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289296:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd724505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289302:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd724505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289394:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd400/0xe984082ccd72450c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289403:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd400/0xe984082ccd72450c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289408:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd400/0xe984082ccd72450c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143684.289416:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143684.289485:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7244fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289490:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7244fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289496:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7244fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289500:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e3a200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143684.289503:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7244fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289508:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7244fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289517:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143684.289520:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143684.289523:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7244fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289531:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7244fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289561:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd724505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289566:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd724505 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289570:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd724505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289574:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b51fd600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143684.289576:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd724505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289580:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd724505 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289586:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9dd00) 00010000:00010000:3.0:1746143684.289588:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143684.289590:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd724505 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289594:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd724505 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.289624:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd7244f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b0c expref: 277 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.289635:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd400/0xe984082ccd72450c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b0c expref: 276 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.289644:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.289646:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143684.289648:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b51fd400, rc 0) 00000100:00100000:3.0:1746143684.289704:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+276:28124:x1830963592039552:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 598us (755us total) trans 8589942247 rc 0/0 00000100:00100000:3.0:1746143684.289709:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8168 00000100:00100000:0.0:1746143684.292517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.292567:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.292642:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592039680 00000100:00100000:1.0:1746143684.292650:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592039680 00000100:00100000:1.0:1746143684.292704:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 551 00000100:00100000:1.0:1746143684.292710:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+276:1964:x1830963592039680:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143684.292722:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143684.292743:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd400/0xe984082ccd72450c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b0c expref: 276 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.292763:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143684.292767:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143684.292802:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091714700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+275:1964:x1830963592039680:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 92us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.292808:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 551 00000100:00100000:2.0:1746143684.292917:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592039936 00000100:00100000:2.0:1746143684.292921:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592039936 00000100:00100000:2.0:1746143684.292952:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3299 00000100:00100000:2.0:1746143684.292957:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+275:28124:x1830963592039936:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143684.293103:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+276:28124:x1830963592039936:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 144us (534us total) trans 8589942248 rc 0/0 00000100:00100000:2.0:1746143684.293108:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3299 00000100:00100000:0.0:1746143684.328879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.329032:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592040192 00000100:00100000:2.0:1746143684.329041:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592040192 00000100:00100000:2.0:1746143684.329114:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8169 00000100:00100000:2.0:1746143684.329123:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+43:28127:x1830963592040192:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143684.329504:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143684.329524:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d1400/0xe984082ccd72451a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b13 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.329634:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd724521 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329648:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd724521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329659:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd724521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329672:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b000/0xe984082ccd724528 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329679:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b000/0xe984082ccd724528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329684:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b000/0xe984082ccd724528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329800:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b200/0xe984082ccd72452f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329811:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b200/0xe984082ccd72452f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329817:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b200/0xe984082ccd72452f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143684.329826:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143684.329910:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd724521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329916:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd724521 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329921:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd724521 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329926:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800950d0400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143684.329929:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd724521 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329942:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd724521 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329951:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143684.329953:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143684.329956:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd724521 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.329960:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd724521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.332267:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b000/0xe984082ccd724528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.332278:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b000/0xe984082ccd724528 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.332284:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b000/0xe984082ccd724528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.332289:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009518b000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143684.332292:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b000/0xe984082ccd724528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.332297:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b000/0xe984082ccd724528 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.332309:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a500) 00010000:00010000:2.0:1746143684.332312:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143684.332314:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b000/0xe984082ccd724528 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.332319:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b000/0xe984082ccd724528 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.332370:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d1400/0xe984082ccd72451a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b13 expref: 46 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.332381:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b200/0xe984082ccd72452f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b13 expref: 45 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.332386:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143684.332389:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143684.332391:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009518b200, rc 0) 00000100:00100000:2.0:1746143684.332455:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+45:28127:x1830963592040192:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3332us (3584us total) trans 8589942249 rc 0/0 00000100:00100000:2.0:1746143684.332462:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8169 00000100:00100000:0.0:1746143684.337301:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.337370:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592040320 00000100:00100000:3.0:1746143684.337377:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592040320 00000100:00100000:3.0:1746143684.337433:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 552 00000100:00100000:3.0:1746143684.337439:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+45:1963:x1830963592040320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.337450:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.337469:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009518b200/0xe984082ccd72452f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b13 expref: 45 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.337496:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.337500:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.337535:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+44:1963:x1830963592040320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 95us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.337541:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 552 00000100:00100000:0.0:1746143684.360594:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.360691:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592040448 00000100:00100000:2.0:1746143684.360699:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592040448 00000100:00100000:2.0:1746143684.360739:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9091 00000100:00100000:2.0:1746143684.360746:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28124:x1830963592040448:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143684.360762:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143684.360776:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b1a expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.360800:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd7244bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ad4 expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.360808:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e3b200/0xe984082ccd7244e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0af7 expref: 13 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143684.360812:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.360814:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.360817:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3129344->3145727] (req 3129344->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 29 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.360837:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e3b200/0xe984082ccd7244e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0af7 expref: 13 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143684.360847:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e3b200/0xe984082ccd7244e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0af7 expref: 13 pid: 6929 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746143684.360858:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593652608:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143684.362277:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd7244bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ad4 expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.362286:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd7244bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ad4 expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.362295:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593652736:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.362758:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143684.365845:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593652608:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.365855:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593652736:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143684.365877:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3129344->3145727] (req 3129344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 29 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.365892:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009518bc00, rc 0) 00000100:00100000:2.0:1746143684.365944:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28124:x1830963592040448:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5198us (5358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.365951:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9091 00000100:00100000:0.0:1746143684.366557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.366802:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592040576 00000100:00100000:2.0:1746143684.366807:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592040576 00010000:00010000:2.0:1746143684.366829:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd7244bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ad4 expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.366968:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4645 00000100:00100000:2.0:1746143684.366980:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091714a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592040576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.366994:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.367019:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd7244bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ad4 expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.367029:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd7244bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ad4 expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.367050:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d59f000/0xe984082ccd7244bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ad4 expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.368153:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.368195:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091714a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592040576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1218us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.368201:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4645 00000100:00100000:0.0:1746143684.374880:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.375049:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592040704 00000100:00100000:2.0:1746143684.375057:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592040704 00010000:00010000:2.0:1746143684.375087:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e3b200/0xe984082ccd7244e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0af7 expref: 14 pid: 6929 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.375745:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4646 00000100:00100000:3.0:1746143684.375755:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592040704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.375767:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.375786:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e3b200/0xe984082ccd7244e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0af7 expref: 14 pid: 6929 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746143684.375802:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e3b200/0xe984082ccd7244e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0af7 expref: 14 pid: 6929 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746143684.375820:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e3b200/0xe984082ccd7244e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0af7 expref: 14 pid: 6929 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746143684.375845:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.375847:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.375853:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 27 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.375860:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 27 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.375890:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 27 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.375901:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593652864:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143684.375984:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.378236:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.378692:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592040960 00000100:00100000:3.0:1746143684.378700:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592040960 00000100:00100000:3.0:1746143684.378745:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8170 00000100:00100000:3.0:1746143684.378751:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+276:28131:x1830963592040960:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143684.378772:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.378786:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd724544 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b21 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.379120:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd72454b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379132:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd72454b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379169:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd72454b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379181:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724552 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379187:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724552 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379192:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724552 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379285:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd724559 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379293:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd724559 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379298:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd724559 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143684.379305:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143684.379364:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd72454b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379369:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd72454b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379378:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd72454b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379382:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e3a400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143684.379385:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd72454b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379389:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd72454b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379397:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143684.379399:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143684.379402:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd72454b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379406:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd72454b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379414:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724552 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379417:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724552 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379421:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724552 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379425:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c176a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143684.379426:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724552 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379430:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724552 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379437:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9d600) 00010000:00010000:3.0:1746143684.379439:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143684.379441:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724552 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379444:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724552 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.379470:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd724544 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b21 expref: 279 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.379477:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd724559 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b21 expref: 278 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.379482:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.379484:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143684.379485:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c177600, rc 0) 00000100:00100000:3.0:1746143684.379523:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+278:28131:x1830963592040960:12345-192.168.202.48@tcp:101:cat.0 Request processed in 772us (1291us total) trans 8589942250 rc 0/0 00000100:00100000:3.0:1746143684.379528:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8170 00000100:00100000:3.0:1746143684.380189:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593652864:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143684.380204:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.380239:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592040704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4485us (5367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.380246:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4646 00000100:00100000:0.0:1746143684.383525:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.385841:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.385896:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.385921:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.385957:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592041472 00000100:00100000:0.0:1746143684.385967:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592041472 00000100:00100000:0.0:1746143684.386005:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592041600 00000100:00100000:0.0:1746143684.386009:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592041600 00000100:00100000:0.0:1746143684.386030:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9092 00000100:00100000:0.0:1746143684.386038:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592041472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143684.386057:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143684.386063:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9093 00000100:00100000:3.0:1746143684.386071:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592041600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143684.386075:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6000/0xe984082ccd724567 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b28 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.386080:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.386088:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c176800/0xe984082ccd72456e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b2f expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.386100:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.386101:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.386108:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c176800/0xe984082ccd72456e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b2f expref: 27 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.386120:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c176800/0xe984082ccd72456e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b2f expref: 27 pid: 6929 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143684.386127:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091717b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593652992:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143684.386231:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143684.386289:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.386312:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592041728 00000100:00100000:0.0:1746143684.386316:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592041728 00000100:00100000:0.0:1746143684.386353:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9094 00000100:00100000:0.0:1746143684.386360:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592041728:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143684.386368:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143684.386378:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7400/0xe984082ccd724575 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b36 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.386391:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.386392:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.386398:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7400/0xe984082ccd724575 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b36 expref: 29 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143684.386410:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7400/0xe984082ccd724575 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b36 expref: 29 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143684.386419:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc7400, rc 0) 00000100:00100000:0.0:1746143684.386447:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592041728:12345-192.168.202.48@tcp:101:cat.0 Request processed in 86us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143684.386453:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9094 00000100:00100000:1.0:1746143684.387608:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592041216 00000100:00100000:1.0:1746143684.387616:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592041216 00002000:00100000:1.0:1746143684.387651:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3129344->3133439) req@ffff880091717800 x1830963592041216/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.387661:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091717800 with x1830963592041216 ext(3129344->3133439) 00002000:00010000:1.0:1746143684.387665:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091717800 00000100:00100000:1.0:1746143684.387688:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3250 00000100:00100000:1.0:1746143684.387695:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592041216:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143684.387873:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592041216:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 176us (4353us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143684.387879:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3250 00002000:00100000:1.0:1746143684.387885:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3129344->3133439) req@ffff880091717800 x1830963592041216/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/4536 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.387891:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091717800 with x1830963592041216 ext(3129344->3133439) 00002000:00010000:1.0:1746143684.387894:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091717800 00000100:00100000:1.0:1746143684.388013:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592041344 00000100:00100000:1.0:1746143684.388019:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592041344 00000100:00100000:1.0:1746143684.388051:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 553 00000100:00100000:1.0:1746143684.388058:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+278:1965:x1830963592041344:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143684.388069:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143684.388089:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd724559 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b21 expref: 278 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.388109:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143684.388114:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143684.388136:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+277:1965:x1830963592041344:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 79us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.388160:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 553 00010000:00010000:3.0:1746143684.389106:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c176800, rc 0) 00000100:00100000:3.0:1746143684.389133:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592041600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3063us (3211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.389151:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9093 00000100:00100000:1.0:1746143684.392225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.392290:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592041856 00000100:00100000:3.0:1746143684.392297:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592041856 00002000:00010000:0.0:1746143684.392329:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143683 -> 1746143684 00000100:00100000:3.0:1746143684.392341:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9095 00000100:00100000:3.0:1746143684.392347:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28124:x1830963592041856:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:0.0:1746143684.392348:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091717b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593652992:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143684.392361:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.392375:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b3d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.392375:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6000/0xe984082ccd724567 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b28 expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143684.392385:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6000/0xe984082ccd724567 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b28 expref: 29 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.392396:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd7244f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b05 expref: 16 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.392407:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7400/0xe984082ccd724575 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b36 expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.392412:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.392413:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.392416:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2617343] (req 2097152->2617343) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.392440:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7400/0xe984082ccd724575 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b36 expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.392451:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7400/0xe984082ccd724575 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b36 expref: 28 pid: 4582 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.392460:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593653120:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143684.392958:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc6000, rc 0) 00010000:00010000:3.0:1746143684.393425:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd7244f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b05 expref: 16 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.393433:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd7244f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b05 expref: 16 pid: 21542 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.393441:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593653248:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143684.394356:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592041472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8314us (8456us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143684.394365:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9092 00000100:00100000:3.0:1746143684.395069:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.407594:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593653120:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143684.408953:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.409004:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.409049:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.409076:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592042240 00000100:00100000:1.0:1746143684.409083:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592042240 00000100:00100000:1.0:1746143684.409126:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9096 00000100:00100000:1.0:1746143684.409133:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28131:x1830963592042240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143684.409173:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.409192:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ee00/0xe984082ccd724583 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b44 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.409222:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.409235:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143684.409236:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143684.409240:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ee00/0xe984082ccd724583 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b44 expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.409269:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.409280:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 16 pid: 6929 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.409291:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593653376:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143684.409400:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.409426:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592041984 00000100:00100000:1.0:1746143684.409431:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592041984 00010000:00010000:1.0:1746143684.409451:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7400/0xe984082ccd724575 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b36 expref: 30 pid: 4582 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746143684.409471:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592042112 00000100:00100000:1.0:1746143684.409474:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592042112 00010000:00010000:1.0:1746143684.409487:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd7244f0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b05 expref: 17 pid: 21542 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.409512:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4647 00000100:00100000:1.0:1746143684.409519:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963592041984:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143684.409529:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143684.409552:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7400/0xe984082ccd724575 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b36 expref: 30 pid: 4582 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746143684.409561:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7400/0xe984082ccd724575 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b36 expref: 30 pid: 4582 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746143684.409577:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7400/0xe984082ccd724575 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b36 expref: 30 pid: 4582 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746143684.409599:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143684.409627:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592041984:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 108us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.409634:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4647 00000100:00100000:1.0:1746143684.409651:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4648 00000100:00100000:1.0:1746143684.409657:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592042112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143684.409664:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143684.409674:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd7244f0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b05 expref: 17 pid: 21542 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.409683:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd7244f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b05 expref: 17 pid: 21542 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.409694:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.409696:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.409701:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.409713:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.409736:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.409746:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e624380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593653504:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143684.409775:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746143684.409990:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd7244f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b05 expref: 17 pid: 21542 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.410003:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593653248:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.410022:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.410030:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c177e00, rc 0) 00000100:00100000:3.0:1746143684.410050:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28124:x1830963592041856:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 17704us (17832us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.410056:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9095 00000100:00100000:2.0:1746143684.412134:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e624000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593653376:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143684.412298:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ee00/0xe984082ccd724583 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b44 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.412314:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5ee00, rc 0) 00000100:00100000:2.0:1746143684.412622:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:28131:x1830963592042240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3487us (3573us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.412630:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9096 00000100:00100000:0.0:1746143684.413894:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.413905:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e624380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593653504:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143684.413943:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592042368 00000100:00100000:2.0:1746143684.413949:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592042368 00002000:00100000:2.0:1746143684.413982:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1802240->2097151) req@ffff880091717b80 x1830963592042368/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.413991:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091717b80 with x1830963592042368 ext(1802240->2097151) 00010000:00010000:2.0:1746143684.413998:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 17 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.414010:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 17 pid: 6929 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746143684.414016:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091717b80 00000100:00100000:2.0:1746143684.414032:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 779 00000100:00100000:2.0:1746143684.414038:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592042368:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:1.0:1746143684.414554:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143684.414584:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592042112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4927us (5579us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.414591:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4648 00000100:00100000:2.0:1746143684.422561:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592042368:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8511us (8658us total) trans 21474839621 rc 0/0 00000100:00100000:2.0:1746143684.422573:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 779 00002000:00100000:2.0:1746143684.422586:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1802240->2097151) req@ffff880091717b80 x1830963592042368/t21474839621(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/448 e 0 to 0 dl 1746143695 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.422601:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091717b80 with x1830963592042368 ext(1802240->2097151) 00010000:00010000:2.0:1746143684.422611:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 18 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.422626:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 18 pid: 6929 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746143684.422633:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091717b80 00000100:00100000:1.0:1746143684.441979:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.442044:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592042624 00000100:00100000:2.0:1746143684.442053:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592042624 00002000:00100000:2.0:1746143684.442093:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2613248->2617343) req@ffff88008e624380 x1830963592042624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.442101:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624380 with x1830963592042624 ext(2613248->2617343) 00002000:00010000:2.0:1746143684.442106:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e624380 00000100:00100000:2.0:1746143684.442133:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3251 00000100:00100000:2.0:1746143684.442161:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592042624:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143684.442329:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592042624:12345-192.168.202.48@tcp:3:cat.0 Request processed in 189us (356us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143684.442335:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3251 00002000:00100000:2.0:1746143684.442340:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2613248->2617343) req@ffff88008e624380 x1830963592042624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/4536 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.442347:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624380 with x1830963592042624 ext(2613248->2617343) 00002000:00010000:2.0:1746143684.442349:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e624380 00000100:00100000:2.0:1746143684.442868:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.443015:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592042752 00000100:00100000:1.0:1746143684.443019:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592042752 00010000:00010000:1.0:1746143684.443039:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 18 pid: 6929 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.443066:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4649 00000100:00100000:1.0:1746143684.443072:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592042752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143684.443080:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143684.443094:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 18 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.443108:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 18 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.443126:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a25400/0xe984082ccd724479 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0aaa expref: 18 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.443162:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.443164:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.443171:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ee00/0xe984082ccd724583 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b44 expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.443178:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ee00/0xe984082ccd724583 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b44 expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.443204:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ee00/0xe984082ccd724583 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b44 expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.443214:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e627480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593653632:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143684.443274:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.455527:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e627480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593653632:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143684.455546:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143684.455596:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592042752:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12523us (12727us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.455605:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4649 00000100:00100000:1.0:1746143684.462283:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.462348:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592043008 00000100:00100000:0.0:1746143684.462356:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592043008 00002000:00100000:0.0:1746143684.462391:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008e627480 x1830963592043008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143684.462401:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e627480 with x1830963592043008 ext(1048576->2097151) 00002000:00010000:0.0:1746143684.462406:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e627480 00000100:00100000:0.0:1746143684.462434:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3252 00000100:00100000:0.0:1746143684.462441:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592043008:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143684.473134:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.473240:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592043264 00000100:00100000:2.0:1746143684.473249:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592043264 00002000:00100000:2.0:1746143684.473286:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880091714700 x1830963592043264/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.473295:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091714700 with x1830963592043264 ext(1048576->2097151) 00002000:00010000:2.0:1746143684.473299:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091714700 00000100:00100000:2.0:1746143684.473327:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3253 00000100:00100000:2.0:1746143684.473333:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592043264:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143684.475199:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592043008:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12751us (12916us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143684.475208:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3252 00002000:00100000:2.0:1746143684.475216:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008e627480 x1830963592043008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.475224:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e627480 with x1830963592043008 ext(1048576->2097151) 00002000:00010000:2.0:1746143684.475228:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e627480 00000100:00100000:0.0:1746143684.479378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.479642:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592043392 00000100:00100000:2.0:1746143684.479649:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592043392 00000100:00100000:2.0:1746143684.479767:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9097 00000100:00100000:2.0:1746143684.479775:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28127:x1830963592043392:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143684.479790:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143684.479803:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b4b expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.479828:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.479838:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143684.479840:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143684.479843:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2686976->3145727] (req 2686976->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 18 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.479866:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.479875:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 28 pid: 6929 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.479883:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593653760:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.479955:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.486875:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.486951:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592043520 00000100:00100000:3.0:1746143684.486958:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592043520 00002000:00100000:3.0:1746143684.486996:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2617343) req@ffff88008e624000 x1830963592043520/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143684.487004:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624000 with x1830963592043520 ext(2097152->2617343) 00010000:00010000:3.0:1746143684.487012:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.487024:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746143684.487030:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e624000 00000100:00100000:3.0:1746143684.487048:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 780 00000100:00100000:3.0:1746143684.487055:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592043520:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143684.487821:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592043264:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14486us (14692us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143684.487828:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3253 00002000:00100000:3.0:1746143684.487834:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880091714700 x1830963592043264/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143684.487841:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091714700 with x1830963592043264 ext(1048576->2097151) 00002000:00010000:3.0:1746143684.487844:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091714700 00000100:00100000:2.0:1746143684.487946:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593653760:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143684.487967:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2686976->3145727] (req 2686976->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 18 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.487980:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095387200, rc 0) 00000100:00100000:2.0:1746143684.487998:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28127:x1830963592043392:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8225us (8628us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.488005:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9097 00000100:00100000:0.0:1746143684.501845:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.501912:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592043776 00000100:00100000:2.0:1746143684.501919:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592043776 00002000:00100000:2.0:1746143684.501964:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3129343) req@ffff880091714a80 x1830963592043776/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.501980:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091714a80 with x1830963592043776 ext(2097152->3129343) 00002000:00010000:2.0:1746143684.501984:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091714a80 00000100:00100000:1.0:1746143684.502864:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3254 00000100:00100000:1.0:1746143684.502874:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592043776:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143684.506027:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592043520:12345-192.168.202.48@tcp:4:cat.0 Request processed in 18962us (19148us total) trans 21474839622 rc 0/0 00000100:00100000:3.0:1746143684.506037:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 780 00002000:00100000:3.0:1746143684.506047:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2617343) req@ffff88008e624000 x1830963592043520/t21474839622(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/448 e 0 to 0 dl 1746143695 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143684.506056:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624000 with x1830963592043520 ext(2097152->2617343) 00010000:00010000:3.0:1746143684.506064:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.506078:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746143684.506084:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e624000 00000100:00100000:0.0:1746143684.512250:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.512317:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592043904 00000100:00100000:1.0:1746143684.512326:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592043904 00010000:00010000:1.0:1746143684.512356:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.512390:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4650 00000100:00100000:1.0:1746143684.512397:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592043904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143684.512409:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143684.512426:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143683 -> 1746143684 00002000:00010000:1.0:1746143684.512428:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143683 -> 1746143684 00010000:00010000:1.0:1746143684.512433:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.512444:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.512462:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c177e00/0xe984082ccd72457c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2617343) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b3d expref: 29 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.512489:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.512491:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.512498:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 17 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.512510:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 17 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.512538:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 17 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.512549:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593653888:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143684.512631:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.515582:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592043776:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12703us (13738us total) trans 0 rc 1032192/1032192 00000100:00100000:1.0:1746143684.515591:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3254 00002000:00100000:1.0:1746143684.515601:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3129343) req@ffff880091714a80 x1830963592043776/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1032192/1032192 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.515609:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091714a80 with x1830963592043776 ext(2097152->3129343) 00002000:00010000:1.0:1746143684.515614:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091714a80 00000100:00100000:2.0:1746143684.516002:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593653888:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143684.516022:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.516045:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592043904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3648us (3803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.516052:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4650 00000100:00100000:0.0:1746143684.517914:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.519763:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592044160 00000100:00100000:1.0:1746143684.519772:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592044160 00002000:00100000:1.0:1746143684.519813:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2686976->2691071) req@ffff880093502300 x1830963592044160/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.519821:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502300 with x1830963592044160 ext(2686976->2691071) 00002000:00010000:1.0:1746143684.519826:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093502300 00000100:00100000:1.0:1746143684.519862:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3255 00000100:00100000:1.0:1746143684.519868:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592044160:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143684.520030:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592044160:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 161us (2120us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143684.520036:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3255 00002000:00100000:1.0:1746143684.520040:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2686976->2691071) req@ffff880093502300 x1830963592044160/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/4536 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.520046:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502300 with x1830963592044160 ext(2686976->2691071) 00002000:00010000:1.0:1746143684.520048:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093502300 00000100:00100000:0.0:1746143684.525222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.525406:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592044288 00000100:00100000:2.0:1746143684.525413:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592044288 00000100:00100000:2.0:1746143684.525620:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9098 00000100:00100000:2.0:1746143684.525628:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28131:x1830963592044288:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143684.525647:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143684.525664:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd724591 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b52 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.525694:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 17 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.525701:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143684.525703:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143684.525706:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd724591 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b52 expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.525733:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 17 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.525747:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 17 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.525757:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593654016:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.526597:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143684.532315:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.532339:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.532366:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.532444:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592044544 00000100:00100000:1.0:1746143684.532452:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592044544 00002000:00100000:1.0:1746143684.532487:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2686976->3145727) req@ffff880093501180 x1830963592044544/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143684.532495:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501180 with x1830963592044544 ext(2686976->3145727) 00010000:00010000:1.0:1746143684.532503:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 18 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.532514:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 18 pid: 15784 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746143684.532520:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093501180 00000100:00100000:1.0:1746143684.532536:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 781 00000100:00100000:1.0:1746143684.532541:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592044544:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143684.532971:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592044672 00000100:00100000:1.0:1746143684.532974:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592044672 00000100:00100000:1.0:1746143684.532998:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9099 00000100:00100000:1.0:1746143684.533003:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28127:x1830963592044672:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143684.533011:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.533024:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b59 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.533043:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 27 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.533049:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143684.533051:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143684.533054:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->3407871] (req 3145728->3407871) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.533080:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 27 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.533089:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 27 pid: 21542 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.533098:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593654144:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143684.533167:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.533240:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592044928 00000100:00100000:3.0:1746143684.533244:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592044928 00000100:00100000:3.0:1746143684.533278:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8171 00000100:00100000:3.0:1746143684.533283:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+44:28135:x1830963592044928:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143684.533297:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.533306:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72459f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b60 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.533386:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7245a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533395:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7245a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533403:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7245a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533413:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd7245ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533418:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd7245ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533422:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd7245ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533644:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd400/0xe984082ccd7245b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533652:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd400/0xe984082ccd7245b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533657:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd400/0xe984082ccd7245b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143684.533666:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143684.533733:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7245a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533741:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7245a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533746:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7245a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533751:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e3a200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143684.533754:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7245a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533760:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7245a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533768:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143684.533771:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143684.533773:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7245a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533777:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7245a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533788:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd7245ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533792:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd7245ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533795:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd7245ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533798:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e3a400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143684.533800:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd7245ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533807:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd7245ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533812:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9d000) 00010000:00010000:3.0:1746143684.533814:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143684.533816:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd7245ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533819:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3a400/0xe984082ccd7245ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.533848:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72459f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b60 expref: 47 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.533857:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd400/0xe984082ccd7245b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b60 expref: 46 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.533861:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.533862:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143684.533864:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b51fd400, rc 0) 00000100:00100000:3.0:1746143684.533890:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+46:28135:x1830963592044928:12345-192.168.202.48@tcp:101:cat.0 Request processed in 607us (1580us total) trans 8589942251 rc 0/0 00000100:00100000:3.0:1746143684.533895:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8171 00000100:00100000:3.0:1746143684.533945:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593654016:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.533962:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd724591 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b52 expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.533971:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095387c00, rc 0) 00000100:00100000:3.0:1746143684.533987:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28131:x1830963592044288:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8361us (8772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.533991:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9098 00000100:00100000:1.0:1746143684.540936:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.541374:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593654144:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143684.541402:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->3407871] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.541419:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5805000, rc 0) 00000100:00100000:1.0:1746143684.541454:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28127:x1830963592044672:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8450us (9086us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.541462:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9099 00000100:00100000:1.0:1746143684.541498:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.541511:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592045184 00000100:00100000:1.0:1746143684.541516:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592045184 00000100:00100000:3.0:1746143684.541683:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592045056 00000100:00100000:3.0:1746143684.541687:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592045056 00000100:00100000:3.0:1746143684.541714:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 554 00000100:00100000:3.0:1746143684.541720:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+46:1965:x1830963592045056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.541730:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.541748:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd400/0xe984082ccd7245b4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b60 expref: 46 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.541760:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.541764:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.541777:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+45:1965:x1830963592045056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 58us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.541782:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 554 00000100:00100000:3.0:1746143684.541815:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.542702:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.542716:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592045568 00000100:00100000:0.0:1746143684.542719:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592045568 00002000:00100000:0.0:1746143684.542742:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3129344->3145727) req@ffff880093500000 x1830963592045568/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 16872/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143684.542750:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500000 with x1830963592045568 ext(3129344->3145727) 00010000:00010000:0.0:1746143684.542756:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 28 pid: 21542 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.542764:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 28 pid: 21542 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746143684.542770:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093500000 00000100:00100000:1.0:1746143684.542835:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592045440 00000100:00100000:1.0:1746143684.542838:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592045440 00000100:00100000:3.0:1746143684.542866:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9100 00000100:00100000:3.0:1746143684.542873:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592045184:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143684.542885:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.542895:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd7245c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b67 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.542909:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.542911:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.542918:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd7245c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b67 expref: 22 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.542941:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd7245c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b67 expref: 22 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.542948:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b51fd600, rc 0) 00000100:00100000:3.0:1746143684.542965:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592045184:12345-192.168.202.48@tcp:101:cat.0 Request processed in 93us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.542970:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9100 00000100:00100000:3.0:1746143684.542981:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9101 00000100:00100000:3.0:1746143684.542985:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592045440:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143684.542990:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.542997:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3b200/0xe984082ccd7245c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b75 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.543027:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593654272:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143684.543072:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.543103:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.549168:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 782 00000100:00100000:0.0:1746143684.549181:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592045568:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143684.549514:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592045568:12345-192.168.202.48@tcp:4:cat.0 Request processed in 336us (6812us total) trans 17179872355 rc 0/0 00000100:00100000:0.0:1746143684.549520:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 782 00002000:00100000:0.0:1746143684.549528:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3129344->3145727) req@ffff880093500000 x1830963592045568/t17179872355(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 16872/448 e 0 to 0 dl 1746143695 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143684.549537:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500000 with x1830963592045568 ext(3129344->3145727) 00010000:00010000:0.0:1746143684.549544:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 30 pid: 21542 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.549559:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 30 pid: 21542 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746143684.549565:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093500000 00000100:00100000:1.0:1746143684.550418:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592045312 00000100:00100000:1.0:1746143684.550425:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592045312 00000100:00100000:1.0:1746143684.550452:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9102 00000100:00100000:1.0:1746143684.550458:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592045312:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143684.550467:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.550479:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5804600/0xe984082ccd7245d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b6e expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.550517:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593654400:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143684.550558:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143684.551733:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963592044544:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 19189us (19390us total) trans 21474839623 rc 0/0 00000100:00100000:2.0:1746143684.551741:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 781 00002000:00100000:2.0:1746143684.551747:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2686976->3145727) req@ffff880093501180 x1830963592044544/t21474839623(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/448 e 0 to 0 dl 1746143695 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.551755:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501180 with x1830963592044544 ext(2686976->3145727) 00010000:00010000:2.0:1746143684.551761:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 23 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.551771:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 23 pid: 15784 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746143684.551777:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093501180 00000100:00100000:0.0:1746143684.556094:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:3.0:1746143684.556124:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143683 -> 1746143684 00000100:00100000:3.0:1746143684.556156:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593654272:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143684.556163:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143684.556184:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3b200/0xe984082ccd7245c9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b75 expref: 22 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.556201:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3b200/0xe984082ccd7245c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b75 expref: 22 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.556213:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e3b200, rc 0) 00010000:00010000:1.0:1746143684.556225:0:8497:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff88009ff6ca80 x1830963593654400) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 29 pid: 21542 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746143684.556241:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143683 -> 1746143684 00002000:00010000:1.0:1746143684.556243:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143683 -> 1746143684 00002000:00010000:1.0:1746143684.556245:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143683 -> 1746143684 00010000:00010000:1.0:1746143684.556251:0:8497:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 29 pid: 21542 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.556252:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592045440:12345-192.168.202.48@tcp:101:cat.0 Request processed in 13266us (14436us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143684.556260:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9101 00010000:00010000:1.0:1746143684.556270:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009518bc00/0xe984082ccd72453d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b1a expref: 29 pid: 21542 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.556281:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593654400:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143684.556284:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592045696 00000100:00100000:3.0:1746143684.556288:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592045696 00010000:00010000:1.0:1746143684.556297:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.556298:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.556304:0:8497:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.556310:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592045824 00010000:00010000:1.0:1746143684.556311:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.556312:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592045824 00010000:00010000:3.0:1746143684.556319:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 21 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.556331:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4651 00010000:00010000:1.0:1746143684.556334:0:8497:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.556336:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592045824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.556344:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143684.556344:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593654528:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143684.556352:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 21 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.556358:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 21 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.556368:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095387200/0xe984082ccd72458a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b4b expref: 21 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.556376:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.556377:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.556380:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd724591 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b52 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.556386:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd724591 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b52 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.556386:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.556400:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 555 00010000:00010000:3.0:1746143684.556402:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd724591 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b52 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.556405:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592045696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143684.556408:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593654656:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143684.556412:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143684.556414:0:11106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie e984082ccd72453d) 00010000:00010000:1.0:1746143684.556415:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.556425:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.556425:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592045696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 21us (339us total) trans 0 rc 116/116 00000100:00100000:1.0:1746143684.556433:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 555 00000100:00100000:1.0:1746143684.557545:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593654528:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143684.557561:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5804600/0xe984082ccd7245d0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b6e expref: 15 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.557574:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5804600/0xe984082ccd7245d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b6e expref: 15 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.557581:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5804600, rc 0) 00000100:00100000:1.0:1746143684.557602:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592045312:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7144us (14498us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143684.557607:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9102 00000100:00100000:0.0:1746143684.560059:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.560075:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593654656:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143684.560092:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.560158:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592045824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3800us (3972us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.560167:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4651 00000100:00100000:2.0:1746143684.560257:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592046208 00000100:00100000:2.0:1746143684.560262:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592046208 00002000:00100000:2.0:1746143684.560289:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3403776->3407871) req@ffff880093503800 x1830963592046208/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.560298:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503800 with x1830963592046208 ext(3403776->3407871) 00002000:00010000:2.0:1746143684.560302:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093503800 00000100:00100000:2.0:1746143684.560314:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3256 00000100:00100000:2.0:1746143684.560319:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592046208:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143684.560443:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592046208:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 123us (390us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143684.560449:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3256 00002000:00100000:2.0:1746143684.560454:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3403776->3407871) req@ffff880093503800 x1830963592046208/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/4536 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.560460:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503800 with x1830963592046208 ext(3403776->3407871) 00002000:00010000:2.0:1746143684.560463:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093503800 00000100:00100000:0.0:1746143684.561183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.561415:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592046464 00000100:00100000:2.0:1746143684.561419:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592046464 00002000:00100000:2.0:1746143684.561437:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880093502d80 x1830963592046464/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.561444:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502d80 with x1830963592046464 ext(2097152->3145727) 00002000:00010000:2.0:1746143684.561447:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093502d80 00000100:00100000:2.0:1746143684.561467:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3257 00000100:00100000:2.0:1746143684.561472:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592046464:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143684.565673:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.565696:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592046720 00000100:00100000:3.0:1746143684.565704:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592046720 00000100:00100000:3.0:1746143684.565747:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3300 00000100:00100000:3.0:1746143684.565754:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+45:28127:x1830963592046720:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143684.565976:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+46:28127:x1830963592046720:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 221us (309us total) trans 8589942252 rc 0/0 00000100:00100000:3.0:1746143684.565982:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3300 00010000:00010000:3.0:1746143684.569258:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143684.569556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.569954:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592046976 00000100:00100000:2.0:1746143684.569962:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592046976 00002000:00100000:2.0:1746143684.570000:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093500380 x1830963592046976/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.570009:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500380 with x1830963592046976 ext(1048576->2097151) 00002000:00010000:2.0:1746143684.570013:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093500380 00000100:00100000:2.0:1746143684.570029:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3258 00000100:00100000:2.0:1746143684.570035:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592046976:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143684.580572:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592046464:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19090us (19379us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143684.580582:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3257 00002000:00100000:2.0:1746143684.580593:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880093502d80 x1830963592046464/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.580603:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502d80 with x1830963592046464 ext(2097152->3145727) 00002000:00010000:2.0:1746143684.580608:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093502d80 00000100:00100000:2.0:1746143684.584700:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592046976:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14657us (15141us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143684.584709:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3258 00002000:00100000:2.0:1746143684.584718:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093500380 x1830963592046976/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.584725:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500380 with x1830963592046976 ext(1048576->2097151) 00002000:00010000:2.0:1746143684.584730:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093500380 00000100:00100000:0.0:1746143684.590753:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.591432:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592047104 00000100:00100000:1.0:1746143684.591440:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592047104 00000100:00100000:1.0:1746143684.591488:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9103 00000100:00100000:1.0:1746143684.591495:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28131:x1830963592047104:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143684.591510:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.591524:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9c00/0xe984082ccd7245d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b7c expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.591549:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.591556:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143684.591558:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143684.591561:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9c00/0xe984082ccd7245d7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b7c expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.591585:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.591595:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 13 pid: 8497 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.591605:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593654784:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143684.591674:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143684.595595:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.595685:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592047232 00000100:00100000:2.0:1746143684.595693:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592047232 00002000:00100000:2.0:1746143684.595730:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3407871) req@ffff880093500700 x1830963592047232/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.595739:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500700 with x1830963592047232 ext(3145728->3407871) 00010000:00010000:2.0:1746143684.595746:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 14 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.595758:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 14 pid: 8497 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746143684.595764:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093500700 00000100:00100000:2.0:1746143684.595795:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 783 00000100:00100000:2.0:1746143684.595802:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592047232:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143684.596047:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593654784:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143684.596073:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9c00/0xe984082ccd7245d7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b7c expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.596084:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d9c00, rc 0) 00000100:00100000:1.0:1746143684.596122:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28131:x1830963592047104:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4628us (5376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.596129:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9103 00000100:00100000:3.0:1746143684.601376:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592047232:12345-192.168.202.48@tcp:4:cat.0 Request processed in 5565us (5780us total) trans 17179872356 rc 0/0 00000100:00100000:3.0:1746143684.601389:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 783 00002000:00100000:3.0:1746143684.601400:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3407871) req@ffff880093500700 x1830963592047232/t17179872356(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/448 e 0 to 0 dl 1746143695 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143684.601409:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500700 with x1830963592047232 ext(3145728->3407871) 00010000:00010000:3.0:1746143684.601417:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 16 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.601429:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 16 pid: 8497 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746143684.601435:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093500700 00000100:00100000:1.0:1746143684.601579:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.601689:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592047360 00000100:00100000:0.0:1746143684.601695:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592047360 00000100:00100000:0.0:1746143684.601730:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9104 00000100:00100000:0.0:1746143684.601736:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28135:x1830963592047360:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143684.601748:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143684.601759:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7000/0xe984082ccd7245de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b83 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.601778:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143684.601780:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143684.601783:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7000/0xe984082ccd7245de lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b83 expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.601792:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7000/0xe984082ccd7245de lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b83 expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.601806:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc7000, rc 0) 00000100:00100000:0.0:1746143684.601838:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28135:x1830963592047360:12345-192.168.202.48@tcp:101:cat.0 Request processed in 102us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143684.601843:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9104 00000100:00100000:0.0:1746143684.603948:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.604033:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592047488 00000100:00100000:3.0:1746143684.604039:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592047488 00010000:00010000:3.0:1746143684.604061:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 17 pid: 8497 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.604091:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4652 00000100:00100000:3.0:1746143684.604097:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592047488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.604106:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.604123:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 17 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.604453:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 17 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.604476:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd724598 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b59 expref: 17 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.604490:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.604492:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.604498:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9c00/0xe984082ccd7245d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b7c expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.604506:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9c00/0xe984082ccd7245d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b7c expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.604513:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.604514:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.604517:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7000/0xe984082ccd7245de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b83 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.604523:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7000/0xe984082ccd7245de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b83 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.604547:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7000/0xe984082ccd7245de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b83 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.604557:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593654912:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143684.604638:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9c00/0xe984082ccd7245d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b7c expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.604650:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593655040:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143684.604668:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.611870:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593654912:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143684.611880:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593655040:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143684.611897:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143684.611925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.611953:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963592047488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7855us (8009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.611963:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4652 00000100:00100000:2.0:1746143684.613538:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592048128 00000100:00100000:2.0:1746143684.613546:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592048128 00000100:00100000:0.0:1746143684.613562:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:2.0:1746143684.613582:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880093503100 x1830963592048128/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.613591:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503100 with x1830963592048128 ext(2097152->3145727) 00002000:00010000:2.0:1746143684.613595:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093503100 00000100:00100000:0.0:1746143684.613596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.613613:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3259 00000100:00100000:2.0:1746143684.613622:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592047872 00000100:00100000:2.0:1746143684.613625:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592047872 00002000:00100000:2.0:1746143684.613637:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880093502a00 x1830963592047872/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.613644:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502a00 with x1830963592047872 ext(3145728->4194303) 00002000:00010000:2.0:1746143684.613646:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093502a00 00000100:00100000:2.0:1746143684.613660:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592048256 00000100:00100000:2.0:1746143684.613662:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592048256 00002000:00100000:2.0:1746143684.613671:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880093501500 x1830963592048256/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.613678:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501500 with x1830963592048256 ext(3145728->4194303) 00002000:00010000:2.0:1746143684.613680:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093501500 00000100:00100000:0.0:1746143684.613686:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3260 00000100:00100000:2.0:1746143684.613689:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3261 00000100:00100000:2.0:1746143684.613692:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963592048256:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143684.613693:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592047872:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143684.614717:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592048128:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143684.629315:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963592048256:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15613us (15709us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143684.629325:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3261 00002000:00100000:2.0:1746143684.629334:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880093501500 x1830963592048256/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.629343:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501500 with x1830963592048256 ext(3145728->4194303) 00002000:00010000:2.0:1746143684.629348:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093501500 00000100:00100000:2.0:1746143684.636595:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592047872:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22896us (23027us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143684.636603:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3260 00002000:00100000:2.0:1746143684.636611:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880093502a00 x1830963592047872/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.636618:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502a00 with x1830963592047872 ext(3145728->4194303) 00002000:00010000:2.0:1746143684.636622:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093502a00 00000100:00100000:0.0:1746143684.644101:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592048128:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30471us (32166us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143684.644110:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3259 00002000:00100000:0.0:1746143684.644120:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880093503100 x1830963592048128/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143684.644129:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503100 with x1830963592048128 ext(2097152->3145727) 00002000:00010000:0.0:1746143684.644134:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093503100 00000100:00100000:0.0:1746143684.649354:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.649637:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592048512 00000100:00100000:2.0:1746143684.649645:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592048512 00002000:00100000:2.0:1746143684.649680:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880093503b80 x1830963592048512/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.649689:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503b80 with x1830963592048512 ext(4194304->4898815) 00002000:00010000:2.0:1746143684.649693:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093503b80 00000100:00100000:2.0:1746143684.649711:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3262 00000100:00100000:2.0:1746143684.649718:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592048512:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143684.650337:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.650420:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592048640 00000100:00100000:3.0:1746143684.650424:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592048640 00000100:00100000:3.0:1746143684.650455:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9105 00000100:00100000:3.0:1746143684.650461:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28135:x1830963592048640:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143684.650470:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.650484:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cff5000/0xe984082ccd7245e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b8a expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.650500:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.650502:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.650508:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cff5000/0xe984082ccd7245e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b8a expref: 21 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.650520:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cff5000/0xe984082ccd7245e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b8a expref: 21 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.650528:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cff5000, rc 0) 00000100:00100000:3.0:1746143684.650566:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28135:x1830963592048640:12345-192.168.202.48@tcp:101:cat.0 Request processed in 105us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.650572:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9105 00000100:00100000:2.0:1746143684.655936:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592048512:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6204us (6574us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143684.655947:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3262 00002000:00100000:2.0:1746143684.655957:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880093503b80 x1830963592048512/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.655970:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503b80 with x1830963592048512 ext(4194304->4898815) 00002000:00010000:2.0:1746143684.655975:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093503b80 00000100:00100000:0.0:1746143684.662617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.662663:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.662798:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592048896 00000100:00100000:1.0:1746143684.662806:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592048896 00000100:00100000:2.0:1746143684.662950:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592049152 00000100:00100000:2.0:1746143684.662954:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592049152 00002000:00100000:2.0:1746143684.662990:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880093bf0380 x1830963592049152/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.663108:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf0380 with x1830963592049152 ext(3145728->4194303) 00002000:00100000:1.0:1746143684.663315:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880093bf3100 x1830963592048896/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746143684.663340:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bf0380 00002000:00100000:1.0:1746143684.663459:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf3100 with x1830963592048896 ext(2097152->3145727) 00002000:00010000:1.0:1746143684.663463:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bf3100 00000100:00100000:2.0:1746143684.663500:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3263 00000100:00100000:2.0:1746143684.663506:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592049152:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143684.663941:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3264 00000100:00100000:1.0:1746143684.663947:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592048896:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143684.669989:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.670257:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592049536 00000100:00100000:2.0:1746143684.670266:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592049536 00000100:00100000:2.0:1746143684.670303:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3301 00000100:00100000:2.0:1746143684.670310:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+277:28131:x1830963592049536:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143684.670634:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+278:28131:x1830963592049536:12345-192.168.202.48@tcp:35:cat.0 Request processed in 324us (652us total) trans 8589942253 rc 0/0 00000100:00100000:2.0:1746143684.670640:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3301 00000100:00100000:0.0:1746143684.673567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.674103:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592049664 00000100:00100000:2.0:1746143684.674110:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592049664 00002000:00100000:2.0:1746143684.674152:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880093bf0000 x1830963592049664/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.674161:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf0000 with x1830963592049664 ext(3145728->4194303) 00002000:00010000:2.0:1746143684.674165:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf0000 00000100:00100000:2.0:1746143684.674191:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3265 00000100:00100000:2.0:1746143684.674196:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592049664:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143684.684180:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.684664:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592049920 00000100:00100000:3.0:1746143684.684672:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592049920 00000100:00100000:3.0:1746143684.684709:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8172 00000100:00100000:3.0:1746143684.684715:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+278:28138:x1830963592049920:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143684.684731:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.684747:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095387600/0xe984082ccd7245ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b91 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.684832:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd7245f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.684842:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd7245f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.684851:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd7245f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.684861:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804200/0xe984082ccd7245fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.684866:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804200/0xe984082ccd7245fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.684871:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804200/0xe984082ccd7245fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.684968:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd724601 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.684976:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd724601 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.684983:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd724601 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143684.684989:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143684.685053:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd7245f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685058:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd7245f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685063:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd7245f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685067:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5805000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143684.685070:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd7245f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685075:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd7245f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685083:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143684.685085:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143684.685088:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd7245f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685091:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd7245f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685111:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804200/0xe984082ccd7245fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685115:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804200/0xe984082ccd7245fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685123:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804200/0xe984082ccd7245fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685126:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5804200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143684.685128:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804200/0xe984082ccd7245fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685132:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804200/0xe984082ccd7245fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685136:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009acbfe00) 00010000:00010000:3.0:1746143684.685158:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143684.685160:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804200/0xe984082ccd7245fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685164:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804200/0xe984082ccd7245fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.685193:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095387600/0xe984082ccd7245ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b91 expref: 281 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.685202:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd724601 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b91 expref: 280 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.685207:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.685209:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143684.685210:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5805200, rc 0) 00000100:00100000:3.0:1746143684.685247:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+280:28138:x1830963592049920:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 532us (1115us total) trans 8589942254 rc 0/0 00000100:00100000:3.0:1746143684.685252:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8172 00000100:00100000:3.0:1746143684.685638:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592049152:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22132us (22974us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143684.685644:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3263 00002000:00100000:3.0:1746143684.685651:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880093bf0380 x1830963592049152/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143684.685659:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf0380 with x1830963592049152 ext(3145728->4194303) 00002000:00010000:3.0:1746143684.685663:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bf0380 00000100:00100000:2.0:1746143684.690102:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592048896:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26147us (27483us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143684.690111:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3264 00002000:00100000:2.0:1746143684.690121:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880093bf3100 x1830963592048896/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.690129:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf3100 with x1830963592048896 ext(2097152->3145727) 00002000:00010000:2.0:1746143684.690134:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bf3100 00000100:00100000:2.0:1746143684.690903:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592049664:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16704us (17340us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143684.690909:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3265 00002000:00100000:2.0:1746143684.690914:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880093bf0000 x1830963592049664/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.690921:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf0000 with x1830963592049664 ext(3145728->4194303) 00002000:00010000:2.0:1746143684.690924:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf0000 00000100:00100000:0.0:1746143684.696718:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.696767:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.698351:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592050176 00000100:00100000:2.0:1746143684.698359:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592050176 00000100:00100000:2.0:1746143684.698411:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3302 00000100:00100000:2.0:1746143684.698418:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+280:28138:x1830963592050176:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143684.698605:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+281:28138:x1830963592050176:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 186us (1894us total) trans 8589942255 rc 0/0 00000100:00100000:2.0:1746143684.698611:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3302 00000100:00100000:3.0:1746143684.698732:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592050304 00000100:00100000:3.0:1746143684.698736:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592050304 00000100:00100000:3.0:1746143684.698771:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 556 00000100:00100000:3.0:1746143684.698776:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+281:1963:x1830963592050304:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.698785:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.698802:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd724601 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b91 expref: 281 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.698817:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.698821:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.698835:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+280:1963:x1830963592050304:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 59us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.698840:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 556 00000100:00100000:0.0:1746143684.708434:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.708534:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592050560 00000100:00100000:2.0:1746143684.708542:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592050560 00002000:00100000:2.0:1746143684.708578:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880093bf1f80 x1830963592050560/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.708587:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf1f80 with x1830963592050560 ext(4194304->4898815) 00002000:00010000:2.0:1746143684.708591:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf1f80 00000100:00100000:2.0:1746143684.708609:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3266 00000100:00100000:2.0:1746143684.708615:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592050560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143684.720035:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592050560:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11412us (11601us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143684.720045:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3266 00002000:00100000:2.0:1746143684.720055:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880093bf1f80 x1830963592050560/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:80/0 lens 488/440 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.720064:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf1f80 with x1830963592050560 ext(4194304->4898815) 00002000:00010000:2.0:1746143684.720069:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf1f80 00000100:00100000:0.0:1746143684.728534:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.728651:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592050816 00000100:00100000:2.0:1746143684.728658:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592050816 00000100:00100000:2.0:1746143684.728745:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3303 00000100:00100000:2.0:1746143684.728752:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+46:28135:x1830963592050816:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143684.729554:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+47:28135:x1830963592050816:12345-192.168.202.48@tcp:35:cat.0 Request processed in 801us (1024us total) trans 8589942256 rc 0/0 00000100:00100000:2.0:1746143684.729563:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3303 00000100:00100000:0.0:1746143684.734488:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.735619:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592050944 00000100:00100000:3.0:1746143684.735626:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592050944 00000100:00100000:3.0:1746143684.735667:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9106 00000100:00100000:3.0:1746143684.735674:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28138:x1830963592050944:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143684.735689:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.735703:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b98 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.735728:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0383800/0xe984082ccd723cf4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a067b expref: 31 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.735736:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd723f0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a079a expref: 6 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.735742:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0383c00/0xe984082ccd723d5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06c8 expref: 15 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.735747:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.735749:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.735751:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [716800->1048575] (req 716800->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 31 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.735773:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0383c00/0xe984082ccd723d5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06c8 expref: 15 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.735782:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0383c00/0xe984082ccd723d5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06c8 expref: 15 pid: 25369 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.735792:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593655168:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.737800:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd723f0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a079a expref: 6 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.737811:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd723f0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a079a expref: 6 pid: 12618 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.737826:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593655296:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.737863:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0383800/0xe984082ccd723cf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a067b expref: 31 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.737870:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0383800/0xe984082ccd723cf4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a067b expref: 31 pid: 4582 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.737876:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593655424:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143684.737888:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.742347:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593655168:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143684.743740:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.743766:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.744023:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592051072 00000100:00100000:3.0:1746143684.744029:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592051072 00010000:00010000:3.0:1746143684.744055:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0383c00/0xe984082ccd723d5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06c8 expref: 16 pid: 25369 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.744662:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592051200 00000100:00100000:3.0:1746143684.744665:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592051200 00010000:00010000:3.0:1746143684.744683:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd723f0f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a079a expref: 7 pid: 12618 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746143684.744901:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.745618:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592051328 00000100:00100000:2.0:1746143684.745622:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592051328 00010000:00010000:2.0:1746143684.745640:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0383800/0xe984082ccd723cf4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a067b expref: 32 pid: 4582 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746143684.745667:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4653 00000100:00100000:2.0:1746143684.745674:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592051072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.745685:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.745704:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0383c00/0xe984082ccd723d5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06c8 expref: 16 pid: 25369 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.745713:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0383c00/0xe984082ccd723d5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06c8 expref: 16 pid: 25369 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.745730:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0383c00/0xe984082ccd723d5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a06c8 expref: 16 pid: 25369 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.745746:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.745780:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963592051072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 106us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.745790:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4653 00000100:00100000:2.0:1746143684.745805:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4654 00000100:00100000:2.0:1746143684.745809:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592051200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.745814:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.745821:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd723f0f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a079a expref: 7 pid: 12618 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.745827:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd723f0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a079a expref: 7 pid: 12618 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.745836:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.745850:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592051200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 40us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.745854:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4654 00000100:00100000:2.0:1746143684.745863:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4655 00000100:00100000:2.0:1746143684.745866:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963592051328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.745872:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.745878:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0383800/0xe984082ccd723cf4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a067b expref: 32 pid: 4582 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.745886:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0383800/0xe984082ccd723cf4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a067b expref: 32 pid: 4582 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.745900:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.745902:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.745908:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 32 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.745916:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 32 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.745945:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd723f0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a079a expref: 6 pid: 12618 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.745950:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 32 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.745958:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593655296:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.745961:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593655552:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143684.745968:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0383800/0xe984082ccd723cf4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a067b expref: 32 pid: 4582 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.745976:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593655424:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.745996:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 31 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.746003:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5805800, rc 0) 00000100:00100000:3.0:1746143684.746024:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:28138:x1830963592050944:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 10351us (11544us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.746030:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9106 00000100:00080000:1.0:1746143684.746052:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143684.746127:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143684.747548:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593655552:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143684.747557:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.747582:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592051328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1715us (2682us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.747587:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4655 00000100:00100000:0.0:1746143684.748823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.748901:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592051584 00000100:00100000:2.0:1746143684.748907:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592051584 00002000:00100000:2.0:1746143684.748947:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (716800->720895) req@ffff880093bf2d80 x1830963592051584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.748956:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf2d80 with x1830963592051584 ext(716800->720895) 00002000:00010000:2.0:1746143684.748961:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf2d80 00000100:00100000:2.0:1746143684.748983:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3267 00000100:00100000:2.0:1746143684.748989:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592051584:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143684.749188:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592051584:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 198us (367us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143684.749194:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3267 00002000:00100000:2.0:1746143684.749199:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (716800->720895) req@ffff880093bf2d80 x1830963592051584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/4536 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.749205:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf2d80 with x1830963592051584 ext(716800->720895) 00002000:00010000:2.0:1746143684.749208:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf2d80 00000100:00100000:0.0:1746143684.753059:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.753103:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592051712 00000100:00100000:3.0:1746143684.753110:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592051712 00000100:00100000:3.0:1746143684.753163:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9107 00000100:00100000:3.0:1746143684.753169:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28138:x1830963592051712:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143684.753184:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.753198:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0b9f expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.753221:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ee00/0xe984082ccd724583 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b44 expref: 30 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.753229:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd7245c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b67 expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.753234:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.753236:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.753239:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1048576->1179647] (req 1048576->1179647) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 30 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.753261:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd7245c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b67 expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.753272:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd7245c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b67 expref: 20 pid: 15784 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.753282:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593655680:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.753376:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ee00/0xe984082ccd724583 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b44 expref: 30 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.753384:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ee00/0xe984082ccd724583 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b44 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.753392:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593655808:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143684.753412:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.755548:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593655680:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143684.755558:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593655808:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.755580:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1048576->1179647] (req 1048576->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 30 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.755591:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5804600, rc 0) 00000100:00100000:3.0:1746143684.756071:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28138:x1830963592051712:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2900us (3017us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.756080:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9107 00000100:00100000:0.0:1746143684.757198:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.757359:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592051840 00000100:00100000:2.0:1746143684.757365:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592051840 00000100:00100000:0.0:1746143684.757367:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143684.757421:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd7245c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b67 expref: 21 pid: 15784 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746143684.757449:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592051968 00000100:00100000:2.0:1746143684.757452:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592051968 00000100:00100000:1.0:1746143684.757456:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4656 00010000:00010000:2.0:1746143684.757461:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ee00/0xe984082ccd724583 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b44 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.757464:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592051840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143684.757475:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143684.757494:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd7245c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b67 expref: 21 pid: 15784 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746143684.757503:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd7245c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b67 expref: 21 pid: 15784 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746143684.757525:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd7245c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b67 expref: 21 pid: 15784 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746143684.757623:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4657 00000100:00100000:2.0:1746143684.757628:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592051968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.757635:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.757642:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ee00/0xe984082ccd724583 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b44 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.757649:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ee00/0xe984082ccd724583 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b44 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.757659:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ee00/0xe984082ccd724583 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b44 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.757671:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.757672:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.757677:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.757683:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.757707:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143684.757716:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593655936:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143684.757756:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f180 going to sleep for 11 seconds 00010000:00010000:1.0:1746143684.758029:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143684.758059:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592051840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 595us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.758065:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4656 00000100:00100000:2.0:1746143684.758916:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593655936:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143684.758936:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.758967:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592051968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1339us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.758973:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4657 00000100:00100000:0.0:1746143684.760439:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.761122:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592052224 00000100:00100000:2.0:1746143684.761128:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592052224 00002000:00100000:2.0:1746143684.761193:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1175552->1179647) req@ffff880093bf2680 x1830963592052224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.761202:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf2680 with x1830963592052224 ext(1175552->1179647) 00002000:00010000:2.0:1746143684.761206:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bf2680 00000100:00100000:2.0:1746143684.761231:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3268 00000100:00100000:2.0:1746143684.761237:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592052224:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143684.761378:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592052224:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 140us (941us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143684.761384:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3268 00002000:00100000:2.0:1746143684.761390:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1175552->1179647) req@ffff880093bf2680 x1830963592052224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/4536 e 0 to 0 dl 1746143695 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.761402:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf2680 with x1830963592052224 ext(1175552->1179647) 00002000:00010000:2.0:1746143684.761405:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bf2680 00000100:00100000:0.0:1746143684.783101:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.783901:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592052352 00000100:00100000:2.0:1746143684.783908:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592052352 00000100:00080000:1.0:1746143684.784065:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143684.784309:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8173 00000100:00100000:2.0:1746143684.784316:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:28142:x1830963592052352:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143684.784334:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143684.784347:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d1000/0xe984082ccd72461d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ba6 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.784392:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0600/0xe984082ccd724624 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.784401:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0600/0xe984082ccd724624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.784408:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0600/0xe984082ccd724624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.784416:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72462b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.784421:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72462b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.784425:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72462b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.784507:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.784519:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ca expref: 279 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.784525:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.784547:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ca expref: 279 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.784556:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ca expref: 279 pid: 21713 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.784565:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593656064:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.784626:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143684.788539:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.788755:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592052608 00000100:00100000:3.0:1746143684.788762:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592052608 00000100:00100000:3.0:1746143684.789570:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3304 00000100:00100000:3.0:1746143684.789578:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+280:26913:x1830963592052608:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143684.789897:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+281:26913:x1830963592052608:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 319us (1367us total) trans 8589942257 rc 0/0 00000100:00100000:3.0:1746143684.789903:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3304 00000100:00100000:2.0:1746143684.790087:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0363100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593656064:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143684.790106:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143684.795354:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.795586:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592052736 00000100:00100000:2.0:1746143684.795594:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592052736 00010000:00010000:2.0:1746143684.795624:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ca expref: 281 pid: 21713 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.795653:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4658 00000100:00100000:2.0:1746143684.795659:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+281:1962:x1830963592052736:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.795669:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.795674:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ca expref: 281 pid: 21713 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.795684:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ca expref: 281 pid: 21713 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.796096:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d53b400/0xe984082ccd7242b2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09ca expref: 281 pid: 21713 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.796121:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143684.796250:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.796259:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.796265:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.796292:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.796325:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+280:1962:x1830963592052736:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 666us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.796331:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4658 00010000:00010000:3.0:1746143684.797384:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797392:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143684.797427:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:3.0:1746143684.797430:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143684.797445:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797455:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797463:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0600/0xe984082ccd724624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797468:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0600/0xe984082ccd724624 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797473:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0600/0xe984082ccd724624 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797481:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f9d0600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143684.797484:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0600/0xe984082ccd724624 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797489:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0600/0xe984082ccd724624 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797497:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143684.797499:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143684.797502:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0600/0xe984082ccd724624 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797505:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0600/0xe984082ccd724624 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797531:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72462b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797536:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72462b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797540:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72462b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797543:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f9d0e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143684.797545:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72462b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797549:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72462b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797555:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a800) 00010000:00010000:3.0:1746143684.797556:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143684.797558:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72462b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797562:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72462b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.797590:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d1000/0xe984082ccd72461d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ba6 expref: 16 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.797600:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ba6 expref: 15 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.797606:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.797608:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143684.797610:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9d0c00, rc 0) 00000100:00100000:3.0:1746143684.797648:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:28142:x1830963592052352:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 13333us (14554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.797654:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8173 00000100:00100000:0.0:1746143684.805064:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.805093:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.805114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.805133:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.805163:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.805179:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592052864 00000100:00100000:0.0:1746143684.805184:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592052864 00000100:00100000:0.0:1746143684.805210:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592052992 00000100:00100000:0.0:1746143684.805211:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592052992 00000100:00100000:0.0:1746143684.805225:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592053120 00000100:00100000:0.0:1746143684.805226:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592053120 00000100:00100000:0.0:1746143684.805233:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592053248 00000100:00100000:0.0:1746143684.805234:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592053248 00000100:00100000:0.0:1746143684.805243:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592053376 00000100:00100000:0.0:1746143684.805244:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592053376 00000100:00100000:0.0:1746143684.805253:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9108 00000100:00100000:0.0:1746143684.805258:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592052864:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143684.805273:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143684.805286:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6400/0xe984082ccd724639 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0bad expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143684.805324:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593656192:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143684.805482:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9109 00000100:00100000:1.0:1746143684.805489:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1962:x1830963592052992:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143684.805496:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.805504:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a717200/0xe984082ccd724640 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0bb4 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.805530:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593656320:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143684.805588:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.805602:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9110 00000100:00100000:1.0:1746143684.805606:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592053120:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143684.805612:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.805617:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a716400/0xe984082ccd724647 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0bbb expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.805625:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.805627:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.805633:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a716400/0xe984082ccd724647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bbb expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.805644:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a716400/0xe984082ccd724647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bbb expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.805652:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a716400, rc 0) 00000100:00100000:1.0:1746143684.805667:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592053120:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 60us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.805672:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9110 00000100:00100000:1.0:1746143684.805685:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9111 00000100:00100000:1.0:1746143684.805688:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592053248:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143684.805693:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.805697:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd72464e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0bc2 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.805704:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.805705:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.805709:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd72464e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc2 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.805716:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd72464e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc2 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.805721:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a717600, rc 0) 00000100:00100000:1.0:1746143684.805729:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963592053248:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 40us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.805732:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9111 00000100:00100000:1.0:1746143684.805738:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9112 00000100:00100000:1.0:1746143684.805741:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592053376:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143684.805745:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.805749:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009808a400/0xe984082ccd724655 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0bc9 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.805756:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.805757:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.805760:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009808a400/0xe984082ccd724655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc9 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.805766:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009808a400/0xe984082ccd724655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc9 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.805776:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009808a400, rc 0) 00000100:00100000:1.0:1746143684.805784:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963592053376:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 42us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.805788:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9112 00000100:00080000:1.0:1746143684.805799:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143684.805828:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.805839:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592053504 00000100:00100000:1.0:1746143684.805842:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592053504 00000100:00100000:1.0:1746143684.805854:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9113 00000100:00100000:1.0:1746143684.805857:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592053504:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143684.805862:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143684.805867:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009808bc00/0xe984082ccd72465c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0bd0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.805874:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.805875:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.805878:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009808bc00/0xe984082ccd72465c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd0 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.805885:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009808bc00/0xe984082ccd72465c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd0 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.805891:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009808bc00, rc 0) 00000100:00100000:1.0:1746143684.805901:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963592053504:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 43us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.805904:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9113 00000100:00100000:3.0:1746143684.807293:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b840 going to sleep for 11 seconds 00002000:00010000:1.0:1746143684.809347:0:8497:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime: 1746143683 -> 1746143684 00002000:00010000:1.0:1746143684.809352:0:8497:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime: 1746143683 -> 1746143684 00000100:00100000:1.0:1746143684.809371:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593656320:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143684.809397:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a717200/0xe984082ccd724640 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bb4 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.809408:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a717200/0xe984082ccd724640 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bb4 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746143684.809496:0:6929:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime: 1746143680 -> 1746143684 00002000:00010000:3.0:1746143684.809499:0:6929:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime: 1746143679 -> 1746143684 00002000:00010000:3.0:1746143684.809501:0:6929:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime: 1746143680 -> 1746143684 00000100:00100000:3.0:1746143684.809512:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593656192:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143684.809532:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6400/0xe984082ccd724639 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bad expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.809540:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6400/0xe984082ccd724639 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bad expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.809833:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a717200, rc 0) 00000100:00100000:1.0:1746143684.809875:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592052992:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4386us (4779us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143684.809883:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9109 00010000:00010000:3.0:1746143684.810234:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc6400, rc 0) 00000100:00100000:3.0:1746143684.810252:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592052864:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4993us (5194us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143684.810257:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9108 00000100:00100000:0.0:1746143684.814924:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.815285:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592053760 00000100:00100000:3.0:1746143684.815293:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592053760 00000100:00100000:3.0:1746143684.815450:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8174 00000100:00100000:3.0:1746143684.815458:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:28142:x1830963592053760:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143684.815475:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.815489:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804000/0xe984082ccd724663 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0bd7 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.815564:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.815576:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ba6 expref: 16 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.815581:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.815606:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ba6 expref: 16 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.815616:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ba6 expref: 16 pid: 21713 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.815626:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593656448:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143684.816529:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143684.818319:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.818418:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592053888 00000100:00100000:2.0:1746143684.818425:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592053888 00010000:00010000:2.0:1746143684.818451:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ba6 expref: 17 pid: 21713 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.818482:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4659 00000100:00100000:2.0:1746143684.818488:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+17:1965:x1830963592053888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.818497:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.818502:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ba6 expref: 17 pid: 21713 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.818512:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ba6 expref: 17 pid: 21713 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.818641:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593656448:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.818900:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.818952:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd724632 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ba6 expref: 17 pid: 21713 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.818976:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143684.818981:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.818988:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.818993:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.819014:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143684.819040:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.819045:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143684.819059:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143684.819199:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804000/0xe984082ccd724663 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd7 expref: 18 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.819210:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd7 expref: 17 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.819215:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.819217:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143684.819219:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5805200, rc 0) 00000100:00100000:3.0:1746143684.819249:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+17:28142:x1830963592053760:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3791us (4332us total) trans 8589942258 rc 0/0 00000100:00100000:3.0:1746143684.819254:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8174 00000100:00100000:2.0:1746143684.819530:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:1965:x1830963592053888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1041us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.819536:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4659 00000100:00100000:0.0:1746143684.821412:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.821477:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592054016 00000100:00100000:3.0:1746143684.821483:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592054016 00000100:00100000:3.0:1746143684.821509:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8175 00000100:00100000:3.0:1746143684.821514:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:28142:x1830963592054016:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143684.821531:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.821543:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804400/0xe984082ccd724678 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0bde expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.821603:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805c00/0xe984082ccd72467f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.821612:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd7 expref: 17 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.821618:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805c00/0xe984082ccd72467f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.821638:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd7 expref: 17 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.821646:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd7 expref: 17 pid: 21713 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.821655:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593656576:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143684.822097:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.825557:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593656576:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.825579:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805c00/0xe984082ccd72467f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143684.826132:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.826282:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592054144 00000100:00100000:2.0:1746143684.826287:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592054144 00010000:00010000:2.0:1746143684.826312:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd7 expref: 18 pid: 21713 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.826340:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4660 00000100:00100000:2.0:1746143684.826347:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+18:1964:x1830963592054144:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.826360:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.826365:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd7 expref: 18 pid: 21713 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.826373:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd7 expref: 18 pid: 21713 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.826389:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805200/0xe984082ccd72466a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd7 expref: 18 pid: 21713 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.826400:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143684.826403:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805c00/0xe984082ccd72467f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.826411:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805c00/0xe984082ccd72467f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.826416:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805c00/0xe984082ccd72467f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143684.826437:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.826465:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+17:1964:x1830963592054144:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 119us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.826471:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4660 00010000:00010000:3.0:1746143684.826881:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805c00/0xe984082ccd72467f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.826889:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805c00/0xe984082ccd72467f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143684.826924:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:3.0:1746143684.826937:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143684.826952:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805c00/0xe984082ccd72467f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.826977:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804400/0xe984082ccd724678 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bde expref: 17 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.826990:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805c00/0xe984082ccd72467f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bde expref: 16 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.826996:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.826998:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143684.827000:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5805c00, rc 0) 00000100:00100000:3.0:1746143684.827024:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:28142:x1830963592054016:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5510us (5617us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.827030:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8175 00000100:00100000:0.0:1746143684.829355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.829395:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.829445:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592054272 00000100:00100000:1.0:1746143684.829455:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592054272 00000100:00100000:3.0:1746143684.829469:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592054400 00000100:00100000:3.0:1746143684.829472:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592054400 00000100:00100000:1.0:1746143684.829501:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9114 00000100:00100000:1.0:1746143684.829507:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963592054272:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143684.829521:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143684.829526:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9115 00000100:00100000:3.0:1746143684.829531:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963592054400:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143684.829534:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009808a800/0xe984082ccd724686 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0be5 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.829536:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.829543:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72468d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0bec expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.829571:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593656704:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143684.829571:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593656832:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143684.829631:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.829670:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.831863:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593656832:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143684.831887:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009808a800/0xe984082ccd724686 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0be5 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.831903:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009808a800/0xe984082ccd724686 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0be5 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.831931:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009808a800, rc 0) 00000100:00100000:1.0:1746143684.831972:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963592054272:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2464us (2622us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143684.831977:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593656704:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143684.831978:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9114 00010000:00010000:3.0:1746143684.831993:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72468d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bec expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.832002:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72468d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bec expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.832011:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5804c00, rc 0) 00000100:00100000:3.0:1746143684.832681:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963592054400:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3148us (3283us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143684.832686:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9115 00000100:00100000:2.0:1746143684.834436:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.834605:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592054656 00000100:00100000:3.0:1746143684.834612:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592054656 00000100:00100000:3.0:1746143684.834713:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8176 00000100:00100000:3.0:1746143684.834719:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:28142:x1830963592054656:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143684.834733:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.834744:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805e00/0xe984082ccd724694 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0bf3 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.834812:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd72469b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.834822:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd72469b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.834830:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd72469b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143684.834838:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143684.834917:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805e00/0xe984082ccd724694 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bf3 expref: 19 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.834942:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd72469b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bf3 expref: 18 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.834948:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.834950:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143684.834952:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5805000, rc 0) 00000100:00100000:3.0:1746143684.834988:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+18:28142:x1830963592054656:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 269us (556us total) trans 8589942259 rc 0/0 00000100:00100000:3.0:1746143684.834993:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8176 00000100:00100000:0.0:1746143684.837676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.837785:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592054784 00000100:00100000:2.0:1746143684.837793:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592054784 00000100:00100000:2.0:1746143684.837831:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9116 00000100:00100000:2.0:1746143684.837838:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592054784:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143684.837874:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.837889:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.837896:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143684.837897:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143684.837900:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.837923:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.837944:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.837955:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593656960:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.838020:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143684.838776:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.838812:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592054912 00000100:00100000:1.0:1746143684.838816:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592054912 00000100:00100000:1.0:1746143684.839094:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9117 00000100:00100000:1.0:1746143684.839101:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592054912:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143684.839122:0:8497:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.839133:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.839166:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143684.839168:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143684.839170:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.839188:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.839196:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 28 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.839206:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593657088:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143684.839254:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143684.839882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.839935:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.840311:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.841155:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.841352:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592055040 00000100:00100000:3.0:1746143684.841357:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592055040 00000100:00100000:3.0:1746143684.841381:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592055168 00000100:00100000:3.0:1746143684.841382:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592055168 00000100:00100000:3.0:1746143684.841392:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592055424 00000100:00100000:3.0:1746143684.841393:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592055424 00000100:00100000:3.0:1746143684.841408:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9118 00000100:00100000:3.0:1746143684.841413:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592055040:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143684.841441:0:8496:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841453:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4c00/0xe984082ccd7244c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0adb expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841460:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a716400/0xe984082ccd724647 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bbb expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.841466:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c176800/0xe984082ccd72456e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b2f expref: 28 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.841472:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.841473:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.841475:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841494:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c176800/0xe984082ccd72456e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b2f expref: 28 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.841502:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c176800/0xe984082ccd72456e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b2f expref: 28 pid: 6929 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.841511:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593657216:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.841576:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a716400/0xe984082ccd724647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bbb expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.841583:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a716400/0xe984082ccd724647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bbb expref: 10 pid: 25369 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.841591:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593657344:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.841612:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4c00/0xe984082ccd7244c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0adb expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841618:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4c00/0xe984082ccd7244c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0adb expref: 19 pid: 6929 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.841630:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593657472:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143684.841646:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.841661:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9119 00000100:00100000:3.0:1746143684.841666:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592055168:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143684.841682:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841691:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd72422d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0984 expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841698:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd72464e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc2 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.841703:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5793200/0xe984082ccd724265 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a0 expref: 29 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.841708:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.841709:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.841711:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841725:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5793200/0xe984082ccd724265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a0 expref: 29 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.841732:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5793200/0xe984082ccd724265 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a0 expref: 29 pid: 21542 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.841741:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593657600:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.841769:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd72464e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc2 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.841777:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd72464e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc2 expref: 9 pid: 25369 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.841784:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593657728:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.841805:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd72422d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0984 expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841812:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd72422d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0984 expref: 14 pid: 8497 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.841819:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593657856:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143684.841834:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143684.841847:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9120 00000100:00100000:3.0:1746143684.841853:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592055424:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143684.841866:0:6929:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841874:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd724591 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b52 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841884:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009808bc00/0xe984082ccd72465c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd0 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.841890:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cff5000/0xe984082ccd7245e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b8a expref: 19 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841894:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.841895:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.841897:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841909:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cff5000/0xe984082ccd7245e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b8a expref: 19 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841914:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cff5000/0xe984082ccd7245e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b8a expref: 19 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.841920:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593657984:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.841947:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009808bc00/0xe984082ccd72465c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd0 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143684.841953:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009808bc00/0xe984082ccd72465c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd0 expref: 10 pid: 8495 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.841959:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593658112:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.841973:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd724591 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b52 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.841979:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd724591 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b52 expref: 28 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.841984:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593658240:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143684.841994:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.842410:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592055296 00000100:00100000:1.0:1746143684.842415:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592055296 00000100:00100000:1.0:1746143684.842443:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9121 00000100:00100000:1.0:1746143684.842448:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592055296:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143684.842463:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.842476:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9c00/0xe984082ccd7245d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b7c expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.842482:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009808a400/0xe984082ccd724655 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc9 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.842487:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7000/0xe984082ccd7245de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b83 expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.842491:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.842492:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143684.842494:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.842506:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7000/0xe984082ccd7245de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b83 expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.842518:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7000/0xe984082ccd7245de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b83 expref: 14 pid: 8497 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.842525:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593658368:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143684.842569:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009808a400/0xe984082ccd724655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc9 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143684.842576:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009808a400/0xe984082ccd724655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc9 expref: 10 pid: 25369 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746143684.842582:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593658496:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143684.842601:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9c00/0xe984082ccd7245d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b7c expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.842608:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9c00/0xe984082ccd7245d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b7c expref: 29 pid: 8497 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.842615:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593658624:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143684.842630:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143684.845411:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593657088:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143684.845434:0:8497:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.845696:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593656960:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.845710:0:4582:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.845909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.846334:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592055552 00000100:00100000:2.0:1746143684.846339:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592055552 00002000:00100000:2.0:1746143684.846371:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (716800->1048575) req@ffff88009ff6d880 x1830963592055552/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143684.846379:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d880 with x1830963592055552 ext(716800->1048575) 00010000:00010000:2.0:1746143684.846385:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.846399:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746143684.846405:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6d880 00000100:00100000:3.0:1746143684.846757:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593657216:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.846871:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 784 00000100:00100000:2.0:1746143684.846878:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592055552:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143684.848039:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593657344:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143684.865289:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592055552:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 18404us (19373us total) trans 17179872357 rc 0/0 00000100:00100000:3.0:1746143684.865299:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 784 00002000:00100000:3.0:1746143684.865308:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (716800->1048575) req@ffff88009ff6d880 x1830963592055552/t17179872357(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/448 e 0 to 0 dl 1746143695 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143684.865316:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d880 with x1830963592055552 ext(716800->1048575) 00010000:00010000:3.0:1746143684.865324:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 32 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.865334:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 32 pid: 15784 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746143684.865341:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6d880 00000100:00100000:2.0:1746143684.865512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.865540:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.865555:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.865568:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592055808 00000100:00100000:2.0:1746143684.865573:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592055808 00010000:00010000:2.0:1746143684.865594:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a716400/0xe984082ccd724647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bbb expref: 11 pid: 25369 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746143684.865610:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592056064 00000100:00100000:2.0:1746143684.865612:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592056064 00010000:00010000:2.0:1746143684.865620:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4c00/0xe984082ccd7244c6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0adb expref: 20 pid: 6929 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.865644:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4661 00000100:00100000:2.0:1746143684.865650:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592055808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.865660:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.865675:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a716400/0xe984082ccd724647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bbb expref: 11 pid: 25369 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.865688:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a716400/0xe984082ccd724647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bbb expref: 11 pid: 25369 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.865705:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a716400/0xe984082ccd724647 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bbb expref: 11 pid: 25369 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.865721:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.865740:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592055808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 91us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.865745:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4661 00000100:00100000:2.0:1746143684.865755:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4662 00000100:00100000:2.0:1746143684.865760:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592056064:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.865765:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.865773:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4c00/0xe984082ccd7244c6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0adb expref: 20 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.865781:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4c00/0xe984082ccd7244c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0adb expref: 20 pid: 6929 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746143684.865790:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.865803:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592056064:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 43us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.865808:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4662 00000100:00100000:3.0:1746143684.865956:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593657600:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143684.865968:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593657728:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.865982:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f8e4c00/0xe984082ccd7244c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0adb expref: 19 pid: 6929 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.865993:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593657472:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.866012:0:8496:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.866026:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592055680 00000100:00100000:3.0:1746143684.866028:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592055680 00002000:00100000:3.0:1746143684.866049:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1179647) req@ffff8800a0362a00 x1830963592055680/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/0 e 0 to 0 dl 1746143695 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143684.866055:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0362a00 with x1830963592055680 ext(1048576->1179647) 00010000:00010000:3.0:1746143684.866060:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.866067:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746143684.866072:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0362a00 00000100:00100000:3.0:1746143684.866084:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 785 00000100:00100000:3.0:1746143684.866089:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592055680:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:2.0:1746143684.866951:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.866981:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593657856:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.866997:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143684.867227:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.867240:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.867249:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592055936 00000100:00100000:2.0:1746143684.867252:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592055936 00010000:00010000:2.0:1746143684.867264:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c176800/0xe984082ccd72456e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b2f expref: 31 pid: 6929 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746143684.867277:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592056320 00000100:00100000:2.0:1746143684.867279:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592056320 00010000:00010000:2.0:1746143684.867289:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd72464e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc2 expref: 11 pid: 25369 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746143684.867301:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592056192 00000100:00100000:2.0:1746143684.867303:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592056192 00010000:00010000:2.0:1746143684.867310:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5793200/0xe984082ccd724265 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a0 expref: 32 pid: 21542 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746143684.867321:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4663 00000100:00100000:2.0:1746143684.867327:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592055936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.867333:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.867341:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c176800/0xe984082ccd72456e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b2f expref: 31 pid: 6929 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.867348:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c176800/0xe984082ccd72456e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b2f expref: 31 pid: 6929 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.867359:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c176800/0xe984082ccd72456e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b2f expref: 31 pid: 6929 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.867373:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.867375:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.867378:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.867385:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.867400:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143684.867419:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592055936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 93us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.867424:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4663 00000100:00100000:2.0:1746143684.867452:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4664 00000100:00100000:2.0:1746143684.867456:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592056320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143684.867462:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.867473:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd72464e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc2 expref: 11 pid: 25369 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.867481:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd72464e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc2 expref: 11 pid: 25369 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.867492:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd72464e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc2 expref: 11 pid: 25369 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746143684.867500:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143684.867607:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593657984:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143684.867659:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4665 00000100:00100000:1.0:1746143684.867667:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592056192:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143684.867674:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143684.867682:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5793200/0xe984082ccd724265 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a0 expref: 32 pid: 21542 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746143684.867689:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5793200/0xe984082ccd724265 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a0 expref: 32 pid: 21542 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746143684.867699:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5793200/0xe984082ccd724265 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a09a0 expref: 32 pid: 21542 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746143684.867712:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143684.867738:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.867745:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.867764:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.867770:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.867776:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.867782:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5805200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143684.867785:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.867791:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.867800:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.867807:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd7246b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143684.869347:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592056320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1884us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.869355:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4664 00000100:00100000:1.0:1746143684.869557:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592056192:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1888us (2312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.869563:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4665 00000100:00100000:3.0:1746143684.869600:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592055040:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 28182us (29714us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.869608:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9118 00000100:00100000:0.0:1746143684.869794:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.869808:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.869821:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592056576 00000100:00100000:0.0:1746143684.869825:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592056576 00010000:00010000:0.0:1746143684.869844:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cff5000/0xe984082ccd7245e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b8a expref: 19 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746143684.869860:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592056704 00000100:00100000:0.0:1746143684.869863:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592056704 00010000:00010000:0.0:1746143684.869871:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd724591 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b52 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746143684.869884:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4666 00000100:00100000:0.0:1746143684.869889:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592056576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143684.869897:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143684.869911:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cff5000/0xe984082ccd7245e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b8a expref: 19 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.869919:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cff5000/0xe984082ccd7245e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b8a expref: 19 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.869941:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cff5000/0xe984082ccd7245e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b8a expref: 19 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.869953:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143684.869969:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592056576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 80us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143684.869974:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4666 00000100:00100000:0.0:1746143684.869987:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4667 00000100:00100000:0.0:1746143684.869992:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592056704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143684.869997:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143684.870004:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd724591 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b52 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.870010:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd724591 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b52 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.870020:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143684.870032:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592056704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 40us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143684.870037:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4667 00000100:00100000:0.0:1746143684.870060:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.870071:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592056960 00000100:00100000:0.0:1746143684.870073:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592056960 00010000:00010000:0.0:1746143684.870083:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9c00/0xe984082ccd7245d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b7c expref: 31 pid: 8497 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746143684.870096:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4668 00000100:00100000:0.0:1746143684.870100:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592056960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143684.870106:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143684.870115:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9c00/0xe984082ccd7245d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b7c expref: 31 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.870123:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9c00/0xe984082ccd7245d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b7c expref: 31 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746143684.870134:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143684.870165:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592056960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 64us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143684.870170:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4668 00000100:00100000:1.0:1746143684.870252:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593658368:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143684.870261:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593658496:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143684.870277:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9c00/0xe984082ccd7245d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b7c expref: 30 pid: 8497 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746143684.870283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.870286:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593658624:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143684.870292:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592056448 00000100:00100000:0.0:1746143684.870294:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592056448 00010000:00010000:0.0:1746143684.870304:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009808bc00/0xe984082ccd72465c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd0 expref: 9 pid: 8495 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746143684.870309:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143684.870315:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4669 00000100:00100000:0.0:1746143684.870319:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592056448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143684.870324:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143684.870331:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593658112:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143684.870331:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009808bc00/0xe984082ccd72465c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd0 expref: 9 pid: 8495 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746143684.870338:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009808bc00/0xe984082ccd72465c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd0 expref: 9 pid: 8495 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746143684.870339:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095387c00/0xe984082ccd724591 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b52 expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.870346:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593658240:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143684.870348:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009808bc00/0xe984082ccd72465c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bd0 expref: 9 pid: 8495 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746143684.870355:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.870357:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.870360:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143684.870566:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.870582:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.870595:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.870618:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.871128:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592056832 00000100:00100000:3.0:1746143684.871132:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592056832 00010000:00010000:3.0:1746143684.871171:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009808a400/0xe984082ccd724655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc9 expref: 10 pid: 25369 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746143684.871182:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592057216 00000100:00100000:3.0:1746143684.871184:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592057216 00010000:00010000:3.0:1746143684.871191:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7000/0xe984082ccd7245de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b83 expref: 15 pid: 8497 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.871199:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592057088 00000100:00100000:3.0:1746143684.871200:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592057088 00010000:00010000:3.0:1746143684.871207:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd72422d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0984 expref: 16 pid: 8497 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.871213:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592057344 00000100:00100000:3.0:1746143684.871215:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592057344 00010000:00010000:3.0:1746143684.871222:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.871237:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4670 00000100:00100000:3.0:1746143684.871242:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592056832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.871250:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.871259:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009808a400/0xe984082ccd724655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc9 expref: 10 pid: 25369 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746143684.871265:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009808a400/0xe984082ccd724655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc9 expref: 10 pid: 25369 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746143684.871278:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009808a400/0xe984082ccd724655 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bc9 expref: 10 pid: 25369 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746143684.871286:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.871300:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592056832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 58us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.871305:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4670 00000100:00100000:3.0:1746143684.871313:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4671 00000100:00100000:3.0:1746143684.871316:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592057216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.871320:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.871325:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7000/0xe984082ccd7245de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b83 expref: 16 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.871332:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7000/0xe984082ccd7245de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b83 expref: 16 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.871340:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7000/0xe984082ccd7245de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b83 expref: 16 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.871352:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.871354:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.871356:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.871362:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.871382:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.871392:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1962:x1830963592057216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 75us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.871396:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4671 00000100:00100000:3.0:1746143684.871403:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4672 00000100:00100000:3.0:1746143684.871406:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592057088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.871411:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.871418:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd72422d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0984 expref: 14 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.871424:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd72422d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0984 expref: 14 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.871431:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd72422d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0984 expref: 14 pid: 8497 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.871437:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.871439:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.871441:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.871446:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.871460:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.871470:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592057088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 63us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.871473:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4672 00000100:00100000:3.0:1746143684.871479:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4673 00000100:00100000:3.0:1746143684.871483:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592057344:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.871487:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.871494:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.871501:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.871520:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805800/0xe984082ccd72460f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b98 expref: 30 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.871527:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.871528:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.871530:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.871540:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.871549:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.871559:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592057344:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 75us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.871562:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4673 00010000:00010000:3.0:1746143684.871580:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.871586:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.871601:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.871606:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.871738:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.871766:0:6929:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.871777:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.871782:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.871794:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.871798:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.871804:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.871813:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a2121600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143684.871816:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.871821:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.871829:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.871834:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a2121600/0xe984082ccd7246cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.871864:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592055296:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 29416us (30725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.871870:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9121 00010000:00010000:0.0:1746143684.871921:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143684.871954:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592056448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1634us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143684.871959:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4669 00010000:00010000:1.0:1746143684.872391:0:6929:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.872393:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.872398:0:6929:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.872399:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a623f200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143684.872401:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.872410:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.872412:0:6929:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.872418:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.872418:0:6929:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.872424:0:6929:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.872429:0:6929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e3a200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143684.872431:0:6929:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.872436:0:6929:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.872445:0:6929:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143684.872449:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3a200/0xe984082ccd7246c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.872483:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963592055424:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 30630us (32172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.872489:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9120 00010000:00010000:3.0:1746143684.872677:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd7246a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.872718:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592054784:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 34880us (35048us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.872727:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9116 00010000:00010000:2.0:1746143684.872850:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.872857:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.872871:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.872876:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.872882:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.872886:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095197600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143684.872888:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.872894:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.872907:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.872912:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd7246be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143684.872949:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1965:x1830963592055168:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 31282us (33013us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.872954:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9119 00000100:00100000:3.0:1746143684.874870:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592055680:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 8776us (9358us total) trans 21474839624 rc 0/0 00000100:00100000:3.0:1746143684.874878:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 785 00002000:00100000:3.0:1746143684.874887:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1179647) req@ffff8800a0362a00 x1830963592055680/t21474839624(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:80/0 lens 488/448 e 0 to 0 dl 1746143695 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143684.874899:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0362a00 with x1830963592055680 ext(1048576->1179647) 00010000:00010000:3.0:1746143684.874906:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.874917:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746143684.874922:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0362a00 00000100:00100000:0.0:1746143684.878285:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.878363:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592057472 00000100:00100000:3.0:1746143684.878370:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592057472 00010000:00010000:3.0:1746143684.878399:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.878420:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4674 00000100:00100000:3.0:1746143684.878425:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592057472:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.878435:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.878453:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.878461:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.878477:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804600/0xe984082ccd724616 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0b9f expref: 29 pid: 15784 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.878490:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.878492:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.878495:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.878502:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.879182:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.879220:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592057472:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 794us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.879230:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4674 00010000:00010000:0.0:1746143684.882754:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.882766:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.882796:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.882801:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.882808:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.882813:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a717400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143684.882820:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.882827:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.882846:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.882851:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a717400/0xe984082ccd7246b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143684.882919:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1964:x1830963592054912:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 43815us (44140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143684.882953:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9117 00000100:00100000:0.0:1746143684.884843:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.885220:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592057728 00000100:00100000:2.0:1746143684.885228:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592057728 00000100:00100000:2.0:1746143684.885259:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8177 00000100:00100000:2.0:1746143684.885265:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+18:28142:x1830963592057728:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:2.0:1746143684.885303:0:14764:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143684.885322:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805c00/0xe984082ccd72467f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bde expref: 18 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.885334:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143684.885418:0:14764:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143684.885442:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143684.885452:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b800/0xe984082ccd723bb2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a2 expref: 46 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.885458:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e200/0xe984082ccd723bb9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b7 expref: 46 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.885464:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dee00/0xe984082ccd723bc0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05be expref: 279 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.885468:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161a00/0xe984082ccd723df7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0707 expref: 46 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.885473:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd400/0xe984082ccd723e83 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a075b expref: 279 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.885478:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143684.885502:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd400/0xe984082ccd723e83 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a075b expref: 279 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.885511:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd400/0xe984082ccd723e83 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a075b expref: 279 pid: 14763 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.885522:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593658752:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143684.885945:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161a00/0xe984082ccd723df7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0707 expref: 46 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.885952:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161a00/0xe984082ccd723df7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0707 expref: 46 pid: 14764 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.885958:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593658880:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143684.885984:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dee00/0xe984082ccd723bc0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05be expref: 279 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.885990:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dee00/0xe984082ccd723bc0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05be expref: 279 pid: 16090 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.885995:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593659008:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143684.886010:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e200/0xe984082ccd723bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b7 expref: 46 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.886016:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e200/0xe984082ccd723bb9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b7 expref: 46 pid: 14763 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.886021:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593659136:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143684.886037:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b800/0xe984082ccd723bb2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a2 expref: 46 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.886043:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b800/0xe984082ccd723bb2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a2 expref: 46 pid: 21713 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.886048:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593659264:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.886059:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143684.888612:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.888636:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.888657:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.888713:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.888788:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592057984 00000100:00100000:1.0:1746143684.888795:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592057984 00000100:00100000:3.0:1746143684.888813:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592058112 00000100:00100000:3.0:1746143684.888817:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592058112 00010000:00010000:1.0:1746143684.888829:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd400/0xe984082ccd723e83 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a075b expref: 280 pid: 14763 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.888831:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161a00/0xe984082ccd723df7 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0707 expref: 47 pid: 14764 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.888848:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592057856 00000100:00100000:3.0:1746143684.888850:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592057856 00000100:00100000:1.0:1746143684.888850:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592058240 00000100:00100000:1.0:1746143684.888851:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592058240 00010000:00010000:3.0:1746143684.888857:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e200/0xe984082ccd723bb9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b7 expref: 49 pid: 14763 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.888857:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b800/0xe984082ccd723bb2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a2 expref: 49 pid: 21713 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.888867:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4675 00000100:00100000:3.0:1746143684.888872:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+49:1964:x1830963592058112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143684.888873:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4676 00000100:00100000:1.0:1746143684.888877:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+280:1963:x1830963592057984:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143684.888883:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143684.888883:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.888888:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161a00/0xe984082ccd723df7 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0707 expref: 49 pid: 14764 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.888888:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd400/0xe984082ccd723e83 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a075b expref: 280 pid: 14763 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.888897:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd400/0xe984082ccd723e83 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a075b expref: 280 pid: 14763 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746143684.889122:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593658752:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.889130:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593658880:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.889150:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593659008:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.889156:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593659136:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143684.889164:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593659264:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143684.889290:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161a00/0xe984082ccd723df7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0707 expref: 49 pid: 14764 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.889306:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b161a00/0xe984082ccd723df7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0707 expref: 49 pid: 14764 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.889323:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cbd400/0xe984082ccd723e83 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a075b expref: 280 pid: 14763 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.889325:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.889329:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.889336:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143684.889336:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143684.889339:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143684.889342:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143684.889396:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:3.0:1746143684.889558:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+48:1964:x1830963592058112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 684us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.889560:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+279:1963:x1830963592057984:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 682us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.889565:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4675 00000100:00100000:0.0:1746143684.889771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143684.889932:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4676 00000100:00100000:1.0:1746143684.889945:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592058368 00000100:00100000:1.0:1746143684.889948:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592058368 00010000:00010000:1.0:1746143684.889958:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dee00/0xe984082ccd723bc0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05be expref: 279 pid: 16090 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.889970:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4677 00000100:00100000:1.0:1746143684.889975:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+47:1964:x1830963592057856:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143684.889987:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143684.889992:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e200/0xe984082ccd723bb9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b7 expref: 47 pid: 14763 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.889999:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e200/0xe984082ccd723bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b7 expref: 47 pid: 14763 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.890009:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0e200/0xe984082ccd723bb9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05b7 expref: 47 pid: 14763 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746143684.890012:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4678 00010000:00010000:1.0:1746143684.890016:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00000100:00100000:3.0:1746143684.890019:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+46:1963:x1830963592058240:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143684.890019:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143684.890024:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143684.890026:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143684.890030:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b800/0xe984082ccd723bb2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a2 expref: 46 pid: 21713 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746143684.890036:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b800/0xe984082ccd723bb2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a2 expref: 46 pid: 21713 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.890040:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+46:1964:x1830963592057856:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 66us (1383us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143684.890045:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd1b800/0xe984082ccd723bb2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05a2 expref: 46 pid: 21713 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746143684.890045:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4677 00010000:00010000:3.0:1746143684.890051:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.890054:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143684.890058:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143684.890069:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+44:1963:x1830963592058240:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 52us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.890074:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4678 00000100:00100000:1.0:1746143684.890403:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4679 00000100:00100000:1.0:1746143684.890410:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+279:1964:x1830963592058368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143684.890416:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143684.890420:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dee00/0xe984082ccd723bc0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05be expref: 279 pid: 16090 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.890428:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dee00/0xe984082ccd723bc0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05be expref: 279 pid: 16090 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.890437:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dee00/0xe984082ccd723bc0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a05be expref: 279 pid: 16090 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746143684.890448:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143684.890450:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143684.890456:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143684.890461:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143684.890954:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143684.890986:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+278:1964:x1830963592058368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 576us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143684.890992:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4679 00010000:00010000:2.0:1746143684.891298:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143684.891304:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000040:00080000:2.0:1746143684.891798:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2212, 88 off185592 00000004:00080000:2.0:1746143684.891805:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763901664748ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143684.891846:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2169, 88 off181632 00000004:00080000:2.0:1746143684.891850:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763901710056ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143684.891868:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2170, 88 off181720 00000004:00080000:2.0:1746143684.891871:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763901731321ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143684.891877:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2213, 88 off185680 00000004:00080000:2.0:1746143684.891879:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763901739666ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143684.891884:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2214, 88 off185768 00000004:00080000:2.0:1746143684.891887:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763901746992ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143684.891891:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2171, 88 off181808 00000004:00080000:2.0:1746143684.891894:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763901753856ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143684.891900:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2172, 88 off181896 00000004:00080000:2.0:1746143684.891902:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763901762673ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143684.891908:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2173, 88 off181984 00000004:00080000:2.0:1746143684.891910:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763901770548ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143684.891916:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2215, 88 off185856 00000004:00080000:2.0:1746143684.891918:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763901777976ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143684.891923:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2174, 88 off182072 00000004:00080000:2.0:1746143684.891935:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763901794944ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143684.891941:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2216, 88 off185944 00000004:00080000:2.0:1746143684.891944:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763901803937ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143684.891949:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2175, 88 off182160 00000004:00080000:2.0:1746143684.891951:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763901810993ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143684.891956:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2217, 88 off186032 00000004:00080000:2.0:1746143684.891959:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763901819063ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143684.891964:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2218, 88 off186120 00000004:00080000:2.0:1746143684.891966:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763901826408ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143684.891971:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2219, 88 off186208 00000004:00080000:2.0:1746143684.891973:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763901833897ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143684.891979:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2220, 88 off186296 00000004:00080000:2.0:1746143684.891982:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763901842533ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143684.891988:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2176, 88 off182248 00000004:00080000:2.0:1746143684.891991:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763901851417ns, next at 718087967394ns, rc = 0 00000001:00080000:1.0:1746143684.921455:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942212 is committed 00000001:00080000:1.0:1746143684.921465:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942206 is committed 00000004:00010000:3.0:1746143684.921645:0:14764:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c3f9f80 reply state ffff88008fe5d000 transno 8589942260 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:3.0:1746143684.921654:0:14764:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746143684.921826:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942246 is committed 00000001:00080000:0.0:1746143684.921835:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942242 is committed 00000001:00080000:0.0:1746143684.921852:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942220 is committed 00000001:00080000:0.0:1746143684.921883:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942260 is committed 00000004:00080000:0.0:1746143684.921886:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1522 committed 00000004:00080000:0.0:1746143684.921893:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1566 committed 00000004:00080000:0.0:1746143684.921897:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1565 committed 00000004:00080000:0.0:1746143684.921900:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1564 committed 00000004:00080000:0.0:1746143684.921901:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1563 committed 00000004:00080000:0.0:1746143684.921902:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1521 committed 00000004:00080000:0.0:1746143684.921904:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1562 committed 00000004:00080000:0.0:1746143684.921905:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1520 committed 00000004:00080000:0.0:1746143684.921907:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1561 committed 00000004:00080000:0.0:1746143684.921908:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1519 committed 00000004:00080000:0.0:1746143684.921910:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1518 committed 00000004:00080000:0.0:1746143684.921911:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1517 committed 00000004:00080000:0.0:1746143684.921912:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1560 committed 00000004:00080000:0.0:1746143684.921913:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1559 committed 00000004:00080000:0.0:1746143684.921914:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1516 committed 00000004:00080000:0.0:1746143684.921916:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1515 committed 00000004:00080000:0.0:1746143684.921917:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1558 committed 00000001:00080000:0.0:1746143684.921919:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942256 is committed 00000001:00080000:0.0:1746143684.921932:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942255 is committed 00000001:00080000:0.0:1746143684.921974:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942257 is committed 00000100:00100000:2.0:1746143684.922210:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593659392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.922258:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143684.922285:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593659904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.922296:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143684.922312:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746143684.922317:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593659520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.922327:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143684.922337:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593660032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.922347:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143684.922364:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593659776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.922376:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143684.922385:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593660288:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.922395:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143684.922404:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746143684.922407:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593659648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.922417:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143684.922426:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593660160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.922436:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143684.922454:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593659392 00000100:00100000:2.0:1746143684.922459:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593659392 00000100:00100000:2.0:1746143684.922486:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593659904 00000100:00100000:2.0:1746143684.922487:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593659904 00000100:00100000:2.0:1746143684.922496:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593659520 00000100:00100000:2.0:1746143684.922497:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593659520 00000100:00100000:2.0:1746143684.922505:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593660032 00000100:00100000:2.0:1746143684.922506:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593660032 00000100:00100000:2.0:1746143684.922512:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593659776 00000100:00100000:2.0:1746143684.922513:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593659776 00000100:00100000:2.0:1746143684.922520:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593660288 00000100:00100000:2.0:1746143684.922521:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593660288 00000100:00100000:2.0:1746143684.922527:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593659648 00000100:00100000:2.0:1746143684.922529:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593659648 00000100:00100000:2.0:1746143684.922534:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593660160 00000100:00100000:2.0:1746143684.922536:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593660160 00000100:00100000:2.0:1746143684.922543:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9122 00000100:00100000:2.0:1746143684.922549:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593659392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.922717:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593659392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (458us total) trans 21474839625 rc 0/0 00000100:00100000:2.0:1746143684.922723:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9122 00000100:00100000:2.0:1746143684.922735:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9123 00000100:00100000:2.0:1746143684.922739:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593659904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143684.922843:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:2.0:1746143684.922846:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:2.0:1746143684.922848:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143684.922850:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:2.0:1746143684.922852:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:2.0:1746143684.922873:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593659904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (575us total) trans 21474839626 rc 0/0 00000100:00100000:2.0:1746143684.922877:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9123 00000100:00100000:2.0:1746143684.922888:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9124 00000100:00100000:2.0:1746143684.922892:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593659520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.922997:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593659520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (668us total) trans 21474839627 rc 0/0 00000100:00100000:2.0:1746143684.923003:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9124 00000100:00100000:2.0:1746143684.923013:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9125 00000100:00100000:2.0:1746143684.923017:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593660032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.923078:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593660032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (730us total) trans 21474839628 rc 0/0 00000100:00100000:2.0:1746143684.923082:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9125 00000100:00100000:2.0:1746143684.923089:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9126 00000100:00100000:2.0:1746143684.923092:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963593659776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143684.923166:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143684.923168:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143684.923170:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143684.923172:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143684.923174:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143684.923198:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593659776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (820us total) trans 21474839629 rc 0/0 00000100:00100000:2.0:1746143684.923203:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9126 00000100:00100000:2.0:1746143684.923213:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9127 00000100:00100000:2.0:1746143684.923218:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963593660288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.923301:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593660288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (904us total) trans 21474839630 rc 0/0 00000100:00100000:2.0:1746143684.923306:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9127 00000100:00100000:2.0:1746143684.923316:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9128 00000100:00100000:2.0:1746143684.923320:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963593659648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.923393:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593659648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (974us total) trans 21474839631 rc 0/0 00000100:00100000:2.0:1746143684.923398:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9128 00000100:00100000:2.0:1746143684.923404:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9129 00000100:00100000:2.0:1746143684.923408:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963593660160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143684.923466:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593660160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (1028us total) trans 21474839632 rc 0/0 00000100:00100000:2.0:1746143684.923470:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9129 00000004:00080000:2.0:1746143684.923505:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0361f80/2, rc 0, transno 21474839631 00000100:00100000:2.0:1746143684.923509:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593659648:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143684.923516:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0361880/2, rc 0, transno 21474839632 00000100:00100000:2.0:1746143684.923519:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593660160:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143684.923524:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0362680/2, rc 0, transno 21474839629 00000100:00100000:2.0:1746143684.923527:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593659776:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143684.923531:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0362d80/2, rc 0, transno 21474839630 00000100:00100000:2.0:1746143684.923533:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593660288:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143684.923549:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bf1880/2, rc 0, transno 21474839627 00000100:00100000:2.0:1746143684.923551:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593659520:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143684.923556:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0360000/2, rc 0, transno 21474839628 00000100:00100000:2.0:1746143684.923558:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0360000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593660032:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143684.923564:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bf0a80/2, rc 0, transno 21474839625 00000100:00100000:2.0:1746143684.923566:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593659392:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143684.923571:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0361c00/2, rc 0, transno 21474839626 00000100:00100000:2.0:1746143684.923573:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593659904:0@lo:2:osp-syn-0-0.0 00010000:00080000:3.0:1746143684.923671:0:14764:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143684.923684:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28142:x1830963592057728:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 38416us (38842us total) trans 8589942260 rc 0/0 00000100:00100000:3.0:1746143684.923690:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8177 00010000:00010000:1.0:1746143684.924001:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143684.924010:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143684.924016:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143684.924020:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6566600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143684.924024:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143684.924029:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143684.924045:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143684.924048:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143684.924051:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143684.924055:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6566600/0xe984082ccd7246d3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00000100:00100000:3.0:1746143684.924193:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593660544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143684.924225:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143684.924244:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593661056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143684.924254:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143684.924262:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746143684.924265:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593660416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143684.924275:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143684.924281:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593660928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143684.924291:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143684.924304:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593660544 00000100:00100000:3.0:1746143684.924308:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593660544 00000100:00100000:3.0:1746143684.924325:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593661056 00000100:00100000:3.0:1746143684.924327:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593661056 00000100:00100000:3.0:1746143684.924333:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593660416 00000100:00100000:3.0:1746143684.924334:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593660416 00000100:00100000:3.0:1746143684.924341:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593660928 00000100:00100000:3.0:1746143684.924342:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593660928 00000100:00100000:3.0:1746143684.924349:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9130 00000100:00100000:3.0:1746143684.924353:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3295:x1830963593660544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143684.924466:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3295:x1830963593660544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (241us total) trans 17179872358 rc 0/0 00000100:00100000:3.0:1746143684.924471:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9130 00000100:00100000:3.0:1746143684.924479:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9131 00000100:00100000:3.0:1746143684.924482:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3295:x1830963593661056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143684.924546:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3295:x1830963593661056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (290us total) trans 17179872359 rc 0/0 00000100:00100000:3.0:1746143684.924552:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9131 00000100:00100000:3.0:1746143684.924560:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9132 00000100:00100000:3.0:1746143684.924563:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3295:x1830963593660416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143684.924632:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3295:x1830963593660416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (356us total) trans 17179872360 rc 0/0 00000100:00100000:3.0:1746143684.924636:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9132 00000100:00100000:3.0:1746143684.924643:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9133 00000100:00100000:3.0:1746143684.924646:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3295:x1830963593660928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143684.924702:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3295:x1830963593660928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (409us total) trans 17179872361 rc 0/0 00000100:00100000:3.0:1746143684.924706:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9133 00000004:00080000:3.0:1746143684.924728:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6c000/2, rc 0, transno 17179872360 00000100:00100000:3.0:1746143684.924734:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593660416:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143684.924739:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6f800/2, rc 0, transno 17179872361 00000100:00100000:3.0:1746143684.924742:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593660928:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143684.924746:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6df80/2, rc 0, transno 17179872358 00000100:00100000:3.0:1746143684.924748:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593660544:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143684.924752:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6c380/2, rc 0, transno 17179872359 00000100:00100000:3.0:1746143684.924754:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593661056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143684.924773:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593661440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143684.924786:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143684.924799:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593661440 00000100:00100000:3.0:1746143684.924801:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593661440 00000100:00100000:3.0:1746143684.924810:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9134 00000100:00100000:3.0:1746143684.924813:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3294:x1830963593661440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143684.924877:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3294:x1830963593661440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (90us total) trans 17179872362 rc 0/0 00000100:00100000:3.0:1746143684.924881:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9134 00000004:00080000:3.0:1746143684.924895:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe3800/2, rc 0, transno 17179872362 00000100:00100000:3.0:1746143684.924897:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593661440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143684.924968:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593660672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143684.924987:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143684.925001:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593661184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143684.925010:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143684.925017:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143684.925020:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593660800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143684.925030:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143684.925036:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593661312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143684.925046:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143684.925059:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593660672 00000100:00100000:0.0:1746143684.925061:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593660672 00000100:00100000:0.0:1746143684.925071:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593661184 00000100:00100000:0.0:1746143684.925072:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593661184 00000100:00100000:0.0:1746143684.925076:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593660800 00000100:00100000:0.0:1746143684.925077:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593660800 00000100:00100000:0.0:1746143684.925082:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593661312 00000100:00100000:0.0:1746143684.925083:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593661312 00000100:00100000:0.0:1746143684.925089:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9135 00000100:00100000:0.0:1746143684.925093:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963593660672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143684.925187:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963593660672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (198us total) trans 17179872363 rc 0/0 00000100:00100000:0.0:1746143684.925192:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9135 00000100:00100000:0.0:1746143684.925200:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9136 00000100:00100000:0.0:1746143684.925204:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963593661184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143684.925302:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963593661184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (290us total) trans 17179872364 rc 0/0 00000100:00100000:0.0:1746143684.925307:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9136 00000100:00100000:0.0:1746143684.925318:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9137 00000100:00100000:0.0:1746143684.925321:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963593660800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143684.925378:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143684.925380:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143684.925382:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143684.925384:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143684.925386:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143684.925399:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963593660800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (369us total) trans 17179872365 rc 0/0 00000100:00100000:0.0:1746143684.925403:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9137 00000100:00100000:0.0:1746143684.925410:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9138 00000100:00100000:0.0:1746143684.925413:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963593661312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143684.925472:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963593661312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (425us total) trans 17179872366 rc 0/0 00000100:00100000:0.0:1746143684.925476:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9138 00000004:00080000:0.0:1746143684.925605:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6f100/2, rc 0, transno 17179872365 00000100:00100000:0.0:1746143684.925609:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593660800:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143684.925615:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6dc00/2, rc 0, transno 17179872366 00000100:00100000:0.0:1746143684.925617:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593661312:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143684.925622:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6e300/2, rc 0, transno 17179872363 00000100:00100000:0.0:1746143684.925624:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593660672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143684.925629:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6c700/2, rc 0, transno 17179872364 00000100:00100000:0.0:1746143684.925632:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593661184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143684.928456:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.929048:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592058496 00000100:00100000:3.0:1746143684.929056:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592058496 00000100:00100000:3.0:1746143684.929098:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8178 00000100:00100000:3.0:1746143684.929105:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28142:x1830963592058496:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143684.929127:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.930449:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9600/0xe984082ccd7246da lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0bfa expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.930504:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9600/0xe984082ccd7246da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bfa expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.930516:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9600/0xe984082ccd7246da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bfa expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.930530:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.930533:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143684.930535:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a9600, rc 0) 00000100:00100000:3.0:1746143684.930587:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28142:x1830963592058496:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1482us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.930593:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8178 00000100:00100000:0.0:1746143684.933603:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143684.933954:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592058624 00000100:00100000:3.0:1746143684.933962:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592058624 00000100:00100000:3.0:1746143684.934006:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8179 00000100:00100000:3.0:1746143684.934013:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28142:x1830963592058624:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143684.934030:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143684.934045:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd7246e1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c01 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.934110:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9c00/0xe984082ccd7246e8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.934120:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9c00/0xe984082ccd7246e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.934130:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9c00/0xe984082ccd7246e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143684.934167:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:3.0:1746143684.934171:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143684.934183:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9c00/0xe984082ccd7246e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143684.934201:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd7246e1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c01 expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.934213:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9c00/0xe984082ccd7246e8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c01 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.934220:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143684.934222:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143684.934224:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a9c00, rc 0) 00000100:00100000:3.0:1746143684.934404:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28142:x1830963592058624:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 391us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143684.934411:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8179 00000100:00100000:0.0:1746143684.940651:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.940684:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.940709:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.940710:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592058752 00000100:00100000:2.0:1746143684.940719:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592058752 00000100:00100000:0.0:1746143684.940728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.940739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.940753:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592058880 00000100:00100000:2.0:1746143684.940754:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592058880 00000100:00100000:0.0:1746143684.940759:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.940776:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592059008 00000100:00100000:2.0:1746143684.940778:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592059008 00000100:00100000:2.0:1746143684.940793:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592059136 00000100:00100000:2.0:1746143684.940795:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592059136 00000100:00100000:2.0:1746143684.940805:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592059264 00000100:00100000:2.0:1746143684.940806:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592059264 00000100:00100000:2.0:1746143684.940817:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592059392 00000100:00100000:2.0:1746143684.940818:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592059392 00000100:00100000:2.0:1746143684.940828:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9139 00000100:00100000:2.0:1746143684.940836:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592058752:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143684.940854:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143684.940872:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a962c00/0xe984082ccd7246ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c08 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143684.940897:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409c4, atime: 0x681409bf, ctime: 0x681409c4, blocks: 0x809 00010000:00010000:2.0:1746143684.940913:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.940915:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.940922:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a962c00/0xe984082ccd7246ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c08 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143684.940943:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a962c00/0xe984082ccd7246ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c08 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143684.940951:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a962c00, rc 0) 00000100:00100000:2.0:1746143684.940987:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592058752:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 152us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.940992:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9139 00000100:00100000:2.0:1746143684.941004:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9140 00000100:00100000:2.0:1746143684.941008:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592058880:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143684.941014:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143684.941023:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a963000/0xe984082ccd7246f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c0f expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143684.941035:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34a:0x0] initial LVB size: 2097152, mtime: 0x681409c4, atime: 0x681409c4, ctime: 0x681409c4, blocks: 0x821 00010000:00010000:2.0:1746143684.941043:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.941044:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.941048:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a963000/0xe984082ccd7246f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c0f expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143684.941060:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a963000/0xe984082ccd7246f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c0f expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143684.941065:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a963000, rc 0) 00000100:00100000:2.0:1746143684.941078:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592058880:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 70us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.941081:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9140 00000100:00100000:2.0:1746143684.941088:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9141 00000100:00100000:2.0:1746143684.941092:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592059008:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143684.941096:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143684.941102:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a962600/0xe984082ccd7246fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c16 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143684.941109:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34b:0x0] initial LVB size: 2097152, mtime: 0x681409c3, atime: 0x681409c2, ctime: 0x681409c3, blocks: 0x821 00010000:00010000:2.0:1746143684.941114:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.941115:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.941118:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a962600/0xe984082ccd7246fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c16 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143684.941125:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a962600/0xe984082ccd7246fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c16 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143684.941129:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a962600, rc 0) 00000100:00100000:2.0:1746143684.941165:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592059008:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 47us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.941173:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9141 00000100:00100000:2.0:1746143684.941186:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9142 00000100:00100000:2.0:1746143684.941191:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592059136:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143684.941196:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143684.941203:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a963c00/0xe984082ccd724704 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c1d expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143684.941208:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9143 00002000:00010000:2.0:1746143684.941212:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409c2, atime: 0x681409c2, ctime: 0x681409c2, blocks: 0x821 00000100:00100000:0.0:1746143684.941214:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592059264:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143684.941218:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.941219:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.941219:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143684.941223:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a963c00/0xe984082ccd724704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c1d expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143684.941226:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd72470b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c24 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.941230:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a963c00/0xe984082ccd724704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c1d expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746143684.941235:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 4897312, mtime: 0x681409c4, atime: 0x681409c4, ctime: 0x681409c4, blocks: 0x15a7 00010000:00010000:2.0:1746143684.941236:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a963c00, rc 0) 00010000:00010000:0.0:1746143684.941242:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.941243:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.941246:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd72470b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c24 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143684.941249:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592059136:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 58us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143684.941253:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9142 00010000:00010000:0.0:1746143684.941254:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd72470b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c24 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143684.941260:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095197600, rc 0) 00000100:00100000:0.0:1746143684.941272:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592059264:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 58us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143684.941276:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9143 00000100:00100000:0.0:1746143684.941301:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9144 00000100:00100000:0.0:1746143684.941305:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592059392:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143684.941309:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143684.941316:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009135ba00/0xe984082ccd724712 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c2b expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143684.941325:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409c4, atime: 0x681409c3, ctime: 0x681409c4, blocks: 0x102b 00010000:00010000:0.0:1746143684.941330:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.941331:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.941334:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009135ba00/0xe984082ccd724712 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c2b expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143684.941341:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009135ba00/0xe984082ccd724712 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c2b expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143684.941346:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009135ba00, rc 0) 00000100:00100000:0.0:1746143684.941359:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592059392:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 53us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143684.941363:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9144 00000100:00100000:0.0:1746143684.962545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.962584:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.962613:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.962644:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.962685:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592059648 00000100:00100000:2.0:1746143684.962694:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592059648 00000100:00100000:3.0:1746143684.962718:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592059904 00000100:00100000:3.0:1746143684.962721:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592059904 00000100:00100000:2.0:1746143684.962741:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592060160 00000100:00100000:3.0:1746143684.962743:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592060416 00000100:00100000:2.0:1746143684.962743:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592060160 00000100:00100000:3.0:1746143684.962744:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592060416 00000100:00100000:3.0:1746143684.962758:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3269 00000100:00100000:3.0:1746143684.962764:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592059648:12345-192.168.202.48@tcp:3:lfs.0 00000100:00100000:2.0:1746143684.962764:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3270 00000100:00100000:2.0:1746143684.962768:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592059904:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143684.962791:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9800/0xe984082ccd724719 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.962791:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724720 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.962802:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.962802:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.962804:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.962804:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.962808:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9800/0xe984082ccd724719 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.962808:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724720 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.962819:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9800/0xe984082ccd724719 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.962819:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724720 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143684.964040:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3271 00000100:00100000:2.0:1746143684.964049:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592060416:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143684.964073:0:26144:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095387c00/0xe984082ccd724727 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.964082:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.964084:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.964088:0:26144:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095387c00/0xe984082ccd724727 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.964097:0:26144:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095387c00/0xe984082ccd724727 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143684.964852:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3272 00000100:00100000:0.0:1746143684.964862:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592060160:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143684.964993:0:8502:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7c00/0xe984082ccd72472e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.965002:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.965004:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.965007:0:8502:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7c00/0xe984082ccd72472e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.965015:0:8502:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7c00/0xe984082ccd72472e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143684.965743:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143684.969242:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592060672 00000100:00100000:2.0:1746143684.969252:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592060672 00000100:00100000:2.0:1746143684.969299:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3273 00000100:00100000:2.0:1746143684.969306:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592060672:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143684.969336:0:31339:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a6567000/0xe984082ccd724735 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.969348:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.969349:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143684.969353:0:31339:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6567000/0xe984082ccd724735 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.969362:0:31339:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6567000/0xe984082ccd724735 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143684.974874:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.974902:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.974946:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143684.975000:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592060928 00000100:00100000:0.0:1746143684.975009:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592060928 00000100:00100000:0.0:1746143684.975059:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592061184 00000100:00100000:0.0:1746143684.975061:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592061184 00000100:00100000:0.0:1746143684.975077:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592061440 00000100:00100000:0.0:1746143684.975078:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592061440 00000100:00100000:0.0:1746143684.975095:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3274 00000100:00100000:0.0:1746143684.975103:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1965:x1830963592060928:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143684.975154:0:21518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1400/0xe984082ccd72473c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.975168:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.975170:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143684.975175:0:21518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1400/0xe984082ccd72473c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143684.975189:0:21518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1400/0xe984082ccd72473c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.977020:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3275 00000100:00100000:3.0:1746143684.977034:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1964:x1830963592061184:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143684.977070:0:8501:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8200/0xe984082ccd724743 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.977082:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.977084:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.977088:0:8501:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8200/0xe984082ccd724743 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.977102:0:8501:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8200/0xe984082ccd724743 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.978223:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3276 00000100:00100000:3.0:1746143684.978231:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1965:x1830963592061440:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143684.978251:0:25544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8000/0xe984082ccd72474a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.978259:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.978261:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143684.978264:0:25544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8000/0xe984082ccd72474a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.978272:0:25544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8000/0xe984082ccd72474a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.980261:0:31338:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724720 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.980273:0:31338:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724720 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.980279:0:31338:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.980285:0:31338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a963e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143684.980289:0:31338:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.980294:0:31338:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.980310:0:31338:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724720 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.980319:0:31338:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724720 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143684.980376:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1964:x1830963592059904:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 17604us (17789us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143684.980384:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3270 00010000:00010000:2.0:1746143684.991333:0:8502:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7c00/0xe984082ccd72472e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.991348:0:8502:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7c00/0xe984082ccd72472e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.991355:0:8502:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7c00/0xe984082ccd72472e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.991361:0:8502:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbc7c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143684.991365:0:8502:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7c00/0xe984082ccd72472e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.991372:0:8502:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7c00/0xe984082ccd72472e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.991390:0:8502:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7c00/0xe984082ccd72472e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143684.991395:0:8502:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7c00/0xe984082ccd72472e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143684.991485:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963592060160:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 26621us (28867us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143684.991493:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3272 00010000:00010000:3.0:1746143684.994417:0:26144:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095387c00/0xe984082ccd724727 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.994431:0:26144:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095387c00/0xe984082ccd724727 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.994439:0:26144:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095387c00/0xe984082ccd724727 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.994445:0:26144:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095387c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143684.994448:0:26144:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095387c00/0xe984082ccd724727 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.994456:0:26144:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095387c00/0xe984082ccd724727 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.994472:0:26144:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095387c00/0xe984082ccd724727 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143684.994478:0:26144:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095387c00/0xe984082ccd724727 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143684.994940:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1964:x1830963592060416:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 30887us (32290us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143684.994948:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3271 00010000:00010000:3.0:1746143685.009030:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9800/0xe984082ccd724719 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.009044:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9800/0xe984082ccd724719 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.009051:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9800/0xe984082ccd724719 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.009057:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01a9800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143685.009061:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9800/0xe984082ccd724719 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.009068:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9800/0xe984082ccd724719 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.009090:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9800/0xe984082ccd724719 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.009096:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9800/0xe984082ccd724719 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143685.014004:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963592059648:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 51229us (51456us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143685.014016:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3269 00010000:00010000:3.0:1746143685.022652:0:8501:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8200/0xe984082ccd724743 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.022666:0:8501:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8200/0xe984082ccd724743 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.022673:0:8501:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8200/0xe984082ccd724743 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.022679:0:8501:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01a8200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143685.022682:0:8501:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8200/0xe984082ccd724743 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.022688:0:8501:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8200/0xe984082ccd724743 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.022706:0:8501:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8200/0xe984082ccd724743 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.022717:0:8501:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8200/0xe984082ccd724743 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143685.022802:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592061184:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 45769us (47895us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143685.022810:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3275 00010000:00010000:2.0:1746143685.033575:0:31339:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a6567000/0xe984082ccd724735 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.033590:0:31339:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6567000/0xe984082ccd724735 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.033597:0:31339:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a6567000/0xe984082ccd724735 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.033603:0:31339:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6567000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143685.033606:0:31339:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6567000/0xe984082ccd724735 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.033612:0:31339:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6567000/0xe984082ccd724735 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.033627:0:31339:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a6567000/0xe984082ccd724735 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.033633:0:31339:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6567000/0xe984082ccd724735 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143685.033712:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592060672:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 64402us (67966us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143685.033722:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3273 00010000:00010000:3.0:1746143685.034538:0:25544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8000/0xe984082ccd72474a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.034546:0:25544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8000/0xe984082ccd72474a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.034552:0:25544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8000/0xe984082ccd72474a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.034556:0:25544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01a8000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143685.034558:0:25544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8000/0xe984082ccd72474a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.034563:0:25544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8000/0xe984082ccd72474a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.034573:0:25544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8000/0xe984082ccd72474a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.034578:0:25544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8000/0xe984082ccd72474a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143685.035727:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592061440:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 57491us (60775us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143685.035736:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3276 00010000:00010000:3.0:1746143685.039030:0:21518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1400/0xe984082ccd72473c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.039043:0:21518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1400/0xe984082ccd72473c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.039050:0:21518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1400/0xe984082ccd72473c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.039056:0:21518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5d1400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143685.039059:0:21518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1400/0xe984082ccd72473c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.039065:0:21518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1400/0xe984082ccd72473c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.039078:0:21518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1400/0xe984082ccd72473c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.039083:0:21518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1400/0xe984082ccd72473c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143685.039164:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592060928:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 64058us (64296us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143685.039173:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3274 00000100:00100000:3.0:1746143685.039263:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.039306:0:14758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592061568 00000100:00100000:3.0:1746143685.039312:0:14758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592061568 00000100:00100000:3.0:1746143685.039344:0:14758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 169 00000100:00100000:3.0:1746143685.039349:0:14758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1962:x1830963592061568:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1746143685.039374:0:14758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1962:x1830963592061568:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.039378:0:14758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 169 00000100:00100000:0.0:1746143685.049889:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.050063:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592061824 00000100:00100000:3.0:1746143685.050071:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592061824 00000100:00100000:3.0:1746143685.050108:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8180 00000100:00100000:3.0:1746143685.050114:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28142:x1830963592061824:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:3.0:1746143685.050171:0:21713:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143685.050193:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9c00/0xe984082ccd7246e8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c01 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.050209:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:3.0:1746143685.050212:0:21713:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143685.050238:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724751 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.050248:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724751 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.050255:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724751 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00010000:3.0:1746143685.050408:0:21713:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e1e1f80 reply state ffff8800a076b000 transno 8589942261 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724751 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:3.0:1746143685.050414:0:21713:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746143685.051163:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28142:x1830963592061824:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 1024us (1257us total) trans 8589942261 rc 0/0 00000100:00100000:3.0:1746143685.051169:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8180 00000100:00100000:1.0:1746143685.055065:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.055088:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.055108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.055118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.055128:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.055168:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.055184:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592061952 00000100:00100000:1.0:1746143685.055191:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592061952 00000100:00100000:1.0:1746143685.055217:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592062080 00000100:00100000:1.0:1746143685.055219:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592062080 00000100:00100000:1.0:1746143685.055227:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592062208 00000100:00100000:1.0:1746143685.055228:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592062208 00010000:00010000:2.0:1746143685.055379:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724751 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143685.055388:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724751 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143685.055394:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724751 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143685.055399:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01a8800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143685.055402:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724751 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143685.055408:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724751 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143685.055421:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:2.0:1746143685.055424:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143685.055426:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724751 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143685.055431:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724751 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00000100:00100000:1.0:1746143685.055625:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592062336 00000100:00100000:1.0:1746143685.055628:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592062336 00000100:00100000:3.0:1746143685.055655:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592062464 00000100:00100000:3.0:1746143685.055658:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592062464 00000100:00100000:3.0:1746143685.055673:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592062592 00000100:00100000:3.0:1746143685.055675:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592062592 00000100:00100000:3.0:1746143685.055686:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9145 00000100:00100000:3.0:1746143685.055692:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592061952:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143685.055836:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143685.055839:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.055841:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143679 -> 1746143684 00002000:00010000:3.0:1746143685.055842:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.055844:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:3.0:1746143685.055883:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592061952:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 190us (824us total) trans 17179872367 rc 0/0 00000100:00100000:3.0:1746143685.055889:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9145 00000100:00100000:3.0:1746143685.055903:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9146 00000100:00100000:3.0:1746143685.055907:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592062080:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143685.055994:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143685.055996:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.055999:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.056000:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.056002:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143685.056018:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592062080:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 110us (929us total) trans 21474839633 rc 0/0 00000100:00100000:3.0:1746143685.056023:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9146 00000100:00100000:3.0:1746143685.056032:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9147 00000100:00100000:3.0:1746143685.056037:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592062208:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143685.056092:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143685.056095:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143683 -> 1746143684 00002000:00010000:3.0:1746143685.056096:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143682 -> 1746143684 00002000:00010000:3.0:1746143685.056098:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143683 -> 1746143684 00002000:00010000:3.0:1746143685.056099:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143685.056113:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592062208:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 76us (1004us total) trans 21474839634 rc 0/0 00000100:00100000:3.0:1746143685.056118:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9147 00000100:00100000:3.0:1746143685.056128:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9148 00000100:00100000:3.0:1746143685.056133:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592062336:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143685.056207:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143685.056210:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143682 -> 1746143684 00002000:00010000:3.0:1746143685.056211:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143682 -> 1746143684 00002000:00010000:3.0:1746143685.056213:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143682 -> 1746143684 00002000:00010000:3.0:1746143685.056214:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143685.056230:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592062336:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 97us (1110us total) trans 17179872368 rc 0/0 00000100:00100000:3.0:1746143685.056238:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9148 00000100:00100000:3.0:1746143685.056248:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9149 00000100:00100000:3.0:1746143685.056252:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592062464:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143685.056305:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:3.0:1746143685.056307:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.056308:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.056310:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.056312:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5543 -> 5543 00000100:00100000:3.0:1746143685.056327:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592062464:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 74us (1198us total) trans 17179872369 rc 0/0 00000100:00100000:3.0:1746143685.056331:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9149 00000100:00100000:3.0:1746143685.056341:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9150 00000100:00100000:3.0:1746143685.056345:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592062592:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143685.056401:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143685.056403:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.056405:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143683 -> 1746143684 00002000:00010000:3.0:1746143685.056406:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.056408:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746143685.056423:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592062592:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 77us (1254us total) trans 21474839635 rc 0/0 00000100:00100000:3.0:1746143685.056428:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9150 00000100:00100000:0.0:1746143685.059026:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.059121:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592062848 00000100:00100000:3.0:1746143685.059129:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592062848 00000100:00100000:3.0:1746143685.059798:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3305 00000100:00100000:3.0:1746143685.059807:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28142:x1830963592062848:12345-192.168.202.48@tcp:35:lfs.0 00000004:00010000:3.0:1746143685.059857:0:28880:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x2d6:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd72469b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bf3 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.059895:0:28880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28880 initiator: MDT0 00010000:00010000:3.0:1746143685.059905:0:28880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9600/0xe984082ccd7246da lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bfa expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.059912:0:28880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28880 initiator: MDT0 00010000:00010000:3.0:1746143685.059949:0:28880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9600/0xe984082ccd7246da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bfa expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.059960:0:28880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9600/0xe984082ccd7246da lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bfa expref: 9 pid: 14764 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746143685.059971:0:28880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:28880:1830963593661568:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143685.060735:0:28880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143685.063977:0:28880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:28880:1830963593661568:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143685.063997:0:28880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00000100:00100000:2.0:1746143685.064102:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.064262:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592062976 00000100:00100000:1.0:1746143685.064268:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592062976 00010000:00010000:1.0:1746143685.064296:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9600/0xe984082ccd7246da lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bfa expref: 10 pid: 14764 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746143685.064317:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4680 00000100:00100000:1.0:1746143685.064324:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592062976:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143685.064335:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143685.064339:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9600/0xe984082ccd7246da lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bfa expref: 10 pid: 14764 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746143685.064349:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9600/0xe984082ccd7246da lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bfa expref: 10 pid: 14764 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746143685.064364:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9600/0xe984082ccd7246da lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bfa expref: 10 pid: 14764 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746143685.064390:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143685.064394:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143685.064401:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143685.064406:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143685.065531:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143685.065610:0:28880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00010000:00010000:0.0:1746143685.065617:0:28880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00000040:00080000:0.0:1746143685.066190:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2221, 88 off186384 00000004:00080000:0.0:1746143685.066198:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764076057391ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143685.066237:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2177, 88 off182336 00000004:00080000:0.0:1746143685.066242:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764076102186ns, next at 718087967394ns, rc = 0 00000100:00100000:1.0:1746143685.066289:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592062976:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1962us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143685.066298:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4680 00000040:00080000:0.0:1746143685.066873:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2178, 88 off182424 00000004:00080000:0.0:1746143685.066879:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764076739234ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143685.066887:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2222, 88 off186472 00000004:00080000:0.0:1746143685.066890:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764076750419ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143685.067453:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2223, 88 off186560 00000004:00080000:0.0:1746143685.067458:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764077318329ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143685.067840:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2179, 88 off182512 00000004:00080000:0.0:1746143685.067844:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764077704309ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143685.067861:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2180, 88 off182600 00000004:00080000:0.0:1746143685.067863:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764077723335ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143685.067869:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2181, 88 off182688 00000004:00080000:0.0:1746143685.067871:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764077731069ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143685.067877:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2224, 88 off186648 00000004:00080000:0.0:1746143685.067879:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764077739417ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143685.067885:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2182, 88 off182776 00000004:00080000:0.0:1746143685.067888:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764077748495ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143685.067893:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2225, 88 off186736 00000004:00080000:0.0:1746143685.067895:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764077755908ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143685.067901:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2183, 88 off182864 00000004:00080000:0.0:1746143685.067903:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764077763619ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143685.067908:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2226, 88 off186824 00000004:00080000:0.0:1746143685.067911:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764077771265ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143685.067917:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2227, 88 off186912 00000004:00080000:0.0:1746143685.067919:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764077779229ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143685.067932:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2228, 88 off187000 00000004:00080000:0.0:1746143685.067934:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764077794760ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143685.067940:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2229, 88 off187088 00000004:00080000:0.0:1746143685.067942:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764077802578ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143685.067948:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2184, 88 off182952 00000004:00080000:0.0:1746143685.067950:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764077810528ns, next at 718087967394ns, rc = 0 00000004:00010000:0.0:1746143685.091770:0:28880:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e1e3800 reply state ffff88009135ec00 transno 8589942262 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00000100:00100000:0.0:1746143685.091783:0:28880:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746143685.091791:0:28880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:0.0:1746143685.091793:0:28880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143685.091800:0:28880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805000/0xe984082ccd72469b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0bf3 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143685.091896:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28142:x1830963592062848:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 32089us (32875us total) trans 8589942262 rc 0/0 00000100:00100000:0.0:1746143685.091904:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3305 00000001:00080000:0.0:1746143685.092302:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942262 is committed 00000004:00080000:0.0:1746143685.092309:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1530 committed 00000004:00080000:0.0:1746143685.092315:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1575 committed 00000004:00080000:0.0:1746143685.092613:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1574 committed 00000004:00080000:0.0:1746143685.092615:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1573 committed 00000004:00080000:0.0:1746143685.092617:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1572 committed 00000004:00080000:0.0:1746143685.092618:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1529 committed 00000004:00080000:0.0:1746143685.092620:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1571 committed 00000004:00080000:0.0:1746143685.092622:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1528 committed 00000004:00080000:0.0:1746143685.092624:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1570 committed 00000004:00080000:0.0:1746143685.092625:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1527 committed 00000004:00080000:0.0:1746143685.092627:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1526 committed 00000004:00080000:0.0:1746143685.092628:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1525 committed 00000004:00080000:0.0:1746143685.092629:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1569 committed 00000004:00080000:0.0:1746143685.092631:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1568 committed 00000004:00080000:0.0:1746143685.092632:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1524 committed 00000004:00080000:0.0:1746143685.092634:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1523 committed 00000004:00080000:0.0:1746143685.092636:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1567 committed 00000100:00100000:0.0:1746143685.093272:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593661824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143685.093318:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143685.093364:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143685.093369:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593661952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143685.093385:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143685.093499:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593662464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143685.093608:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593662080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.093630:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593661696:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746143685.093940:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143685.093949:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143685.093955:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143685.093961:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5d1c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143685.093964:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143685.093970:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143685.093983:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88008f0f2900) 00010000:00010000:1.0:1746143685.093985:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143685.093988:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143685.093992:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d1c00/0xe984082ccd724758 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28880 initiator: MDT0 00000100:00100000:1.0:1746143685.094870:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593661824 00000100:00100000:1.0:1746143685.094877:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593661824 00000100:00100000:3.0:1746143685.095021:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.095049:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593662976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143685.095072:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.095089:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593663488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.095103:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.095112:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1746143685.095117:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593662336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143685.095128:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.095137:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593662848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143685.095164:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.095172:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593663360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.095183:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.095198:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593661952 00000100:00100000:3.0:1746143685.095200:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593661952 00000100:00100000:3.0:1746143685.095213:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593662464 00000100:00100000:3.0:1746143685.095215:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593662464 00000100:00100000:3.0:1746143685.095224:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593662976 00000100:00100000:3.0:1746143685.095225:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593662976 00000100:00100000:3.0:1746143685.095229:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593663488 00000100:00100000:3.0:1746143685.095231:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593663488 00000100:00100000:3.0:1746143685.095235:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593662336 00000100:00100000:3.0:1746143685.095236:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593662336 00000100:00100000:3.0:1746143685.095240:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593662848 00000100:00100000:3.0:1746143685.095241:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593662848 00000100:00100000:3.0:1746143685.095245:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593663360 00000100:00100000:3.0:1746143685.095246:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593663360 00000100:00100000:3.0:1746143685.095253:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9151 00000100:00100000:3.0:1746143685.095258:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963593661824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143685.095408:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143685.095411:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.095412:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.095414:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.095415:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:3.0:1746143685.095436:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3292:x1830963593661824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (2118us total) trans 17179872370 rc 0/0 00000100:00100000:3.0:1746143685.095441:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9151 00000100:00100000:3.0:1746143685.095452:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9152 00000100:00100000:3.0:1746143685.095456:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963593661952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143685.095509:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143685.095511:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.095513:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.095514:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.095516:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143685.095529:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3292:x1830963593661952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (2143us total) trans 17179872371 rc 0/0 00000100:00100000:3.0:1746143685.095533:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9152 00000100:00100000:3.0:1746143685.095541:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9153 00000100:00100000:3.0:1746143685.095544:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3293:x1830963593662464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143685.095621:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143685.095624:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:3.0:1746143685.095625:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:3.0:1746143685.095626:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:3.0:1746143685.095628:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143685.095648:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3293:x1830963593662464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (629us total) trans 21474839636 rc 0/0 00000100:00100000:3.0:1746143685.095653:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9153 00000100:00100000:3.0:1746143685.095660:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9154 00000100:00100000:3.0:1746143685.095664:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3293:x1830963593662976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143685.095730:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3293:x1830963593662976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (657us total) trans 21474839637 rc 0/0 00000100:00100000:3.0:1746143685.095734:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9154 00000100:00100000:3.0:1746143685.095742:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9155 00000100:00100000:3.0:1746143685.095745:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3293:x1830963593663488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.095818:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3293:x1830963593663488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (714us total) trans 17179872372 rc 0/0 00000100:00100000:3.0:1746143685.095823:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9155 00000100:00100000:3.0:1746143685.095831:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9156 00000100:00100000:3.0:1746143685.095835:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3293:x1830963593662336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143685.095893:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143685.095895:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.095897:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.095898:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.095900:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746143685.095914:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3293:x1830963593662336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (785us total) trans 21474839638 rc 0/0 00000100:00100000:3.0:1746143685.095918:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9156 00000100:00100000:3.0:1746143685.095934:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9157 00000100:00100000:3.0:1746143685.095938:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3293:x1830963593662848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143685.095993:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3293:x1830963593662848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (828us total) trans 21474839639 rc 0/0 00000100:00100000:3.0:1746143685.095997:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9157 00000100:00100000:3.0:1746143685.096004:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9158 00000100:00100000:3.0:1746143685.096007:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3293:x1830963593663360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.096062:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3293:x1830963593663360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (878us total) trans 17179872373 rc 0/0 00000100:00100000:3.0:1746143685.096066:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9158 00000100:00100000:3.0:1746143685.096092:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.096105:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593662208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143685.096119:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.096128:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593662720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143685.096156:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.096167:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593663232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.096179:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.096197:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593661696 00000100:00100000:3.0:1746143685.096200:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593661696 00000100:00100000:3.0:1746143685.096211:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593662208 00000100:00100000:3.0:1746143685.096213:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593662208 00000100:00100000:3.0:1746143685.096219:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593662720 00000100:00100000:3.0:1746143685.096220:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593662720 00000100:00100000:3.0:1746143685.096226:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593663232 00000100:00100000:3.0:1746143685.096228:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593663232 00000100:00100000:3.0:1746143685.096235:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9159 00000100:00100000:3.0:1746143685.096239:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3295:x1830963593661696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143685.096309:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143685.096311:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.096313:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.096314:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.096316:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143685.096335:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963593661696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (242us total) trans 21474839640 rc 0/0 00000100:00100000:3.0:1746143685.096343:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9159 00000100:00100000:3.0:1746143685.096351:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9160 00000100:00100000:3.0:1746143685.096355:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3295:x1830963593662208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143685.096419:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143685.096421:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.096423:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.096425:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.096426:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143685.096443:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963593662208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (323us total) trans 21474839641 rc 0/0 00000100:00100000:3.0:1746143685.096447:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9160 00000100:00100000:3.0:1746143685.096455:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9161 00000100:00100000:3.0:1746143685.096459:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3295:x1830963593662720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143685.096525:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963593662720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (367us total) trans 21474839642 rc 0/0 00000100:00100000:3.0:1746143685.096530:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9161 00000100:00100000:3.0:1746143685.096538:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9162 00000100:00100000:3.0:1746143685.096542:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3295:x1830963593663232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.096608:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3295:x1830963593663232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (427us total) trans 17179872374 rc 0/0 00000100:00100000:3.0:1746143685.096612:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9162 00000100:00100000:3.0:1746143685.096633:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.096648:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593662592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143685.096664:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.096674:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593663104:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.096686:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.096695:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593663616:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.096706:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.096723:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593662080 00000100:00100000:3.0:1746143685.096726:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593662080 00000100:00100000:3.0:1746143685.096737:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593662592 00000100:00100000:3.0:1746143685.096738:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593662592 00000100:00100000:3.0:1746143685.096745:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593663104 00000100:00100000:3.0:1746143685.096746:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593663104 00000100:00100000:3.0:1746143685.096751:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593663616 00000100:00100000:3.0:1746143685.096753:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593663616 00000100:00100000:3.0:1746143685.096759:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9163 00000100:00100000:3.0:1746143685.096763:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593662080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143685.096832:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:3.0:1746143685.096834:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.096836:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.096838:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.096840:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5543 -> 5543 00000100:00100000:3.0:1746143685.096862:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963593662080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (228us total) trans 17179872375 rc 0/0 00000100:00100000:3.0:1746143685.096866:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9163 00000100:00100000:3.0:1746143685.096874:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9164 00000100:00100000:3.0:1746143685.096879:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963593662592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143685.096952:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:3.0:1746143685.096954:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:3.0:1746143685.096956:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143685.096958:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:3.0:1746143685.096960:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:3.0:1746143685.096975:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593662592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (310us total) trans 21474839643 rc 0/0 00000100:00100000:3.0:1746143685.096980:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9164 00000100:00100000:3.0:1746143685.096987:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9165 00000100:00100000:3.0:1746143685.096991:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593663104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143685.097046:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143685.097048:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746143685.097050:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143685.097051:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746143685.097053:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143685.097068:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963593663104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (381us total) trans 17179872376 rc 0/0 00000100:00100000:3.0:1746143685.097073:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9165 00000100:00100000:3.0:1746143685.097080:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9166 00000100:00100000:3.0:1746143685.097084:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593663616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.097163:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963593663616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (456us total) trans 17179872377 rc 0/0 00000100:00100000:3.0:1746143685.097168:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9166 00000004:00080000:3.0:1746143685.097200:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe1880/2, rc 0, transno 17179872375 00000100:00100000:3.0:1746143685.097209:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593662080:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143685.097217:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f532680/2, rc 0, transno 21474839643 00000100:00100000:3.0:1746143685.097220:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593662592:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143685.097225:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe0000/2, rc 0, transno 17179872376 00000100:00100000:3.0:1746143685.097228:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593663104:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143685.097234:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094763480/2, rc 0, transno 17179872377 00000100:00100000:3.0:1746143685.097236:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593663616:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143685.097247:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f531c00/2, rc 0, transno 21474839640 00000100:00100000:3.0:1746143685.097250:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593661696:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143685.097255:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f532a00/2, rc 0, transno 21474839641 00000100:00100000:3.0:1746143685.097258:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593662208:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143685.097263:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f531500/2, rc 0, transno 21474839642 00000100:00100000:3.0:1746143685.097266:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593662720:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143685.097271:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe1180/2, rc 0, transno 17179872374 00000100:00100000:3.0:1746143685.097273:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593663232:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143685.097287:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f530e00/2, rc 0, transno 21474839638 00000100:00100000:3.0:1746143685.097289:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593662336:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143685.097295:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f530000/2, rc 0, transno 21474839639 00000100:00100000:3.0:1746143685.097297:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593662848:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143685.097303:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe3100/2, rc 0, transno 17179872373 00000100:00100000:3.0:1746143685.097305:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593663360:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143685.097311:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094760e00/2, rc 0, transno 17179872372 00000100:00100000:3.0:1746143685.097313:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593663488:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143685.097319:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f532300/2, rc 0, transno 21474839636 00000100:00100000:3.0:1746143685.097321:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593662464:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143685.097326:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f533b80/2, rc 0, transno 21474839637 00000100:00100000:3.0:1746143685.097329:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593662976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143685.097366:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593663744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.097381:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.097397:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593663744 00000100:00100000:3.0:1746143685.097400:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593663744 00000100:00100000:3.0:1746143685.097412:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9167 00000100:00100000:3.0:1746143685.097416:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963593663744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.097490:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963593663744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (107us total) trans 17179872378 rc 0/0 00000100:00100000:3.0:1746143685.097494:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9167 00000004:00080000:3.0:1746143685.097510:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f185500/2, rc 0, transno 17179872378 00000100:00100000:3.0:1746143685.097512:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593663744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143685.097855:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe0380/2, rc 0, transno 17179872371 00000100:00100000:0.0:1746143685.097859:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593661952:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143685.097865:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe0a80/2, rc 0, transno 17179872370 00000100:00100000:0.0:1746143685.097867:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593661824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143685.098012:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:1.0:1746143685.098549:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746143685.098554:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143685.098748:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592063104 00000100:00100000:3.0:1746143685.098752:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592063104 00000100:00100000:0.0:1746143685.099830:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8181 00000100:00100000:0.0:1746143685.099841:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:28142:x1830963592063104:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143685.099859:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143685.099875:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ec00/0xe984082ccd72475f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c32 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143685.099935:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ec00/0xe984082ccd72475f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c32 expref: 7 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143685.099948:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ec00/0xe984082ccd72475f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c32 expref: 7 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143685.099965:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:0.0:1746143685.099967:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143685.099970:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5ec00, rc 0) 00000100:00100000:0.0:1746143685.100604:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28142:x1830963592063104:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 765us (2591us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143685.100611:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8181 00000100:00100000:0.0:1746143685.104890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.104976:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592063360 00000100:00100000:2.0:1746143685.104983:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592063360 00000100:00100000:2.0:1746143685.105034:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3306 00000100:00100000:2.0:1746143685.105042:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28142:x1830963592063360:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1746143685.105290:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28142:x1830963592063360:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 247us (405us total) trans 8589942263 rc 0/0 00000100:00100000:2.0:1746143685.105296:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3306 00000100:00100000:0.0:1746143685.145535:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.145737:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592063616 00000100:00100000:3.0:1746143685.145745:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592063616 00000100:00100000:3.0:1746143685.145781:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8182 00000100:00100000:3.0:1746143685.145787:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+6:28155:x1830963592063616:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143685.145805:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.145819:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9a00/0xe984082ccd724766 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c39 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.145904:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9200/0xe984082ccd72476d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.145915:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9200/0xe984082ccd72476d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.145940:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9200/0xe984082ccd72476d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.145950:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724774 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.145955:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724774 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.145960:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724774 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146047:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd72477b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146052:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd72477b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146057:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd72477b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143685.146064:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143685.146125:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9200/0xe984082ccd72476d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146131:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9200/0xe984082ccd72476d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146135:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9200/0xe984082ccd72476d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146161:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01a9200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143685.146165:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9200/0xe984082ccd72476d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146170:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9200/0xe984082ccd72476d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146179:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143685.146181:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143685.146185:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9200/0xe984082ccd72476d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146189:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9200/0xe984082ccd72476d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146216:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724774 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146221:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724774 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146225:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724774 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146228:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01a8e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143685.146230:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724774 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146234:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724774 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146239:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800951f4e00) 00010000:00010000:3.0:1746143685.146241:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143685.146243:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724774 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146247:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8e00/0xe984082ccd724774 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143685.146278:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9a00/0xe984082ccd724766 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c39 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.146289:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd72477b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c39 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.146295:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143685.146296:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143685.146298:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a8800, rc 0) 00000100:00100000:3.0:1746143685.146334:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28155:x1830963592063616:12345-192.168.202.48@tcp:101:cat.0 Request processed in 547us (806us total) trans 8589942264 rc 0/0 00000100:00100000:3.0:1746143685.146340:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8182 00000100:00100000:0.0:1746143685.156026:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.156098:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592063872 00000100:00100000:2.0:1746143685.156105:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592063872 00000100:00100000:2.0:1746143685.157206:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8183 00000100:00100000:2.0:1746143685.157215:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:28149:x1830963592063872:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143685.157235:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.157250:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598600/0xe984082ccd724789 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c40 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.157340:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25c00/0xe984082ccd724790 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157351:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25c00/0xe984082ccd724790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157360:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25c00/0xe984082ccd724790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157370:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd724797 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157376:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd724797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157380:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd724797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157469:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc800/0xe984082ccd72479e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157476:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc800/0xe984082ccd72479e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157482:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc800/0xe984082ccd72479e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143685.157489:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143685.157574:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25c00/0xe984082ccd724790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157579:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25c00/0xe984082ccd724790 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157584:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25c00/0xe984082ccd724790 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157589:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a25c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143685.157592:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25c00/0xe984082ccd724790 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157598:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25c00/0xe984082ccd724790 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157610:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143685.157612:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143685.157615:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25c00/0xe984082ccd724790 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157620:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a25c00/0xe984082ccd724790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157656:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd724797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157665:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd724797 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157669:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd724797 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157673:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a24600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143685.157675:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd724797 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157679:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd724797 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157684:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009066df00) 00010000:00010000:2.0:1746143685.157686:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143685.157687:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd724797 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157691:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a24600/0xe984082ccd724797 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157723:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598600/0xe984082ccd724789 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c40 expref: 243 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.157734:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc800/0xe984082ccd72479e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c40 expref: 242 pid: 14764 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143685.157736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143685.157739:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143685.157741:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143685.157743:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61cc800, rc 0) 00000100:00100000:0.0:1746143685.157761:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.157777:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28149:x1830963592063872:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 564us (1759us total) trans 8589942265 rc 0/0 00000100:00100000:2.0:1746143685.157783:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8183 00000100:00100000:2.0:1746143685.157796:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592064256 00000100:00100000:2.0:1746143685.157799:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592064256 00000100:00100000:2.0:1746143685.157818:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8184 00000100:00100000:2.0:1746143685.157822:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28153:x1830963592064256:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143685.157830:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.157836:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc600/0xe984082ccd7247ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c4e expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.157868:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157876:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd72477b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c39 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.157882:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc800/0xe984082ccd72479e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c40 expref: 241 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.157887:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.157911:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc800/0xe984082ccd72479e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c40 expref: 241 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.157921:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc800/0xe984082ccd72479e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c40 expref: 241 pid: 14764 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.157944:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593663872:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143685.158007:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd72477b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c39 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.158015:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd72477b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c39 expref: 9 pid: 21713 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.158022:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593664000:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143685.158041:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143685.158202:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592064000 00000100:00100000:1.0:1746143685.158205:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592064000 00000100:00100000:1.0:1746143685.158234:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9168 00000100:00100000:1.0:1746143685.158239:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28155:x1830963592064000:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143685.158246:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.158254:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d53aa00/0xe984082ccd7247ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c47 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.158267:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.158269:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.158274:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d53aa00/0xe984082ccd7247ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c47 expref: 14 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.158288:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d53aa00/0xe984082ccd7247ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c47 expref: 14 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.158295:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d53aa00, rc 0) 00000100:00100000:1.0:1746143685.158311:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28155:x1830963592064000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 72us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143685.158315:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9168 00000100:00080000:1.0:1746143685.158329:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143685.162564:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.162651:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592064512 00000100:00100000:3.0:1746143685.162749:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592064512 00002000:00100000:3.0:1746143685.162787:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009ba45500 x1830963592064512/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.162795:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba45500 with x1830963592064512 ext(0->1048575) 00002000:00010000:3.0:1746143685.162799:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba45500 00000100:00100000:3.0:1746143685.162817:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3277 00000100:00100000:3.0:1746143685.162823:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592064512:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143685.164714:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.164749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.164783:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.164882:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592064768 00000100:00100000:2.0:1746143685.164888:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592064768 00010000:00010000:2.0:1746143685.164911:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc800/0xe984082ccd72479e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c40 expref: 242 pid: 14764 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.164937:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592064640 00000100:00100000:2.0:1746143685.164939:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592064640 00010000:00010000:2.0:1746143685.164947:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd72477b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c39 expref: 10 pid: 21713 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.164958:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4681 00000100:00100000:2.0:1746143685.164963:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:1964:x1830963592064768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143685.164971:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143685.164976:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc800/0xe984082ccd72479e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c40 expref: 242 pid: 14764 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.164984:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc800/0xe984082ccd72479e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c40 expref: 242 pid: 14764 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.165000:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143685.165005:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165010:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165015:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143685.165044:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:1964:x1830963592064768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 80us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.165049:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4681 00000100:00100000:2.0:1746143685.165071:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4682 00000100:00100000:2.0:1746143685.165075:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592064640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143685.165080:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143685.165083:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd72477b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c39 expref: 10 pid: 21713 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.165090:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd72477b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c39 expref: 10 pid: 21713 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.165098:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143685.165100:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165105:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165110:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165122:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143685.165132:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592064640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 56us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.165136:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4682 00010000:00010000:2.0:1746143685.165197:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc800/0xe984082ccd72479e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c40 expref: 241 pid: 14764 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.165208:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593663872:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143685.165216:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd72477b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c39 expref: 9 pid: 21713 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.165223:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593664000:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143685.165235:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165240:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165244:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143685.165258:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143685.165356:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc600/0xe984082ccd7247ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c4e expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.165367:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c4e expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.165371:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143685.165374:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143685.165375:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d598c00, rc 0) 00000100:00100000:2.0:1746143685.165394:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28153:x1830963592064256:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7572us (7633us total) trans 8589942266 rc 0/0 00000100:00100000:2.0:1746143685.165399:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8184 00000100:00100000:2.0:1746143685.165409:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592065024 00000100:00100000:2.0:1746143685.165412:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592065024 00000100:00100000:2.0:1746143685.165426:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8185 00000100:00100000:2.0:1746143685.165430:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:28154:x1830963592065024:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143685.165442:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.165450:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd7247c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c55 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.165508:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd7247cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165515:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd7247cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165521:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd7247cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165530:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ba00/0xe984082ccd7247d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165534:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ba00/0xe984082ccd7247d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165539:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ba00/0xe984082ccd7247d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165610:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b200/0xe984082ccd7247dd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165616:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b200/0xe984082ccd7247dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165621:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b200/0xe984082ccd7247dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143685.165626:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143685.165657:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd7247cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165663:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd7247cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165667:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd7247cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165671:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c25aa00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143685.165674:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd7247cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165679:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd7247cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165685:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143685.165687:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143685.165689:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd7247cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165693:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd7247cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165698:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ba00/0xe984082ccd7247d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165702:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ba00/0xe984082ccd7247d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165709:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ba00/0xe984082ccd7247d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165713:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c25ba00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143685.165714:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ba00/0xe984082ccd7247d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165718:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ba00/0xe984082ccd7247d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165723:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f442100) 00010000:00010000:2.0:1746143685.165725:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143685.165727:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ba00/0xe984082ccd7247d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165731:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ba00/0xe984082ccd7247d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.165755:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd7247c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c55 expref: 244 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.165762:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b200/0xe984082ccd7247dd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c55 expref: 243 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.165767:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143685.165768:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143685.165770:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c25b200, rc 0) 00000100:00100000:2.0:1746143685.165784:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28154:x1830963592065024:12345-192.168.202.48@tcp:101:cat.0 Request processed in 353us (1076us total) trans 8589942267 rc 0/0 00000100:00100000:2.0:1746143685.165789:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8185 00000100:00100000:0.0:1746143685.193654:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.193731:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592065152 00000100:00100000:1.0:1746143685.193739:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592065152 00000100:00100000:1.0:1746143685.193781:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9169 00000100:00100000:1.0:1746143685.193787:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28154:x1830963592065152:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143685.193801:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.193813:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd7247eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c5c expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.193833:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.193834:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.193840:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd7247eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c5c expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.193851:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd7247eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c5c expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.193860:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd2d200, rc 0) 00000100:00100000:1.0:1746143685.193894:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28154:x1830963592065152:12345-192.168.202.48@tcp:101:cat.0 Request processed in 107us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143685.193899:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9169 00000100:00100000:3.0:1746143685.194118:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592064512:12345-192.168.202.48@tcp:3:cat.0 Request processed in 31294us (31560us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143685.194126:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3277 00002000:00100000:3.0:1746143685.194133:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009ba45500 x1830963592064512/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.194172:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba45500 with x1830963592064512 ext(0->1048575) 00002000:00010000:3.0:1746143685.194176:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba45500 00000100:00080000:0.0:1746143685.195566:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143685.205683:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.205782:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592065408 00000100:00100000:3.0:1746143685.205791:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592065408 00002000:00100000:3.0:1746143685.205830:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009ba45f80 x1830963592065408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.205838:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba45f80 with x1830963592065408 ext(0->1048575) 00002000:00010000:3.0:1746143685.205843:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba45f80 00000100:00100000:3.0:1746143685.205871:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3278 00000100:00100000:3.0:1746143685.205878:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592065408:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143685.210385:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.212018:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592065536 00000100:00100000:1.0:1746143685.212027:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592065536 00000100:00080000:0.0:1746143685.213376:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143685.213641:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9170 00000100:00100000:1.0:1746143685.213651:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28155:x1830963592065536:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143685.213668:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.213685:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7247f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c63 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.213709:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.213711:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.213718:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7247f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c63 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.213732:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7247f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c63 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.213742:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd2c800, rc 0) 00000100:00100000:1.0:1746143685.219862:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28155:x1830963592065536:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6205us (9474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143685.219872:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9170 00000100:00100000:3.0:1746143685.220176:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592065408:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14298us (14500us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143685.220184:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3278 00002000:00100000:3.0:1746143685.220192:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009ba45f80 x1830963592065408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.220200:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba45f80 with x1830963592065408 ext(0->1048575) 00002000:00010000:3.0:1746143685.220205:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba45f80 00000100:00100000:0.0:1746143685.237395:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.237439:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.237515:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592065664 00000100:00100000:2.0:1746143685.237523:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592065664 00000100:00100000:1.0:1746143685.237827:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592065792 00000100:00100000:1.0:1746143685.237830:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592065792 00000100:00100000:1.0:1746143685.237871:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9171 00000100:00100000:1.0:1746143685.237877:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28154:x1830963592065792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143685.237891:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.237905:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c200/0xe984082ccd7247f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c71 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.237936:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.237938:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.237944:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c200/0xe984082ccd7247f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c71 expref: 29 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.237956:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c200/0xe984082ccd7247f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c71 expref: 29 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.237964:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd2c200, rc 0) 00000100:00100000:1.0:1746143685.237997:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28154:x1830963592065792:12345-192.168.202.48@tcp:101:cat.0 Request processed in 121us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143685.238003:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9171 00000100:00080000:0.0:1746143685.238261:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143685.238370:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8186 00000100:00100000:2.0:1746143685.238376:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28155:x1830963592065664:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143685.238431:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.238441:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25a800/0xe984082ccd724800 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c6a expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.238480:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25a800/0xe984082ccd724800 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c6a expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.238490:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25a800/0xe984082ccd724800 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c6a expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.238502:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143685.238504:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143685.238506:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c25a800, rc 0) 00000100:00100000:2.0:1746143685.238537:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28155:x1830963592065664:12345-192.168.202.48@tcp:101:cat.0 Request processed in 161us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.238542:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8186 00000100:00100000:0.0:1746143685.242198:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.242746:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592065920 00000100:00100000:2.0:1746143685.242754:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592065920 00000100:00100000:3.0:1746143685.243941:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8187 00000100:00100000:3.0:1746143685.243952:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28153:x1830963592065920:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143685.243970:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.243988:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9c00/0xe984082ccd724807 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c78 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.244039:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9c00/0xe984082ccd724807 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c78 expref: 11 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.244050:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9c00/0xe984082ccd724807 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c78 expref: 11 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.244063:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143685.244066:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143685.244069:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a9c00, rc 0) 00000100:00100000:3.0:1746143685.244122:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28153:x1830963592065920:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 172us (1931us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.244128:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8187 00000100:00100000:0.0:1746143685.246337:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.248062:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592066304 00000100:00100000:3.0:1746143685.248072:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592066304 00002000:00100000:3.0:1746143685.248109:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88009ba47b80 x1830963592066304/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.248119:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba47b80 with x1830963592066304 ext(1048576->2097151) 00002000:00010000:3.0:1746143685.248123:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba47b80 00000100:00100000:3.0:1746143685.248160:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3279 00000100:00100000:3.0:1746143685.248167:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592066304:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143685.250182:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.250228:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592066432 00000100:00100000:2.0:1746143685.250235:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592066432 00002000:00100000:2.0:1746143685.250269:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88012f187b80 x1830963592066432/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.250277:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187b80 with x1830963592066432 ext(1048576->2097151) 00002000:00010000:2.0:1746143685.250281:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f187b80 00000100:00100000:2.0:1746143685.250298:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3280 00000100:00100000:2.0:1746143685.250309:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592066432:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143685.251775:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.251896:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592066560 00000100:00100000:2.0:1746143685.251901:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592066560 00000100:00100000:2.0:1746143685.252235:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 557 00000100:00100000:2.0:1746143685.252244:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592066560:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143685.252256:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143685.252278:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9c00/0xe984082ccd724807 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c78 expref: 11 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.252341:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143685.252345:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143685.252515:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963592066560:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 271us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.252522:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 557 00000100:00100000:1.0:1746143685.257102:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.257535:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592066816 00000100:00100000:2.0:1746143685.257544:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592066816 00000100:00100000:2.0:1746143685.257592:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8188 00000100:00100000:2.0:1746143685.257601:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28153:x1830963592066816:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143685.257621:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.257624:0:14764:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143685.257652:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25a800/0xe984082ccd724800 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c6a expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.257667:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143685.257671:0:14764:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143685.257684:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ae00/0xe984082ccd72480e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c7f expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.257736:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.257748:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ec00/0xe984082ccd72475f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c32 expref: 7 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.257754:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b200/0xe984082ccd7247dd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c55 expref: 242 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.257760:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.257788:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b200/0xe984082ccd7247dd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c55 expref: 242 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.257800:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b200/0xe984082ccd7247dd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c55 expref: 242 pid: 14764 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.257812:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593664128:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143685.257918:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ec00/0xe984082ccd72475f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c32 expref: 7 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.257941:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ec00/0xe984082ccd72475f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c32 expref: 7 pid: 14764 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.257949:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593664256:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143685.257977:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143685.268538:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592066304:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20358us (22194us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143685.268550:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3279 00002000:00100000:3.0:1746143685.268564:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88009ba47b80 x1830963592066304/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.268574:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba47b80 with x1830963592066304 ext(1048576->2097151) 00002000:00010000:3.0:1746143685.268580:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba47b80 00000100:00100000:2.0:1746143685.270843:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593664128:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143685.272466:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.272770:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592066944 00000100:00100000:2.0:1746143685.272778:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592066944 00010000:00010000:2.0:1746143685.272815:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b200/0xe984082ccd7247dd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c55 expref: 243 pid: 14764 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746143685.273682:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.279392:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592067072 00000100:00100000:2.0:1746143685.279405:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592067072 00010000:00010000:2.0:1746143685.279446:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ec00/0xe984082ccd72475f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c32 expref: 8 pid: 14764 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.279478:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4683 00000100:00100000:2.0:1746143685.279487:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1964:x1830963592066944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143685.279503:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143685.279510:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b200/0xe984082ccd7247dd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c55 expref: 243 pid: 14764 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.279520:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b200/0xe984082ccd7247dd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c55 expref: 243 pid: 14764 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.279540:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b200/0xe984082ccd7247dd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c55 expref: 243 pid: 14764 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.279556:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143685.279561:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.279568:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143685.279577:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143685.279695:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4684 00000100:00100000:1.0:1746143685.279705:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592067072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143685.279714:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143685.279720:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ec00/0xe984082ccd72475f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c32 expref: 8 pid: 14764 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746143685.279730:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ec00/0xe984082ccd72475f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c32 expref: 8 pid: 14764 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746143685.279742:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:1.0:1746143685.279745:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.279752:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.279758:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.279774:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143685.280727:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ec00/0xe984082ccd72475f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c32 expref: 8 pid: 14764 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746143685.280749:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593664256:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143685.280771:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143685.280780:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143685.280784:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:02000000:3.0:1746143685.280826:0:14764:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:3.0:1746143685.281427:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2230, 88 off187176 00000004:00080000:3.0:1746143685.281433:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764291292546ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143685.281495:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2185, 88 off183040 00000004:00080000:3.0:1746143685.281498:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764291357916ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143685.281526:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2186, 88 off183128 00000004:00080000:3.0:1746143685.281529:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764291389067ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143685.281538:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2231, 88 off187264 00000004:00080000:3.0:1746143685.281540:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764291400838ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143685.281549:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2232, 88 off187352 00000004:00080000:3.0:1746143685.281552:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764291411969ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143685.281560:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2187, 88 off183216 00000004:00080000:3.0:1746143685.281563:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764291423323ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143685.281572:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2188, 88 off183304 00000004:00080000:3.0:1746143685.281574:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764291434294ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143685.281582:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2189, 88 off183392 00000004:00080000:3.0:1746143685.281584:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764291444666ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143685.281593:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2233, 88 off187440 00000004:00080000:3.0:1746143685.281595:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764291455211ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143685.281603:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2190, 88 off183480 00000004:00080000:3.0:1746143685.281605:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764291465506ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143685.281613:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2234, 88 off187528 00000004:00080000:3.0:1746143685.281616:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764291476054ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143685.281624:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2191, 88 off183568 00000004:00080000:3.0:1746143685.281626:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764291486573ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143685.281634:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2235, 88 off187616 00000004:00080000:3.0:1746143685.281637:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764291497538ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143685.281646:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2236, 88 off187704 00000004:00080000:3.0:1746143685.281648:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764291508261ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143685.281656:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2237, 88 off187792 00000004:00080000:3.0:1746143685.281658:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764291518758ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143685.281667:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2238, 88 off187880 00000004:00080000:3.0:1746143685.281669:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764291529837ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143685.281678:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2192, 88 off183656 00000004:00080000:3.0:1746143685.281680:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764291540673ns, next at 718087967394ns, rc = 0 00000100:00100000:2.0:1746143685.285172:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:1964:x1830963592066944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5677us (12703us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.285183:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4683 00000100:00100000:1.0:1746143685.285660:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592067072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5952us (11975us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143685.285668:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4684 00000100:00100000:0.0:1746143685.285869:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592066432:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 35560us (35691us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143685.285878:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3280 00002000:00100000:0.0:1746143685.285891:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88012f187b80 x1830963592066432/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143685.285907:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187b80 with x1830963592066432 ext(1048576->2097151) 00002000:00010000:0.0:1746143685.285912:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f187b80 00000100:00100000:0.0:1746143685.293317:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.295936:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592067200 00000100:00100000:1.0:1746143685.295947:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592067200 00000100:00100000:1.0:1746143685.296004:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9172 00000100:00100000:1.0:1746143685.296012:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28154:x1830963592067200:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143685.296029:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.296047:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a63df000/0xe984082ccd72481c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c86 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.296071:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.296073:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.296082:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63df000/0xe984082ccd72481c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c86 expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.296097:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a63df000/0xe984082ccd72481c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c86 expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.296108:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63df000, rc 0) 00000100:00100000:1.0:1746143685.296203:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28154:x1830963592067200:12345-192.168.202.48@tcp:101:cat.0 Request processed in 189us (2889us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143685.296210:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9172 00000100:00100000:0.0:1746143685.296564:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.297321:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592067328 00000100:00100000:2.0:1746143685.297327:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592067328 00000100:00100000:2.0:1746143685.297358:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9173 00000100:00100000:2.0:1746143685.297366:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28155:x1830963592067328:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143685.297376:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.297386:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd724823 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c8d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.297402:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.297403:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.297408:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd724823 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c8d expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.297419:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd724823 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c8d expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.297428:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c25b200, rc 0) 00000100:00100000:2.0:1746143685.297461:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28155:x1830963592067328:12345-192.168.202.48@tcp:101:cat.0 Request processed in 94us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.297466:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9173 00000100:00100000:0.0:1746143685.307830:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.309200:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592067456 00000100:00100000:3.0:1746143685.309210:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592067456 00000100:00100000:3.0:1746143685.309257:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8189 00000100:00100000:3.0:1746143685.309267:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28155:x1830963592067456:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143685.309287:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.309304:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c94 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.309358:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143685.309367:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.309384:0:14763:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143685.309398:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.309408:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143685.309411:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143685.309414:0:14763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.309420:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d9200, rc 0) 00000100:00100000:3.0:1746143685.309471:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28155:x1830963592067456:12345-192.168.202.48@tcp:101:cat.0 Request processed in 204us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.309477:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8189 00000100:00100000:3.0:1746143685.309546:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.310887:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592067584 00000100:00100000:3.0:1746143685.310894:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592067584 00000100:00100000:3.0:1746143685.310937:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8190 00000100:00100000:3.0:1746143685.310945:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28154:x1830963592067584:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143685.310959:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.310970:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0c9b expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.311005:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c9b expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.311014:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c9b expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.311023:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143685.311025:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143685.311029:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 12 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.311034:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d9a00, rc 0) 00000100:00100000:3.0:1746143685.311070:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28154:x1830963592067584:12345-192.168.202.48@tcp:101:cat.0 Request processed in 125us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.311075:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8190 00000001:00080000:0.0:1746143685.319757:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942267 is committed 00000001:00080000:0.0:1746143685.319766:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942266 is committed 00000001:00080000:0.0:1746143685.319773:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942263 is committed 00000001:00080000:0.0:1746143685.319777:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942268 is committed 00000004:00080000:0.0:1746143685.319780:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1538 committed 00000004:00080000:0.0:1746143685.319786:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1584 committed 00000004:00080000:0.0:1746143685.319791:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1583 committed 00000004:00080000:0.0:1746143685.319793:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1582 committed 00000004:00080000:0.0:1746143685.319794:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1581 committed 00000004:00080000:0.0:1746143685.319796:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1537 committed 00000004:00080000:0.0:1746143685.319797:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1580 committed 00000004:00080000:0.0:1746143685.319798:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1536 committed 00000004:00080000:0.0:1746143685.319800:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1579 committed 00000004:00080000:0.0:1746143685.319801:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1535 committed 00000004:00080000:0.0:1746143685.319802:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1534 committed 00000004:00080000:0.0:1746143685.319803:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1533 committed 00000004:00080000:0.0:1746143685.319805:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1578 committed 00000004:00080000:0.0:1746143685.319806:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1577 committed 00000004:00080000:0.0:1746143685.319807:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1532 committed 00000004:00080000:0.0:1746143685.319808:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1531 committed 00000004:00080000:0.0:1746143685.319809:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1576 committed 00000100:00100000:0.0:1746143685.319837:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593664384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143685.319888:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143685.319907:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593664640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143685.319937:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143685.319944:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593664896:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143685.319950:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593665152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143685.319959:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143685.319970:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593664384 00000100:00100000:0.0:1746143685.319972:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143685.319975:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593664384 00000100:00100000:0.0:1746143685.319975:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593664512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143685.319987:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143685.319997:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593665024:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143685.320001:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593664640 00000100:00100000:2.0:1746143685.320003:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593664640 00000100:00100000:0.0:1746143685.320010:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143685.320014:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593664896 00000100:00100000:2.0:1746143685.320015:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593664896 00000100:00100000:2.0:1746143685.320022:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593664512 00000100:00100000:2.0:1746143685.320024:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593664512 00000100:00100000:0.0:1746143685.320024:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593665024 00000100:00100000:0.0:1746143685.320026:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593665024 00000100:00100000:2.0:1746143685.320036:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9174 00000100:00100000:0.0:1746143685.320039:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9175 00000100:00100000:2.0:1746143685.320041:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3292:x1830963593664384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143685.320043:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3294:x1830963593664640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143685.320055:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9176 00000100:00100000:2.0:1746143685.320058:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3292:x1830963593664896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143685.320091:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9177 00000100:00100000:2.0:1746143685.320095:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3292:x1830963593664512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143685.320129:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9178 00000100:00100000:0.0:1746143685.320133:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3292:x1830963593665024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143685.320253:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143685.320256:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:0.0:1746143685.320259:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00002000:00010000:0.0:1746143685.320260:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:0.0:1746143685.320262:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4139 -> 4139 00002000:00010000:2.0:1746143685.320282:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:2.0:1746143685.320284:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00000100:00100000:0.0:1746143685.320285:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1830963593664640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 241us (347us total) trans 21474839644 rc 0/0 00002000:00010000:2.0:1746143685.320286:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143685.320288:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:2.0:1746143685.320289:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:0.0:1746143685.320291:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9175 00000100:00100000:2.0:1746143685.320308:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3292:x1830963593664896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 249us (348us total) trans 21474839646 rc 0/0 00000100:00100000:2.0:1746143685.320312:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9176 00000100:00100000:2.0:1746143685.320324:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143685.320348:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3292:x1830963593665024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 214us (337us total) trans 21474839647 rc 0/0 00000100:00100000:0.0:1746143685.320353:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9178 00000004:00080000:2.0:1746143685.320357:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bf3800/2, rc 0, transno 21474839644 00000100:00100000:2.0:1746143685.320361:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593664640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143685.320361:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593665152 00000100:00100000:0.0:1746143685.320363:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593665152 00000100:00100000:2.0:1746143685.320365:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746143685.320369:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593664768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143685.320374:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9179 00000100:00100000:0.0:1746143685.320377:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3294:x1830963593665152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143685.320384:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143685.320393:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593665280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143685.320404:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143685.320418:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593664768 00000100:00100000:2.0:1746143685.320421:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593664768 00000100:00100000:2.0:1746143685.320433:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593665280 00000100:00100000:2.0:1746143685.320434:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593665280 00000100:00100000:2.0:1746143685.320442:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9180 00000100:00100000:2.0:1746143685.320446:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3294:x1830963593664768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143685.320451:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3294:x1830963593665152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (126us total) trans 21474839648 rc 0/0 00000100:00100000:0.0:1746143685.320455:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9179 00000100:00100000:0.0:1746143685.320463:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9181 00000100:00100000:0.0:1746143685.320467:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3294:x1830963593665280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143685.320505:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143685.320507:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143685.320509:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143685.320511:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143685.320512:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143685.320525:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963593665280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (119us total) trans 21474839650 rc 0/0 00000100:00100000:2.0:1746143685.320526:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963593664768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (141us total) trans 21474839649 rc 0/0 00000100:00100000:0.0:1746143685.320529:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9181 00000100:00100000:2.0:1746143685.320531:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9180 00000004:00080000:0.0:1746143685.320549:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bf1500/2, rc 0, transno 21474839647 00000100:00100000:0.0:1746143685.320552:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593665024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143685.320558:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bf2300/2, rc 0, transno 21474839646 00000100:00100000:0.0:1746143685.320561:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593664896:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143685.320604:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143685.320606:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:2.0:1746143685.320608:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00002000:00010000:2.0:1746143685.320610:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:2.0:1746143685.320611:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746143685.320629:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3292:x1830963593664384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 588us (742us total) trans 21474839651 rc 0/0 00000100:00100000:2.0:1746143685.320634:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9174 00010000:00010000:3.0:1746143685.320712:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c7f expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.320722:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143685.320724:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746143685.320727:0:14764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.320739:0:14764:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.320744:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.320750:0:14764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c9b expref: 240 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.320757:0:14764:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c9b expref: 240 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.320762:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c9b expref: 240 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.320783:0:14764:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c9b expref: 240 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143685.320791:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593665408:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143685.320843:0:14764:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143685.320849:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593665536:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143685.320865:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143685.320961:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593665792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.320980:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.320992:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593666304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.321006:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.321016:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746143685.321020:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593665664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.321031:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.321040:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593666176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.321050:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.321063:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593666048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.321074:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.321083:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593666560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.321093:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.321102:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746143685.321106:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593665920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.321118:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.321124:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593666432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.321134:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.321166:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593665792 00000100:00100000:3.0:1746143685.321169:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593665792 00000100:00100000:3.0:1746143685.321180:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593666304 00000100:00100000:3.0:1746143685.321182:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593666304 00000100:00100000:3.0:1746143685.321187:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593665664 00000100:00100000:3.0:1746143685.321188:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593665664 00000100:00100000:3.0:1746143685.321193:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593666176 00000100:00100000:3.0:1746143685.321194:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593666176 00000100:00100000:3.0:1746143685.321199:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593666048 00000100:00100000:3.0:1746143685.321200:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593666048 00000100:00100000:3.0:1746143685.321205:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593666560 00000100:00100000:3.0:1746143685.321206:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593666560 00000100:00100000:3.0:1746143685.321211:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593665920 00000100:00100000:3.0:1746143685.321212:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593665920 00000100:00100000:3.0:1746143685.321217:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593666432 00000100:00100000:3.0:1746143685.321219:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593666432 00000100:00100000:3.0:1746143685.321225:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9182 00000100:00100000:3.0:1746143685.321229:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3293:x1830963593665792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143685.321313:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143685.321315:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.321317:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.321319:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.321320:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143685.321338:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3293:x1830963593665792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (358us total) trans 17179872379 rc 0/0 00000100:00100000:3.0:1746143685.321342:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9182 00000100:00100000:3.0:1746143685.321357:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9183 00000100:00100000:3.0:1746143685.321361:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3293:x1830963593666304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.321418:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3293:x1830963593666304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (412us total) trans 17179872380 rc 0/0 00000100:00100000:3.0:1746143685.321422:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9183 00000100:00100000:3.0:1746143685.321431:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9184 00000100:00100000:3.0:1746143685.321435:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3293:x1830963593665664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143685.321483:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143685.321485:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.321487:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.321488:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.321490:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:3.0:1746143685.321503:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3293:x1830963593665664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (471us total) trans 17179872381 rc 0/0 00000100:00100000:3.0:1746143685.321507:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9184 00000100:00100000:3.0:1746143685.321517:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9185 00000100:00100000:3.0:1746143685.321521:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3293:x1830963593666176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.321586:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3293:x1830963593666176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (534us total) trans 17179872382 rc 0/0 00000100:00100000:3.0:1746143685.321591:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9185 00000100:00100000:3.0:1746143685.321600:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9186 00000100:00100000:3.0:1746143685.321603:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3295:x1830963593666048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143685.321653:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143685.321655:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746143685.321656:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143685.321658:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746143685.321659:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143685.321675:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3295:x1830963593666048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (600us total) trans 17179872383 rc 0/0 00000100:00100000:3.0:1746143685.321679:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9186 00000100:00100000:3.0:1746143685.321687:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9187 00000100:00100000:3.0:1746143685.321690:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3295:x1830963593666560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.321744:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3295:x1830963593666560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (649us total) trans 17179872384 rc 0/0 00000100:00100000:3.0:1746143685.321748:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9187 00000100:00100000:3.0:1746143685.321756:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9188 00000100:00100000:3.0:1746143685.321759:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3295:x1830963593665920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143685.321818:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:3.0:1746143685.321820:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.321822:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.321823:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00002000:00010000:3.0:1746143685.321825:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5543 -> 5543 00000100:00100000:3.0:1746143685.321841:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3295:x1830963593665920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (722us total) trans 17179872385 rc 0/0 00000100:00100000:2.0:1746143685.321844:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9189 00000100:00100000:3.0:1746143685.321847:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9188 00000100:00100000:2.0:1746143685.321850:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3295:x1830963593666432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143685.321938:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3295:x1830963593666432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (801us total) trans 17179872386 rc 0/0 00000100:00100000:2.0:1746143685.321943:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9189 00000004:00080000:3.0:1746143685.321959:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f184380/2, rc 0, transno 17179872385 00000100:00100000:3.0:1746143685.321966:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593665920:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143685.321972:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0adc00/2, rc 0, transno 17179872386 00000100:00100000:3.0:1746143685.321974:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593666432:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143685.321975:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143685.321977:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143684 -> 1746143684 00002000:00010000:2.0:1746143685.321979:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143684 -> 1746143684 00000004:00080000:3.0:1746143685.321980:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0aea00/2, rc 0, transno 17179872383 00002000:00010000:2.0:1746143685.321981:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143684 -> 1746143684 00000100:00100000:3.0:1746143685.321982:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593666048:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143685.321983:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000004:00080000:3.0:1746143685.321987:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0ad180/2, rc 0, transno 17179872384 00000100:00100000:3.0:1746143685.321989:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593666560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143685.321998:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963593664512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1903us (2010us total) trans 21474839645 rc 0/0 00000100:00100000:2.0:1746143685.322003:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9177 00000004:00080000:3.0:1746143685.322015:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f184e00/2, rc 0, transno 17179872381 00000100:00100000:3.0:1746143685.322017:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593665664:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143685.322022:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0af100/2, rc 0, transno 17179872382 00000100:00100000:3.0:1746143685.322024:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593666176:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143685.322028:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f185180/2, rc 0, transno 17179872379 00000100:00100000:3.0:1746143685.322030:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593665792:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143685.322035:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0ae300/2, rc 0, transno 17179872380 00000100:00100000:3.0:1746143685.322037:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593666304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.322041:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746143685.322044:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593666688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.322059:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143685.322073:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593666688 00000100:00100000:3.0:1746143685.322075:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593666688 00000100:00100000:3.0:1746143685.322087:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9190 00000100:00100000:3.0:1746143685.322091:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3293:x1830963593666688:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143685.322101:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bf0700/2, rc 0, transno 21474839649 00000100:00100000:2.0:1746143685.322104:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593664768:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143685.322110:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f9c00/2, rc 0, transno 21474839650 00000100:00100000:2.0:1746143685.322113:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593665280:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143685.322119:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f532d80/2, rc 0, transno 21474839648 00000100:00100000:2.0:1746143685.322121:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593665152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143685.322501:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bf3480/2, rc 0, transno 21474839645 00000100:00100000:0.0:1746143685.322506:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593664512:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143685.322512:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bf1c00/2, rc 0, transno 21474839651 00000100:00100000:0.0:1746143685.322514:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593664384:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143685.323457:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3293:x1830963593666688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1363us (1395us total) trans 17179872387 rc 0/0 00000100:00100000:3.0:1746143685.323463:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9190 00000004:00080000:0.0:1746143685.323516:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0afb80/2, rc 0, transno 17179872387 00000100:00100000:0.0:1746143685.323519:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593666688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143685.327342:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.327438:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f185c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593665536:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143685.328189:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592067712 00000100:00100000:1.0:1746143685.328195:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592067712 00000100:00100000:1.0:1746143685.328238:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3307 00000100:00100000:1.0:1746143685.328245:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28155:x1830963592067712:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:0.0:1746143685.328563:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593665408:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143685.328595:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ae00/0xe984082ccd72480e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c7f expref: 11 pid: 14764 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746143685.328611:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c7f expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143685.328627:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c25b600, rc 0) 00000100:00100000:1.0:1746143685.328750:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28155:x1830963592067712:12345-192.168.202.48@tcp:49:cat.0 Request processed in 504us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143685.328756:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3307 00000100:00100000:0.0:1746143685.330022:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28153:x1830963592066816:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 72419us (72926us total) trans 8589942268 rc 0/0 00000100:00100000:0.0:1746143685.330028:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8188 00000100:00100000:0.0:1746143685.330089:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.330170:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592067840 00000100:00100000:1.0:1746143685.330174:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592067840 00000100:00100000:1.0:1746143685.330193:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3308 00000100:00100000:1.0:1746143685.330198:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:28154:x1830963592067840:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:1.0:1746143685.330245:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:28154:x1830963592067840:12345-192.168.202.48@tcp:49:cat.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143685.330249:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3308 00000100:00100000:0.0:1746143685.341936:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.342640:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592067968 00000100:00100000:2.0:1746143685.342648:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592067968 00000100:00100000:2.0:1746143685.342692:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9191 00000100:00100000:2.0:1746143685.342697:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28153:x1830963592067968:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143685.342712:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.342725:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ca2 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.342752:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009135ba00/0xe984082ccd724712 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c2b expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.342758:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.342759:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.342762:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3780608->4194303] (req 3780608->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 21 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.342782:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009135ba00/0xe984082ccd724712 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c2b expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.342791:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009135ba00/0xe984082ccd724712 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c2b expref: 11 pid: 8495 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746143685.342799:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593666816:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143685.342861:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143685.344865:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.346132:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592068224 00000100:00100000:1.0:1746143685.346154:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592068224 00002000:00100000:1.0:1746143685.346194:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800908f2300 x1830963592068224/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143685.346203:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f2300 with x1830963592068224 ext(1048576->2097151) 00002000:00010000:1.0:1746143685.346208:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f2300 00000100:00100000:1.0:1746143685.346324:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3281 00000100:00100000:1.0:1746143685.346331:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592068224:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143685.346513:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593666816:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143685.346534:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3780608->4194303] (req 3780608->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.346546:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9c5600, rc 0) 00000100:00100000:3.0:1746143685.346589:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28153:x1830963592067968:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3892us (4670us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.346595:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9191 00000100:00100000:0.0:1746143685.348639:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.348687:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592068480 00000100:00100000:3.0:1746143685.348692:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592068480 00002000:00100000:3.0:1746143685.348717:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800908f0e00 x1830963592068480/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.348724:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f0e00 with x1830963592068480 ext(1048576->2097151) 00002000:00010000:3.0:1746143685.348728:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f0e00 00000100:00100000:2.0:1746143685.349130:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.349343:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3282 00000100:00100000:3.0:1746143685.349350:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592068480:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143685.349359:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592068608 00000100:00100000:1.0:1746143685.349363:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592068608 00010000:00010000:1.0:1746143685.349381:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009135ba00/0xe984082ccd724712 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c2b expref: 12 pid: 8495 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746143685.349399:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4685 00000100:00100000:1.0:1746143685.349403:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592068608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143685.349410:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143685.349424:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009135ba00/0xe984082ccd724712 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c2b expref: 12 pid: 8495 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746143685.349433:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009135ba00/0xe984082ccd724712 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c2b expref: 12 pid: 8495 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746143685.349449:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009135ba00/0xe984082ccd724712 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c2b expref: 12 pid: 8495 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746143685.349463:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.349465:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.349470:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.349476:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.349500:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143685.349509:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593666944:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143685.349553:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143685.360390:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593666944:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143685.360408:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143685.360692:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592068608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 11285us (11560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.360701:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4685 00000100:00100000:0.0:1746143685.362863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.363257:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592068864 00000100:00100000:2.0:1746143685.363264:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592068864 00002000:00100000:2.0:1746143685.363304:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3780608->3784703) req@ffff8800908f1880 x1830963592068864/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.363318:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f1880 with x1830963592068864 ext(3780608->3784703) 00002000:00010000:2.0:1746143685.363322:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f1880 00000100:00100000:2.0:1746143685.363351:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3283 00000100:00100000:2.0:1746143685.363358:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592068864:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143685.364107:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592068864:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 747us (1247us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143685.364113:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3283 00002000:00100000:2.0:1746143685.364119:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3780608->3784703) req@ffff8800908f1880 x1830963592068864/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/4536 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.364126:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f1880 with x1830963592068864 ext(3780608->3784703) 00002000:00010000:2.0:1746143685.364128:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f1880 00000100:00100000:2.0:1746143685.364993:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592068224:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 18660us (20132us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143685.364998:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3281 00002000:00100000:2.0:1746143685.365003:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800908f2300 x1830963592068224/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.365009:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f2300 with x1830963592068224 ext(1048576->2097151) 00002000:00010000:2.0:1746143685.365013:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f2300 00000100:00100000:3.0:1746143685.372541:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592068480:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23184us (23901us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143685.372550:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3282 00002000:00100000:3.0:1746143685.372561:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800908f0e00 x1830963592068480/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.372569:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f0e00 with x1830963592068480 ext(1048576->2097151) 00002000:00010000:3.0:1746143685.372573:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f0e00 00000100:00100000:0.0:1746143685.380548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.380823:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592068992 00000100:00100000:3.0:1746143685.380831:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592068992 00000100:00100000:3.0:1746143685.380868:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9192 00000100:00100000:3.0:1746143685.380874:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28153:x1830963592068992:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143685.380890:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.380906:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ca9 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.380936:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd72470b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c24 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143685.380942:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143685.380943:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143685.380946:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [4194304->4345855] (req 4194304->4345855) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.380972:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd72470b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c24 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143685.380983:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd72470b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c24 expref: 11 pid: 8495 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746143685.380993:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593667072:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143685.381833:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143685.387263:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.387297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.387339:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.387366:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592069248 00000100:00100000:3.0:1746143685.387374:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592069248 00000100:00100000:2.0:1746143685.387426:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592069120 00000100:00100000:2.0:1746143685.387430:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592069120 00000100:00100000:0.0:1746143685.387448:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592069376 00000100:00100000:0.0:1746143685.387452:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592069376 00010000:00010000:2.0:1746143685.387455:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd72470b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c24 expref: 12 pid: 8495 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746143685.387482:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4686 00000100:00100000:2.0:1746143685.387488:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592069120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143685.387499:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143685.387688:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd72470b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c24 expref: 12 pid: 8495 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746143685.387699:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd72470b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c24 expref: 12 pid: 8495 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746143685.387720:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.387722:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.387728:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 16 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.387736:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 16 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.387761:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 16 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143685.387771:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593667200:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143685.388064:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9193 00000100:00100000:0.0:1746143685.388071:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28155:x1830963592069376:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143685.388074:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9194 00000100:00100000:3.0:1746143685.388081:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28154:x1830963592069248:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143685.388084:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.388088:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143685.388093:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd724846 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0cb7 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.388095:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a623b600/0xe984082ccd72484d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0cb0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143685.388106:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143685.388107:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143685.388111:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd724846 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb7 expref: 17 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143685.388179:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143685.388225:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143685.388227:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143685.388232:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a623b600/0xe984082ccd72484d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb0 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.388242:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a623b600/0xe984082ccd72484d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb0 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.388250:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a623b600, rc 0) 00000100:00100000:3.0:1746143685.388273:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:28154:x1830963592069248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 192us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.388278:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9194 00010000:00010000:3.0:1746143685.388317:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095197600/0xe984082ccd72470b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c24 expref: 12 pid: 8495 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746143685.388338:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593667072:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143685.388354:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.388361:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900cb000, rc 0) 00010000:00010000:0.0:1746143685.388462:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd724846 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb7 expref: 17 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143685.388471:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d8a00, rc 0) 00000100:00100000:0.0:1746143685.388491:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28155:x1830963592069376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 421us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143685.388496:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9193 00000100:00100000:3.0:1746143685.389003:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28153:x1830963592068992:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7503us (7836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.389009:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9192 00000100:00100000:2.0:1746143685.396608:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593667200:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143685.396608:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.396673:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592069632 00000100:00100000:3.0:1746143685.396678:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592069632 00002000:00100000:3.0:1746143685.396715:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008e627800 x1830963592069632/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.396723:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e627800 with x1830963592069632 ext(1048576->2097151) 00002000:00010000:3.0:1746143685.396727:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e627800 00000100:00100000:3.0:1746143685.396757:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3284 00000100:00100000:3.0:1746143685.396764:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592069632:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:2.0:1746143685.398043:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143685.398066:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.398069:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592069120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10580us (10814us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.398078:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4686 00000100:00100000:0.0:1746143685.400828:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592069888 00000100:00100000:0.0:1746143685.400837:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592069888 00002000:00100000:0.0:1746143685.400874:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4341760->4345855) req@ffff8800908f1180 x1830963592069888/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143685.400882:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f1180 with x1830963592069888 ext(4341760->4345855) 00002000:00010000:0.0:1746143685.400887:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800908f1180 00000100:00100000:0.0:1746143685.400917:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3285 00000100:00100000:0.0:1746143685.400934:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592069888:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143685.401076:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592069888:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 142us (3010us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143685.401082:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3285 00002000:00100000:0.0:1746143685.401087:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4341760->4345855) req@ffff8800908f1180 x1830963592069888/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/4536 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143685.401095:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f1180 with x1830963592069888 ext(4341760->4345855) 00002000:00010000:0.0:1746143685.401097:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800908f1180 00000100:00100000:1.0:1746143685.405222:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.405315:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592070144 00000100:00100000:2.0:1746143685.405322:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592070144 00002000:00100000:2.0:1746143685.405356:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008e626d80 x1830963592070144/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.405365:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e626d80 with x1830963592070144 ext(1048576->2097151) 00002000:00010000:2.0:1746143685.405369:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e626d80 00000100:00100000:2.0:1746143685.405396:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3286 00000100:00100000:2.0:1746143685.405401:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963592070144:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143685.417539:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592069632:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20764us (20927us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143685.417551:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3284 00002000:00100000:3.0:1746143685.417563:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008e627800 x1830963592069632/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.417573:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e627800 with x1830963592069632 ext(1048576->2097151) 00002000:00010000:3.0:1746143685.417579:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e627800 00000100:00100000:2.0:1746143685.422944:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963592070144:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 17533us (17720us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143685.422955:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3286 00002000:00100000:2.0:1746143685.422965:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008e626d80 x1830963592070144/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.422973:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e626d80 with x1830963592070144 ext(1048576->2097151) 00002000:00010000:2.0:1746143685.422978:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e626d80 00000100:00100000:1.0:1746143685.436227:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.436281:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.436359:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592070272 00000100:00100000:0.0:1746143685.436366:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592070272 00000100:00100000:0.0:1746143685.436401:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592070400 00000100:00100000:0.0:1746143685.436404:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592070400 00000100:00100000:0.0:1746143685.436435:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9195 00000100:00100000:0.0:1746143685.436443:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592070272:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143685.436459:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143685.436475:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5003000/0xe984082ccd724854 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0cbe expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143685.436519:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800908f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593667328:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143685.436587:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143685.436732:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9196 00000100:00100000:3.0:1746143685.436740:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592070400:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143685.436748:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.436758:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a623a600/0xe984082ccd72485b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0cc5 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143685.436783:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593667456:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143685.436811:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3780 going to sleep for 11 seconds 00002000:00010000:3.0:1746143685.442645:0:9527:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime: 1746143684 -> 1746143685 00002000:00010000:3.0:1746143685.442653:0:9527:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143684 -> 1746143685 00002000:00010000:3.0:1746143685.442655:0:9527:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime: 1746143684 -> 1746143685 00000100:00100000:3.0:1746143685.442677:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593667456:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143685.442707:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a623a600/0xe984082ccd72485b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cc5 expref: 31 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143685.442719:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a623a600/0xe984082ccd72485b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cc5 expref: 31 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143685.442734:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a623a600, rc 0) 00002000:00010000:2.0:1746143685.443053:0:12618:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime: 1746143684 -> 1746143685 00002000:00010000:2.0:1746143685.443056:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime: 1746143684 -> 1746143685 00002000:00010000:2.0:1746143685.443058:0:12618:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime: 1746143684 -> 1746143685 00000100:00100000:2.0:1746143685.443068:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800908f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593667328:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143685.443083:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5003000/0xe984082ccd724854 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cbe expref: 32 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.443096:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5003000/0xe984082ccd724854 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cbe expref: 32 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.443106:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5003000, rc 0) 00000100:00100000:3.0:1746143685.443852:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592070400:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7111us (7568us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143685.443852:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592070272:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7408us (7632us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143685.443860:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9196 00000100:00100000:2.0:1746143685.443862:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9195 00000100:00100000:0.0:1746143685.445469:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.445500:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.445523:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.445546:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.445607:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592070656 00000100:00100000:2.0:1746143685.445614:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592070656 00002000:00100000:2.0:1746143685.445648:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800908f2d80 x1830963592070656/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.445658:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f2d80 with x1830963592070656 ext(2097152->3145727) 00002000:00010000:2.0:1746143685.445662:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800908f2d80 00000100:00100000:2.0:1746143685.445675:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592070912 00000100:00100000:2.0:1746143685.445677:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592070912 00000100:00100000:3.0:1746143685.445684:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592071168 00000100:00100000:3.0:1746143685.445687:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592071168 00002000:00100000:2.0:1746143685.445687:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800908f0000 x1830963592070912/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.445693:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f0000 with x1830963592070912 ext(3145728->4194303) 00002000:00010000:2.0:1746143685.445695:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800908f0000 00002000:00100000:3.0:1746143685.445702:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800908f2680 x1830963592071168/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143685.445707:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592071424 00002000:00100000:3.0:1746143685.445708:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f2680 with x1830963592071168 ext(2097152->3145727) 00000100:00100000:2.0:1746143685.445709:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592071424 00002000:00010000:3.0:1746143685.445711:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f2680 00002000:00100000:2.0:1746143685.445717:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3780607) req@ffff8800908f1c00 x1830963592071424/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143685.445722:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3287 00002000:00100000:2.0:1746143685.445723:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f1c00 with x1830963592071424 ext(3145728->3780607) 00002000:00010000:2.0:1746143685.445726:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f1c00 00000100:00100000:3.0:1746143685.445728:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592070656:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143685.445733:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3288 00000100:00100000:2.0:1746143685.445737:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592070912:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143685.446772:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3289 00000100:00100000:2.0:1746143685.446779:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592071168:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143685.447765:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3290 00000100:00100000:0.0:1746143685.447773:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592071424:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143685.453616:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.453643:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592071552 00000100:00100000:3.0:1746143685.453649:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592071552 00000100:00100000:3.0:1746143685.453692:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9197 00000100:00100000:3.0:1746143685.453699:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:28154:x1830963592071552:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143685.453714:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.453731:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ccc expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.453755:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 19 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.453762:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143685.453764:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143685.453767:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.453793:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 19 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.453804:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 19 pid: 9527 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746143685.453815:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593667584:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143685.453871:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143685.457576:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.457662:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592071680 00000100:00100000:2.0:1746143685.457670:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592071680 00000100:00100000:2.0:1746143685.457984:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9198 00000100:00100000:2.0:1746143685.457992:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:28149:x1830963592071680:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143685.458010:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.458025:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0cd3 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.458048:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143685.458053:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.458059:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143685.458062:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.458091:0:9527:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.458101:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.458113:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5793800, rc 0) 00000100:00100000:2.0:1746143685.458256:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:28149:x1830963592071680:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 263us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.458261:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9198 00000100:00100000:3.0:1746143685.459827:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593667584:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143685.459846:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 33 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.460591:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a623f200, rc 0) 00000100:00100000:3.0:1746143685.460635:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:28154:x1830963592071552:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6935us (7025us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.460643:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9197 00000100:00100000:0.0:1746143685.460861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.462539:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592071808 00000100:00100000:2.0:1746143685.462548:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592071808 00002000:00100000:2.0:1746143685.462584:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4345855) req@ffff8800908f0700 x1830963592071808/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.462593:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f0700 with x1830963592071808 ext(4194304->4345855) 00010000:00010000:2.0:1746143685.462601:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 20 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.462614:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 20 pid: 9527 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746143685.462620:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800908f0700 00000100:00100000:2.0:1746143685.462647:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 786 00000100:00100000:2.0:1746143685.462653:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592071808:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143685.468490:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592070912:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22743us (22980us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143685.468501:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3288 00002000:00100000:2.0:1746143685.468510:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800908f0000 x1830963592070912/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.468525:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f0000 with x1830963592070912 ext(3145728->4194303) 00010000:00010000:2.0:1746143685.468534:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 20 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.468548:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 20 pid: 9527 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746143685.468554:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800908f0000 00000100:00100000:1.0:1746143685.470479:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592071424:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22701us (24924us total) trans 0 rc 634880/634880 00000100:00100000:1.0:1746143685.470489:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3290 00002000:00100000:1.0:1746143685.470497:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3780607) req@ffff8800908f1c00 x1830963592071424/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143685.470505:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f1c00 with x1830963592071424 ext(3145728->3780607) 00002000:00010000:1.0:1746143685.470510:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f1c00 00000100:00100000:3.0:1746143685.479312:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592070656:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33577us (33840us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143685.479312:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592071808:12345-192.168.202.48@tcp:4:cat.0 Request processed in 16651us (18444us total) trans 17179872388 rc 0/0 00000100:00100000:3.0:1746143685.479322:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3287 00002000:00100000:3.0:1746143685.479335:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800908f2d80 x1830963592070656/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.479345:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f2d80 with x1830963592070656 ext(2097152->3145727) 00010000:00010000:3.0:1746143685.479353:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 19 pid: 9527 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.479361:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 786 00010000:00010000:3.0:1746143685.479367:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 19 pid: 9527 timeout: 864 lvb_type: 0 00002000:00100000:2.0:1746143685.479368:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4345855) req@ffff8800908f0700 x1830963592071808/t17179872388(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/448 e 0 to 0 dl 1746143696 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746143685.479374:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800908f2d80 00002000:00100000:2.0:1746143685.479375:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f0700 with x1830963592071808 ext(4194304->4345855) 00010000:00010000:2.0:1746143685.479380:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 19 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.479388:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 18 pid: 9527 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746143685.479393:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800908f0700 00000100:00100000:2.0:1746143685.481132:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592071168:12345-192.168.202.48@tcp:3:cat.0 Request processed in 34349us (35604us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143685.481155:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3289 00002000:00100000:2.0:1746143685.481162:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800908f2680 x1830963592071168/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.481170:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f2680 with x1830963592071168 ext(2097152->3145727) 00002000:00010000:2.0:1746143685.481173:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f2680 00000100:00100000:0.0:1746143685.495224:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.496895:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592071936 00000100:00100000:2.0:1746143685.496905:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592071936 00010000:00010000:2.0:1746143685.496959:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 18 pid: 9527 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.496998:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4687 00000100:00100000:2.0:1746143685.497005:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592071936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143685.497016:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143685.497036:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 18 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.497047:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 18 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.497066:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900cb000/0xe984082ccd72483f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca9 expref: 18 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.497814:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.497817:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.497825:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.497834:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.497864:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.497875:0:23335:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 32 pid: 12618 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.497885:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593667840:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143685.498103:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143685.499388:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.499471:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592072064 00000100:00100000:2.0:1746143685.499476:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592072064 00000100:00100000:2.0:1746143685.499506:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9199 00000100:00100000:2.0:1746143685.499511:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28155:x1830963592072064:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143685.499524:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.499536:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd724870 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0cda expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.499552:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.499554:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.499559:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd724870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cda expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.499569:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd724870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cda expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.499577:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffb6c00, rc 0) 00000100:00100000:2.0:1746143685.501240:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28155:x1830963592072064:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1721us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.501248:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9199 00000100:00100000:0.0:1746143685.503461:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.503720:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593667840:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143685.503737:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143685.505799:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592071936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8787us (10576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.505811:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4687 00000100:00100000:3.0:1746143685.505936:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592072320 00000100:00100000:3.0:1746143685.505944:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592072320 00002000:00100000:3.0:1746143685.505979:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800908f3800 x1830963592072320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.505988:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f3800 with x1830963592072320 ext(2097152->3145727) 00010000:00010000:3.0:1746143685.505997:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746143685.506010:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746143685.506016:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800908f3800 00000100:00100000:3.0:1746143685.506031:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 787 00000100:00100000:3.0:1746143685.506037:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963592072320:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143685.507513:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.507576:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592072576 00000100:00100000:2.0:1746143685.507581:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592072576 00002000:00100000:2.0:1746143685.507600:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800908f1f80 x1830963592072576/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.507607:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f1f80 with x1830963592072576 ext(3145728->4194303) 00002000:00010000:2.0:1746143685.507611:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800908f1f80 00000100:00100000:2.0:1746143685.507625:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3291 00000100:00100000:2.0:1746143685.507630:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592072576:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143685.525315:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592072576:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17674us (17797us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143685.525327:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3291 00002000:00100000:2.0:1746143685.525336:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800908f1f80 x1830963592072576/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.525344:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f1f80 with x1830963592072576 ext(3145728->4194303) 00002000:00010000:2.0:1746143685.525350:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800908f1f80 00000100:00100000:2.0:1746143685.526813:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963592072320:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 20773us (23354us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143685.526822:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 787 00002000:00100000:2.0:1746143685.526829:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800908f3800 x1830963592072320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.526837:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f3800 with x1830963592072320 ext(2097152->3145727) 00010000:00010000:2.0:1746143685.526845:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.526859:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746143685.526865:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800908f3800 00000100:00100000:0.0:1746143685.538522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.538554:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.538586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.538588:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592072704 00000100:00100000:2.0:1746143685.538595:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592072704 00000100:00100000:2.0:1746143685.538643:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592072832 00000100:00100000:2.0:1746143685.538645:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592072832 00000100:00100000:2.0:1746143685.538661:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9200 00000100:00100000:2.0:1746143685.538668:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592072704:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143685.538683:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.538697:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724877 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ce1 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.538714:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.538723:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724877 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce1 expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.538733:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724877 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce1 expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.538746:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d7c00, rc 0) 00000100:00100000:2.0:1746143685.538781:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592072704:12345-192.168.202.48@tcp:101:cat.0 Request processed in 113us (265us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143685.538787:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9200 00000100:00100000:2.0:1746143685.538798:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9201 00000100:00100000:2.0:1746143685.538803:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28154:x1830963592072832:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143685.538808:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.538815:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ce8 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.538831:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 20 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.538837:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143685.538838:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143685.538841:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.538864:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 20 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.538873:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 20 pid: 9527 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.538884:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593667968:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143685.538944:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143685.538962:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592072960 00000100:00100000:2.0:1746143685.538965:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592072960 00010000:00010000:2.0:1746143685.538978:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.538993:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4688 00000100:00100000:2.0:1746143685.538997:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963592072960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143685.539004:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143685.539019:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.539027:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.539039:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a623f200/0xe984082ccd724862 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ccc expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.539049:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.539050:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.539055:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 32 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.539061:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 32 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.539078:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 32 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143685.539086:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593668096:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143685.539103:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143685.543098:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.543165:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592073216 00000100:00100000:0.0:1746143685.543172:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592073216 00002000:00100000:0.0:1746143685.543210:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009c3fb800 x1830963592073216/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143685.543219:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb800 with x1830963592073216 ext(4194304->4898815) 00002000:00010000:0.0:1746143685.543224:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb800 00000100:00100000:0.0:1746143685.543240:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3292 00000100:00100000:0.0:1746143685.543246:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592073216:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143685.547914:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593668096:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143685.547947:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143685.547973:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592072960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8973us (9384us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.547983:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4688 00000100:00100000:2.0:1746143685.548033:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.548072:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592073472 00000100:00100000:2.0:1746143685.548078:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592073472 00002000:00100000:2.0:1746143685.548106:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2879488->2883583) req@ffff88009c3fbb80 x1830963592073472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.548116:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830963592073472 ext(2879488->2883583) 00002000:00010000:2.0:1746143685.548120:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fbb80 00000100:00100000:2.0:1746143685.548135:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3293 00000100:00100000:2.0:1746143685.548168:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592073472:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143685.548280:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592073472:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 113us (247us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143685.548285:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3293 00002000:00100000:2.0:1746143685.548290:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2879488->2883583) req@ffff88009c3fbb80 x1830963592073472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/4536 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.548296:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830963592073472 ext(2879488->2883583) 00002000:00010000:2.0:1746143685.548300:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fbb80 00000100:00100000:3.0:1746143685.548423:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593667968:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143685.548441:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.548454:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d6800, rc 0) 00000100:00100000:3.0:1746143685.548475:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:28154:x1830963592072832:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9672us (9919us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.548482:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9201 00000100:00100000:2.0:1746143685.551545:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.551999:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592073600 00000100:00100000:1.0:1746143685.552006:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592073600 00002000:00100000:1.0:1746143685.552044:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3780608->4194303) req@ffff88009c3faa00 x1830963592073600/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143685.552053:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830963592073600 ext(3780608->4194303) 00010000:00010000:1.0:1746143685.552060:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 21 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746143685.552073:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 21 pid: 9527 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746143685.552083:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c3faa00 00000100:00100000:1.0:1746143685.552112:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 788 00000100:00100000:1.0:1746143685.552118:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592073600:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143685.557440:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592073216:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14185us (14340us total) trans 0 rc 704512/704512 00000100:00100000:0.0:1746143685.557451:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3292 00002000:00100000:0.0:1746143685.557460:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009c3fb800 x1830963592073216/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143685.557469:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb800 with x1830963592073216 ext(4194304->4898815) 00002000:00010000:0.0:1746143685.557475:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb800 00000100:00100000:0.0:1746143685.563281:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.563366:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592073728 00000100:00100000:3.0:1746143685.563374:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592073728 00000100:00100000:3.0:1746143685.563409:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9202 00000100:00100000:3.0:1746143685.563416:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:28149:x1830963592073728:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143685.563432:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.563446:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0cef expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.563468:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143685.563473:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.563479:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143685.563483:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2879487] (req 2097152->2879487) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.563510:0:12618:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.563521:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2879487] (req 2097152->2879487) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.563530:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0701a00, rc 0) 00000100:00100000:3.0:1746143685.563656:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:28149:x1830963592073728:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 238us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.563662:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9202 00000100:00100000:0.0:1746143685.570393:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.570423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.570439:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592073984 00000100:00100000:0.0:1746143685.570447:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592073984 00000100:00100000:0.0:1746143685.570482:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592073856 00000100:00100000:0.0:1746143685.570484:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592073856 00000100:00100000:0.0:1746143685.570499:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9203 00000100:00100000:0.0:1746143685.570505:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592073984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143685.570519:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143685.570536:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1c00/0xe984082ccd72488c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0cfd expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143685.570583:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593668352:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143685.570646:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143685.570798:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9204 00000100:00100000:2.0:1746143685.570805:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592073856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143685.570812:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.570821:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9800/0xe984082ccd724893 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0cf6 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.570839:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9800/0xe984082ccd724893 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cf6 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.570848:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9800/0xe984082ccd724893 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cf6 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.570860:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a9800, rc 0) 00000100:00100000:2.0:1746143685.570883:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592073856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 79us (459us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143685.570888:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9204 00010000:00010000:3.0:1746143685.570990:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143685.574089:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963592073600:12345-192.168.202.48@tcp:4:cat.0 Request processed in 21964us (22544us total) trans 21474839652 rc 0/0 00000100:00100000:1.0:1746143685.574099:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 788 00002000:00100000:1.0:1746143685.574109:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3780608->4194303) req@ffff88009c3faa00 x1830963592073600/t21474839652(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/448 e 0 to 0 dl 1746143696 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143685.574118:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830963592073600 ext(3780608->4194303) 00010000:00010000:1.0:1746143685.574127:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 25 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746143685.574157:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 25 pid: 9527 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746143685.574163:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c3faa00 00000100:00100000:2.0:1746143685.576102:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593668352:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143685.576128:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1c00/0xe984082ccd72488c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cfd expref: 24 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.576201:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1c00/0xe984082ccd72488c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cfd expref: 24 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.576227:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5d1c00, rc 0) 00000100:00100000:2.0:1746143685.576290:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592073984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5783us (5903us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143685.576435:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9203 00000100:00100000:0.0:1746143685.582013:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.582052:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.582093:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.582178:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592074112 00000100:00100000:2.0:1746143685.582185:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592074112 00010000:00010000:2.0:1746143685.582215:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 23 pid: 9527 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.582239:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4689 00000100:00100000:2.0:1746143685.582246:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592074112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143685.582257:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143685.582275:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 23 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.582286:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 23 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.582304:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724838 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3780608->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ca2 expref: 23 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.582321:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.582322:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.582328:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.582335:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.582366:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.582375:0:23335:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 31 pid: 12618 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.582385:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593668480:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143685.582447:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143685.582512:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592074240 00000100:00100000:1.0:1746143685.582516:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592074240 00000100:00100000:1.0:1746143685.582536:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592074368 00000100:00100000:1.0:1746143685.582538:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592074368 00000100:00100000:1.0:1746143685.582548:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9205 00000100:00100000:1.0:1746143685.582553:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592074240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143685.582563:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.582575:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd72489a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d04 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.582593:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd72489a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d04 expref: 19 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.582601:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e600/0xe984082ccd72489a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d04 expref: 19 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.582612:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef3e600, rc 0) 00000100:00100000:1.0:1746143685.582632:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592074240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 78us (579us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143685.582637:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9205 00000100:00100000:1.0:1746143685.582650:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9206 00000100:00100000:1.0:1746143685.582655:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592074368:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143685.582661:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.582666:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f9c4e00/0xe984082ccd7248a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d0b expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.582675:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.582679:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f9c4e00/0xe984082ccd7248a1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d0b expref: 24 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.582685:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f9c4e00/0xe984082ccd7248a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d0b expref: 24 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.582691:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9c4e00, rc 0) 00000100:00100000:1.0:1746143685.582706:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592074368:12345-192.168.202.48@tcp:101:cat.0 Request processed in 51us (613us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143685.582711:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9206 00000100:00100000:2.0:1746143685.585299:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593668480:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143685.585317:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143685.585350:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592074112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3104us (3343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.585359:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4689 00000100:00100000:0.0:1746143685.588077:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.588201:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592074624 00000100:00100000:1.0:1746143685.588208:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592074624 00002000:00100000:1.0:1746143685.588246:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880090765180 x1830963592074624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143685.588255:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765180 with x1830963592074624 ext(2097152->3145727) 00010000:00010000:1.0:1746143685.588263:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 32 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746143685.588276:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 32 pid: 12618 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746143685.588283:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090765180 00000100:00100000:1.0:1746143685.588298:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 789 00000100:00100000:1.0:1746143685.588304:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592074624:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143685.591605:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.591733:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592074880 00000100:00100000:3.0:1746143685.591741:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592074880 00000100:00100000:3.0:1746143685.591787:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3309 00000100:00100000:3.0:1746143685.591794:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28155:x1830963592074880:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143685.593219:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28155:x1830963592074880:12345-192.168.202.48@tcp:35:cat.0 Request processed in 1421us (1616us total) trans 8589942269 rc 0/0 00000100:00100000:3.0:1746143685.593227:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3309 00000100:00100000:1.0:1746143685.610095:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592074624:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 21783us (22018us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143685.610105:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 789 00002000:00100000:1.0:1746143685.610114:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880090765180 x1830963592074624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143685.610124:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765180 with x1830963592074624 ext(2097152->3145727) 00010000:00010000:1.0:1746143685.610132:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 32 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746143685.610165:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 32 pid: 12618 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746143685.610172:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090765180 00000100:00100000:0.0:1746143685.615884:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.615940:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.616019:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592075008 00000100:00100000:2.0:1746143685.616027:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592075008 00000100:00100000:2.0:1746143685.616061:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9207 00000100:00100000:2.0:1746143685.616067:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:28154:x1830963592075008:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143685.616082:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.616096:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8800/0xe984082ccd7248a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d12 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.616118:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.616119:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.616125:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8800/0xe984082ccd7248a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d12 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.616162:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8800/0xe984082ccd7248a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d12 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.616170:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a8800, rc 0) 00000100:00100000:2.0:1746143685.616214:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:28154:x1830963592075008:12345-192.168.202.48@tcp:101:cat.0 Request processed in 147us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.616219:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9207 00000100:00100000:3.0:1746143685.616373:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592075136 00000100:00100000:3.0:1746143685.616377:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592075136 00010000:00010000:3.0:1746143685.616394:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 32 pid: 12618 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746143685.616408:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4690 00000100:00100000:3.0:1746143685.616411:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592075136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143685.616418:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143685.616434:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 32 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746143685.616442:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 32 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746143685.616706:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c3d6800/0xe984082ccd72487e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ce8 expref: 32 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746143685.616766:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143685.616768:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143685.616773:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.616779:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.616804:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143685.616814:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593668608:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143685.619108:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143685.621465:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593668608:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143685.621482:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143685.621516:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592075136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5102us (5574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.621525:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4690 00000100:00100000:0.0:1746143685.639007:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.639063:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.639171:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592075520 00000100:00100000:2.0:1746143685.639179:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592075520 00002000:00100000:2.0:1746143685.639217:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880090765f80 x1830963592075520/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.639227:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765f80 with x1830963592075520 ext(3145728->4194303) 00002000:00010000:2.0:1746143685.639232:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090765f80 00000100:00100000:2.0:1746143685.639260:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592075648 00000100:00100000:2.0:1746143685.639262:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592075648 00002000:00100000:2.0:1746143685.639275:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880090765c00 x1830963592075648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.639282:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765c00 with x1830963592075648 ext(3145728->4194303) 00002000:00010000:2.0:1746143685.639285:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090765c00 00000100:00100000:2.0:1746143685.639298:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3294 00000100:00100000:2.0:1746143685.639305:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963592075520:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143685.640416:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3295 00000100:00100000:0.0:1746143685.640424:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592075648:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143685.641670:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.643446:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592075904 00000100:00100000:3.0:1746143685.643455:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592075904 00002000:00100000:3.0:1746143685.643495:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2875392->2879487) req@ffff880090767100 x1830963592075904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.643505:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767100 with x1830963592075904 ext(2875392->2879487) 00002000:00010000:3.0:1746143685.643509:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767100 00000100:00100000:3.0:1746143685.643537:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3296 00000100:00100000:3.0:1746143685.643543:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963592075904:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143685.643685:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963592075904:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 141us (2017us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143685.643691:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3296 00002000:00100000:3.0:1746143685.643696:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2875392->2879487) req@ffff880090767100 x1830963592075904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/4536 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.643707:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767100 with x1830963592075904 ext(2875392->2879487) 00002000:00010000:3.0:1746143685.643709:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767100 00000100:00100000:0.0:1746143685.670368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.670645:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963592075520:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 31339us (31644us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143685.670658:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3294 00002000:00100000:3.0:1746143685.670666:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880090765f80 x1830963592075520/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.670678:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765f80 with x1830963592075520 ext(3145728->4194303) 00002000:00010000:3.0:1746143685.670683:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090765f80 00000100:00100000:1.0:1746143685.670744:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592076160 00000100:00100000:1.0:1746143685.670753:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592076160 00000100:00100000:1.0:1746143685.670790:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8191 00000100:00100000:1.0:1746143685.670795:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28160:x1830963592076160:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143685.670816:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.670830:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd7248af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d19 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.670942:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4e00/0xe984082ccd7248b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.670958:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4e00/0xe984082ccd7248b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.670967:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4e00/0xe984082ccd7248b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.670983:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630e600/0xe984082ccd7248bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.670988:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630e600/0xe984082ccd7248bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.670992:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630e600/0xe984082ccd7248bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671101:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f600/0xe984082ccd7248c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671108:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f600/0xe984082ccd7248c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671114:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f600/0xe984082ccd7248c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143685.671121:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143685.671212:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4e00/0xe984082ccd7248b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671218:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4e00/0xe984082ccd7248b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671223:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4e00/0xe984082ccd7248b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671227:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f9c4e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143685.671230:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4e00/0xe984082ccd7248b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671235:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4e00/0xe984082ccd7248b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671243:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143685.671246:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143685.671249:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4e00/0xe984082ccd7248b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671254:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4e00/0xe984082ccd7248b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671270:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630e600/0xe984082ccd7248bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671275:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630e600/0xe984082ccd7248bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671279:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630e600/0xe984082ccd7248bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671282:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a630e600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143685.671290:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630e600/0xe984082ccd7248bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671294:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630e600/0xe984082ccd7248bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671299:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74500) 00010000:00010000:1.0:1746143685.671304:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143685.671307:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630e600/0xe984082ccd7248bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671311:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630e600/0xe984082ccd7248bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143685.671350:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd7248af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d19 expref: 13 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.671366:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f600/0xe984082ccd7248c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d19 expref: 12 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.671372:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:1.0:1746143685.671374:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143685.671376:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a630f600, rc 0) 00000100:00100000:1.0:1746143685.671412:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28160:x1830963592076160:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 612us (1046us total) trans 8589942270 rc 0/0 00000100:00100000:1.0:1746143685.671418:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8191 00000100:00100000:2.0:1746143685.673246:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592075648:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 32813us (34172us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143685.673260:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3295 00002000:00100000:2.0:1746143685.673271:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880090765c00 x1830963592075648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.673282:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765c00 with x1830963592075648 ext(3145728->4194303) 00002000:00010000:2.0:1746143685.673289:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090765c00 00000100:00100000:0.0:1746143685.675264:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.675362:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592076416 00000100:00100000:1.0:1746143685.675370:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592076416 00000100:00100000:1.0:1746143685.675415:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3310 00000100:00100000:1.0:1746143685.675421:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28160:x1830963592076416:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143685.675610:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28160:x1830963592076416:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 188us (352us total) trans 8589942271 rc 0/0 00000100:00100000:1.0:1746143685.675615:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3310 00000100:00100000:0.0:1746143685.676711:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.676771:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592076672 00000100:00100000:3.0:1746143685.676776:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592076672 00000100:00100000:3.0:1746143685.676809:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3311 00000100:00100000:3.0:1746143685.676813:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:28149:x1830963592076672:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143685.676946:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28149:x1830963592076672:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 131us (236us total) trans 8589942272 rc 0/0 00000100:00100000:3.0:1746143685.676952:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3311 00000100:00100000:0.0:1746143685.692825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.692909:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592076800 00000100:00100000:2.0:1746143685.692924:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592076800 00000100:00100000:2.0:1746143685.692959:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9208 00000100:00100000:2.0:1746143685.692966:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963592076800:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143685.692979:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.692992:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9600/0xe984082ccd7248d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d20 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.693017:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9600/0xe984082ccd7248d2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d20 expref: 34 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.693026:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9600/0xe984082ccd7248d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d20 expref: 34 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.693050:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a9600, rc 0) 00000100:00100000:2.0:1746143685.693083:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963592076800:12345-192.168.202.48@tcp:101:cat.0 Request processed in 118us (266us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143685.693089:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9208 00000100:00100000:0.0:1746143685.711450:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.711535:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592077056 00000100:00100000:2.0:1746143685.711543:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592077056 00002000:00100000:2.0:1746143685.711583:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880136919c00 x1830963592077056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.711593:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919c00 with x1830963592077056 ext(4194304->4898815) 00002000:00010000:2.0:1746143685.711597:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136919c00 00000100:00100000:2.0:1746143685.711628:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3297 00000100:00100000:2.0:1746143685.711636:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963592077056:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143685.731682:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963592077056:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20038us (20231us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143685.731710:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3297 00002000:00100000:2.0:1746143685.731721:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880136919c00 x1830963592077056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.731729:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919c00 with x1830963592077056 ext(4194304->4898815) 00002000:00010000:2.0:1746143685.731735:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136919c00 00000100:00100000:0.0:1746143685.736889:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.736976:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592077312 00000100:00100000:3.0:1746143685.737000:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592077312 00000100:00100000:3.0:1746143685.737056:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8192 00000100:00100000:3.0:1746143685.737064:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28164:x1830963592077312:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143685.737111:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.737179:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc800/0xe984082ccd7248d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d27 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.737299:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc600/0xe984082ccd7248e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737310:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc600/0xe984082ccd7248e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737319:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc600/0xe984082ccd7248e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737341:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0700000/0xe984082ccd7248e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737347:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0700000/0xe984082ccd7248e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737352:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0700000/0xe984082ccd7248e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737443:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd7248ee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737452:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd7248ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737458:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd7248ee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143685.737465:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143685.737553:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc600/0xe984082ccd7248e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737560:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc600/0xe984082ccd7248e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737568:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc600/0xe984082ccd7248e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737574:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a61cc600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143685.737576:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc600/0xe984082ccd7248e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737583:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc600/0xe984082ccd7248e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737592:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143685.737594:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143685.737597:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc600/0xe984082ccd7248e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737602:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc600/0xe984082ccd7248e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737629:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0700000/0xe984082ccd7248e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737633:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0700000/0xe984082ccd7248e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737638:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0700000/0xe984082ccd7248e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737642:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0700000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143685.737644:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0700000/0xe984082ccd7248e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737648:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0700000/0xe984082ccd7248e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737658:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5e000) 00010000:00010000:3.0:1746143685.737659:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143685.737661:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0700000/0xe984082ccd7248e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737666:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0700000/0xe984082ccd7248e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.737699:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cc800/0xe984082ccd7248d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d27 expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.737709:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd7248ee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d27 expref: 15 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.737715:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143685.737717:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143685.737718:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5fe00, rc 0) 00000100:00100000:3.0:1746143685.737772:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28164:x1830963592077312:12345-192.168.202.48@tcp:101:cat.0 Request processed in 709us (889us total) trans 8589942273 rc 0/0 00000100:00100000:3.0:1746143685.737778:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8192 00000100:00100000:0.0:1746143685.741985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.742088:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592077440 00000100:00100000:2.0:1746143685.742096:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592077440 00000100:00100000:2.0:1746143685.742169:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9209 00000100:00100000:2.0:1746143685.742176:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963592077440:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143685.742191:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.742205:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9c00/0xe984082ccd7248fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d2e expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.742229:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9c00/0xe984082ccd7248fc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d2e expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.742239:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01a9c00/0xe984082ccd7248fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d2e expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143685.742265:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a9c00, rc 0) 00000100:00100000:2.0:1746143685.742308:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963592077440:12345-192.168.202.48@tcp:101:cat.0 Request processed in 132us (329us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143685.742313:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9209 00000100:00100000:0.0:1746143685.744048:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.744082:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.744115:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.744179:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592077568 00000100:00100000:1.0:1746143685.744184:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592077568 00000100:00100000:1.0:1746143685.744207:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592077696 00000100:00100000:1.0:1746143685.744209:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592077696 00000100:00100000:1.0:1746143685.744221:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592077824 00000100:00100000:1.0:1746143685.744223:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592077824 00000100:00100000:1.0:1746143685.744236:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9210 00000100:00100000:1.0:1746143685.744241:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963592077568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143685.744252:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.744264:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f9c4c00/0xe984082ccd724903 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d35 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.744287:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f9c4c00/0xe984082ccd724903 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d35 expref: 34 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.744295:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f9c4c00/0xe984082ccd724903 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d35 expref: 34 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.744307:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9c4c00, rc 0) 00000100:00100000:1.0:1746143685.744334:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963592077568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 93us (292us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143685.744339:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9210 00000100:00100000:1.0:1746143685.744351:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9211 00000100:00100000:1.0:1746143685.744356:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592077696:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143685.744361:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.744366:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f9c4e00/0xe984082ccd72490a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d3c expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.744377:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f9c4e00/0xe984082ccd72490a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d3c expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.744384:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f9c4e00/0xe984082ccd72490a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d3c expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.744390:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9c4e00, rc 0) 00000100:00100000:1.0:1746143685.744402:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592077696:12345-192.168.202.48@tcp:101:cat.0 Request processed in 47us (321us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143685.744407:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9211 00000100:00100000:1.0:1746143685.744415:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9212 00000100:00100000:1.0:1746143685.744419:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963592077824:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143685.744443:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.744459:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724911 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d43 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143685.744501:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593668736:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143685.744562:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143685.746865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.746937:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592077952 00000100:00100000:3.0:1746143685.746944:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592077952 00000100:00100000:3.0:1746143685.746988:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 558 00000100:00100000:3.0:1746143685.746994:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592077952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143685.747005:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143685.747024:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd7248ee lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d27 expref: 15 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.747060:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143685.747065:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143685.747094:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592077952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.747101:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 558 00000100:00100000:1.0:1746143685.747941:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593668736:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143685.747963:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724911 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d43 expref: 23 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.747973:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5600/0xe984082ccd724911 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d43 expref: 23 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.747992:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9c5600, rc 0) 00000100:00100000:1.0:1746143685.748015:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963592077824:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3595us (3899us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143685.748021:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9212 00000100:00100000:0.0:1746143685.756218:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.756335:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592078208 00000100:00100000:1.0:1746143685.756343:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592078208 00000100:00100000:1.0:1746143685.756393:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3312 00000100:00100000:1.0:1746143685.756400:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28154:x1830963592078208:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143685.756598:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28154:x1830963592078208:12345-192.168.202.48@tcp:35:cat.0 Request processed in 197us (386us total) trans 8589942274 rc 0/0 00000100:00100000:1.0:1746143685.756604:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3312 00000100:00100000:0.0:1746143685.766873:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.769580:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592078464 00000100:00100000:2.0:1746143685.769591:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592078464 00002000:00100000:2.0:1746143685.769631:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880136919500 x1830963592078464/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.769641:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919500 with x1830963592078464 ext(0->1048575) 00002000:00010000:2.0:1746143685.769646:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136919500 00000100:00100000:3.0:1746143685.771570:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3298 00000100:00100000:3.0:1746143685.771582:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592078464:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143685.773192:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.773275:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592078720 00000100:00100000:2.0:1746143685.773283:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592078720 00002000:00100000:2.0:1746143685.773315:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88013691b800 x1830963592078720/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.773324:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691b800 with x1830963592078720 ext(1048576->2097151) 00002000:00010000:2.0:1746143685.773328:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013691b800 00000100:00100000:2.0:1746143685.773344:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3299 00000100:00100000:2.0:1746143685.773349:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592078720:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143685.798895:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592078464:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27308us (32021us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143685.798905:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3298 00002000:00100000:3.0:1746143685.798922:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880136919500 x1830963592078464/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143685.798931:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919500 with x1830963592078464 ext(0->1048575) 00002000:00010000:3.0:1746143685.798937:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136919500 00000100:00100000:2.0:1746143685.800915:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592078720:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27557us (27724us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143685.800936:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3299 00002000:00100000:2.0:1746143685.800944:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88013691b800 x1830963592078720/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.800956:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691b800 with x1830963592078720 ext(1048576->2097151) 00002000:00010000:2.0:1746143685.800961:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013691b800 00000100:00100000:0.0:1746143685.829251:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.829453:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592078848 00000100:00100000:1.0:1746143685.829465:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592078848 00000100:00100000:1.0:1746143685.829532:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9213 00000100:00100000:1.0:1746143685.829541:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28164:x1830963592078848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143685.829563:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.829582:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0xe984082ccd724918 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d4a expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.829611:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 32 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.829619:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143685.829620:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143685.829624:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0xe984082ccd724918 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d4a expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.829653:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 32 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.829663:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 32 pid: 9527 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746143685.829674:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593668864:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143685.829774:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143685.838049:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.838180:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592079104 00000100:00100000:3.0:1746143685.838192:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592079104 00000100:00100000:3.0:1746143685.838246:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8193 00000100:00100000:3.0:1746143685.838253:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28167:x1830963592079104:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143685.838274:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.838289:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5f800/0xe984082ccd72491f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d51 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.838383:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5e000/0xe984082ccd724926 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838398:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5e000/0xe984082ccd724926 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838407:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5e000/0xe984082ccd724926 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838417:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd72492d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838423:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd72492d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838428:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd72492d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838514:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd724934 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838522:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd724934 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838528:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd724934 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143685.838535:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000100:00100000:1.0:1746143685.838595:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593668864:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143685.838607:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5e000/0xe984082ccd724926 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838613:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5e000/0xe984082ccd724926 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143685.838617:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0xe984082ccd724918 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d4a expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.838618:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5e000/0xe984082ccd724926 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838625:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e5e000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143685.838628:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5e000/0xe984082ccd724926 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143685.838630:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090487400, rc 0) 00010000:00010000:3.0:1746143685.838633:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5e000/0xe984082ccd724926 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838641:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143685.838643:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143685.838646:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5e000/0xe984082ccd724926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838649:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5e000/0xe984082ccd724926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00000100:00100000:1.0:1746143685.838675:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28164:x1830963592078848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9135us (9431us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143685.838683:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd72492d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00000100:00100000:1.0:1746143685.838685:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9213 00010000:00010000:3.0:1746143685.838688:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd72492d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838692:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd72492d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838696:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e5ea00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143685.838698:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd72492d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838701:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd72492d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838707:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5e000) 00010000:00010000:3.0:1746143685.838709:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143685.838711:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd72492d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838714:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd72492d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.838745:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5f800/0xe984082ccd72491f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d51 expref: 246 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.838754:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd724934 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d51 expref: 245 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.838759:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143685.838761:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143685.838763:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5fe00, rc 0) 00000100:00100000:3.0:1746143685.838785:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28167:x1830963592079104:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 532us (750us total) trans 8589942275 rc 0/0 00000100:00100000:3.0:1746143685.838790:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8193 00000100:00100000:0.0:1746143685.848099:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.848544:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592079232 00000100:00100000:2.0:1746143685.848556:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592079232 00002000:00100000:2.0:1746143685.848632:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2879488->3145727) req@ffff88013691b480 x1830963592079232/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.848651:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691b480 with x1830963592079232 ext(2879488->3145727) 00010000:00010000:2.0:1746143685.848663:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 33 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.848679:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 33 pid: 9527 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746143685.848693:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013691b480 00000100:00100000:2.0:1746143685.848742:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 790 00000100:00100000:2.0:1746143685.848751:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963592079232:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143685.873591:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.877686:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592079360 00000100:00100000:0.0:1746143685.877696:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592079360 00000100:00100000:0.0:1746143685.877746:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8194 00000100:00100000:0.0:1746143685.877753:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:28168:x1830963592079360:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143685.877775:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143685.877790:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6a00/0xe984082ccd724942 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d58 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143685.877835:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6800/0xe984082ccd724949 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143685.877845:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6800/0xe984082ccd724949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143685.877854:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6800/0xe984082ccd724949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143685.877866:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d7a00/0xe984082ccd724950 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143685.877870:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d7a00/0xe984082ccd724950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143685.877875:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d7a00/0xe984082ccd724950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143685.877995:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143685.878003:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c4e expref: 13 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143685.878010:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143685.878035:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c4e expref: 13 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143685.878045:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c4e expref: 13 pid: 14764 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746143685.878054:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593668992:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143685.878726:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963592079232:12345-192.168.202.48@tcp:4:cat.0 Request processed in 29976us (30635us total) trans 17179872389 rc 0/0 00000100:00100000:2.0:1746143685.878734:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 790 00002000:00100000:2.0:1746143685.878742:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2879488->3145727) req@ffff88013691b480 x1830963592079232/t17179872389(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/448 e 0 to 0 dl 1746143696 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.878750:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691b480 with x1830963592079232 ext(2879488->3145727) 00010000:00010000:2.0:1746143685.878757:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 35 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.878767:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 35 pid: 9527 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746143685.878773:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013691b480 00000100:00100000:0.0:1746143685.882201:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143685.888722:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593668992:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143685.888745:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143685.888867:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.889328:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.889392:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592079488 00000100:00100000:2.0:1746143685.889397:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592079488 00010000:00010000:2.0:1746143685.889424:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c4e expref: 14 pid: 14764 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.889453:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592079616 00000100:00100000:2.0:1746143685.889455:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592079616 00010000:00010000:2.0:1746143685.889466:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 35 pid: 9527 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.889490:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4691 00000100:00100000:2.0:1746143685.889495:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592079488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143685.889507:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143685.889512:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c4e expref: 14 pid: 14764 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.889520:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c4e expref: 14 pid: 14764 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.889541:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d598c00/0xe984082ccd7247b3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c4e expref: 14 pid: 14764 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.889568:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143685.889573:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889581:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889587:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889601:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143685.889630:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592079488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 134us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.889635:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4691 00000100:00100000:2.0:1746143685.889647:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4692 00000100:00100000:2.0:1746143685.889652:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963592079616:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143685.889658:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143685.889676:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 35 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.889684:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 35 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.889697:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd724869 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cd3 expref: 35 pid: 9527 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.889712:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.889713:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143685.889718:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0xe984082ccd724918 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d4a expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.889725:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0xe984082ccd724918 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d4a expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.889745:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0xe984082ccd724918 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d4a expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143685.889755:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593669120:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143685.889803:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00010000:00010000:2.0:1746143685.889813:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889819:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:2.0:1746143685.889851:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:2.0:1746143685.889855:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143685.889868:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889876:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889884:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6800/0xe984082ccd724949 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889893:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6800/0xe984082ccd724949 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889898:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6800/0xe984082ccd724949 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889902:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c3d6800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143685.889905:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6800/0xe984082ccd724949 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889910:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6800/0xe984082ccd724949 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889929:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143685.889931:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143685.889934:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6800/0xe984082ccd724949 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889938:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6800/0xe984082ccd724949 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889945:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d7a00/0xe984082ccd724950 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889950:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d7a00/0xe984082ccd724950 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889955:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d7a00/0xe984082ccd724950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889958:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c3d7a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143685.889960:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d7a00/0xe984082ccd724950 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889968:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d7a00/0xe984082ccd724950 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889973:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a100) 00010000:00010000:2.0:1746143685.889975:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143685.889977:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d7a00/0xe984082ccd724950 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.889981:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d7a00/0xe984082ccd724950 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.890004:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3d6a00/0xe984082ccd724942 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d58 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.890013:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d58 expref: 7 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.890018:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143685.890020:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143685.890021:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a623f200, rc 0) 00000100:00100000:2.0:1746143685.890044:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28168:x1830963592079360:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 12291us (16462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.890049:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8194 00000100:00100000:0.0:1746143685.898595:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.898624:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.899532:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592079744 00000100:00100000:1.0:1746143685.899542:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592079744 00000100:00100000:1.0:1746143685.899576:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592079872 00000100:00100000:1.0:1746143685.899578:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592079872 00000100:00100000:3.0:1746143685.899858:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593669120:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143685.899874:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143685.899906:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963592079616:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10254us (10579us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.899913:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4692 00000100:00100000:1.0:1746143685.900052:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9214 00000100:00100000:1.0:1746143685.900059:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592079744:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143685.900074:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.900086:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090486600/0xe984082ccd72495e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d5f expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.900104:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.900106:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.900113:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090486600/0xe984082ccd72495e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d5f expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.900125:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090486600/0xe984082ccd72495e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d5f expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.900134:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090486600, rc 0) 00000100:00100000:1.0:1746143685.900170:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592079744:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 112us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143685.900175:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9214 00000100:00100000:1.0:1746143685.900186:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9215 00000100:00100000:1.0:1746143685.900191:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592079872:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143685.900198:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143685.900205:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090486c00/0xe984082ccd724965 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d66 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143685.900234:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593669248:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143685.900278:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143685.901071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.902104:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592080128 00000100:00100000:2.0:1746143685.902111:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592080128 00002000:00100000:2.0:1746143685.902338:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880130fd6d80 x1830963592080128/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.902346:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6d80 with x1830963592080128 ext(2097152->3145727) 00002000:00010000:2.0:1746143685.902351:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd6d80 00000100:00100000:2.0:1746143685.902378:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3300 00000100:00100000:2.0:1746143685.902384:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592080128:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143685.910537:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.910962:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592080256 00000100:00100000:2.0:1746143685.910969:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592080256 00000100:00100000:2.0:1746143685.911005:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9216 00000100:00100000:2.0:1746143685.911012:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28160:x1830963592080256:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143685.911028:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.911042:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d6d expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.911065:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.911072:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143685.911073:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143685.911077:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3252224->4071423] (req 3252224->4071423) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.911101:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.911112:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 30 pid: 12618 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.911122:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593669376:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143685.913593:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143685.914718:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e627100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593669248:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143685.914740:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090486c00/0xe984082ccd724965 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d66 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.914750:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090486c00/0xe984082ccd724965 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d66 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143685.914773:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090486c00, rc 0) 00000100:00100000:1.0:1746143685.914797:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592079872:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 14605us (16171us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143685.914804:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9215 00000100:00100000:2.0:1746143685.915649:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592080128:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13263us (14577us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143685.915656:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3300 00002000:00100000:2.0:1746143685.915664:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880130fd6d80 x1830963592080128/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.915672:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6d80 with x1830963592080128 ext(2097152->3145727) 00002000:00010000:2.0:1746143685.915676:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd6d80 00000100:00100000:2.0:1746143685.916999:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593669376:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143685.917017:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3252224->4071423] (req 3252224->4071423) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.917032:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a9200, rc 0) 00000100:00100000:2.0:1746143685.917064:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28160:x1830963592080256:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6053us (6535us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.917070:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9216 00000100:00100000:0.0:1746143685.919336:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.919407:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592080640 00000100:00100000:2.0:1746143685.919414:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592080640 00000100:00100000:2.0:1746143685.919446:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8195 00000100:00100000:2.0:1746143685.919451:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28168:x1830963592080640:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143685.919465:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.919478:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9800/0xe984082ccd724973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d74 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.919553:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.919566:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d58 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.919573:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.919600:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d58 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143685.919609:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d58 expref: 8 pid: 14763 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.919618:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593669504:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143685.919697:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143685.921088:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.921215:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592080384 00000100:00100000:2.0:1746143685.921220:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592080384 00002000:00100000:2.0:1746143685.921248:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2879487) req@ffff880130fd5500 x1830963592080384/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.921256:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5500 with x1830963592080384 ext(2097152->2879487) 00010000:00010000:2.0:1746143685.921263:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 31 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.921272:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 31 pid: 12618 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746143685.921279:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130fd5500 00000100:00100000:2.0:1746143685.921291:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 791 00000100:00100000:2.0:1746143685.921296:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592080384:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143685.921950:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593669504:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143685.921968:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:2.0:1746143685.931535:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.931585:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.931774:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592080896 00000100:00100000:3.0:1746143685.931783:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592080896 00000100:00100000:3.0:1746143685.931820:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9217 00000100:00100000:3.0:1746143685.931826:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28164:x1830963592080896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143685.931843:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.931857:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800955db600/0xe984082ccd724981 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d7b expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.931878:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143685.931880:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143685.931884:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800955db600/0xe984082ccd724981 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d7b expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.931893:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800955db600/0xe984082ccd724981 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d7b expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.931903:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955db600, rc 0) 00000100:00100000:3.0:1746143685.931951:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28164:x1830963592080896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 123us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.931957:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9217 00000100:00100000:3.0:1746143685.931985:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592080768 00000100:00100000:3.0:1746143685.931988:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592080768 00010000:00010000:3.0:1746143685.932002:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d58 expref: 9 pid: 14763 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746143685.932017:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4693 00000100:00100000:3.0:1746143685.932022:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592080768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143685.932030:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143685.932034:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d58 expref: 9 pid: 14763 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746143685.932043:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d58 expref: 9 pid: 14763 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746143685.932059:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd724957 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d58 expref: 9 pid: 14763 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746143685.932075:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143685.932079:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.932086:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.932092:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.932107:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143685.932121:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592080768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 99us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.932126:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4693 00010000:00010000:3.0:1746143685.932170:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.932176:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143685.932191:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143685.932307:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9800/0xe984082ccd724973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d74 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.932321:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d74 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.932327:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143685.932329:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143685.932331:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a9e00, rc 0) 00000100:00100000:3.0:1746143685.932350:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28168:x1830963592080640:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 12898us (13021us total) trans 8589942276 rc 0/0 00000100:00100000:3.0:1746143685.932356:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8195 00000100:00100000:0.0:1746143685.937767:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.937964:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963592080384:12345-192.168.202.48@tcp:4:cat.0 Request processed in 16665us (16876us total) trans 21474839653 rc 0/0 00000100:00100000:2.0:1746143685.937973:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 791 00002000:00100000:2.0:1746143685.937982:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2879487) req@ffff880130fd5500 x1830963592080384/t21474839653(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:81/0 lens 488/448 e 0 to 0 dl 1746143696 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.937990:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5500 with x1830963592080384 ext(2097152->2879487) 00010000:00010000:2.0:1746143685.937999:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.938011:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746143685.938017:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130fd5500 00000100:00100000:3.0:1746143685.940331:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592081024 00000100:00100000:3.0:1746143685.940341:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592081024 00000100:00100000:3.0:1746143685.940399:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8196 00000100:00100000:3.0:1746143685.940407:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28168:x1830963592081024:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143685.940427:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.940442:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db400/0xe984082ccd72498f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d82 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.940503:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.940521:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d74 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.940527:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.940553:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d74 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.940567:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d74 expref: 9 pid: 14763 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746143685.940576:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593669632:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143685.940646:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143685.944341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.944448:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592081152 00000100:00100000:2.0:1746143685.944454:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592081152 00010000:00010000:2.0:1746143685.944485:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d74 expref: 10 pid: 14763 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746143685.944508:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4694 00000100:00100000:2.0:1746143685.944515:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592081152:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143685.944525:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143685.944529:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d74 expref: 10 pid: 14763 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.944539:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d74 expref: 10 pid: 14763 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746143685.944561:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143685.944565:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.944573:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.944579:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143685.944592:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143685.944641:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592081152:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 126us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.944648:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4694 00010000:00010000:3.0:1746143685.946099:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a9e00/0xe984082ccd72497a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d74 expref: 9 pid: 14763 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746143685.947236:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593669632:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143685.947259:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.947268:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.947273:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143685.947309:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:3.0:1746143685.947313:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143685.947327:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.947354:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db400/0xe984082ccd72498f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d82 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.947374:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d82 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.947385:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143685.947388:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143685.947390:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955db800, rc 0) 00000100:00100000:3.0:1746143685.947439:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28168:x1830963592081024:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 7032us (9677us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143685.947450:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8196 00000100:00100000:0.0:1746143685.947722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.947944:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592081280 00000100:00100000:1.0:1746143685.947950:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592081280 00010000:00010000:1.0:1746143685.947972:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746143685.948004:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4695 00000100:00100000:1.0:1746143685.948010:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963592081280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143685.948019:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143685.948036:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746143685.948050:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746143685.948065:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd724885 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2879487) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cef expref: 33 pid: 12618 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746143685.948079:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.948080:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.948086:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.948093:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.948101:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.948102:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143685.948105:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800955db600/0xe984082ccd724981 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d7b expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.948111:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800955db600/0xe984082ccd724981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d7b expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143685.948133:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800955db600/0xe984082ccd724981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d7b expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143685.948166:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e627100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593669760:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143685.948233:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143685.948242:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091717100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593669888:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143685.948258:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143685.955043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.955688:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592081408 00000100:00100000:2.0:1746143685.955696:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592081408 00000100:00100000:2.0:1746143685.956204:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9218 00000100:00100000:2.0:1746143685.956211:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592081408:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143685.956226:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143685.956239:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9800/0xe984082ccd72499d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d89 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143685.956285:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670016:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143685.956926:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143685.957383:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e627100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593669760:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143685.957555:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091717100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593669888:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143685.957571:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143685.957604:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592081280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9593us (9883us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143685.957612:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4695 00000100:00100000:1.0:1746143685.958011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143685.958060:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592081664 00000100:00100000:2.0:1746143685.958064:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592081664 00002000:00100000:2.0:1746143685.958094:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3252224->3256319) req@ffff880091716a00 x1830963592081664/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.958169:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091716a00 with x1830963592081664 ext(3252224->3256319) 00002000:00010000:2.0:1746143685.958174:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091716a00 00000100:00100000:2.0:1746143685.958187:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3301 00000100:00100000:2.0:1746143685.958193:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1962:x1830963592081664:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143685.958938:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1962:x1830963592081664:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 743us (925us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143685.958943:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3301 00002000:00100000:2.0:1746143685.958949:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3252224->3256319) req@ffff880091716a00 x1830963592081664/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/4536 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143685.958955:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091716a00 with x1830963592081664 ext(3252224->3256319) 00002000:00010000:2.0:1746143685.958957:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091716a00 00000100:00100000:0.0:1746143685.965618:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143685.965656:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143685.965807:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592081920 00000100:00100000:1.0:1746143685.965815:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592081920 00002000:00100000:1.0:1746143685.965851:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880130fd4a80 x1830963592081920/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143685.965860:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4a80 with x1830963592081920 ext(2097152->3145727) 00002000:00010000:1.0:1746143685.965865:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd4a80 00000100:00100000:1.0:1746143685.965878:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592082048 00000100:00100000:1.0:1746143685.965880:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592082048 00002000:00100000:1.0:1746143685.965889:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880130fd5880 x1830963592082048/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 504/0 e 0 to 0 dl 1746143696 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143685.965896:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5880 with x1830963592082048 ext(3145728->4194303) 00002000:00010000:1.0:1746143685.965899:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd5880 00000100:00100000:1.0:1746143685.965908:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3302 00000100:00100000:1.0:1746143685.965924:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592081920:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143685.967170:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3303 00000100:00100000:2.0:1746143685.967179:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592082048:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143685.968411:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670016:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143685.968441:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9800/0xe984082ccd72499d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d89 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143685.968453:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9800/0xe984082ccd72499d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d89 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143685.968468:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a9800, rc 0) 00000100:00100000:3.0:1746143685.968496:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592081408:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 12285us (13459us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143685.968502:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9218 00000100:00100000:0.0:1746143685.978792:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143685.981423:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592082432 00000100:00100000:3.0:1746143685.981434:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592082432 00000100:00100000:3.0:1746143685.982825:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8197 00000100:00100000:3.0:1746143685.982839:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28168:x1830963592082432:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143685.982856:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143685.982875:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458e00/0xe984082ccd7249a4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d90 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.983119:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458200/0xe984082ccd7249ab lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.983132:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458200/0xe984082ccd7249ab lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.983426:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458200/0xe984082ccd7249ab lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.983437:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458200/0xe984082ccd7249ab lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.983442:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458200/0xe984082ccd7249ab lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.983448:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458200/0xe984082ccd7249ab lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.983452:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b458200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143685.983455:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458200/0xe984082ccd7249ab lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.983461:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458200/0xe984082ccd7249ab lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.983470:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143685.983473:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143685.983479:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458200/0xe984082ccd7249ab lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143685.983484:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458200/0xe984082ccd7249ab lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00000100:00100000:1.0:1746143685.984246:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592081920:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 18327us (18631us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143685.984255:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3302 00002000:00100000:1.0:1746143685.984265:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880130fd4a80 x1830963592081920/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 488/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143685.984279:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4a80 with x1830963592081920 ext(2097152->3145727) 00002000:00010000:1.0:1746143685.984284:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd4a80 00010000:00010000:3.0:1746143685.984365:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458e00/0xe984082ccd7249a4 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d90 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.984373:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458e00/0xe984082ccd7249a4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d90 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143685.984384:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b458e00, rc 0) 00000100:00100000:3.0:1746143685.984407:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28168:x1830963592082432:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1573us (5622us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143685.984412:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8197 00000100:00100000:0.0:1746143686.002739:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.002807:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592082688 00000100:00100000:3.0:1746143686.002816:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592082688 00000100:00100000:3.0:1746143686.002884:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3313 00000100:00100000:3.0:1746143686.002892:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28168:x1830963592082688:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1746143686.003085:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28168:x1830963592082688:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 194us (351us total) trans 8589942277 rc 0/0 00000100:00100000:3.0:1746143686.003091:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3313 00000100:00100000:2.0:1746143686.003404:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963592082048:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 36227us (37746us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746143686.003412:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3303 00002000:00100000:2.0:1746143686.003419:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880130fd5880 x1830963592082048/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:81/0 lens 504/440 e 0 to 0 dl 1746143696 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.003428:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5880 with x1830963592082048 ext(3145728->4194303) 00002000:00010000:2.0:1746143686.003432:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd5880 00000100:00080000:0.0:1746143686.003607:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143686.006508:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.006886:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592082944 00000100:00100000:3.0:1746143686.006895:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592082944 00000100:00080000:0.0:1746143686.006938:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143686.006948:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8198 00000100:00100000:3.0:1746143686.006957:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28172:x1830963592082944:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143686.006978:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.006996:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd7249b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d97 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.007096:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145400/0xe984082ccd7249b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007109:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145400/0xe984082ccd7249b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007119:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145400/0xe984082ccd7249b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007131:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd7249c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007136:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd7249c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007170:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd7249c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007280:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd7249c7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007286:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd7249c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007291:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd7249c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143686.007298:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143686.007367:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145400/0xe984082ccd7249b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007373:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145400/0xe984082ccd7249b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007377:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145400/0xe984082ccd7249b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007384:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b145400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.007387:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145400/0xe984082ccd7249b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007392:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145400/0xe984082ccd7249b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007401:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143686.007403:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.007406:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145400/0xe984082ccd7249b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007409:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145400/0xe984082ccd7249b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007427:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd7249c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007431:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd7249c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007434:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd7249c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007438:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b145000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.007440:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd7249c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007443:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd7249c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007448:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5e400) 00010000:00010000:3.0:1746143686.007450:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.007452:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd7249c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007456:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145000/0xe984082ccd7249c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.007486:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd7249b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d97 expref: 248 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.007498:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd7249c7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d97 expref: 247 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.007504:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.007506:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143686.007508:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5548200, rc 0) 00000100:00100000:3.0:1746143686.007559:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:28172:x1830963592082944:12345-192.168.202.48@tcp:101:cat.0 Request processed in 603us (1058us total) trans 8589942278 rc 0/0 00000100:00100000:3.0:1746143686.007564:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8198 00000100:00100000:0.0:1746143686.035325:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.035367:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.035396:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.035420:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.035643:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592083200 00000100:00100000:3.0:1746143686.035651:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592083200 00000100:00100000:2.0:1746143686.035723:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592083328 00000100:00100000:2.0:1746143686.035728:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592083328 00000100:00100000:2.0:1746143686.035752:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592083456 00000100:00100000:2.0:1746143686.035753:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592083456 00000100:00080000:0.0:1746143686.035781:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143686.035866:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3314 00000100:00100000:3.0:1746143686.035875:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28160:x1830963592083200:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143686.035889:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592083584 00000100:00100000:2.0:1746143686.035892:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592083584 00000100:00100000:1.0:1746143686.035932:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9219 00000100:00100000:1.0:1746143686.035939:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963592083328:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143686.035949:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.035963:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090486200/0xe984082ccd7249d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0d9e expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.035980:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143686.035982:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143686.035990:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090486200/0xe984082ccd7249d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d9e expref: 35 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.036003:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090486200/0xe984082ccd7249d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d9e expref: 35 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.036013:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090486200, rc 0) 00000100:00100000:2.0:1746143686.036217:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9220 00000100:00100000:2.0:1746143686.036223:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592083456:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143686.036231:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143686.036239:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8e00/0xe984082ccd7249dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0da5 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143686.036273:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670144:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143686.036340:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963592083328:12345-192.168.202.48@tcp:101:cat.0 Request processed in 401us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.036342:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28160:x1830963592083200:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 467us (1023us total) trans 8589942279 rc 0/0 00000100:00100000:1.0:1746143686.036346:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9219 00000100:00100000:3.0:1746143686.036348:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3314 00000100:00100000:1.0:1746143686.036361:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9221 00000100:00100000:1.0:1746143686.036365:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963592083584:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143686.036373:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.036379:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090487000/0xe984082ccd7249e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0dac expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143686.036404:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091717480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593670272:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143686.036447:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143686.036549:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143686.045331:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091717480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593670272:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143686.045352:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670144:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143686.045361:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090487000/0xe984082ccd7249e3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dac expref: 25 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.045370:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8e00/0xe984082ccd7249dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0da5 expref: 33 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.045373:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090487000/0xe984082ccd7249e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dac expref: 25 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.045379:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a8e00/0xe984082ccd7249dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0da5 expref: 33 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.045670:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090487000, rc 0) 00000100:00100000:1.0:1746143686.045724:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963592083584:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9357us (10301us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143686.045731:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9221 00010000:00010000:2.0:1746143686.046715:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a8e00, rc 0) 00000100:00100000:2.0:1746143686.046743:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592083456:12345-192.168.202.48@tcp:101:cat.0 Request processed in 10520us (11346us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143686.046750:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9220 00000100:00100000:0.0:1746143686.055406:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.055543:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592083712 00000100:00100000:2.0:1746143686.055554:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592083712 00000100:00100000:2.0:1746143686.055612:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9222 00000100:00100000:2.0:1746143686.055620:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963592083712:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143686.055642:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143686.055661:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9c00/0xe984082ccd7249ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0db3 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143686.055723:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670400:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143686.055841:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143686.060028:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670400:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143686.060063:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9c00/0xe984082ccd7249ea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0db3 expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.060076:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9c00/0xe984082ccd7249ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0db3 expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.060090:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a9c00, rc 0) 00000100:00100000:2.0:1746143686.060175:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963592083712:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4554us (4784us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143686.060183:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9222 00000100:00100000:0.0:1746143686.062136:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.062210:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.062281:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592083968 00000100:00100000:1.0:1746143686.062290:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592083968 00002000:00100000:1.0:1746143686.062333:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880131e9ed80 x1830963592083968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.062342:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9ed80 with x1830963592083968 ext(0->1048575) 00002000:00010000:1.0:1746143686.062346:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9ed80 00000100:00100000:1.0:1746143686.062359:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592084224 00000100:00100000:1.0:1746143686.062360:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592084224 00002000:00100000:1.0:1746143686.062369:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880131e9e300 x1830963592084224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.062375:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9e300 with x1830963592084224 ext(1048576->2097151) 00002000:00010000:1.0:1746143686.062378:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9e300 00000100:00100000:1.0:1746143686.062396:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3304 00000100:00100000:1.0:1746143686.062402:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963592083968:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143686.063459:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3305 00000100:00100000:3.0:1746143686.063476:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592084224:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143686.078265:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.078356:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592084352 00000100:00100000:2.0:1746143686.078367:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592084352 00000100:00100000:2.0:1746143686.078599:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9223 00000100:00100000:2.0:1746143686.078609:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1963:x1830963592084352:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143686.078632:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143686.078651:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9e00/0xe984082ccd7249f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0dba expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143686.078712:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670528:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143686.080574:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143686.086720:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963592083968:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24303us (24577us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143686.086732:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3304 00002000:00100000:1.0:1746143686.086745:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880131e9ed80 x1830963592083968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.086754:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9ed80 with x1830963592083968 ext(0->1048575) 00002000:00010000:1.0:1746143686.086760:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9ed80 00000100:00100000:3.0:1746143686.091167:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592084224:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27663us (28921us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143686.091180:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3305 00002000:00100000:3.0:1746143686.091194:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880131e9e300 x1830963592084224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.091203:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9e300 with x1830963592084224 ext(1048576->2097151) 00002000:00010000:3.0:1746143686.091210:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9e300 00000100:00100000:2.0:1746143686.091364:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670528:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143686.091407:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9e00/0xe984082ccd7249f1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dba expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.091424:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9e00/0xe984082ccd7249f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dba expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.091451:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a9e00, rc 0) 00000100:00100000:2.0:1746143686.091472:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1963:x1830963592084352:12345-192.168.202.48@tcp:101:cat.0 Request processed in 12865us (13217us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143686.091479:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9223 00000100:00100000:0.0:1746143686.095244:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.095313:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592084608 00000100:00100000:3.0:1746143686.095323:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592084608 00000100:00100000:3.0:1746143686.095375:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3315 00000100:00100000:3.0:1746143686.095382:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28164:x1830963592084608:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143686.095806:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28164:x1830963592084608:12345-192.168.202.48@tcp:35:cat.0 Request processed in 423us (573us total) trans 8589942280 rc 0/0 00000100:00100000:3.0:1746143686.095813:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3315 00000100:00100000:0.0:1746143686.114825:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.115304:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592084864 00000100:00100000:3.0:1746143686.115316:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592084864 00002000:00100000:3.0:1746143686.115369:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880131e9f480 x1830963592084864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.115380:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9f480 with x1830963592084864 ext(2097152->3145727) 00002000:00010000:3.0:1746143686.115386:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9f480 00000100:00100000:3.0:1746143686.115428:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3306 00000100:00100000:3.0:1746143686.115436:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963592084864:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143686.125473:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963592084864:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10022us (10644us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143686.125487:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3306 00002000:00100000:3.0:1746143686.125501:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880131e9f480 x1830963592084864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.125510:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9f480 with x1830963592084864 ext(2097152->3145727) 00002000:00010000:3.0:1746143686.125517:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9f480 00000100:00100000:0.0:1746143686.134086:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.134132:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.134520:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592085120 00000100:00100000:1.0:1746143686.134531:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592085120 00000100:00100000:1.0:1746143686.134586:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592084992 00000100:00100000:1.0:1746143686.134588:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592084992 00000100:00100000:2.0:1746143686.134600:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9224 00000100:00100000:1.0:1746143686.134606:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9225 00000100:00100000:2.0:1746143686.134610:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:28167:x1830963592085120:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:1.0:1746143686.134610:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:28172:x1830963592084992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143686.134647:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.134647:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143686.134667:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0dc8 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.134667:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094677200/0xe984082ccd7249ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0dc1 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.134691:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143686.134693:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.134695:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a962600/0xe984082ccd7246fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c16 expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.134700:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094677200/0xe984082ccd7249ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc1 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.134705:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd724823 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c8d expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.134710:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a63df000/0xe984082ccd72481c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c86 expref: 35 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.134713:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.134715:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143686.134715:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094677200/0xe984082ccd7249ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc1 expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.134718:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [1495040->2097151] (req 1495040->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 35 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.134730:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094677200, rc 0) 00010000:00010000:2.0:1746143686.134745:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a63df000/0xe984082ccd72481c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c86 expref: 35 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.134756:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a63df000/0xe984082ccd72481c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c86 expref: 35 pid: 8497 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.134766:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670656:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143686.134821:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28172:x1830963592084992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 209us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143686.134826:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9225 00010000:00010000:2.0:1746143686.134852:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd724823 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c8d expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.134860:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd724823 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c8d expref: 23 pid: 6929 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.134868:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670784:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143686.134890:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a962600/0xe984082ccd7246fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c16 expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.134897:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a962600/0xe984082ccd7246fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c16 expref: 10 pid: 21542 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746143686.134904:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670912:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143686.134935:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143686.137801:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670656:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143686.137816:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670784:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143686.137823:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593670912:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143686.137852:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [1495040->2097151] (req 1495040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.137869:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01a9600, rc 0) 00000100:00100000:2.0:1746143686.137929:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:28167:x1830963592085120:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3320us (3852us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.137938:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9224 00000100:00100000:0.0:1746143686.139589:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.140034:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592085248 00000100:00100000:2.0:1746143686.140043:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592085248 00010000:00010000:2.0:1746143686.140082:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63df000/0xe984082ccd72481c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c86 expref: 34 pid: 8497 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.140121:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4696 00000100:00100000:2.0:1746143686.140128:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592085248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.140327:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.140353:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a63df000/0xe984082ccd72481c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c86 expref: 34 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.140365:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a63df000/0xe984082ccd72481c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c86 expref: 34 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.140388:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a63df000/0xe984082ccd72481c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c86 expref: 34 pid: 8497 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746143686.141066:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143686.141118:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.141186:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963592085248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1057us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.141194:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4696 00000100:00100000:2.0:1746143686.141239:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592085376 00000100:00100000:2.0:1746143686.141243:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592085376 00010000:00010000:2.0:1746143686.141255:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd724823 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c8d expref: 24 pid: 6929 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.141271:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4697 00000100:00100000:2.0:1746143686.141276:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963592085376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.141283:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.141292:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd724823 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c8d expref: 24 pid: 6929 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.141299:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd724823 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c8d expref: 24 pid: 6929 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.141311:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c25b200/0xe984082ccd724823 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c8d expref: 24 pid: 6929 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.141320:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.141336:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592085376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 59us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.141341:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4697 00000100:00100000:0.0:1746143686.143619:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.143864:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592085504 00000100:00100000:3.0:1746143686.143872:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592085504 00010000:00010000:3.0:1746143686.143929:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a962600/0xe984082ccd7246fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c16 expref: 11 pid: 21542 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746143686.143964:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4698 00000100:00100000:3.0:1746143686.143971:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592085504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143686.143984:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143686.144005:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a962600/0xe984082ccd7246fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c16 expref: 11 pid: 21542 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746143686.144016:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a962600/0xe984082ccd7246fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c16 expref: 11 pid: 21542 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746143686.144038:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a962600/0xe984082ccd7246fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c16 expref: 11 pid: 21542 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746143686.144103:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.144105:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.144113:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.144120:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.144187:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143686.144199:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593671040:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143686.144267:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7b40 going to sleep for 11 seconds 00000100:00080000:0.0:1746143686.144370:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143686.144682:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.145992:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592085760 00000100:00100000:3.0:1746143686.145999:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592085760 00002000:00100000:3.0:1746143686.146041:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880131e9c380 x1830963592085760/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.146051:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9c380 with x1830963592085760 ext(2097152->3145727) 00002000:00010000:3.0:1746143686.146056:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9c380 00000100:00100000:3.0:1746143686.146567:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3307 00000100:00100000:3.0:1746143686.146576:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963592085760:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143686.147986:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593671040:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143686.148011:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.148636:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592085504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4663us (5025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.148647:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4698 00000100:00100000:0.0:1746143686.150900:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.150985:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592086016 00000100:00100000:1.0:1746143686.150995:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592086016 00002000:00100000:1.0:1746143686.151048:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1495040->1499135) req@ffff880131e9c000 x1830963592086016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.151057:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9c000 with x1830963592086016 ext(1495040->1499135) 00002000:00010000:1.0:1746143686.151063:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9c000 00000100:00100000:1.0:1746143686.151089:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3308 00000100:00100000:1.0:1746143686.151096:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963592086016:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143686.151308:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963592086016:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 212us (418us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143686.151314:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3308 00002000:00100000:1.0:1746143686.151320:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1495040->1499135) req@ffff880131e9c000 x1830963592086016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/4536 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.151327:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9c000 with x1830963592086016 ext(1495040->1499135) 00002000:00010000:1.0:1746143686.151330:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9c000 00000100:00100000:3.0:1746143686.160777:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963592085760:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 14190us (16082us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143686.160791:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3307 00002000:00100000:3.0:1746143686.160803:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880131e9c380 x1830963592085760/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.160812:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9c380 with x1830963592085760 ext(2097152->3145727) 00002000:00010000:3.0:1746143686.160818:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9c380 00000100:00100000:0.0:1746143686.161300:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.161385:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592086144 00000100:00100000:2.0:1746143686.161394:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592086144 00000100:00100000:2.0:1746143686.161440:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9226 00000100:00100000:2.0:1746143686.161446:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28167:x1830963592086144:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143686.161462:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143686.161479:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0dcf expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.161507:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a963c00/0xe984082ccd724704 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c1d expref: 11 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.161514:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a623b600/0xe984082ccd72484d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb0 expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.161526:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd724846 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb7 expref: 18 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.161531:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.161534:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.161537:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1048576->1458175] (req 1048576->1458175) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 36 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.161567:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd724846 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb7 expref: 18 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.161579:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd724846 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb7 expref: 18 pid: 8496 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.161590:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593671168:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143686.161671:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a623b600/0xe984082ccd72484d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb0 expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.161679:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a623b600/0xe984082ccd72484d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb0 expref: 36 pid: 25369 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.161687:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593671296:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143686.161713:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a963c00/0xe984082ccd724704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c1d expref: 11 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.161726:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a963c00/0xe984082ccd724704 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c1d expref: 11 pid: 21542 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746143686.161734:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593671424:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143686.161764:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143686.167272:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.167369:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592086272 00000100:00100000:3.0:1746143686.167378:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592086272 00010000:00010000:3.0:1746143686.167416:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd724846 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb7 expref: 19 pid: 8496 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746143686.167447:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4699 00000100:00100000:3.0:1746143686.167455:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592086272:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143686.167468:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143686.167493:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd724846 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb7 expref: 19 pid: 8496 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.167504:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd724846 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb7 expref: 19 pid: 8496 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.167529:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143686.167584:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592086272:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 130us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.167591:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4699 00010000:00010000:2.0:1746143686.167677:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd724846 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb7 expref: 18 pid: 8496 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.167694:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593671168:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143686.167706:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593671296:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143686.170835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.171174:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592086400 00000100:00100000:2.0:1746143686.171183:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592086400 00010000:00010000:2.0:1746143686.171223:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a623b600/0xe984082ccd72484d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb0 expref: 37 pid: 25369 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.171260:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4700 00000100:00100000:2.0:1746143686.171268:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963592086400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.171283:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.171308:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a623b600/0xe984082ccd72484d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb0 expref: 37 pid: 25369 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.171320:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a623b600/0xe984082ccd72484d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb0 expref: 37 pid: 25369 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.171350:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a623b600/0xe984082ccd72484d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cb0 expref: 37 pid: 25369 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.171370:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.171414:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963592086400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 147us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.171420:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4700 00000100:00100000:2.0:1746143686.173244:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593671424:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143686.173284:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->1458175] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 35 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.173300:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3d7c00, rc 0) 00000100:00100000:2.0:1746143686.173340:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28167:x1830963592086144:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 11893us (12040us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.173348:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9226 00000100:00100000:0.0:1746143686.173475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.174398:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.174688:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592086656 00000100:00100000:2.0:1746143686.174695:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592086656 00000100:00100000:3.0:1746143686.175691:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592086528 00000100:00100000:3.0:1746143686.175698:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592086528 00000100:00100000:2.0:1746143686.175698:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9227 00000100:00100000:2.0:1746143686.175707:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:28172:x1830963592086656:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143686.175727:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143686.175745:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd724a0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0dd6 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.175861:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.175873:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143686.175875:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143686.175878:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd724a0d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dd6 expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.175908:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.175929:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 22 pid: 4581 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.175940:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593671552:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143686.176061:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143686.176220:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a963c00/0xe984082ccd724704 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c1d expref: 12 pid: 21542 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746143686.176247:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4701 00000100:00100000:3.0:1746143686.176253:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592086528:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143686.176262:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143686.176285:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a963c00/0xe984082ccd724704 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c1d expref: 12 pid: 21542 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746143686.176299:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a963c00/0xe984082ccd724704 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c1d expref: 12 pid: 21542 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746143686.176316:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a963c00/0xe984082ccd724704 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c1d expref: 12 pid: 21542 timeout: 865 lvb_type: 1 00000100:00080000:1.0:1746143686.176394:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746143686.177175:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.177177:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.177185:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.177194:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.177222:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143686.177232:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593671680:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143686.177293:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143686.178406:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593671552:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143686.178434:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd724a0d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dd6 expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.178446:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950aae00, rc 0) 00000100:00100000:2.0:1746143686.178479:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:28172:x1830963592086656:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2773us (4081us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.178487:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9227 00000100:00100000:0.0:1746143686.179492:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.179662:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592086784 00000100:00100000:2.0:1746143686.179668:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592086784 00002000:00100000:2.0:1746143686.179711:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3252224->4071423) req@ffff880131e9d500 x1830963592086784/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.179724:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9d500 with x1830963592086784 ext(3252224->4071423) 00010000:00010000:2.0:1746143686.179731:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 23 pid: 4581 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.179744:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 23 pid: 4581 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746143686.179750:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131e9d500 00000100:00100000:3.0:1746143686.180043:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593671680:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143686.180465:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 792 00000100:00100000:1.0:1746143686.180477:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592086784:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:3.0:1746143686.180499:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143686.180544:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592086528:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4291us (7069us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.180553:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4701 00000100:00100000:0.0:1746143686.187410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.187800:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592087040 00000100:00100000:2.0:1746143686.187810:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592087040 00002000:00100000:2.0:1746143686.187859:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1454080->1458175) req@ffff880131e9d180 x1830963592087040/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.187870:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9d180 with x1830963592087040 ext(1454080->1458175) 00002000:00010000:2.0:1746143686.187876:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9d180 00000100:00100000:2.0:1746143686.187908:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3309 00000100:00100000:2.0:1746143686.187926:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963592087040:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143686.188159:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963592087040:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 214us (741us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143686.188166:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3309 00002000:00100000:2.0:1746143686.188172:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1454080->1458175) req@ffff880131e9d180 x1830963592087040/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/4536 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.188179:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9d180 with x1830963592087040 ext(1454080->1458175) 00002000:00010000:2.0:1746143686.188181:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9d180 00000100:00100000:0.0:1746143686.192730:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.192927:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592087296 00000100:00100000:3.0:1746143686.192938:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592087296 00000100:00100000:3.0:1746143686.193167:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3316 00000100:00100000:3.0:1746143686.193176:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:28167:x1830963592087296:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143686.193825:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:28167:x1830963592087296:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 649us (1106us total) trans 8589942281 rc 0/0 00000100:00100000:3.0:1746143686.193832:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3316 00000100:00100000:1.0:1746143686.195190:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592086784:12345-192.168.202.48@tcp:4:cat.0 Request processed in 14709us (15693us total) trans 21474839654 rc 0/0 00000100:00100000:1.0:1746143686.195200:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 792 00002000:00100000:1.0:1746143686.195212:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3252224->4071423) req@ffff880131e9d500 x1830963592086784/t21474839654(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/448 e 0 to 0 dl 1746143697 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.195221:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9d500 with x1830963592086784 ext(3252224->4071423) 00010000:00010000:1.0:1746143686.195231:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 25 pid: 4581 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746143686.195246:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 25 pid: 4581 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746143686.195252:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131e9d500 00000100:00100000:0.0:1746143686.202327:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.202553:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592087424 00000100:00100000:3.0:1746143686.202564:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592087424 00010000:00010000:3.0:1746143686.202602:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 25 pid: 4581 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746143686.203000:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4702 00000100:00100000:3.0:1746143686.203010:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1962:x1830963592087424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143686.203027:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143686.203052:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 25 pid: 4581 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.203064:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 25 pid: 4581 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.203088:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9200/0xe984082ccd72496c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3252224->4071423) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d6d expref: 25 pid: 4581 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.203109:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.203110:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.203118:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd724a0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dd6 expref: 33 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.203176:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd724a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dd6 expref: 33 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.203212:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd724a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dd6 expref: 33 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143686.203226:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593671808:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143686.203316:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143686.205564:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593671808:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143686.205590:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143686.205635:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1962:x1830963592087424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2626us (3318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.205646:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4702 00000100:00100000:0.0:1746143686.210245:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.210307:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592087680 00000100:00100000:1.0:1746143686.210378:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592087680 00002000:00100000:1.0:1746143686.210526:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008e63dc00 x1830963592087680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.210536:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63dc00 with x1830963592087680 ext(3145728->4194303) 00002000:00010000:1.0:1746143686.210541:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e63dc00 00000100:00100000:1.0:1746143686.210575:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3310 00000100:00100000:1.0:1746143686.210582:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963592087680:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143686.237318:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.238204:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963592087680:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 27619us (27966us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143686.238215:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3310 00002000:00100000:1.0:1746143686.238227:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008e63dc00 x1830963592087680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.238237:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63dc00 with x1830963592087680 ext(3145728->4194303) 00002000:00010000:1.0:1746143686.238243:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e63dc00 00000100:00100000:3.0:1746143686.238719:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592087936 00000100:00100000:3.0:1746143686.238729:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592087936 00000100:00100000:3.0:1746143686.238965:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8199 00000100:00100000:3.0:1746143686.238973:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28179:x1830963592087936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143686.238997:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.239015:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd724a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ddd expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.239130:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd724a1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.239158:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd724a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.239170:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd724a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.239185:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963600/0xe984082ccd724a22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.239189:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963600/0xe984082ccd724a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.239194:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963600/0xe984082ccd724a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.240116:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.240127:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.240133:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143686.242497:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143686.242635:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd724a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242644:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd724a1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242650:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd724a1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242655:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a962800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.242659:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd724a1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242667:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd724a1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242682:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143686.242685:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.242689:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd724a1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242694:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd724a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242724:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963600/0xe984082ccd724a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242728:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963600/0xe984082ccd724a22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242733:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963600/0xe984082ccd724a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242737:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a963600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.242739:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963600/0xe984082ccd724a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242743:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963600/0xe984082ccd724a22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242749:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5ec00) 00010000:00010000:3.0:1746143686.242750:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.242752:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963600/0xe984082ccd724a22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242756:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963600/0xe984082ccd724a22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.242812:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd724a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ddd expref: 18 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.242826:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ddd expref: 17 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.242832:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.242834:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143686.242836:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a963c00, rc 0) 00000100:00100000:3.0:1746143686.242905:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28179:x1830963592087936:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3931us (5596us total) trans 8589942282 rc 0/0 00000100:00100000:3.0:1746143686.242924:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8199 00000100:00100000:0.0:1746143686.253041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.253097:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.255011:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592088064 00000100:00100000:1.0:1746143686.255026:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592088064 00000100:00100000:1.0:1746143686.255098:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592088192 00000100:00100000:1.0:1746143686.255100:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592088192 00000100:00100000:1.0:1746143686.255132:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9228 00000100:00100000:1.0:1746143686.255176:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963592088064:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143686.255197:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.255218:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094be3a00/0xe984082ccd724a37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0de4 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143686.255277:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091717480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593671936:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143686.255392:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143686.255573:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9229 00000100:00100000:2.0:1746143686.255582:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592088192:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143686.255590:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143686.255600:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f9c5600/0xe984082ccd724a3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0deb expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143686.255626:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593672064:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143686.255651:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143686.258007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.258105:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592088320 00000100:00100000:3.0:1746143686.258112:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592088320 00000100:00100000:3.0:1746143686.258222:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9230 00000100:00100000:3.0:1746143686.258229:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963592088320:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143686.258247:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.258263:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724a45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0df2 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.258283:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.258285:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.258294:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df2 expref: 27 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.258309:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df2 expref: 27 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.258324:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a963e00, rc 0) 00000100:00100000:0.0:1746143686.258885:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.258998:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592088576 00000100:00100000:2.0:1746143686.259002:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592088576 00000100:00100000:2.0:1746143686.259031:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3317 00000100:00100000:2.0:1746143686.259037:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:28172:x1830963592088576:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143686.259236:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:28172:x1830963592088576:12345-192.168.202.48@tcp:35:cat.0 Request processed in 199us (351us total) trans 8589942283 rc 0/0 00000100:00100000:2.0:1746143686.259243:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3317 00000100:00100000:3.0:1746143686.259825:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592088320:12345-192.168.202.48@tcp:101:cat.0 Request processed in 322us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.259833:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9230 00002000:00010000:2.0:1746143686.260410:0:12618:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143684 -> 1746143685 00002000:00010000:2.0:1746143686.260414:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143684 -> 1746143686 00002000:00010000:2.0:1746143686.260415:0:12618:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143684 -> 1746143685 00000100:00100000:2.0:1746143686.260434:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593672064:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143686.260462:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f9c5600/0xe984082ccd724a3e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0deb expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.260474:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f9c5600/0xe984082ccd724a3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0deb expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.260488:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9c5600, rc 0) 00000100:00100000:2.0:1746143686.260526:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592088192:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4944us (7427us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143686.260531:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9229 00002000:00010000:1.0:1746143686.260928:0:8497:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime: 1746143684 -> 1746143685 00002000:00010000:1.0:1746143686.260932:0:8497:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime: 1746143684 -> 1746143686 00002000:00010000:1.0:1746143686.260933:0:8497:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime: 1746143684 -> 1746143685 00000100:00100000:1.0:1746143686.260947:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091717480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593671936:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143686.260966:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094be3a00/0xe984082ccd724a37 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0de4 expref: 26 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.260975:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094be3a00/0xe984082ccd724a37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0de4 expref: 26 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.260992:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094be3a00, rc 0) 00000100:00100000:1.0:1746143686.261017:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963592088064:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5878us (7988us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143686.261022:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9228 00000100:00100000:0.0:1746143686.275224:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.275382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.275645:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592088832 00000100:00100000:2.0:1746143686.275655:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592088832 00000100:00100000:2.0:1746143686.275703:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8200 00000100:00100000:2.0:1746143686.275711:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28181:x1830963592088832:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143686.275738:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143686.275758:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3a00/0xe984082ccd724a4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0df9 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.275872:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143686.275888:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d82 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.275895:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd7249c7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d97 expref: 248 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.275901:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a29 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ddd expref: 18 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.275907:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143686.275950:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ddd expref: 18 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.275963:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ddd expref: 18 pid: 14763 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.275976:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593672192:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143686.276068:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd7249c7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d97 expref: 248 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.276077:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd7249c7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d97 expref: 248 pid: 14763 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.276085:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593672320:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143686.276111:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d82 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.276118:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d82 expref: 8 pid: 14763 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.276125:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593672448:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143686.276175:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143686.276380:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592088960 00000100:00100000:1.0:1746143686.276384:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592088960 00000100:00100000:1.0:1746143686.276413:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9231 00000100:00100000:1.0:1746143686.276418:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28179:x1830963592088960:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143686.276428:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.276752:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbcc400/0xe984082ccd724a5a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e00 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.276778:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 33 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.276785:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143686.276786:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143686.276789:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcc400/0xe984082ccd724a5a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e00 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.276805:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 33 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.276812:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 33 pid: 12618 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746143686.276824:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091717480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593672576:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143686.276847:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143686.279507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.279547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.279750:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593672192:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143686.279762:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593672320:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143686.279770:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593672448:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143686.279797:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:3.0:1746143686.280164:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592089088 00000100:00100000:3.0:1746143686.280172:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592089088 00010000:00010000:3.0:1746143686.280204:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ddd expref: 19 pid: 14763 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746143686.280270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.280597:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091717480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593672576:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143686.280618:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcc400/0xe984082ccd724a5a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e00 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.280635:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbcc400, rc 0) 00000100:00100000:1.0:1746143686.280683:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+26:28179:x1830963592088960:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4264us (5300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143686.280691:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9231 00000100:00100000:1.0:1746143686.280748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.280841:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592089472 00000100:00100000:1.0:1746143686.280844:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592089472 00002000:00100000:1.0:1746143686.280874:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1495040->2097151) req@ffff880091717480 x1830963592089472/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.280882:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091717480 with x1830963592089472 ext(1495040->2097151) 00010000:00010000:1.0:1746143686.280888:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 34 pid: 12618 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746143686.280898:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 34 pid: 12618 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746143686.280904:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091717480 00000100:00100000:1.0:1746143686.280928:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 793 00000100:00100000:1.0:1746143686.280934:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592089472:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143686.281696:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592089344 00000100:00100000:3.0:1746143686.281702:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592089344 00010000:00010000:3.0:1746143686.281722:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d82 expref: 9 pid: 14763 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746143686.281740:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592089216 00000100:00100000:3.0:1746143686.281743:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592089216 00010000:00010000:3.0:1746143686.281755:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd7249c7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d97 expref: 249 pid: 14763 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746143686.281770:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4703 00000100:00100000:3.0:1746143686.281776:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592089088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143686.281787:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143686.281787:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4704 00010000:00010000:3.0:1746143686.281793:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ddd expref: 19 pid: 14763 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.281796:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592089344:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143686.281802:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ddd expref: 19 pid: 14763 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.281804:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.281810:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d82 expref: 9 pid: 14763 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.281832:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a29 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ddd expref: 19 pid: 14763 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.281994:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d82 expref: 9 pid: 14763 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.282008:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724996 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d82 expref: 9 pid: 14763 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746143686.282014:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4705 00000100:00100000:0.0:1746143686.282022:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091716680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1964:x1830963592089216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143686.282030:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.282035:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:0.0:1746143686.282035:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd7249c7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d97 expref: 249 pid: 14763 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.282040:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143686.282048:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143686.282053:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143686.282055:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.282059:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.282064:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.282068:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.282083:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592089344:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 289us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.282089:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592089088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 312us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.282089:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4704 00000100:00100000:3.0:1746143686.282094:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4703 00010000:00010000:0.0:1746143686.282574:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd7249c7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d97 expref: 249 pid: 14763 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746143686.282587:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd7249c7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d97 expref: 249 pid: 14763 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746143686.282599:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:0.0:1746143686.282602:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143686.282610:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143686.282616:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143686.282632:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143686.282650:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091716680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1964:x1830963592089216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 630us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143686.282655:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4705 00010000:00010000:3.0:1746143686.282706:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.282712:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143686.282731:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143686.282945:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3a00/0xe984082ccd724a4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df9 expref: 19 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.282957:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df9 expref: 18 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.282962:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.282964:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143686.282966:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094be3c00, rc 0) 00000100:00100000:3.0:1746143686.283004:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28181:x1830963592088832:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7294us (7791us total) trans 8589942284 rc 0/0 00000100:00100000:3.0:1746143686.283010:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8200 00000100:00100000:1.0:1746143686.297502:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963592089472:12345-192.168.202.48@tcp:4:cat.0 Request processed in 16555us (16740us total) trans 21474839655 rc 0/0 00000100:00100000:1.0:1746143686.297516:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 793 00002000:00100000:1.0:1746143686.297530:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1495040->2097151) req@ffff880091717480 x1830963592089472/t21474839655(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/448 e 0 to 0 dl 1746143697 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.297540:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091717480 with x1830963592089472 ext(1495040->2097151) 00010000:00010000:1.0:1746143686.297551:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 36 pid: 12618 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746143686.297566:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 36 pid: 12618 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746143686.297572:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091717480 00000100:00100000:0.0:1746143686.308679:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.308783:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592089600 00000100:00100000:2.0:1746143686.308793:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592089600 00010000:00010000:2.0:1746143686.308835:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 36 pid: 12618 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.308884:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4706 00000100:00100000:2.0:1746143686.308892:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963592089600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.308906:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.308940:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 36 pid: 12618 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.308952:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 36 pid: 12618 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.308975:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01a9600/0xe984082ccd7249f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1495040->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc8 expref: 36 pid: 12618 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.308995:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.308997:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.309005:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcc400/0xe984082ccd724a5a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e00 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.309012:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcc400/0xe984082ccd724a5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e00 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.309047:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbcc400/0xe984082ccd724a5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e00 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143686.309061:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593672704:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143686.309176:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143686.317511:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.317647:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593672704:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143686.317667:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.317713:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963592089600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8821us (9046us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.317725:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4706 00000100:00100000:1.0:1746143686.317779:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592089856 00000100:00100000:1.0:1746143686.317787:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592089856 00002000:00100000:1.0:1746143686.317828:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88008e63f480 x1830963592089856/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.317837:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63f480 with x1830963592089856 ext(1048576->2097151) 00002000:00010000:1.0:1746143686.317841:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e63f480 00000100:00100000:1.0:1746143686.317859:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3311 00000100:00100000:1.0:1746143686.317866:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592089856:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143686.335740:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592089856:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17861us (18228us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143686.335753:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3311 00002000:00100000:1.0:1746143686.335767:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88008e63f480 x1830963592089856/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.335776:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63f480 with x1830963592089856 ext(1048576->2097151) 00002000:00010000:1.0:1746143686.335783:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e63f480 00000100:00100000:0.0:1746143686.339615:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.340182:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592089984 00000100:00100000:1.0:1746143686.340196:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592089984 00000100:00100000:1.0:1746143686.340257:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9232 00000100:00100000:1.0:1746143686.340269:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28179:x1830963592089984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143686.340290:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.340309:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801369f1c00/0xe984082ccd724a68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e07 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.340339:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.340347:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143686.340349:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143686.340352:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801369f1c00/0xe984082ccd724a68 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e07 expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.340382:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.340393:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 34 pid: 12618 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746143686.340411:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593672832:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143686.340501:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143686.343354:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.343410:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592090112 00000100:00100000:2.0:1746143686.343419:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592090112 00002000:00100000:2.0:1746143686.343468:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1458175) req@ffff88008e63c380 x1830963592090112/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.343477:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63c380 with x1830963592090112 ext(1048576->1458175) 00010000:00010000:2.0:1746143686.343488:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 35 pid: 12618 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.343502:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 35 pid: 12618 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746143686.343509:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e63c380 00000100:00100000:2.0:1746143686.343544:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 794 00000100:00100000:2.0:1746143686.343552:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963592090112:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143686.343647:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091715c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593672832:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143686.343673:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801369f1c00/0xe984082ccd724a68 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e07 expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.343687:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369f1c00, rc 0) 00000100:00100000:1.0:1746143686.343727:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28179:x1830963592089984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3459us (4123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143686.343734:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9232 00000100:00100000:2.0:1746143686.350456:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963592090112:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6892us (7100us total) trans 17179872390 rc 0/0 00000100:00100000:2.0:1746143686.350470:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 794 00002000:00100000:2.0:1746143686.350484:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1458175) req@ffff88008e63c380 x1830963592090112/t17179872390(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/448 e 0 to 0 dl 1746143697 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.350493:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63c380 with x1830963592090112 ext(1048576->1458175) 00010000:00010000:2.0:1746143686.350505:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 37 pid: 12618 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.350521:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 37 pid: 12618 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746143686.350528:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e63c380 00000100:00100000:0.0:1746143686.352852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.353047:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592090240 00000100:00100000:2.0:1746143686.353055:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592090240 00010000:00010000:2.0:1746143686.353093:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 37 pid: 12618 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.353129:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4707 00000100:00100000:2.0:1746143686.353136:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963592090240:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.353178:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.353200:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 37 pid: 12618 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.353210:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 37 pid: 12618 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.353232:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3d7c00/0xe984082ccd724a06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dcf expref: 37 pid: 12618 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.353252:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.353254:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.353262:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801369f1c00/0xe984082ccd724a68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e07 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.353273:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801369f1c00/0xe984082ccd724a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e07 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.353313:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801369f1c00/0xe984082ccd724a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e07 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143686.353325:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593672960:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143686.353407:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143686.355910:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593672960:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143686.355939:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.356017:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963592090240:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2880us (3172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.356028:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4707 00000100:00100000:0.0:1746143686.359992:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.360136:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592090496 00000100:00100000:2.0:1746143686.360182:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592090496 00002000:00100000:2.0:1746143686.360245:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008e63fb80 x1830963592090496/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.360257:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63fb80 with x1830963592090496 ext(1048576->2097151) 00002000:00010000:2.0:1746143686.360263:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e63fb80 00000100:00100000:2.0:1746143686.361248:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3312 00000100:00100000:2.0:1746143686.361261:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592090496:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143686.389984:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592090496:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28715us (29995us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143686.390001:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3312 00002000:00100000:2.0:1746143686.390013:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008e63fb80 x1830963592090496/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.390022:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63fb80 with x1830963592090496 ext(1048576->2097151) 00002000:00010000:2.0:1746143686.390028:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e63fb80 00000100:00100000:0.0:1746143686.401578:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.404469:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592090752 00000100:00100000:2.0:1746143686.404484:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592090752 00002000:00100000:2.0:1746143686.404542:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008e63ea00 x1830963592090752/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.404554:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63ea00 with x1830963592090752 ext(3145728->4194303) 00002000:00010000:2.0:1746143686.404559:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e63ea00 00000100:00100000:2.0:1746143686.408327:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3313 00000100:00100000:2.0:1746143686.408349:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1963:x1830963592090752:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143686.419455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.421558:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592091008 00000100:00100000:3.0:1746143686.421571:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592091008 00000100:00100000:3.0:1746143686.421630:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8201 00000100:00100000:3.0:1746143686.421638:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:28184:x1830963592091008:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143686.421664:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.421684:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd724a6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e0e expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.421795:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962600/0xe984082ccd724a76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.421808:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962600/0xe984082ccd724a76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.421818:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962600/0xe984082ccd724a76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.421833:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.421839:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.421844:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.421962:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724a84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.421975:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724a84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.421981:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724a84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143686.421991:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143686.422078:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962600/0xe984082ccd724a76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422085:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962600/0xe984082ccd724a76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422090:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962600/0xe984082ccd724a76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422095:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a962600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.422098:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962600/0xe984082ccd724a76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422103:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962600/0xe984082ccd724a76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422111:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143686.422114:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.422117:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962600/0xe984082ccd724a76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422122:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962600/0xe984082ccd724a76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422152:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422160:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422164:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422168:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a963c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.422169:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422173:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422178:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5e000) 00010000:00010000:3.0:1746143686.422180:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.422182:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422186:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963c00/0xe984082ccd724a7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.422234:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd724a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e0e expref: 251 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.422245:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724a84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e0e expref: 250 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.422252:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.422254:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143686.422256:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955db800, rc 0) 00000100:00100000:3.0:1746143686.427037:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:28184:x1830963592091008:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5381us (9152us total) trans 8589942285 rc 0/0 00000100:00100000:3.0:1746143686.427053:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8201 00000100:00100000:1.0:1746143686.428014:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1963:x1830963592090752:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19673us (26446us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143686.428023:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3313 00002000:00100000:1.0:1746143686.428034:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008e63ea00 x1830963592090752/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.428043:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63ea00 with x1830963592090752 ext(3145728->4194303) 00002000:00010000:1.0:1746143686.428049:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e63ea00 00000100:00100000:0.0:1746143686.432694:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.432787:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592091136 00000100:00100000:3.0:1746143686.432796:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592091136 00000100:00100000:3.0:1746143686.432854:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 559 00000100:00100000:3.0:1746143686.432863:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:1964:x1830963592091136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143686.432880:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143686.432909:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800955db800/0xe984082ccd724a84 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e0e expref: 250 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.432953:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.432958:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143686.433016:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1964:x1830963592091136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 153us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.433022:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 559 00000100:00100000:0.0:1746143686.438366:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.438459:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592091392 00000100:00100000:2.0:1746143686.438469:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592091392 00000100:00100000:2.0:1746143686.438800:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3318 00000100:00100000:2.0:1746143686.438810:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28179:x1830963592091392:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143686.439585:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28179:x1830963592091392:12345-192.168.202.48@tcp:35:cat.0 Request processed in 775us (1229us total) trans 8589942286 rc 0/0 00000100:00100000:2.0:1746143686.439593:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3318 00000100:00100000:0.0:1746143686.458803:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.459175:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592091520 00000100:00100000:1.0:1746143686.459186:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592091520 00000100:00100000:1.0:1746143686.460077:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9233 00000100:00100000:1.0:1746143686.460087:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28184:x1830963592091520:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143686.460110:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.460130:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e15 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.460191:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a963000/0xe984082ccd7246f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c0f expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.460201:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c200/0xe984082ccd7247f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c71 expref: 36 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.460208:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7247f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c63 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.460215:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143686.460216:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143686.460220:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [1245184->1552383] (req 1245184->1552383) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 36 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.460252:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7247f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c63 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.460264:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7247f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c63 expref: 25 pid: 6929 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746143686.460277:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593673088:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143686.460390:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c200/0xe984082ccd7247f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c71 expref: 36 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.460398:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c200/0xe984082ccd7247f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c71 expref: 36 pid: 6929 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746143686.460407:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593673216:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143686.460434:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a963000/0xe984082ccd7246f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c0f expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.460442:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a963000/0xe984082ccd7246f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c0f expref: 9 pid: 21542 timeout: 865 lvb_type: 1 00000100:00100000:1.0:1746143686.460449:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593673344:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143686.460464:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143686.469999:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.470042:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.470090:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.470214:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091715c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593673088:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143686.470227:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091715880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593673216:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143686.470234:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091715180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593673344:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143686.470270:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [1245184->1552383] (req 1245184->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 36 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.470290:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369f0600, rc 0) 00000100:00100000:1.0:1746143686.470340:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:28184:x1830963592091520:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 10256us (11548us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143686.470349:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9233 00000100:00100000:3.0:1746143686.470361:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592091648 00000100:00100000:3.0:1746143686.470368:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592091648 00000100:00100000:1.0:1746143686.470396:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592091904 00010000:00010000:3.0:1746143686.470399:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7247f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c63 expref: 26 pid: 6929 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746143686.470399:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592091904 00010000:00010000:1.0:1746143686.470410:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a963000/0xe984082ccd7246f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c0f expref: 10 pid: 21542 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746143686.470419:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592091776 00000100:00100000:3.0:1746143686.470421:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592091776 00000100:00100000:1.0:1746143686.470431:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4708 00010000:00010000:3.0:1746143686.470432:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c200/0xe984082ccd7247f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c71 expref: 36 pid: 6929 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746143686.470437:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592091648:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143686.470444:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4709 00000100:00100000:3.0:1746143686.470449:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592091904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143686.470449:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143686.470458:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143686.470470:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a963000/0xe984082ccd7246f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c0f expref: 10 pid: 21542 timeout: 865 lvb_type: 1 00010000:00010000:1.0:1746143686.470471:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7247f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c63 expref: 26 pid: 6929 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.470479:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a963000/0xe984082ccd7246f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c0f expref: 10 pid: 21542 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746143686.470924:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4710 00000100:00100000:2.0:1746143686.470933:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963592091776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.470941:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143686.472777:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7247f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c63 expref: 26 pid: 6929 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746143686.472813:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7247f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c63 expref: 26 pid: 6929 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746143686.472840:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143686.472899:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592091648:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2461us (2915us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143686.472907:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4708 00010000:00010000:3.0:1746143686.473111:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a963000/0xe984082ccd7246f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c0f expref: 10 pid: 21542 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746143686.473130:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143686.473160:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592091904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2710us (3118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.473167:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4709 00010000:00010000:2.0:1746143686.473201:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c200/0xe984082ccd7247f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c71 expref: 36 pid: 6929 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.473211:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c200/0xe984082ccd7247f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c71 expref: 36 pid: 6929 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.473223:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c200/0xe984082ccd7247f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c71 expref: 36 pid: 6929 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.473239:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.473241:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.473248:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 35 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.473256:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 35 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.473301:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 35 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143686.473313:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593673472:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143686.473356:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143686.483075:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593673472:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143686.483098:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.483232:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963592091776:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12299us (13138us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.483243:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4710 00000100:00100000:0.0:1746143686.483585:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.483703:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592092160 00000100:00100000:2.0:1746143686.483710:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592092160 00002000:00100000:2.0:1746143686.483750:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1245184->1249279) req@ffff88012fc12680 x1830963592092160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.483760:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12680 with x1830963592092160 ext(1245184->1249279) 00002000:00010000:2.0:1746143686.483765:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc12680 00000100:00100000:2.0:1746143686.484601:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3314 00000100:00100000:2.0:1746143686.484611:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963592092160:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143686.484792:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963592092160:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 182us (1209us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143686.484797:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3314 00002000:00100000:2.0:1746143686.484803:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1245184->1249279) req@ffff88012fc12680 x1830963592092160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/4536 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.484810:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12680 with x1830963592092160 ext(1245184->1249279) 00002000:00010000:2.0:1746143686.484813:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc12680 00000100:00100000:0.0:1746143686.490770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.490881:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592092416 00000100:00100000:3.0:1746143686.490892:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592092416 00002000:00100000:3.0:1746143686.490954:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1548288->1552383) req@ffff88012fc10a80 x1830963592092416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.490965:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10a80 with x1830963592092416 ext(1548288->1552383) 00002000:00010000:3.0:1746143686.490970:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10a80 00000100:00100000:3.0:1746143686.491006:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3315 00000100:00100000:3.0:1746143686.491013:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963592092416:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143686.492008:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963592092416:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 991us (1246us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143686.492016:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3315 00002000:00100000:3.0:1746143686.492024:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1548288->1552383) req@ffff88012fc10a80 x1830963592092416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/4536 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.492032:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10a80 with x1830963592092416 ext(1548288->1552383) 00002000:00010000:3.0:1746143686.492035:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10a80 00000100:00100000:0.0:1746143686.509711:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.509812:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592092672 00000100:00100000:2.0:1746143686.509823:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592092672 00000100:00100000:2.0:1746143686.509872:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3319 00000100:00100000:2.0:1746143686.509879:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:28184:x1830963592092672:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143686.511514:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:28184:x1830963592092672:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 1627us (1808us total) trans 8589942287 rc 0/0 00000100:00100000:2.0:1746143686.511523:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3319 00000100:00100000:2.0:1746143686.512208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.512279:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592092928 00000100:00100000:3.0:1746143686.512287:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592092928 00000100:00100000:3.0:1746143686.512400:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8202 00000100:00100000:3.0:1746143686.512406:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:28188:x1830963592092928:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143686.512423:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.512442:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458200/0xe984082ccd724a99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e1c expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.512543:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd724aa0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512556:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd724aa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512567:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd724aa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512580:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd724aa7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512586:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd724aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512591:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd724aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512780:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd724aae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512790:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd724aae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512796:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd724aae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143686.512805:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143686.512866:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd724aa0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512872:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd724aa0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512878:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd724aa0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512882:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63d8a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.512885:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd724aa0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512890:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd724aa0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512899:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143686.512901:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.512904:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd724aa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.512908:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd724aa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.514106:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd724aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.514119:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd724aa7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.514124:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd724aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.514128:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63d9600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.514130:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd724aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.514134:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd724aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.514403:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5ea00) 00010000:00010000:3.0:1746143686.514406:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.514409:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd724aa7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.514414:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd724aa7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.514475:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458200/0xe984082ccd724a99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e1c expref: 253 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.514487:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd724aae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e1c expref: 252 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.514493:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.514495:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143686.514497:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d8600, rc 0) 00000100:00100000:3.0:1746143686.514585:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:28188:x1830963592092928:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2178us (2378us total) trans 8589942288 rc 0/0 00000100:00100000:3.0:1746143686.514593:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8202 00000100:00100000:0.0:1746143686.517101:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.518444:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592093056 00000100:00100000:2.0:1746143686.518458:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592093056 00000100:00100000:2.0:1746143686.519331:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 560 00000100:00100000:2.0:1746143686.519345:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1965:x1830963592093056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.519366:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.519399:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd724aae lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e1c expref: 252 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.519420:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143686.519425:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.519495:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1965:x1830963592093056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 153us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.519502:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 560 00000100:00100000:1.0:1746143686.520735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.520785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.520955:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592093312 00000100:00100000:3.0:1746143686.520963:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592093312 00000100:00100000:3.0:1746143686.521002:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592093184 00000100:00100000:3.0:1746143686.521006:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592093184 00000100:00100000:3.0:1746143686.521050:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9234 00000100:00100000:3.0:1746143686.521059:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1963:x1830963592093312:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143686.521082:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.521100:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8200/0xe984082ccd724abc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e2a expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.521125:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.521126:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.521137:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8200/0xe984082ccd724abc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e2a expref: 37 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.521183:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8200/0xe984082ccd724abc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e2a expref: 37 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.521196:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d8200, rc 0) 00000100:00100000:3.0:1746143686.521239:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963592093312:12345-192.168.202.48@tcp:101:cat.0 Request processed in 180us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.521245:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9234 00000100:00100000:3.0:1746143686.521263:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9235 00000100:00100000:3.0:1746143686.521270:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963592093184:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143686.521279:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.521293:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9c00/0xe984082ccd724ac3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e23 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.521307:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.521309:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.521314:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9c00/0xe984082ccd724ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e23 expref: 36 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.521324:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9c00/0xe984082ccd724ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e23 expref: 36 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.521332:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d9c00, rc 0) 00000100:00100000:3.0:1746143686.521354:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1963:x1830963592093184:12345-192.168.202.48@tcp:101:cat.0 Request processed in 83us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.521359:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9235 00000100:00100000:0.0:1746143686.537684:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.537726:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.537769:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.537845:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592093824 00000100:00100000:2.0:1746143686.537845:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592093568 00000100:00100000:3.0:1746143686.537855:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592093824 00000100:00100000:2.0:1746143686.537855:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592093568 00002000:00100000:3.0:1746143686.537901:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88012fc10000 x1830963592093824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.537901:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88012fc13100 x1830963592093568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 504/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.537920:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10000 with x1830963592093824 ext(1048576->2097151) 00002000:00100000:2.0:1746143686.537920:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13100 with x1830963592093568 ext(1048576->2097151) 00002000:00010000:3.0:1746143686.537925:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10000 00002000:00010000:2.0:1746143686.537925:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc13100 00000100:00100000:3.0:1746143686.538019:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592094080 00000100:00100000:3.0:1746143686.538022:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592094080 00002000:00100000:3.0:1746143686.538039:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88012fc12300 x1830963592094080/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.538045:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12300 with x1830963592094080 ext(1048576->2097151) 00002000:00010000:3.0:1746143686.538049:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc12300 00000100:00100000:2.0:1746143686.538260:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3316 00000100:00100000:2.0:1746143686.538269:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963592093824:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143686.538440:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3317 00000100:00100000:3.0:1746143686.538446:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963592093568:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143686.539416:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3318 00000100:00100000:3.0:1746143686.539423:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963592094080:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143686.551461:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.551583:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592094208 00000100:00100000:1.0:1746143686.551593:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592094208 00000100:00100000:1.0:1746143686.551640:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9236 00000100:00100000:1.0:1746143686.551648:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28181:x1830963592094208:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143686.551667:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.551687:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e31 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.551718:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.551726:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143686.551728:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143686.551731:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1564672->2097151] (req 1564672->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.551761:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.551771:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 39 pid: 8497 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746143686.551783:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091715c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593673600:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143686.551861:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143686.554632:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963592093568:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16172us (16945us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746143686.554644:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3317 00002000:00100000:2.0:1746143686.554658:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88012fc13100 x1830963592093568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 504/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.554668:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13100 with x1830963592093568 ext(1048576->2097151) 00010000:00010000:2.0:1746143686.554680:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 38 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.554696:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 38 pid: 8497 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746143686.554703:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fc13100 00000100:00100000:1.0:1746143686.568033:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091715c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593673600:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143686.568069:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1564672->2097151] (req 1564672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.568087:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369f1000, rc 0) 00000100:00100000:1.0:1746143686.568165:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+26:28181:x1830963592094208:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 16516us (16713us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143686.568175:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9236 00000100:00100000:3.0:1746143686.570881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.571955:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592094336 00000100:00100000:0.0:1746143686.571963:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592094336 00002000:00100000:0.0:1746143686.572002:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1245184->1552383) req@ffff8800930d1f80 x1830963592094336/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143686.572011:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1f80 with x1830963592094336 ext(1245184->1552383) 00010000:00010000:0.0:1746143686.572019:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 37 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746143686.572032:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 37 pid: 8497 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746143686.572038:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d1f80 00010000:00010000:3.0:1746143686.572381:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143686.574126:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963592093824:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35848us (36388us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143686.574137:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3316 00002000:00100000:2.0:1746143686.574157:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88012fc10000 x1830963592093824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.574164:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10000 with x1830963592093824 ext(1048576->2097151) 00002000:00010000:2.0:1746143686.574169:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10000 00000100:00100000:2.0:1746143686.574199:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 795 00000100:00100000:2.0:1746143686.574209:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963592094336:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143686.579222:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963592094080:12345-192.168.202.48@tcp:3:cat.0 Request processed in 39787us (41441us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143686.579235:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3318 00002000:00100000:3.0:1746143686.579247:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88012fc12300 x1830963592094080/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.579256:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12300 with x1830963592094080 ext(1048576->2097151) 00002000:00010000:3.0:1746143686.579262:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc12300 00000100:00100000:0.0:1746143686.584309:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963592094336:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10089us (13424us total) trans 21474839656 rc 0/0 00000100:00100000:0.0:1746143686.584322:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 795 00002000:00100000:0.0:1746143686.584336:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1245184->1552383) req@ffff8800930d1f80 x1830963592094336/t21474839656(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/448 e 0 to 0 dl 1746143697 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143686.584345:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1f80 with x1830963592094336 ext(1245184->1552383) 00010000:00010000:0.0:1746143686.584357:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 38 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746143686.584371:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 38 pid: 8497 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746143686.584379:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d1f80 00000100:00100000:2.0:1746143686.584616:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.585064:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592094592 00000100:00100000:0.0:1746143686.585072:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592094592 00000100:00100000:3.0:1746143686.585692:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8203 00000100:00100000:3.0:1746143686.585703:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28192:x1830963592094592:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143686.585729:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.586775:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74e00/0xe984082ccd724ad1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e38 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.586903:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75000/0xe984082ccd724ad8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.586927:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75000/0xe984082ccd724ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.586938:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75000/0xe984082ccd724ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.586954:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75200/0xe984082ccd724adf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.586959:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75200/0xe984082ccd724adf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.586963:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75200/0xe984082ccd724adf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.587073:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724ae6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.587082:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.587087:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143686.587096:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143686.587200:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75000/0xe984082ccd724ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.587206:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75000/0xe984082ccd724ad8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.587211:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75000/0xe984082ccd724ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.587215:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a75000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.587218:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75000/0xe984082ccd724ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.587223:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75000/0xe984082ccd724ad8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.587234:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143686.587237:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.587883:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75000/0xe984082ccd724ad8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.587890:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75000/0xe984082ccd724ad8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.589460:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75200/0xe984082ccd724adf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.589472:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75200/0xe984082ccd724adf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.589478:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75200/0xe984082ccd724adf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.589484:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a75200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.589487:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75200/0xe984082ccd724adf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.589493:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75200/0xe984082ccd724adf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.589506:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5e000) 00010000:00010000:3.0:1746143686.589508:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.589511:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75200/0xe984082ccd724adf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.589516:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75200/0xe984082ccd724adf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.589606:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74e00/0xe984082ccd724ad1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e38 expref: 22 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.589620:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e38 expref: 21 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.589627:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.589629:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143686.589631:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a75400, rc 0) 00000100:00100000:3.0:1746143686.589713:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28192:x1830963592094592:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4009us (5094us total) trans 8589942289 rc 0/0 00000100:00100000:3.0:1746143686.589723:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8203 00000100:00100000:1.0:1746143686.591749:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.592050:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592094720 00000100:00100000:3.0:1746143686.592060:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592094720 00010000:00010000:3.0:1746143686.592096:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 38 pid: 8497 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746143686.592124:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4711 00000100:00100000:3.0:1746143686.592132:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963592094720:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143686.592162:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143686.592182:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143684 -> 1746143686 00002000:00010000:3.0:1746143686.592185:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143684 -> 1746143686 00010000:00010000:3.0:1746143686.592191:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 38 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.592203:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 38 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.592229:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801369f0600/0xe984082ccd724a92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1245184->1552383) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e15 expref: 38 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.592242:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.592244:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.592252:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.592259:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.592290:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143686.592300:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593673728:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143686.593658:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.594366:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592094848 00000100:00100000:0.0:1746143686.594373:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592094848 00000100:00100000:0.0:1746143686.594426:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9237 00000100:00100000:0.0:1746143686.594434:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963592094848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143686.594454:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143686.594469:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cff5a00/0xe984082ccd724af4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e3f expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143686.594520:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593673856:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143686.594836:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143686.594957:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143686.595467:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.595674:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592094976 00000100:00100000:2.0:1746143686.595679:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592094976 00000100:00100000:2.0:1746143686.595724:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 561 00000100:00100000:2.0:1746143686.595731:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963592094976:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.595742:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.595765:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724ae6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e38 expref: 21 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.595812:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143686.595816:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143686.596314:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593673728:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143686.596337:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.596583:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963592094976:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 849us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.596593:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 561 00000100:00100000:0.0:1746143686.597076:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.597602:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963592094720:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5469us (5858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.597610:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4711 00000100:00100000:1.0:1746143686.598559:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592095232 00000100:00100000:1.0:1746143686.598567:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592095232 00002000:00100000:1.0:1746143686.598617:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1564672->1568767) req@ffff880093f00380 x1830963592095232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.598631:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00380 with x1830963592095232 ext(1564672->1568767) 00002000:00010000:1.0:1746143686.598638:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00380 00000100:00100000:1.0:1746143686.598658:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3319 00000100:00100000:1.0:1746143686.598665:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1962:x1830963592095232:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143686.598850:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1962:x1830963592095232:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 185us (1774us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143686.598855:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3319 00002000:00100000:1.0:1746143686.598860:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1564672->1568767) req@ffff880093f00380 x1830963592095232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/4536 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.598867:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00380 with x1830963592095232 ext(1564672->1568767) 00002000:00010000:1.0:1746143686.598869:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00380 00002000:00010000:1.0:1746143686.599212:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143684 -> 1746143686 00000100:00100000:1.0:1746143686.599224:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593673856:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143686.599254:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cff5a00/0xe984082ccd724af4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e3f expref: 38 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.599265:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cff5a00/0xe984082ccd724af4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e3f expref: 38 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.599285:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cff5a00, rc 0) 00000100:00100000:1.0:1746143686.599306:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963592094848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4874us (5654us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143686.599312:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9237 00000100:00100000:0.0:1746143686.600892:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.600960:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592095488 00000100:00100000:3.0:1746143686.600967:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592095488 00002000:00100000:3.0:1746143686.600996:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093f02680 x1830963592095488/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 504/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.601010:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02680 with x1830963592095488 ext(1048576->2097151) 00002000:00010000:3.0:1746143686.601014:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02680 00000100:00100000:3.0:1746143686.601039:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3320 00000100:00100000:3.0:1746143686.601046:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592095488:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143686.604652:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.604722:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592095616 00000100:00100000:0.0:1746143686.604731:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592095616 00000100:00100000:0.0:1746143686.604786:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9238 00000100:00100000:0.0:1746143686.604795:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592095616:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143686.604818:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143686.604844:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cff5c00/0xe984082ccd724afb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e46 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143686.604917:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593673984:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143686.604994:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143686.608830:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593673984:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143686.608867:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cff5c00/0xe984082ccd724afb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e46 expref: 38 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.608881:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cff5c00/0xe984082ccd724afb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e46 expref: 38 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.609904:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cff5c00, rc 0) 00000100:00100000:2.0:1746143686.609982:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592095616:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5185us (5340us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143686.609991:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9238 00000100:00100000:3.0:1746143686.612630:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592095488:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11574us (11731us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746143686.612641:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3320 00002000:00100000:3.0:1746143686.612652:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093f02680 x1830963592095488/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 504/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.612661:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02680 with x1830963592095488 ext(1048576->2097151) 00002000:00010000:3.0:1746143686.612666:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02680 00000100:00100000:0.0:1746143686.613104:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.613315:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592095744 00000100:00100000:2.0:1746143686.613323:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592095744 00000100:00100000:2.0:1746143686.613424:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9239 00000100:00100000:2.0:1746143686.613431:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592095744:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143686.613448:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143686.613464:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c200/0xe984082ccd724b02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e4d expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143686.613514:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593674112:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143686.613588:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143686.619370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.621223:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592095872 00000100:00100000:2.0:1746143686.621235:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592095872 00000100:00100000:2.0:1746143686.621286:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9240 00000100:00100000:2.0:1746143686.621295:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+26:28181:x1830963592095872:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143686.621317:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143686.621336:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e54 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.621368:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcc400/0xe984082ccd724a5a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e00 expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.621376:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9c00/0xe984082ccd724ac3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e23 expref: 38 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.621382:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.621384:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.621387:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->1499135] (req 1048576->1499135) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.621417:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9c00/0xe984082ccd724ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e23 expref: 38 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.621429:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9c00/0xe984082ccd724ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e23 expref: 38 pid: 12618 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746143686.621442:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593674240:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143686.622839:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbcc400/0xe984082ccd724a5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e00 expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.622853:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bbcc400/0xe984082ccd724a5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e00 expref: 27 pid: 8497 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.622864:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593674368:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143686.622898:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143686.623212:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593674112:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143686.623241:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c200/0xe984082ccd724b02 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e4d expref: 38 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.623251:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c200/0xe984082ccd724b02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e4d expref: 38 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.623276:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd2c200, rc 0) 00000100:00100000:3.0:1746143686.623315:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592095744:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9883us (10211us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143686.623324:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9239 00000100:00100000:2.0:1746143686.626602:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593674240:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143686.626615:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593674368:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143686.626645:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->1499135] (req 1048576->1499135) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.626662:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a963c00, rc 0) 00000100:00100000:2.0:1746143686.626710:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+27:28181:x1830963592095872:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5415us (7352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.626718:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9240 00000100:00100000:0.0:1746143686.627832:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.629203:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592096000 00000100:00100000:3.0:1746143686.629214:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592096000 00010000:00010000:3.0:1746143686.629258:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9c00/0xe984082ccd724ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e23 expref: 37 pid: 12618 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746143686.630312:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4712 00000100:00100000:3.0:1746143686.630324:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963592096000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143686.630340:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143686.630366:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9c00/0xe984082ccd724ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e23 expref: 37 pid: 12618 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746143686.630379:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9c00/0xe984082ccd724ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e23 expref: 37 pid: 12618 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746143686.630402:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9c00/0xe984082ccd724ac3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e23 expref: 37 pid: 12618 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746143686.630429:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143686.630485:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963592096000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 164us (2656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.630490:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4712 00000100:00100000:0.0:1746143686.636922:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.636978:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.637075:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592096128 00000100:00100000:2.0:1746143686.637086:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592096128 00010000:00010000:2.0:1746143686.637127:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbcc400/0xe984082ccd724a5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e00 expref: 27 pid: 8497 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.637191:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4713 00000100:00100000:2.0:1746143686.637200:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592096128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.637215:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.637240:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bbcc400/0xe984082ccd724a5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e00 expref: 27 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.637253:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bbcc400/0xe984082ccd724a5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e00 expref: 27 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.637278:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bbcc400/0xe984082ccd724a5a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e00 expref: 27 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.637298:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.637300:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.637308:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.637316:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.637354:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143686.637368:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593674496:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143686.637449:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143686.637700:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592096384 00000100:00100000:3.0:1746143686.637705:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592096384 00000100:00100000:3.0:1746143686.637742:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3320 00000100:00100000:3.0:1746143686.637748:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:28188:x1830963592096384:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143686.637952:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:28188:x1830963592096384:12345-192.168.202.48@tcp:35:cat.0 Request processed in 203us (973us total) trans 8589942290 rc 0/0 00000100:00100000:3.0:1746143686.637962:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3320 00000100:00100000:0.0:1746143686.640322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.640378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.640461:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592096640 00000100:00100000:2.0:1746143686.640469:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592096640 00000100:00100000:2.0:1746143686.640507:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9241 00000100:00100000:2.0:1746143686.640515:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963592096640:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143686.640532:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143686.640566:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a62de000/0xe984082ccd724b10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e62 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143686.640619:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593674624:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143686.640705:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143686.640942:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592096512 00000100:00100000:3.0:1746143686.640946:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592096512 00000100:00100000:3.0:1746143686.640981:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8204 00000100:00100000:3.0:1746143686.640987:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28194:x1830963592096512:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143686.641001:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.641012:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75e00/0xe984082ccd724b17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e5b expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.641694:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75c00/0xe984082ccd724b1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.641708:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75c00/0xe984082ccd724b1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.641718:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75c00/0xe984082ccd724b1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.641732:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724b25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.641738:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.641743:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.641855:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.641865:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df9 expref: 19 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.641873:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.641896:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df9 expref: 19 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.641919:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df9 expref: 19 pid: 14763 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746143686.641930:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593674752:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143686.641983:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143686.643334:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593674496:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143686.643355:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.643390:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1964:x1830963592096128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6191us (6488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.643402:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4713 00002000:00010000:2.0:1746143686.643451:0:8497:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime: 1746143685 -> 1746143686 00002000:00010000:2.0:1746143686.643454:0:8497:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime: 1746143685 -> 1746143686 00000100:00100000:2.0:1746143686.643471:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593674624:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143686.643496:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a62de000/0xe984082ccd724b10 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e62 expref: 27 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.643508:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a62de000/0xe984082ccd724b10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e62 expref: 27 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.643534:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a62de000, rc 0) 00000100:00100000:2.0:1746143686.643555:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592096640:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3041us (3176us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143686.643562:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9241 00000100:00100000:3.0:1746143686.644803:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593674752:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143686.644819:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143686.645464:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.645806:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592096768 00000100:00100000:2.0:1746143686.645814:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592096768 00010000:00010000:2.0:1746143686.645848:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df9 expref: 20 pid: 14763 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.646255:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4714 00000100:00100000:2.0:1746143686.646265:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592096768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.646281:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.646286:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df9 expref: 20 pid: 14763 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.646297:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df9 expref: 20 pid: 14763 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.646317:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094be3c00/0xe984082ccd724a53 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df9 expref: 20 pid: 14763 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.646329:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143686.646334:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143686.646345:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143686.646351:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143686.646775:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143686.646899:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.646907:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143686.646959:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:3.0:1746143686.646963:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143686.646980:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.646990:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.646999:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75c00/0xe984082ccd724b1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647005:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75c00/0xe984082ccd724b1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647011:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75c00/0xe984082ccd724b1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647016:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a75c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.647020:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75c00/0xe984082ccd724b1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647027:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75c00/0xe984082ccd724b1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647035:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143686.647038:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.647040:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75c00/0xe984082ccd724b1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647045:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75c00/0xe984082ccd724b1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647066:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647071:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724b25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647075:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724b25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647079:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a75400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.647081:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724b25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647089:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724b25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647095:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5e000) 00010000:00010000:3.0:1746143686.647097:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.647099:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724b25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647103:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75400/0xe984082ccd724b25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.647135:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75e00/0xe984082ccd724b17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e5b expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.647163:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e5b expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.647170:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.647171:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143686.647173:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a75800, rc 0) 00000100:00100000:2.0:1746143686.647224:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592096768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 959us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.647231:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4714 00000100:00100000:3.0:1746143686.648507:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28194:x1830963592096512:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 7517us (8191us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.648515:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8204 00000100:00100000:0.0:1746143686.650980:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.651051:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592097024 00000100:00100000:3.0:1746143686.651060:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592097024 00002000:00100000:3.0:1746143686.651100:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1495040->1499135) req@ffff880093f03b80 x1830963592097024/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.651109:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03b80 with x1830963592097024 ext(1495040->1499135) 00002000:00010000:3.0:1746143686.651115:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f03b80 00000100:00100000:3.0:1746143686.651604:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3321 00000100:00100000:3.0:1746143686.651612:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1963:x1830963592097024:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143686.651821:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1963:x1830963592097024:12345-192.168.202.48@tcp:3:cat.0 Request processed in 208us (848us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143686.651826:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3321 00002000:00100000:3.0:1746143686.651831:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1495040->1499135) req@ffff880093f03b80 x1830963592097024/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/4536 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.651837:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03b80 with x1830963592097024 ext(1495040->1499135) 00002000:00010000:3.0:1746143686.651839:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f03b80 00000100:00100000:0.0:1746143686.653554:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.656565:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.656602:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592097152 00000100:00100000:0.0:1746143686.656611:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592097152 00000100:00100000:0.0:1746143686.656648:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592097280 00000100:00100000:0.0:1746143686.656650:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592097280 00000100:00100000:0.0:1746143686.656681:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9242 00000100:00100000:0.0:1746143686.656689:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963592097152:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143686.656710:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143686.656729:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cff5200/0xe984082ccd724b33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e69 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143686.656788:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593674880:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143686.656863:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143686.656886:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9243 00000100:00100000:0.0:1746143686.656891:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592097280:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143686.656898:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143686.656905:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cff5600/0xe984082ccd724b3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e70 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143686.656937:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593675008:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143686.656958:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143686.659545:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.659594:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.659672:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592097408 00000100:00100000:3.0:1746143686.659679:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592097408 00000100:00100000:3.0:1746143686.659715:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592097536 00000100:00100000:3.0:1746143686.659717:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592097536 00000100:00100000:3.0:1746143686.659734:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9244 00000100:00100000:3.0:1746143686.659740:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592097408:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143686.659758:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.659773:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0a75200/0xe984082ccd724b41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e77 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.659795:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.659797:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.659806:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a75200/0xe984082ccd724b41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e77 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.659821:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a75200/0xe984082ccd724b41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e77 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.659838:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a75200, rc 0) 00000100:00100000:3.0:1746143686.659877:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963592097408:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 138us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.659882:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9244 00000100:00100000:3.0:1746143686.659921:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9245 00000100:00100000:3.0:1746143686.659926:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963592097536:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143686.659933:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.659942:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75a00/0xe984082ccd724b48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e7e expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.659952:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.659954:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.659959:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75a00/0xe984082ccd724b48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e7e expref: 14 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.659967:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75a00/0xe984082ccd724b48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e7e expref: 14 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.659974:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a75a00, rc 0) 00000100:00100000:3.0:1746143686.659990:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1962:x1830963592097536:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 64us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.659995:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9245 00000100:00100000:1.0:1746143686.660883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.661191:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593675008:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143686.661216:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cff5600/0xe984082ccd724b3a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e70 expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143686.661226:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cff5600/0xe984082ccd724b3a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e70 expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143686.661238:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cff5600, rc 0) 00000100:00100000:3.0:1746143686.661431:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592097792 00000100:00100000:3.0:1746143686.661435:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592097792 00000100:00100000:3.0:1746143686.661461:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3321 00000100:00100000:3.0:1746143686.661467:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28192:x1830963592097792:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1746143686.662395:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963592097280:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5499us (5834us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143686.662403:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9243 00000100:00100000:0.0:1746143686.662458:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593674880:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143686.662476:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cff5200/0xe984082ccd724b33 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e69 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143686.662484:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cff5200/0xe984082ccd724b33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e69 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143686.662491:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cff5200, rc 0) 00000100:00100000:3.0:1746143686.662595:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28192:x1830963592097792:12345-192.168.202.48@tcp:35:cat.0 Request processed in 1126us (1712us total) trans 8589942291 rc 0/0 00000100:00100000:3.0:1746143686.662602:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3321 00000100:00100000:0.0:1746143686.664086:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963592097152:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 7391us (10529us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143686.664097:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9242 00000100:00100000:0.0:1746143686.666777:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.667400:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592098304 00000100:00100000:3.0:1746143686.667412:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592098304 00000100:00100000:1.0:1746143686.668743:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8205 00000100:00100000:1.0:1746143686.668757:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28194:x1830963592098304:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143686.668780:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.668799:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9600/0xe984082ccd724b4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e8c expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.668897:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.668920:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e5b expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.668926:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.668958:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e5b expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.668968:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e5b expref: 10 pid: 14763 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746143686.668979:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091717100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593675136:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143686.669057:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143686.669258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.669651:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592098560 00000100:00100000:3.0:1746143686.669657:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592098560 00000100:00100000:3.0:1746143686.669693:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3322 00000100:00100000:3.0:1746143686.669699:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28181:x1830963592098560:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143686.669871:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28181:x1830963592098560:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 171us (613us total) trans 8589942292 rc 0/0 00000100:00100000:3.0:1746143686.669877:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3322 00000100:00100000:1.0:1746143686.671344:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.671398:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592098048 00000100:00100000:3.0:1746143686.671403:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592098048 00000100:00100000:3.0:1746143686.671435:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8206 00000100:00100000:3.0:1746143686.671440:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:28195:x1830963592098048:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143686.671457:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.671472:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74c00/0xe984082ccd724b5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e85 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.671563:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724b64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671575:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724b64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671586:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724b64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671599:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74800/0xe984082ccd724b6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671604:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74800/0xe984082ccd724b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671608:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74800/0xe984082ccd724b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671700:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74600/0xe984082ccd724b72 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671708:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74600/0xe984082ccd724b72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671713:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74600/0xe984082ccd724b72 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143686.671721:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143686.671788:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724b64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671794:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724b64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671799:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724b64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671804:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a74a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.671808:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724b64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671814:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724b64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671823:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143686.671826:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.671829:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724b64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671834:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724b64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671852:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74800/0xe984082ccd724b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671856:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74800/0xe984082ccd724b6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671860:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74800/0xe984082ccd724b6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671863:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a74800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.671865:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74800/0xe984082ccd724b6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671869:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74800/0xe984082ccd724b6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671873:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5ea00) 00010000:00010000:3.0:1746143686.671875:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.671876:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74800/0xe984082ccd724b6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671879:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74800/0xe984082ccd724b6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143686.671920:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74c00/0xe984082ccd724b5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e85 expref: 255 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.671933:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74600/0xe984082ccd724b72 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e85 expref: 254 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.671939:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.671941:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143686.671943:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a74600, rc 0) 00000100:00100000:3.0:1746143686.673727:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:28195:x1830963592098048:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2150us (2252us total) trans 8589942293 rc 0/0 00000100:00100000:3.0:1746143686.673739:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8206 00000100:00100000:1.0:1746143686.678920:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.679018:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091717100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593675136:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143686.679046:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:3.0:1746143686.679353:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592098688 00000100:00100000:3.0:1746143686.679361:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592098688 00010000:00010000:3.0:1746143686.679398:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e5b expref: 11 pid: 14763 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746143686.679436:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4715 00000100:00100000:3.0:1746143686.679444:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592098688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143686.679465:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143686.679471:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e5b expref: 11 pid: 14763 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.679482:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e5b expref: 11 pid: 14763 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.679505:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75800/0xe984082ccd724b2c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e5b expref: 11 pid: 14763 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.679523:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.679527:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143686.679536:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143686.679543:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143686.679562:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143686.679602:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592098688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 159us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.679608:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4715 00010000:00010000:1.0:1746143686.679768:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.679774:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143686.679794:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143686.679944:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9600/0xe984082ccd724b4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e8c expref: 11 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.679960:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e8c expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.679966:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:1.0:1746143686.679969:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143686.679971:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01c9400, rc 0) 00000100:00100000:1.0:1746143686.679995:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28194:x1830963592098304:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 11242us (13227us total) trans 8589942294 rc 0/0 00000100:00100000:1.0:1746143686.680001:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8205 00000100:00100000:0.0:1746143686.681634:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.681710:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592098816 00000100:00100000:2.0:1746143686.681719:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592098816 00000100:00100000:2.0:1746143686.681764:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 562 00000100:00100000:2.0:1746143686.681771:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:1963:x1830963592098816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.681785:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.681806:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74600/0xe984082ccd724b72 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e85 expref: 254 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.681834:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143686.681837:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.681870:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:1963:x1830963592098816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 99us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.681876:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 562 00000100:00100000:0.0:1746143686.682509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.682574:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592098944 00000100:00100000:1.0:1746143686.682579:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592098944 00000100:00100000:1.0:1746143686.682606:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8207 00000100:00100000:1.0:1746143686.682611:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28194:x1830963592098944:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143686.682636:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.682650:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8600/0xe984082ccd724b87 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e93 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.682726:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.682741:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e8c expref: 11 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.682748:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.682777:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e8c expref: 11 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.682788:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e8c expref: 11 pid: 14764 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746143686.682799:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593675264:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143686.684926:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143686.690293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.690404:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593675264:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143686.690429:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:3.0:1746143686.690494:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592099072 00000100:00100000:3.0:1746143686.690501:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592099072 00010000:00010000:3.0:1746143686.690533:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e8c expref: 12 pid: 14764 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746143686.691687:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4716 00000100:00100000:3.0:1746143686.691697:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592099072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143686.691712:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143686.691719:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e8c expref: 12 pid: 14764 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.691731:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e8c expref: 12 pid: 14764 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.691759:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9400/0xe984082ccd724b56 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e8c expref: 12 pid: 14764 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.691787:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.691791:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143686.691801:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143686.691808:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143686.691826:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143686.691872:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592099072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 177us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.691878:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4716 00010000:00010000:1.0:1746143686.692047:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.692054:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143686.692098:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:1.0:1746143686.692102:0:14764:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143686.692117:0:14764:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.692159:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8600/0xe984082ccd724b87 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e93 expref: 11 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.692175:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e93 expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.692181:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:1.0:1746143686.692184:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143686.692186:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01c8400, rc 0) 00000100:00100000:1.0:1746143686.692211:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28194:x1830963592098944:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 9600us (9704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143686.692218:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8207 00000100:00100000:0.0:1746143686.693527:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.694111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.694263:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.694297:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592099200 00000100:00100000:0.0:1746143686.694305:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592099200 00000100:00100000:0.0:1746143686.694347:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592099328 00000100:00100000:0.0:1746143686.694349:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592099328 00000100:00100000:0.0:1746143686.694360:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592099456 00000100:00100000:0.0:1746143686.694362:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592099456 00000100:00100000:0.0:1746143686.694374:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9246 00000100:00100000:0.0:1746143686.694379:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:28195:x1830963592099200:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143686.694396:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143686.694411:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0e9a expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143686.694437:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801369f1c00/0xe984082ccd724a68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e07 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143686.694450:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a75200/0xe984082ccd724b41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e77 expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143686.694457:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8200/0xe984082ccd724abc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e2a expref: 38 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143686.694462:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143686.694464:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143686.694468:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1658880->1953791] (req 1658880->1953791) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 38 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143686.694494:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8200/0xe984082ccd724abc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e2a expref: 38 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143686.694505:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8200/0xe984082ccd724abc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e2a expref: 38 pid: 12618 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746143686.694517:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593675392:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143686.694590:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0a75200/0xe984082ccd724b41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e77 expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143686.694598:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a75200/0xe984082ccd724b41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e77 expref: 11 pid: 12618 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746143686.694605:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593675520:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143686.694626:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801369f1c00/0xe984082ccd724a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e07 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143686.694633:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801369f1c00/0xe984082ccd724a68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e07 expref: 18 pid: 8497 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746143686.694640:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593675648:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143686.694652:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143686.694862:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9247 00000100:00100000:3.0:1746143686.694870:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592099328:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143686.694879:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.694889:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75000/0xe984082ccd724b9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ea1 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143686.694930:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593675776:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143686.694956:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143686.694971:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9248 00000100:00100000:3.0:1746143686.694976:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592099456:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143686.694982:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.694988:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74000/0xe984082ccd724ba3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ea8 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143686.695007:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593675904:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143686.695022:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143686.696885:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593675392:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143686.696897:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593675520:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143686.696906:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593675648:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143686.696940:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1658880->1953791] (req 1658880->1953791) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 38 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.696953:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131d22800, rc 0) 00000100:00100000:1.0:1746143686.696987:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:28195:x1830963592099200:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2607us (3465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143686.696995:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9246 00000100:00100000:0.0:1746143686.698427:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.698609:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.698972:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592099712 00000100:00100000:3.0:1746143686.698979:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592099712 00010000:00010000:3.0:1746143686.699007:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a75200/0xe984082ccd724b41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e77 expref: 12 pid: 12618 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746143686.699208:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593675776:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143686.699233:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75000/0xe984082ccd724b9c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ea1 expref: 13 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.699244:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75000/0xe984082ccd724b9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ea1 expref: 13 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.699254:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a75000, rc 0) 00000100:00100000:3.0:1746143686.699283:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592099328:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4414us (5172us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143686.699291:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9247 00000100:00100000:3.0:1746143686.699326:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593675904:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143686.699338:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74000/0xe984082ccd724ba3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ea8 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.699352:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74000/0xe984082ccd724ba3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ea8 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.699357:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a74000, rc 0) 00000100:00100000:3.0:1746143686.699371:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592099456:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4396us (5109us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143686.699376:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9248 00000100:00100000:3.0:1746143686.699387:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592099584 00000100:00100000:3.0:1746143686.699389:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592099584 00010000:00010000:3.0:1746143686.699400:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8200/0xe984082ccd724abc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e2a expref: 38 pid: 12618 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746143686.699708:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4717 00000100:00100000:2.0:1746143686.699717:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592099712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.699731:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.699747:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a75200/0xe984082ccd724b41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e77 expref: 12 pid: 12618 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746143686.699757:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0a75200/0xe984082ccd724b41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e77 expref: 12 pid: 12618 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746143686.699774:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a75200/0xe984082ccd724b41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e77 expref: 12 pid: 12618 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746143686.699789:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.699810:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592099712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 95us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.699815:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4717 00000100:00100000:2.0:1746143686.699827:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4718 00000100:00100000:2.0:1746143686.699832:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963592099584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.699837:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.699844:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8200/0xe984082ccd724abc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e2a expref: 38 pid: 12618 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746143686.699852:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8200/0xe984082ccd724abc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e2a expref: 38 pid: 12618 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746143686.699863:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8200/0xe984082ccd724abc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e2a expref: 38 pid: 12618 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746143686.699870:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.699881:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592099584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.699885:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4718 00000100:00100000:2.0:1746143686.700970:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.701083:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592099840 00000100:00100000:0.0:1746143686.701089:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592099840 00010000:00010000:0.0:1746143686.701109:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801369f1c00/0xe984082ccd724a68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e07 expref: 19 pid: 8497 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746143686.701126:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4719 00000100:00100000:0.0:1746143686.701131:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592099840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143686.701324:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143686.701419:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801369f1c00/0xe984082ccd724a68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e07 expref: 19 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.701428:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801369f1c00/0xe984082ccd724a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e07 expref: 19 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.701444:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801369f1c00/0xe984082ccd724a68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e07 expref: 19 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.701453:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.701455:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.701462:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 36 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.701475:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 36 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.701507:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 36 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143686.701520:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593676032:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143686.701832:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.702241:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143686.702335:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592100096 00000100:00100000:1.0:1746143686.702339:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592100096 00000100:00100000:1.0:1746143686.702502:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8208 00000100:00100000:1.0:1746143686.702509:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28194:x1830963592100096:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143686.702526:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.702541:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8200/0xe984082ccd724baa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0eaf expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.702628:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8000/0xe984082ccd724bb1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.702642:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8000/0xe984082ccd724bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.702651:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8000/0xe984082ccd724bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.702661:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8000/0xe984082ccd724bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.702667:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8000/0xe984082ccd724bb1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.702673:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8000/0xe984082ccd724bb1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.702679:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01c8000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143686.702682:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8000/0xe984082ccd724bb1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.702688:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8000/0xe984082ccd724bb1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.702695:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:1.0:1746143686.702698:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143686.702701:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8000/0xe984082ccd724bb1 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.702706:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8000/0xe984082ccd724bb1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.702744:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8200/0xe984082ccd724baa lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eaf expref: 11 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.702752:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8200/0xe984082ccd724baa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eaf expref: 11 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.702759:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01c8200, rc 0) 00000100:00100000:1.0:1746143686.702795:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28194:x1830963592100096:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 286us (963us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143686.702801:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8208 00000100:00100000:3.0:1746143686.704080:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593676032:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143686.704100:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143686.704164:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592099840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3004us (3169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.704174:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4719 00000100:00100000:0.0:1746143686.704659:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.704769:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592100352 00000100:00100000:2.0:1746143686.704775:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592100352 00000100:00100000:2.0:1746143686.704812:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3323 00000100:00100000:2.0:1746143686.704818:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28194:x1830963592100352:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1746143686.705577:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28194:x1830963592100352:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 756us (916us total) trans 8589942295 rc 0/0 00000100:00100000:2.0:1746143686.705589:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3323 00000100:00100000:0.0:1746143686.706042:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.706122:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592100608 00000100:00100000:1.0:1746143686.706135:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592100608 00002000:00100000:1.0:1746143686.706187:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1658880->1662975) req@ffff88008f1ee680 x1830963592100608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.706196:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ee680 with x1830963592100608 ext(1658880->1662975) 00002000:00010000:1.0:1746143686.706200:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ee680 00000100:00100000:1.0:1746143686.706227:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3322 00000100:00100000:1.0:1746143686.706233:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592100608:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143686.706387:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592100608:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 154us (346us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143686.706392:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3322 00002000:00100000:1.0:1746143686.706397:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1658880->1662975) req@ffff88008f1ee680 x1830963592100608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/4536 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.706403:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ee680 with x1830963592100608 ext(1658880->1662975) 00002000:00010000:1.0:1746143686.706407:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ee680 00000100:00100000:0.0:1746143686.710442:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.710670:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592100864 00000100:00100000:3.0:1746143686.710683:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592100864 00002000:00100000:3.0:1746143686.710734:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1949696->1953791) req@ffff88008f1edf80 x1830963592100864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.710744:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1edf80 with x1830963592100864 ext(1949696->1953791) 00002000:00010000:3.0:1746143686.710750:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1edf80 00000100:00100000:3.0:1746143686.710783:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3323 00000100:00100000:3.0:1746143686.710792:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963592100864:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143686.711006:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963592100864:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 214us (576us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143686.711044:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3323 00002000:00100000:3.0:1746143686.711051:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1949696->1953791) req@ffff88008f1edf80 x1830963592100864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/4536 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.711058:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1edf80 with x1830963592100864 ext(1949696->1953791) 00002000:00010000:3.0:1746143686.711060:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1edf80 00000100:00100000:0.0:1746143686.714848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.715015:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592101120 00000100:00100000:2.0:1746143686.715030:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592101120 00000100:00100000:2.0:1746143686.715088:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3324 00000100:00100000:2.0:1746143686.715097:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:28195:x1830963592101120:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143686.715367:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:28195:x1830963592101120:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 270us (531us total) trans 8589942296 rc 0/0 00000100:00100000:2.0:1746143686.715374:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3324 00000100:00100000:0.0:1746143686.771728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.771800:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592101376 00000100:00100000:2.0:1746143686.771810:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592101376 00000100:00100000:3.0:1746143686.773212:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8209 00000100:00100000:3.0:1746143686.773229:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:28203:x1830963592101376:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143686.773260:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.773282:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74c00/0xe984082ccd724bb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0eb6 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.773400:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724bbf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773415:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724bbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773427:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724bbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773441:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74e00/0xe984082ccd724bc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773446:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74e00/0xe984082ccd724bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773450:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74e00/0xe984082ccd724bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773816:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75e00/0xe984082ccd724bcd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773826:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75e00/0xe984082ccd724bcd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773832:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75e00/0xe984082ccd724bcd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143686.773840:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143686.773940:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724bbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773947:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724bbf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773952:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724bbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773957:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a74a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.773961:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724bbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773967:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724bbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773977:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143686.773980:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.773984:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724bbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.773989:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74a00/0xe984082ccd724bbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.774561:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74e00/0xe984082ccd724bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.774572:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74e00/0xe984082ccd724bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.774577:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74e00/0xe984082ccd724bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.774581:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a74e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.774583:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74e00/0xe984082ccd724bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.774588:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74e00/0xe984082ccd724bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.774595:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5ea00) 00010000:00010000:3.0:1746143686.774598:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.774600:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74e00/0xe984082ccd724bc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.774604:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74e00/0xe984082ccd724bc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.774649:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a74c00/0xe984082ccd724bb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eb6 expref: 257 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.774660:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75e00/0xe984082ccd724bcd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eb6 expref: 256 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.774666:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.774668:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143686.774670:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a75e00, rc 0) 00000100:00100000:3.0:1746143686.774739:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:28203:x1830963592101376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1517us (3023us total) trans 8589942297 rc 0/0 00000100:00100000:3.0:1746143686.774747:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8209 00000100:00100000:0.0:1746143686.778655:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.778710:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.778885:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592101504 00000100:00100000:3.0:1746143686.778896:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592101504 00000100:00100000:3.0:1746143686.779181:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592101632 00000100:00100000:3.0:1746143686.779184:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592101632 00000100:00100000:3.0:1746143686.779203:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9249 00000100:00100000:3.0:1746143686.779210:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963592101504:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143686.779230:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.779247:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75600/0xe984082ccd724bdb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ebd expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143686.779299:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593676160:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143686.779373:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143686.779397:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9250 00000100:00100000:3.0:1746143686.779402:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963592101632:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143686.779408:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.779414:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75000/0xe984082ccd724be2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ec4 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143686.779432:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593676288:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143686.779448:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143686.780823:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593676288:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143686.780845:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75000/0xe984082ccd724be2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ec4 expref: 39 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.780855:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75000/0xe984082ccd724be2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ec4 expref: 39 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.780875:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a75000, rc 0) 00000100:00100000:2.0:1746143686.781504:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963592101632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2100us (2792us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143686.781511:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9250 00000100:00100000:3.0:1746143686.781626:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593676160:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143686.781644:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75600/0xe984082ccd724bdb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ebd expref: 37 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.781657:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75600/0xe984082ccd724bdb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ebd expref: 37 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143686.781664:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a75600, rc 0) 00000100:00100000:3.0:1746143686.781684:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963592101504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2475us (3041us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143686.781689:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9249 00000100:00100000:0.0:1746143686.786973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.789517:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592101760 00000100:00100000:3.0:1746143686.789530:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592101760 00000100:00100000:3.0:1746143686.789588:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9251 00000100:00100000:3.0:1746143686.789596:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:28203:x1830963592101760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143686.789617:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.789635:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74400/0xe984082ccd724be9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ecb expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.789666:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.789674:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143686.789676:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143686.789679:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74400/0xe984082ccd724be9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ecb expref: 37 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.789709:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.789726:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 25 pid: 25369 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746143686.789739:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593676416:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143686.792946:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143686.797065:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593676416:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143686.798993:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74400/0xe984082ccd724be9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ecb expref: 37 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.799020:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a74400, rc 0) 00000100:00100000:3.0:1746143686.799102:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:28203:x1830963592101760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9504us (12137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.799112:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9251 00000100:00100000:0.0:1746143686.804345:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.807279:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592101888 00000100:00100000:3.0:1746143686.807294:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592101888 00002000:00100000:3.0:1746143686.807349:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1564672->2097151) req@ffff880094c0ca80 x1830963592101888/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.807360:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ca80 with x1830963592101888 ext(1564672->2097151) 00010000:00010000:3.0:1746143686.807371:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 26 pid: 25369 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.807386:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 26 pid: 25369 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746143686.807400:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c0ca80 00000100:00100000:3.0:1746143686.807445:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 796 00000100:00100000:3.0:1746143686.807453:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592101888:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143686.825669:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1965:x1830963592101888:12345-192.168.202.48@tcp:4:cat.0 Request processed in 18203us (21321us total) trans 21474839657 rc 0/0 00000100:00100000:3.0:1746143686.825683:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 796 00002000:00100000:3.0:1746143686.825695:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1564672->2097151) req@ffff880094c0ca80 x1830963592101888/t21474839657(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/448 e 0 to 0 dl 1746143697 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.825704:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ca80 with x1830963592101888 ext(1564672->2097151) 00010000:00010000:3.0:1746143686.825715:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 28 pid: 25369 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.825730:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 28 pid: 25369 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746143686.825737:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c0ca80 00000100:00100000:2.0:1746143686.831917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.832753:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592102016 00000100:00100000:3.0:1746143686.832972:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592102016 00010000:00010000:3.0:1746143686.833017:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 28 pid: 25369 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746143686.833060:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4720 00000100:00100000:3.0:1746143686.833068:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1964:x1830963592102016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143686.833085:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143686.833109:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 28 pid: 25369 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.833122:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 28 pid: 25369 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.833166:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801369f1000/0xe984082ccd724aca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e31 expref: 28 pid: 25369 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.833186:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.833188:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143686.833196:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74400/0xe984082ccd724be9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ecb expref: 36 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.833204:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74400/0xe984082ccd724be9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ecb expref: 36 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.833240:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74400/0xe984082ccd724be9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ecb expref: 36 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143686.833254:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593676544:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143686.834480:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143686.837283:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593676544:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143686.837312:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143686.837377:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592102016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4307us (5476us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.837390:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4720 00000100:00100000:0.0:1746143686.844637:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.845529:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592102272 00000100:00100000:3.0:1746143686.845540:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592102272 00002000:00100000:3.0:1746143686.845594:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880094c0ce00 x1830963592102272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.845605:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ce00 with x1830963592102272 ext(1048576->2097151) 00002000:00010000:3.0:1746143686.845610:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0ce00 00000100:00100000:3.0:1746143686.845650:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3324 00000100:00100000:3.0:1746143686.845658:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963592102272:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143686.866413:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963592102272:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20738us (21769us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143686.866432:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3324 00002000:00100000:3.0:1746143686.866449:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880094c0ce00 x1830963592102272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.866458:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ce00 with x1830963592102272 ext(1048576->2097151) 00002000:00010000:3.0:1746143686.866469:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0ce00 00000100:00100000:0.0:1746143686.873498:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.873571:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592102400 00000100:00100000:3.0:1746143686.873581:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592102400 00000100:00100000:3.0:1746143686.873640:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9252 00000100:00100000:3.0:1746143686.873648:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:28203:x1830963592102400:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143686.873670:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.873688:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a08a8e00/0xe984082ccd724bf0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ed2 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.873725:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.873732:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143686.873734:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143686.873737:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a08a8e00/0xe984082ccd724bf0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed2 expref: 38 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.873770:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.873782:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 26 pid: 8497 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746143686.873795:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593676672:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143686.874534:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fe3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143686.877503:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593676672:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143686.877539:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a08a8e00/0xe984082ccd724bf0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed2 expref: 38 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.877559:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a08a8e00, rc 0) 00000100:00100000:3.0:1746143686.877625:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:28203:x1830963592102400:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3974us (4135us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.877634:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9252 00000100:00100000:0.0:1746143686.879337:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.879709:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592102528 00000100:00100000:3.0:1746143686.879718:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592102528 00002000:00100000:3.0:1746143686.879765:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1499135) req@ffff880094c0f480 x1830963592102528/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.879776:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0f480 with x1830963592102528 ext(1048576->1499135) 00010000:00010000:3.0:1746143686.879785:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 27 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.879798:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 27 pid: 8497 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746143686.879805:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c0f480 00000100:00100000:3.0:1746143686.879834:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 797 00000100:00100000:3.0:1746143686.879841:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592102528:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143686.893235:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1964:x1830963592102528:12345-192.168.202.48@tcp:4:cat.0 Request processed in 13382us (13892us total) trans 21474839658 rc 0/0 00000100:00100000:3.0:1746143686.893250:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 797 00002000:00100000:3.0:1746143686.893271:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1499135) req@ffff880094c0f480 x1830963592102528/t21474839658(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/448 e 0 to 0 dl 1746143697 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143686.893294:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0f480 with x1830963592102528 ext(1048576->1499135) 00010000:00010000:3.0:1746143686.893957:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 29 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.893974:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 29 pid: 8497 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746143686.893982:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c0f480 00000100:00100000:0.0:1746143686.906309:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.906348:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.906549:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592102784 00000100:00100000:3.0:1746143686.906559:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592102784 00000100:00100000:0.0:1746143686.906640:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592102912 00000100:00100000:0.0:1746143686.906644:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592102912 00010000:00010000:0.0:1746143686.906670:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 29 pid: 8497 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746143686.906696:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4721 00000100:00100000:0.0:1746143686.906704:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1963:x1830963592102912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143686.906718:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143686.906741:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 29 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746143686.906754:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 29 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746143686.906786:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a963c00/0xe984082ccd724b09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e54 expref: 29 pid: 8497 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746143686.906808:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143686.906810:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143686.906816:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a08a8e00/0xe984082ccd724bf0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed2 expref: 37 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143686.906828:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a08a8e00/0xe984082ccd724bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed2 expref: 37 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143686.906862:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a08a8e00/0xe984082ccd724bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed2 expref: 37 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143686.906876:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593676800:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143686.906952:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0edcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143686.908662:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8210 00000100:00100000:3.0:1746143686.908673:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28208:x1830963592102784:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143686.908696:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143686.908712:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9000/0xe984082ccd724bf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ed9 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.908813:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9200/0xe984082ccd724bfe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.908825:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9200/0xe984082ccd724bfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.908835:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9200/0xe984082ccd724bfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.908849:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9400/0xe984082ccd724c05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.908854:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9400/0xe984082ccd724c05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.908859:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9400/0xe984082ccd724c05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.908973:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9600/0xe984082ccd724c0c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.908982:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9600/0xe984082ccd724c0c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.908988:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9600/0xe984082ccd724c0c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143686.908997:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143686.909075:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9200/0xe984082ccd724bfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.909082:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9200/0xe984082ccd724bfe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.909088:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9200/0xe984082ccd724bfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.909093:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a08a9200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.909097:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9200/0xe984082ccd724bfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.909102:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9200/0xe984082ccd724bfe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.909111:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143686.909113:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.909116:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9200/0xe984082ccd724bfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.909120:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9200/0xe984082ccd724bfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.910378:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9400/0xe984082ccd724c05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.910387:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9400/0xe984082ccd724c05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.910393:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9400/0xe984082ccd724c05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.910401:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a08a9400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143686.910403:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9400/0xe984082ccd724c05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.910409:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9400/0xe984082ccd724c05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.910417:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5ec00) 00010000:00010000:3.0:1746143686.910419:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143686.910422:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9400/0xe984082ccd724c05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.910426:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9400/0xe984082ccd724c05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143686.910474:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9000/0xe984082ccd724bf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed9 expref: 24 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.910491:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9600/0xe984082ccd724c0c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed9 expref: 23 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143686.910497:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.910499:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143686.910501:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a08a9600, rc 0) 00000100:00100000:3.0:1746143686.911486:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28208:x1830963592102784:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2811us (5182us total) trans 8589942298 rc 0/0 00000100:00100000:3.0:1746143686.911496:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8210 00000100:00100000:0.0:1746143686.913981:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.914023:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.914103:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592103296 00000100:00100000:1.0:1746143686.914113:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592103296 00002000:00100000:1.0:1746143686.914191:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009b850a80 x1830963592103296/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 504/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.914201:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850a80 with x1830963592103296 ext(1048576->2097151) 00002000:00010000:1.0:1746143686.914206:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b850a80 00000100:00100000:1.0:1746143686.914223:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592103424 00000100:00100000:1.0:1746143686.914226:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592103424 00002000:00100000:1.0:1746143686.914239:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009b850700 x1830963592103424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.914246:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850700 with x1830963592103424 ext(1048576->2097151) 00002000:00010000:1.0:1746143686.914249:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b850700 00000100:00100000:1.0:1746143686.914261:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3325 00000100:00100000:1.0:1746143686.914268:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592103296:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143686.915059:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593676800:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143686.915079:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.915119:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1963:x1830963592102912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8416us (8770us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.915128:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4721 00000100:00100000:2.0:1746143686.915197:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3326 00000100:00100000:2.0:1746143686.915204:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963592103424:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143686.917701:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.918099:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592103680 00000100:00100000:1.0:1746143686.918107:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592103680 00000100:00100000:1.0:1746143686.918163:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8211 00000100:00100000:1.0:1746143686.918171:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28209:x1830963592103680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143686.918197:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.918216:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8e00/0xe984082ccd724c1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ee0 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.918313:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9800/0xe984082ccd724c21 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143686.918328:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9800/0xe984082ccd724c21 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143686.918340:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9800/0xe984082ccd724c21 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143686.918351:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143686.918454:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8e00/0xe984082ccd724c1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee0 expref: 26 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.918479:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9800/0xe984082ccd724c21 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee0 expref: 25 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.918486:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:1.0:1746143686.918489:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143686.918491:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01c9800, rc 0) 00000100:00100000:1.0:1746143686.918515:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28209:x1830963592103680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 345us (825us total) trans 8589942299 rc 0/0 00000100:00100000:1.0:1746143686.918520:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8211 00000100:00100000:2.0:1746143686.938078:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963592103424:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22864us (24043us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143686.938089:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3326 00002000:00100000:2.0:1746143686.938100:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009b850700 x1830963592103424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143686.938109:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850700 with x1830963592103424 ext(1048576->2097151) 00002000:00010000:2.0:1746143686.938115:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b850700 00000100:00100000:0.0:1746143686.944726:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.944779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.944869:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.945427:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592103808 00000100:00100000:1.0:1746143686.945435:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592103808 00000100:00100000:1.0:1746143686.945498:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592104064 00000100:00100000:1.0:1746143686.945500:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592104064 00000100:00100000:1.0:1746143686.945512:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592103936 00000100:00100000:1.0:1746143686.945513:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592103936 00000100:00100000:1.0:1746143686.945526:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9253 00000100:00100000:1.0:1746143686.945533:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1963:x1830963592103808:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143686.945547:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.945576:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xe984082ccd724c2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ee7 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.945600:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143686.945602:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143686.945618:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xe984082ccd724c2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee7 expref: 30 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.945631:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xe984082ccd724c2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee7 expref: 30 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.945639:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01c9e00, rc 0) 00000100:00100000:1.0:1746143686.945677:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1963:x1830963592103808:12345-192.168.202.48@tcp:101:cat.0 Request processed in 145us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143686.945683:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9253 00000100:00100000:1.0:1746143686.945697:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9254 00000100:00100000:1.0:1746143686.945701:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592104064:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143686.945707:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143686.945733:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01c8e00/0xe984082ccd724c36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ef5 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143686.945775:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593676928:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143686.945822:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143686.945826:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9255 00000100:00100000:2.0:1746143686.945834:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1963:x1830963592103936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143686.945841:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143686.945848:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a62df400/0xe984082ccd724c3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0eee expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.945859:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.945860:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143686.945878:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a62df400/0xe984082ccd724c3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eee expref: 30 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143686.945888:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a62df400/0xe984082ccd724c3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eee expref: 30 pid: 25369 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143686.945894:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592103296:12345-192.168.202.48@tcp:3:cat.0 Request processed in 31626us (31923us total) trans 0 rc 753664/753664 00010000:00010000:2.0:1746143686.945898:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a62df400, rc 0) 00000100:00100000:1.0:1746143686.945902:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3325 00002000:00100000:1.0:1746143686.945921:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009b850a80 x1830963592103296/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:82/0 lens 504/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143686.945929:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1963:x1830963592103936:12345-192.168.202.48@tcp:101:cat.0 Request processed in 96us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.945934:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9255 00002000:00100000:1.0:1746143686.945935:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850a80 with x1830963592103296 ext(1048576->2097151) 00002000:00010000:1.0:1746143686.945939:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b850a80 00002000:00010000:1.0:1746143686.949234:0:8497:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143685 -> 1746143686 00002000:00010000:1.0:1746143686.949241:0:8497:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143685 -> 1746143686 00000100:00100000:1.0:1746143686.949259:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593676928:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143686.949284:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01c8e00/0xe984082ccd724c36 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ef5 expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.949295:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01c8e00/0xe984082ccd724c36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ef5 expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143686.949323:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01c8e00, rc 0) 00000100:00100000:1.0:1746143686.949367:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592104064:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3664us (4587us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143686.949375:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9254 00000100:00100000:0.0:1746143686.956392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143686.956471:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592104320 00000100:00100000:2.0:1746143686.956480:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592104320 00000100:00100000:2.0:1746143686.956538:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8212 00000100:00100000:2.0:1746143686.956546:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:28212:x1830963592104320:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143686.956567:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143686.956581:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62df800/0xe984082ccd724c44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0efc expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.956716:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143686.956743:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e93 expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.956750:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75e00/0xe984082ccd724bcd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eb6 expref: 257 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.956756:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9600/0xe984082ccd724c0c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed9 expref: 24 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.956761:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143686.956790:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9600/0xe984082ccd724c0c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed9 expref: 24 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.956799:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9600/0xe984082ccd724c0c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed9 expref: 24 pid: 21713 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.956809:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593677056:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143686.959684:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75e00/0xe984082ccd724bcd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eb6 expref: 257 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.959701:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75e00/0xe984082ccd724bcd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eb6 expref: 257 pid: 21713 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.959713:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593677184:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143686.960307:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e93 expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143686.960315:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e93 expref: 10 pid: 14764 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.960323:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593677312:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143686.960676:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143686.961094:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593677056:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143686.964945:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.964991:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.965068:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592104704 00000100:00100000:3.0:1746143686.965080:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592104704 00000100:00100000:2.0:1746143686.965125:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592104448 00000100:00100000:2.0:1746143686.965132:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592104448 00000100:00100000:3.0:1746143686.965165:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3325 00000100:00100000:3.0:1746143686.965173:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:28203:x1830963592104704:12345-192.168.202.48@tcp:35:cat.0 00010000:00010000:2.0:1746143686.965187:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9600/0xe984082ccd724c0c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed9 expref: 25 pid: 21713 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.965218:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4722 00000100:00100000:2.0:1746143686.965224:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592104448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.965237:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.965243:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9600/0xe984082ccd724c0c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed9 expref: 25 pid: 21713 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.965253:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9600/0xe984082ccd724c0c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed9 expref: 25 pid: 21713 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.965275:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a08a9600/0xe984082ccd724c0c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed9 expref: 25 pid: 21713 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.965302:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143686.965307:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143686.965315:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143686.965321:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143686.965365:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1963:x1830963592104448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 141us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143686.965370:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:28203:x1830963592104704:12345-192.168.202.48@tcp:35:cat.0 Request processed in 197us (377us total) trans 8589942300 rc 0/0 00000100:00100000:2.0:1746143686.965371:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4722 00000100:00100000:3.0:1746143686.965378:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3325 00000100:00100000:3.0:1746143686.965415:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593677184:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143686.965425:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593677312:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143686.965449:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:0.0:1746143686.967734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.967779:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143686.967858:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592104960 00000100:00100000:2.0:1746143686.967860:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592104832 00000100:00100000:2.0:1746143686.967866:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592104832 00000100:00100000:3.0:1746143686.967867:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592104960 00010000:00010000:2.0:1746143686.967896:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75e00/0xe984082ccd724bcd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eb6 expref: 259 pid: 21713 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.967897:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e93 expref: 11 pid: 14764 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746143686.968965:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4723 00000100:00100000:2.0:1746143686.968974:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1965:x1830963592104832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143686.968989:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143686.968995:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75e00/0xe984082ccd724bcd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eb6 expref: 259 pid: 21713 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.969007:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75e00/0xe984082ccd724bcd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eb6 expref: 259 pid: 21713 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.969026:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a75e00/0xe984082ccd724bcd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eb6 expref: 259 pid: 21713 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746143686.969053:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143686.969058:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143686.969066:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143686.969072:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143686.969175:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4724 00000100:00100000:3.0:1746143686.969186:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592104960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143686.969201:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143686.969208:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e93 expref: 11 pid: 14764 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.969220:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e93 expref: 11 pid: 14764 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.969237:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c8400/0xe984082ccd724b8e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e93 expref: 11 pid: 14764 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746143686.969253:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143686.969258:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143686.969265:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143686.969270:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143686.969286:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143686.969868:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143686.969876:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143686.969892:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143686.970024:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62df800/0xe984082ccd724c44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0efc expref: 260 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.970041:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0efc expref: 259 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143686.970048:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:1.0:1746143686.970050:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143686.970052:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a62dfa00, rc 0) 00000100:00100000:3.0:1746143686.970703:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592104960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1517us (2973us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143686.970703:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1965:x1830963592104832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1727us (2919us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143686.970707:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:28212:x1830963592104320:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 14161us (14322us total) trans 8589942301 rc 0/0 00000100:00100000:3.0:1746143686.970711:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4724 00000100:00100000:1.0:1746143686.970714:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8212 00000100:00100000:2.0:1746143686.971198:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4723 00000100:00100000:0.0:1746143686.979991:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143686.980048:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143686.981550:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592105344 00000100:00100000:1.0:1746143686.981561:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592105344 00002000:00100000:1.0:1746143686.981606:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880094c11500 x1830963592105344/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.981615:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11500 with x1830963592105344 ext(1048576->2097151) 00002000:00010000:1.0:1746143686.981620:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c11500 00000100:00100000:1.0:1746143686.981653:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592105216 00000100:00100000:1.0:1746143686.981656:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592105216 00002000:00100000:1.0:1746143686.981668:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880094c10a80 x1830963592105216/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/0 e 0 to 0 dl 1746143697 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.981674:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10a80 with x1830963592105216 ext(1048576->2097151) 00002000:00010000:1.0:1746143686.981677:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c10a80 00000100:00100000:1.0:1746143686.981705:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3327 00000100:00100000:1.0:1746143686.981713:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1963:x1830963592105344:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143686.984118:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3328 00000100:00100000:2.0:1746143686.984132:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1963:x1830963592105216:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143686.999507:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1963:x1830963592105344:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17787us (19518us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143686.999516:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3327 00002000:00100000:1.0:1746143686.999525:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880094c11500 x1830963592105344/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143686.999535:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11500 with x1830963592105344 ext(1048576->2097151) 00002000:00010000:1.0:1746143686.999540:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c11500 00000100:00100000:2.0:1746143687.012378:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1963:x1830963592105216:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28241us (32320us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143687.012388:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3328 00002000:00100000:2.0:1746143687.012399:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880094c10a80 x1830963592105216/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:82/0 lens 488/440 e 0 to 0 dl 1746143697 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.012408:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10a80 with x1830963592105216 ext(1048576->2097151) 00002000:00010000:2.0:1746143687.012412:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c10a80 00000100:00100000:0.0:1746143687.022271:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.022365:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592105600 00000100:00100000:1.0:1746143687.022374:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592105600 00000100:00080000:2.0:1746143687.022499:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143687.022546:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9256 00000100:00100000:1.0:1746143687.022555:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28209:x1830963592105600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.022573:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.022590:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c94a400/0xe984082ccd724c59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f03 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.022621:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 36 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.022629:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143687.022631:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143687.022635:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94a400/0xe984082ccd724c59 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f03 expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.022660:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 36 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.022671:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 36 pid: 8497 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746143687.022683:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593677440:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143687.025957:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143687.029423:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593677440:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143687.029451:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c94a400/0xe984082ccd724c59 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f03 expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.029465:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94a400, rc 0) 00000100:00100000:1.0:1746143687.029510:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28209:x1830963592105600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6956us (7249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143687.029518:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9256 00000100:00100000:0.0:1746143687.031203:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.031293:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592105728 00000100:00100000:2.0:1746143687.031299:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592105728 00002000:00100000:2.0:1746143687.031461:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1658880->1953791) req@ffff880094c12680 x1830963592105728/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.031470:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12680 with x1830963592105728 ext(1658880->1953791) 00010000:00010000:2.0:1746143687.031478:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 37 pid: 8497 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.031490:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 37 pid: 8497 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746143687.031496:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c12680 00000100:00080000:0.0:1746143687.031648:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143687.033095:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 798 00000100:00100000:2.0:1746143687.033108:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963592105728:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143687.044338:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963592105728:12345-192.168.202.48@tcp:4:cat.0 Request processed in 11224us (13129us total) trans 17179872391 rc 0/0 00000100:00100000:2.0:1746143687.044350:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 798 00002000:00100000:2.0:1746143687.044360:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1658880->1953791) req@ffff880094c12680 x1830963592105728/t17179872391(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/448 e 0 to 0 dl 1746143698 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.044370:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12680 with x1830963592105728 ext(1658880->1953791) 00010000:00010000:2.0:1746143687.044379:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 39 pid: 8497 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.044393:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 39 pid: 8497 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746143687.044400:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c12680 00000100:00100000:0.0:1746143687.049768:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.050289:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592105856 00000100:00100000:2.0:1746143687.050301:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592105856 00010000:00010000:2.0:1746143687.050341:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 39 pid: 8497 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.050497:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4725 00000100:00100000:2.0:1746143687.050505:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1963:x1830963592105856:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143687.050519:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143687.050542:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 39 pid: 8497 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.050553:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 39 pid: 8497 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.050576:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131d22800/0xe984082ccd724b95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1658880->1953791) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e9a expref: 39 pid: 8497 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.050666:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.050669:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.050678:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c94a400/0xe984082ccd724c59 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f03 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.050685:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94a400/0xe984082ccd724c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f03 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.050719:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c94a400/0xe984082ccd724c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f03 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143687.050731:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593677568:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143687.052001:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143687.055206:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593677568:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143687.055224:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143687.055261:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963592105856:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4756us (5503us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143687.055271:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4725 00000100:00100000:0.0:1746143687.067229:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.068722:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592106112 00000100:00100000:2.0:1746143687.068732:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592106112 00002000:00100000:2.0:1746143687.068777:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094c10e00 x1830963592106112/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.068788:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10e00 with x1830963592106112 ext(1048576->2097151) 00002000:00010000:2.0:1746143687.068794:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10e00 00000100:00100000:2.0:1746143687.068900:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3329 00000100:00100000:2.0:1746143687.068936:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592106112:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143687.086174:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592106112:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17231us (18943us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143687.086186:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3329 00002000:00100000:2.0:1746143687.086197:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094c10e00 x1830963592106112/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.086207:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10e00 with x1830963592106112 ext(1048576->2097151) 00002000:00010000:2.0:1746143687.086212:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10e00 00000100:00100000:0.0:1746143687.117013:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.119243:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592106368 00000100:00100000:1.0:1746143687.119255:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592106368 00000100:00100000:1.0:1746143687.120187:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8213 00000100:00100000:1.0:1746143687.120196:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:28216:x1830963592106368:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.120220:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.120236:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94a800/0xe984082ccd724c60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f0a expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.120338:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94aa00/0xe984082ccd724c67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.120350:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94aa00/0xe984082ccd724c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122486:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94aa00/0xe984082ccd724c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122510:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ac00/0xe984082ccd724c6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122518:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ac00/0xe984082ccd724c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122528:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ac00/0xe984082ccd724c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122646:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ae00/0xe984082ccd724c75 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122655:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ae00/0xe984082ccd724c75 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122660:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ae00/0xe984082ccd724c75 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143687.122669:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143687.122740:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94aa00/0xe984082ccd724c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122747:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94aa00/0xe984082ccd724c67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122752:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94aa00/0xe984082ccd724c67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122757:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c94aa00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143687.122760:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94aa00/0xe984082ccd724c67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122766:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94aa00/0xe984082ccd724c67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122775:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143687.122778:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143687.122781:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94aa00/0xe984082ccd724c67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122789:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94aa00/0xe984082ccd724c67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122817:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ac00/0xe984082ccd724c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122822:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ac00/0xe984082ccd724c6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122826:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ac00/0xe984082ccd724c6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122830:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c94ac00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143687.122832:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ac00/0xe984082ccd724c6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122837:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ac00/0xe984082ccd724c6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122843:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74700) 00010000:00010000:1.0:1746143687.122845:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143687.122847:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ac00/0xe984082ccd724c6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122851:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ac00/0xe984082ccd724c6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143687.122892:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94a800/0xe984082ccd724c60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f0a expref: 261 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.122902:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ae00/0xe984082ccd724c75 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f0a expref: 260 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.122927:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:1.0:1746143687.122929:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143687.122931:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94ae00, rc 0) 00000100:00100000:1.0:1746143687.122994:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:28216:x1830963592106368:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2799us (5988us total) trans 8589942302 rc 0/0 00000100:00100000:1.0:1746143687.123001:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8213 00000100:00100000:0.0:1746143687.132810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.132858:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.132928:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592106496 00000100:00100000:2.0:1746143687.132940:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592106496 00000100:00100000:2.0:1746143687.133013:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 563 00000100:00100000:2.0:1746143687.133020:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:1964:x1830963592106496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143687.133032:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143687.133054:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ae00/0xe984082ccd724c75 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f0a expref: 260 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.133084:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143687.133088:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143687.133131:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1964:x1830963592106496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 112us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143687.133169:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 563 00000100:00100000:1.0:1746143687.133435:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592106624 00000100:00100000:1.0:1746143687.133439:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592106624 00000100:00100000:1.0:1746143687.133471:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9257 00000100:00100000:1.0:1746143687.133476:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963592106624:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.133488:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.133499:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c94b200/0xe984082ccd724c83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f11 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.133514:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143687.133515:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143687.133522:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94b200/0xe984082ccd724c83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f11 expref: 39 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.133533:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c94b200/0xe984082ccd724c83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f11 expref: 39 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.133540:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94b200, rc 0) 00000100:00100000:1.0:1746143687.133645:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963592106624:12345-192.168.202.48@tcp:101:cat.0 Request processed in 168us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143687.133651:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9257 00000100:00100000:0.0:1746143687.135034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.135343:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592106752 00000100:00100000:2.0:1746143687.135352:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592106752 00000100:00100000:2.0:1746143687.135408:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9258 00000100:00100000:2.0:1746143687.135419:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:28212:x1830963592106752:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143687.135436:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143687.135454:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f18 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.135488:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd724a0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dd6 expref: 39 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.135496:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75a00/0xe984082ccd724b48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e7e expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.135503:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724a45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df2 expref: 29 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.135510:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800955db600/0xe984082ccd724981 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d7b expref: 29 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.135517:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094677200/0xe984082ccd7249ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc1 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.135523:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143687.135524:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143687.135527:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 8/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 39 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.135556:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094677200/0xe984082ccd7249ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc1 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.135567:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094677200/0xe984082ccd7249ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc1 expref: 39 pid: 25369 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.135582:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593677696:192.168.202.48@tcp:104: 00000100:00080000:0.0:1746143687.135704:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746143687.137604:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800955db600/0xe984082ccd724981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d7b expref: 29 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.137621:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800955db600/0xe984082ccd724981 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d7b expref: 29 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.137634:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593677824:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143687.137689:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df2 expref: 29 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.137696:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724a45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df2 expref: 29 pid: 9527 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746143687.137703:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593677952:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143687.137721:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75a00/0xe984082ccd724b48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e7e expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.137729:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75a00/0xe984082ccd724b48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e7e expref: 9 pid: 12618 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746143687.137735:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593678080:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143687.137757:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd724a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dd6 expref: 39 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.137764:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd724a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dd6 expref: 39 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.137771:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593678208:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143687.137788:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143687.140474:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593677696:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143687.140487:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593677824:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143687.140495:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593677952:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143687.140501:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593678080:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143687.140511:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593678208:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143687.140553:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 39 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.140572:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131d23600, rc 0) 00000100:00100000:2.0:1746143687.140617:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:28212:x1830963592106752:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5201us (5589us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143687.140626:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9258 00000100:00100000:0.0:1746143687.143171:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.143206:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.143647:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.144447:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592107136 00000100:00100000:3.0:1746143687.144457:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592107136 00010000:00010000:3.0:1746143687.144495:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75a00/0xe984082ccd724b48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e7e expref: 10 pid: 12618 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746143687.144519:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592107008 00000100:00100000:3.0:1746143687.144521:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592107008 00010000:00010000:3.0:1746143687.144537:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800955db600/0xe984082ccd724981 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d7b expref: 30 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746143687.144550:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592106880 00000100:00100000:3.0:1746143687.144551:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592106880 00010000:00010000:3.0:1746143687.144561:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094677200/0xe984082ccd7249ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc1 expref: 39 pid: 25369 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746143687.144580:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4726 00000100:00100000:3.0:1746143687.144587:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592107136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.144602:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143687.144624:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75a00/0xe984082ccd724b48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e7e expref: 10 pid: 12618 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746143687.144634:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75a00/0xe984082ccd724b48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e7e expref: 10 pid: 12618 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746143687.144658:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a75a00/0xe984082ccd724b48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0e7e expref: 10 pid: 12618 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746143687.144677:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143687.144718:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592107136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 132us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.144725:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4726 00000100:00100000:3.0:1746143687.144770:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4727 00000100:00100000:3.0:1746143687.144776:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1962:x1830963592107008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.144781:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143687.144788:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800955db600/0xe984082ccd724981 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d7b expref: 30 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.144796:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800955db600/0xe984082ccd724981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d7b expref: 30 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.144812:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800955db600/0xe984082ccd724981 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d7b expref: 30 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.144819:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143687.144831:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1962:x1830963592107008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 56us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.144836:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4727 00000100:00100000:3.0:1746143687.144844:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4728 00000100:00100000:3.0:1746143687.144848:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963592106880:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.144853:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143687.144860:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094677200/0xe984082ccd7249ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc1 expref: 39 pid: 25369 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.144867:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094677200/0xe984082ccd7249ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc1 expref: 39 pid: 25369 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.144877:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094677200/0xe984082ccd7249ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dc1 expref: 39 pid: 25369 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.144884:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143687.144895:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963592106880:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.144900:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4728 00000100:00080000:3.0:1746143687.145044:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143687.149130:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.149192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.149289:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.149463:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592107264 00000100:00100000:2.0:1746143687.149473:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592107264 00010000:00010000:2.0:1746143687.149511:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd724a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dd6 expref: 38 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.149535:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592107392 00000100:00100000:2.0:1746143687.149538:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592107392 00010000:00010000:2.0:1746143687.149547:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724a45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df2 expref: 29 pid: 9527 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746143687.149561:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4729 00000100:00100000:2.0:1746143687.149568:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963592107264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143687.149580:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143687.149605:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd724a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dd6 expref: 38 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.149615:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd724a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dd6 expref: 38 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.149638:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd724a0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0dd6 expref: 38 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.149658:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143687.149703:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592107264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 136us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143687.149709:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4729 00000100:00100000:2.0:1746143687.149724:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4730 00000100:00100000:2.0:1746143687.149728:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1962:x1830963592107392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143687.149734:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143687.149741:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724a45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df2 expref: 29 pid: 9527 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746143687.149753:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df2 expref: 29 pid: 9527 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746143687.149763:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a963e00/0xe984082ccd724a45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0df2 expref: 29 pid: 9527 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746143687.149773:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.149775:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.149782:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 36 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.149790:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 36 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.149823:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 36 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143687.149835:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593678336:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143687.149888:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143687.149978:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592107648 00000100:00100000:3.0:1746143687.149982:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592107648 00002000:00100000:3.0:1746143687.150012:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008f7c3100 x1830963592107648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.150022:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c3100 with x1830963592107648 ext(1048576->2097151) 00002000:00010000:3.0:1746143687.150026:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7c3100 00000100:00100000:3.0:1746143687.150037:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3330 00000100:00100000:3.0:1746143687.150041:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963592107648:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143687.160247:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963592107648:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10190us (10942us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143687.160260:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3330 00002000:00100000:3.0:1746143687.160274:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88008f7c3100 x1830963592107648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.160284:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c3100 with x1830963592107648 ext(1048576->2097151) 00002000:00010000:3.0:1746143687.160291:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7c3100 00000100:00100000:2.0:1746143687.161880:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593678336:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143687.161912:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143687.161948:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1962:x1830963592107392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12218us (12755us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143687.161958:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4730 00000100:00100000:0.0:1746143687.168195:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.169378:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592107904 00000100:00100000:3.0:1746143687.169390:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592107904 00002000:00100000:3.0:1746143687.169442:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3010560->3014655) req@ffff88008f7c1f80 x1830963592107904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.169451:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c1f80 with x1830963592107904 ext(3010560->3014655) 00002000:00010000:3.0:1746143687.169457:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7c1f80 00000100:00100000:3.0:1746143687.169487:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3331 00000100:00100000:3.0:1746143687.169495:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963592107904:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143687.169708:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963592107904:12345-192.168.202.48@tcp:3:cat.0 Request processed in 213us (1574us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143687.169719:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3331 00002000:00100000:3.0:1746143687.169725:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3010560->3014655) req@ffff88008f7c1f80 x1830963592107904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/4536 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.169731:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c1f80 with x1830963592107904 ext(3010560->3014655) 00002000:00010000:3.0:1746143687.169733:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7c1f80 00000100:00100000:1.0:1746143687.172739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.172779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.172848:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592108160 00000100:00100000:3.0:1746143687.172858:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592108160 00002000:00100000:3.0:1746143687.172902:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3149823) req@ffff88012fc13b80 x1830963592108160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 504/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.172920:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13b80 with x1830963592108160 ext(2097152->3149823) 00002000:00010000:3.0:1746143687.172925:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc13b80 00000100:00100000:3.0:1746143687.172949:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592108416 00000100:00100000:3.0:1746143687.172951:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592108416 00002000:00100000:3.0:1746143687.172960:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3149824->4194303) req@ffff88012fc11500 x1830963592108416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.172965:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc11500 with x1830963592108416 ext(3149824->4194303) 00002000:00010000:3.0:1746143687.172968:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc11500 00000100:00100000:3.0:1746143687.172979:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3332 00000100:00100000:3.0:1746143687.172986:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963592108160:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143687.173007:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3333 00000100:00100000:2.0:1746143687.173016:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963592108416:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143687.196886:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963592108160:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23882us (24138us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143687.196914:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3332 00002000:00100000:3.0:1746143687.196932:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3149823) req@ffff88012fc13b80 x1830963592108160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 504/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.196950:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13b80 with x1830963592108160 ext(2097152->3149823) 00002000:00010000:3.0:1746143687.196957:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc13b80 00000100:00100000:0.0:1746143687.204869:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.205014:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592108544 00000100:00100000:2.0:1746143687.205024:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592108544 00000100:00100000:2.0:1746143687.205082:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9259 00000100:00100000:2.0:1746143687.205090:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:28212:x1830963592108544:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143687.205112:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143687.205130:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f1f expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.205189:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0xe984082ccd724918 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d4a expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.205197:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090486200/0xe984082ccd7249d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d9e expref: 40 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.205205:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090486600/0xe984082ccd72495e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d5f expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.205210:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd724870 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cda expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.205216:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8800/0xe984082ccd7248a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d12 expref: 40 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.205222:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143687.205223:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143687.205227:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 8/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->3616767] (req 3145728->3616767) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 40 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.205259:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8800/0xe984082ccd7248a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d12 expref: 40 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.205271:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8800/0xe984082ccd7248a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d12 expref: 40 pid: 25369 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.205284:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593678464:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143687.205379:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd724870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cda expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.205387:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd724870 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cda expref: 18 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.205395:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593678592:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143687.205416:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090486600/0xe984082ccd72495e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d5f expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.205422:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090486600/0xe984082ccd72495e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d5f expref: 10 pid: 12618 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746143687.205429:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593678720:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143687.205462:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090486200/0xe984082ccd7249d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d9e expref: 40 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.205474:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090486200/0xe984082ccd7249d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d9e expref: 40 pid: 25369 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746143687.205482:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593678848:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143687.205505:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0xe984082ccd724918 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d4a expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.205512:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0xe984082ccd724918 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d4a expref: 18 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.205520:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090767800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593678976:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143687.205535:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143687.206486:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963592108416:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33466us (33700us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746143687.206496:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3333 00002000:00100000:3.0:1746143687.206509:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3149824->4194303) req@ffff88012fc11500 x1830963592108416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.206518:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc11500 with x1830963592108416 ext(3149824->4194303) 00002000:00010000:3.0:1746143687.206522:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc11500 00000100:00100000:1.0:1746143687.209948:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.210112:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592108672 00000100:00100000:3.0:1746143687.210122:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592108672 00010000:00010000:3.0:1746143687.210300:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8800/0xe984082ccd7248a8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d12 expref: 41 pid: 25369 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746143687.210329:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4731 00000100:00100000:3.0:1746143687.210337:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963592108672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.210351:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143687.210377:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8800/0xe984082ccd7248a8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d12 expref: 41 pid: 25369 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.210389:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8800/0xe984082ccd7248a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d12 expref: 41 pid: 25369 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.210418:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143687.210717:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01a8800/0xe984082ccd7248a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d12 expref: 41 pid: 25369 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.210736:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593678464:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143687.211492:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963592108672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1153us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.211499:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4731 00000100:00100000:0.0:1746143687.232603:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.232638:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.232663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.232700:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.232780:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592109184 00000100:00100000:1.0:1746143687.232789:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592109184 00000100:00100000:1.0:1746143687.232842:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9260 00000100:00100000:1.0:1746143687.232850:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963592109184:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.232870:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.232888:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724c98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f26 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.232922:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143687.232933:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724c98 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f26 expref: 41 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.232943:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724c98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f26 expref: 41 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.232956:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b102c00, rc 0) 00000100:00100000:1.0:1746143687.233004:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963592109184:12345-192.168.202.48@tcp:101:cat.0 Request processed in 155us (303us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143687.233010:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9260 00000100:00100000:1.0:1746143687.233040:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592108928 00000100:00100000:1.0:1746143687.233044:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592108928 00010000:00010000:1.0:1746143687.233065:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0xe984082ccd724918 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d4a expref: 19 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746143687.233083:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592108800 00000100:00100000:1.0:1746143687.233086:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592108800 00010000:00010000:1.0:1746143687.233095:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd724870 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cda expref: 20 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746143687.233107:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592109056 00000100:00100000:1.0:1746143687.233109:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592109056 00010000:00010000:1.0:1746143687.233119:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090486600/0xe984082ccd72495e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d5f expref: 11 pid: 12618 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746143687.233133:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4732 00000100:00100000:1.0:1746143687.233172:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963592108928:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143687.233185:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143687.233209:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0xe984082ccd724918 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d4a expref: 20 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746143687.233219:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0xe984082ccd724918 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d4a expref: 20 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746143687.233237:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143687.233256:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963592108928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 117us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143687.233261:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4732 00000100:00100000:1.0:1746143687.233271:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4733 00000100:00100000:1.0:1746143687.233276:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592108800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143687.233283:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143687.233290:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd724870 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cda expref: 19 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746143687.233303:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd724870 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cda expref: 19 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746143687.233312:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143687.233327:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592108800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143687.233332:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4733 00000100:00100000:1.0:1746143687.233371:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4734 00000100:00100000:1.0:1746143687.233376:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592109056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143687.233382:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143687.233389:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090486600/0xe984082ccd72495e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d5f expref: 11 pid: 12618 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746143687.233397:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090486600/0xe984082ccd72495e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d5f expref: 11 pid: 12618 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746143687.233407:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143687.233421:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592109056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 45us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143687.233426:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4734 00010000:00010000:2.0:1746143687.233956:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffb6c00/0xe984082ccd724870 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0cda expref: 18 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.233986:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593678592:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143687.234000:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090486600/0xe984082ccd72495e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d5f expref: 10 pid: 12618 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746143687.234014:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593678720:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143687.234024:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593678848:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143687.234032:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0xe984082ccd724918 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d4a expref: 17 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.234040:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090767800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593678976:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143687.234079:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->3616767] (req 3145728->3616767) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 39 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.234089:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b145000, rc 0) 00000100:00100000:2.0:1746143687.234114:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:28212:x1830963592108544:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 29025us (29256us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143687.234120:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9259 00000100:00100000:2.0:1746143687.247024:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.247099:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592109440 00000100:00100000:0.0:1746143687.247108:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592109440 00000100:00100000:0.0:1746143687.247726:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8214 00000100:00100000:0.0:1746143687.247735:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28218:x1830963592109440:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143687.247760:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.247779:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8200/0xe984082ccd724c9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f2d expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.247837:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724ca6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.247851:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.247863:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.247875:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130297e00/0xe984082ccd724cad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.247880:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130297e00/0xe984082ccd724cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.247885:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130297e00/0xe984082ccd724cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.248006:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.248017:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0efc expref: 258 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.248024:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.248054:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0efc expref: 258 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.248064:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0efc expref: 258 pid: 14764 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746143687.248077:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593679104:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143687.251218:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.254359:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.254633:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592109568 00000100:00100000:2.0:1746143687.254644:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592109568 00000100:00100000:2.0:1746143687.254692:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9261 00000100:00100000:2.0:1746143687.254701:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:28216:x1830963592109568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143687.254721:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143687.254740:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351bc000/0xe984082ccd724cbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f34 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.254766:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.254769:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.254776:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351bc000/0xe984082ccd724cbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3620864->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f34 expref: 40 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.254790:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351bc000/0xe984082ccd724cbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3620864->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f34 expref: 40 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.254800:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bc000, rc 0) 00000100:00100000:2.0:1746143687.254857:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:28216:x1830963592109568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 157us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143687.254862:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9261 00000100:00100000:2.0:1746143687.257793:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593679104:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143687.257823:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143687.260914:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.261114:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592109696 00000100:00100000:3.0:1746143687.261123:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592109696 00010000:00010000:3.0:1746143687.261181:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0efc expref: 259 pid: 14764 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746143687.261210:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4735 00000100:00100000:3.0:1746143687.261219:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1962:x1830963592109696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.261233:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143687.261238:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0efc expref: 259 pid: 14764 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.261249:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0efc expref: 259 pid: 14764 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.261270:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62dfa00/0xe984082ccd724c4b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0efc expref: 259 pid: 14764 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.261286:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143687.261291:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143687.261301:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143687.261307:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143687.261338:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143687.261390:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:1962:x1830963592109696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 172us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.261396:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4735 00000100:00100000:3.0:1746143687.262169:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.262757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.262781:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592109952 00000100:00100000:3.0:1746143687.262786:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592109952 00002000:00100000:3.0:1746143687.262821:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800930d1500 x1830963592109952/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.262830:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1500 with x1830963592109952 ext(4194304->4898815) 00002000:00010000:3.0:1746143687.262835:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d1500 00000100:00100000:3.0:1746143687.262850:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3334 00000100:00100000:3.0:1746143687.262856:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963592109952:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:2.0:1746143687.263045:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263052:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143687.263090:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:2.0:1746143687.263093:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143687.263109:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263117:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263126:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263135:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724ca6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263158:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263163:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01a8800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143687.263167:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263172:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263183:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143687.263185:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143687.263188:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724ca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263192:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8800/0xe984082ccd724ca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263206:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130297e00/0xe984082ccd724cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263210:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130297e00/0xe984082ccd724cad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263214:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130297e00/0xe984082ccd724cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263217:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130297e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143687.263219:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130297e00/0xe984082ccd724cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263226:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130297e00/0xe984082ccd724cad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263231:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880130c67f00) 00010000:00010000:2.0:1746143687.263232:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143687.263234:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130297e00/0xe984082ccd724cad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263237:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130297e00/0xe984082ccd724cad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.263267:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01a8200/0xe984082ccd724c9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f2d expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.263278:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f2d expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.263284:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143687.263285:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143687.263287:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130297c00, rc 0) 00000100:00100000:2.0:1746143687.263319:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28218:x1830963592109440:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 15587us (16308us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143687.263326:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8214 00000100:00100000:0.0:1746143687.263978:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592109312 00000100:00100000:0.0:1746143687.263982:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592109312 00010000:00010000:0.0:1746143687.264000:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090486200/0xe984082ccd7249d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d9e expref: 42 pid: 25369 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746143687.264022:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4736 00000100:00100000:0.0:1746143687.264027:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1965:x1830963592109312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143687.264035:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143687.264048:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090486200/0xe984082ccd7249d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d9e expref: 42 pid: 25369 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746143687.264057:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090486200/0xe984082ccd7249d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d9e expref: 42 pid: 25369 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746143687.264072:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090486200/0xe984082ccd7249d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d9e expref: 42 pid: 25369 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746143687.264087:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143687.264089:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143687.264096:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 41 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.264102:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 41 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.264130:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 41 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143687.264168:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593679232:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143687.264223:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143687.264269:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.265772:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592110080 00000100:00100000:0.0:1746143687.265777:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592110080 00000100:00100000:2.0:1746143687.265785:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.265811:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592110208 00000100:00100000:0.0:1746143687.265813:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592110208 00000100:00100000:2.0:1746143687.265815:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9262 00000100:00100000:2.0:1746143687.265822:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+28:28208:x1830963592110080:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:0.0:1746143687.265831:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9263 00000100:00100000:0.0:1746143687.265835:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592110208:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143687.265844:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.265844:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143687.265858:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f3b expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.265858:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130296c00/0xe984082ccd724cc2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f42 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.265874:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143687.265876:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.265878:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 36 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.265881:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130296c00/0xe984082ccd724cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f42 expref: 10 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.265892:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143687.265893:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143687.265895:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130296c00/0xe984082ccd724cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f42 expref: 10 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.265896:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2883584->3145727] (req 2883584->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 29 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.265910:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130296c00, rc 0) 00010000:00010000:2.0:1746143687.265923:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 36 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.265933:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 36 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746143687.265935:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592110208:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 99us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143687.265941:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9263 00000100:00100000:2.0:1746143687.265942:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593679360:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143687.265976:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143687.265999:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.266008:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592110464 00000100:00100000:1.0:1746143687.266011:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592110464 00000100:00100000:2.0:1746143687.266030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.266030:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9264 00000100:00100000:1.0:1746143687.266034:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592110464:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:2.0:1746143687.266041:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592110720 00000100:00100000:2.0:1746143687.266043:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592110720 00010000:00010000:1.0:1746143687.266044:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.266052:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b102a00/0xe984082ccd724cd0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f50 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143687.266058:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9265 00000100:00100000:2.0:1746143687.266061:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592110720:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143687.266064:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143687.266065:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.266066:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.266070:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b102a00/0xe984082ccd724cd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f50 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.266071:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351bd400/0xe984082ccd724cd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f5e expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.266079:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b102a00/0xe984082ccd724cd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f50 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.266086:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b102a00, rc 0) 00000100:00100000:2.0:1746143687.266096:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090766a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593679488:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143687.266101:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592110464:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 67us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143687.266106:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9264 00000100:00100000:2.0:1746143687.266113:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143687.266156:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.266168:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592110336 00000100:00100000:2.0:1746143687.266171:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592110336 00000100:00100000:2.0:1746143687.266185:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9266 00000100:00100000:2.0:1746143687.266189:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592110336:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143687.266195:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143687.266200:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd724cde lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f49 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.266210:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.266212:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.266216:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd724cde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f49 expref: 13 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.266226:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd724cde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f49 expref: 13 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.266233:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bdc00, rc 0) 00000100:00100000:2.0:1746143687.266247:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1963:x1830963592110336:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 57us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143687.266252:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9266 00000100:00100000:2.0:1746143687.266284:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.266313:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.267208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.271028:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592110592 00000100:00100000:0.0:1746143687.271037:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592110976 00000100:00100000:1.0:1746143687.271042:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592110592 00000100:00100000:0.0:1746143687.271043:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592110976 00000100:00100000:1.0:1746143687.271094:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592110848 00000100:00100000:1.0:1746143687.271096:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592110848 00000100:00100000:0.0:1746143687.271104:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9267 00000100:00100000:1.0:1746143687.271201:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9268 00000100:00100000:1.0:1746143687.271209:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1963:x1830963592110976:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.271228:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.271247:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b103400/0xe984082ccd724ce5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f6c expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143687.271299:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593679616:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143687.271322:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592110592:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143687.271332:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.271343:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130296a00/0xe984082ccd724cec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f57 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.271362:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130296a00/0xe984082ccd724cec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f57 expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143687.271376:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143687.271392:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9269 00000100:00100000:1.0:1746143687.271397:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592110848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.271403:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.271409:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b103a00/0xe984082ccd724cf3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f65 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.271423:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b103a00/0xe984082ccd724cf3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f65 expref: 18 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.271432:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b103a00/0xe984082ccd724cf3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f65 expref: 18 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.271439:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130296a00/0xe984082ccd724cec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f57 expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.271446:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b103a00, rc 0) 00010000:00010000:0.0:1746143687.271447:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130296a00, rc 0) 00000100:00100000:1.0:1746143687.271472:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592110848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 74us (4264us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143687.271472:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592110592:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 360us (5186us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143687.271478:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9269 00000100:00100000:0.0:1746143687.271486:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9267 00000100:00100000:3.0:1746143687.276329:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593679360:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143687.276364:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2883584->3145727] (req 2883584->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143687.276424:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bc800, rc 0) 00002000:00010000:2.0:1746143687.276443:0:12618:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime: 1746143685 -> 1746143687 00002000:00010000:2.0:1746143687.276447:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143685 -> 1746143687 00002000:00010000:2.0:1746143687.276448:0:12618:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime: 1746143685 -> 1746143687 00000100:00100000:2.0:1746143687.276470:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090766a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593679488:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143687.276475:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+31:28208:x1830963592110080:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 10653us (12204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.276483:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9262 00010000:00010000:2.0:1746143687.276491:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351bd400/0xe984082ccd724cd7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f5e expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.276500:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351bd400/0xe984082ccd724cd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f5e expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.276510:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bd400, rc 0) 00000100:00100000:2.0:1746143687.276528:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592110720:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 10465us (10497us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143687.276533:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9265 00000100:00100000:3.0:1746143687.276548:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593679232:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143687.276558:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143687.276580:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963592109312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12552us (14413us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.276588:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4736 00000100:00100000:0.0:1746143687.278254:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.278406:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592111104 00000100:00100000:2.0:1746143687.278415:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592111104 00002000:00100000:2.0:1746143687.278456:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3010560->3145727) req@ffff88008f7c0e00 x1830963592111104/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.278466:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c0e00 with x1830963592111104 ext(3010560->3145727) 00010000:00010000:2.0:1746143687.278473:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 37 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.278485:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 37 pid: 4581 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746143687.278492:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f7c0e00 00000100:00100000:2.0:1746143687.278510:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 799 00000100:00100000:2.0:1746143687.278516:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963592111104:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143687.283310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.283651:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592111360 00000100:00100000:1.0:1746143687.283660:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592111360 00002000:00100000:1.0:1746143687.283708:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (3612672->3616767) req@ffff88008f7c0700 x1830963592111360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.283718:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c0700 with x1830963592111360 ext(3612672->3616767) 00002000:00010000:1.0:1746143687.283723:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7c0700 00000100:00100000:1.0:1746143687.283745:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3335 00000100:00100000:1.0:1746143687.283753:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963592111360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143687.283933:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963592111360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 180us (633us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143687.283940:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3335 00002000:00100000:1.0:1746143687.283945:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (3612672->3616767) req@ffff88008f7c0700 x1830963592111360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/4536 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.283953:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c0700 with x1830963592111360 ext(3612672->3616767) 00002000:00010000:1.0:1746143687.283955:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7c0700 00000100:00100000:3.0:1746143687.284422:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963592109952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21565us (21665us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143687.284429:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3334 00002000:00100000:3.0:1746143687.284434:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800930d1500 x1830963592109952/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.284440:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1500 with x1830963592109952 ext(4194304->4898815) 00002000:00010000:3.0:1746143687.284444:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d1500 00000100:00100000:2.0:1746143687.284444:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963592111104:12345-192.168.202.48@tcp:4:cat.0 Request processed in 5928us (6197us total) trans 21474839659 rc 0/0 00000100:00100000:2.0:1746143687.284451:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 799 00002000:00100000:2.0:1746143687.284455:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3010560->3145727) req@ffff88008f7c0e00 x1830963592111104/t21474839659(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/448 e 0 to 0 dl 1746143698 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.284461:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c0e00 with x1830963592111104 ext(3010560->3145727) 00010000:00010000:2.0:1746143687.284469:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 39 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.284483:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 39 pid: 4581 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746143687.284488:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f7c0e00 00000100:00100000:1.0:1746143687.286320:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.286550:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592111616 00000100:00100000:0.0:1746143687.286911:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593679616:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143687.286943:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b103400/0xe984082ccd724ce5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f6c expref: 30 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.286956:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b103400/0xe984082ccd724ce5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f6c expref: 30 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.286979:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b103400, rc 0) 00000100:00100000:0.0:1746143687.287017:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1963:x1830963592110976:12345-192.168.202.48@tcp:101:cat.0 Request processed in 15809us (20702us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143687.287025:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9268 00000100:00100000:2.0:1746143687.287985:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592111616 00000100:00100000:2.0:1746143687.288039:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8215 00000100:00100000:2.0:1746143687.288046:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28218:x1830963592111616:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143687.288062:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143687.288078:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd724cfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f73 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.288187:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd724d01 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.288201:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f2d expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.288208:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd724d01 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.288250:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f2d expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.288259:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f2d expref: 12 pid: 21713 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.288270:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593679744:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143687.288343:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.297119:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.297182:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592112000 00000100:00100000:0.0:1746143687.297187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.297194:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592112000 00000100:00100000:0.0:1746143687.297211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.297241:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3326 00000100:00100000:2.0:1746143687.297250:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:28212:x1830963592112000:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143687.297266:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.297327:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592111872 00000100:00100000:1.0:1746143687.297331:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592111872 00000100:00100000:1.0:1746143687.297354:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592112128 00000100:00100000:1.0:1746143687.297355:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592112128 00000100:00100000:1.0:1746143687.297370:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9270 00000100:00100000:1.0:1746143687.297375:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963592111872:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.297386:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.297402:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b103e00/0xe984082ccd724d08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f7a expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.297428:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b103e00/0xe984082ccd724d08 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f7a expref: 40 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.297437:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b103e00/0xe984082ccd724d08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f7a expref: 40 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.297448:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b103e00, rc 0) 00000100:00100000:2.0:1746143687.297547:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:28212:x1830963592112000:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 297us (440us total) trans 8589942303 rc 0/0 00000100:00100000:2.0:1746143687.297554:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3326 00000100:00100000:3.0:1746143687.297589:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9271 00000100:00100000:3.0:1746143687.297595:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963592112128:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143687.297595:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593679744:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143687.297604:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143687.297614:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01afe00/0xe984082ccd724d0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f81 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.297615:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd724d01 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:3.0:1746143687.297653:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593679872:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143687.297696:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143687.297712:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592112256 00000100:00100000:3.0:1746143687.297715:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592112256 00010000:00010000:3.0:1746143687.297731:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 41 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746143687.297758:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4737 00000100:00100000:3.0:1746143687.297763:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963592112256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.297773:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143687.297792:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 41 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.297801:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 41 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.297817:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143687.297819:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143687.297825:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143687.297833:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143687.297850:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143687.297857:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593680000:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143687.297877:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143687.297958:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963592111872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 582us (769us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143687.297964:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9270 00000100:00100000:2.0:1746143687.299068:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.299687:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592112384 00000100:00100000:3.0:1746143687.299692:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592112384 00010000:00010000:3.0:1746143687.299716:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f2d expref: 13 pid: 21713 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746143687.299747:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4738 00000100:00100000:3.0:1746143687.299753:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963592112384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.299766:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143687.299771:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f2d expref: 13 pid: 21713 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.299781:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f2d expref: 13 pid: 21713 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.299798:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130297c00/0xe984082ccd724cb4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f2d expref: 13 pid: 21713 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.299816:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143687.299821:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd724d01 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143687.299830:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd724d01 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143687.299836:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd724d01 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143687.299855:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143687.299887:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592112384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 133us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.299892:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4738 00010000:00010000:2.0:1746143687.300337:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd724d01 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.300345:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd724d01 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143687.300366:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143687.300492:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b145a00/0xe984082ccd724cfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f73 expref: 13 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.300506:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd724d01 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f73 expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.300512:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143687.300514:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143687.300516:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a963e00, rc 0) 00000100:00100000:2.0:1746143687.300552:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28218:x1830963592111616:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 12506us (14237us total) trans 8589942304 rc 0/0 00000100:00100000:2.0:1746143687.300558:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8215 00000100:00100000:2.0:1746143687.300598:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593680000:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143687.300611:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143687.302110:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963592112256:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4337us (4834us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143687.302121:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4737 00000100:00100000:1.0:1746143687.302415:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143687.302518:0:12618:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff8800930d1c00 x1830963593679872) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 40 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.302553:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131d23600/0xe984082ccd724c8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3010560->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f18 expref: 40 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746143687.302567:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593679872:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143687.302590:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01afe00/0xe984082ccd724d0f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f81 expref: 39 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143687.302600:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01afe00/0xe984082ccd724d0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f81 expref: 39 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143687.302606:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01afe00, rc 0) 00000100:00100000:3.0:1746143687.302637:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963592112128:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5042us (5424us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143687.302643:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9271 00000100:00100000:0.0:1746143687.303194:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592112640 00000100:00100000:0.0:1746143687.303202:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592112640 00002000:00100000:0.0:1746143687.303238:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2883584->2887679) req@ffff88012fc10380 x1830963592112640/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.303248:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10380 with x1830963592112640 ext(2883584->2887679) 00002000:00010000:0.0:1746143687.303252:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10380 00000100:00100000:0.0:1746143687.303278:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3336 00000100:00100000:0.0:1746143687.303284:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1964:x1830963592112640:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143687.303423:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1964:x1830963592112640:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 139us (1008us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143687.303429:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3336 00002000:00100000:0.0:1746143687.303434:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2883584->2887679) req@ffff88012fc10380 x1830963592112640/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/4536 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.303440:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10380 with x1830963592112640 ext(2883584->2887679) 00002000:00010000:0.0:1746143687.303442:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10380 00000100:00100000:1.0:1746143687.303629:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.303671:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592112896 00000100:00100000:2.0:1746143687.303675:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592112896 00000100:00100000:2.0:1746143687.303847:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8216 00000100:00100000:2.0:1746143687.303853:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28218:x1830963592112896:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143687.303866:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143687.303869:0:21713:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143687.303887:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd724d01 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f73 expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.303913:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143687.303917:0:21713:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143687.303928:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc20600/0xe984082ccd724d1d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f88 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.304007:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc20800/0xe984082ccd724d24 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.304018:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc20800/0xe984082ccd724d24 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.304027:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc20800/0xe984082ccd724d24 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.304036:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc20800/0xe984082ccd724d24 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.304042:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc20800/0xe984082ccd724d24 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.304048:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc20800/0xe984082ccd724d24 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.304053:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fc20800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143687.304057:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc20800/0xe984082ccd724d24 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.304063:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc20800/0xe984082ccd724d24 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.304070:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143687.304072:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143687.304075:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc20800/0xe984082ccd724d24 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.304079:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc20800/0xe984082ccd724d24 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143687.304097:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc20600/0xe984082ccd724d1d lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f88 expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.304104:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc20600/0xe984082ccd724d1d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f88 expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.304110:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc20600, rc 0) 00000100:00100000:2.0:1746143687.304134:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28218:x1830963592112896:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 281us (505us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143687.304166:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8216 00000100:00100000:0.0:1746143687.308030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.308080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.308136:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592113280 00000100:00100000:2.0:1746143687.308168:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592113280 00000100:00100000:3.0:1746143687.308169:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592113152 00000100:00100000:3.0:1746143687.308172:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592113152 00000100:00100000:3.0:1746143687.308206:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3327 00000100:00100000:2.0:1746143687.308206:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9272 00000100:00100000:3.0:1746143687.308213:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28218:x1830963592113152:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143687.308213:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28208:x1830963592113280:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143687.308231:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143687.308249:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f8f expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.308273:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 38 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.308280:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351bc000/0xe984082ccd724cbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3620864->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f34 expref: 38 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.308290:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143687.308291:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143687.308295:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3760127] (req 3145728->3760127) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.308323:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351bc000/0xe984082ccd724cbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3620864->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f34 expref: 38 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.308335:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351bc000/0xe984082ccd724cbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3620864->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f34 expref: 38 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.308347:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593680128:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143687.308436:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 38 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.308444:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 38 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.308451:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593680256:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143687.308751:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28218:x1830963592113152:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 537us (729us total) trans 8589942305 rc 0/0 00000100:00100000:3.0:1746143687.308758:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3327 00000100:00100000:2.0:1746143687.308915:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.309534:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.309565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.309692:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593680128:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143687.309784:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592113408 00000100:00100000:2.0:1746143687.309790:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592113408 00000100:00100000:2.0:1746143687.309825:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592113536 00000100:00100000:2.0:1746143687.309828:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592113536 00000100:00100000:2.0:1746143687.309845:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9273 00000100:00100000:2.0:1746143687.309850:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963592113408:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143687.309862:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143687.309871:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc21800/0xe984082ccd724d32 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f96 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143687.309886:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9274 00010000:00010000:2.0:1746143687.309893:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fc21800/0xe984082ccd724d32 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f96 expref: 40 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143687.309893:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963592113536:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.309900:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143687.309910:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc21800/0xe984082ccd724d32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f96 expref: 40 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.309917:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b103400/0xe984082ccd724d39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0f9d expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.309919:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc21800, rc 0) 00000100:00100000:2.0:1746143687.309938:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963592113408:12345-192.168.202.48@tcp:101:cat.0 Request processed in 88us (406us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143687.309943:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9273 00000100:00100000:1.0:1746143687.309946:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593680384:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143687.309982:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143687.310977:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593680384:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143687.310996:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b103400/0xe984082ccd724d39 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f9d expref: 39 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.311006:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b103400/0xe984082ccd724d39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f9d expref: 39 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.311019:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b103400, rc 0) 00000100:00100000:1.0:1746143687.311041:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963592113536:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1149us (1474us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143687.311047:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9274 00000100:00100000:3.0:1746143687.311118:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593680256:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143687.311136:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3760127] (req 3145728->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143687.311175:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc20a00, rc 0) 00000100:00100000:3.0:1746143687.311195:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28208:x1830963592113280:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2983us (3115us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.311200:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9272 00000100:00100000:0.0:1746143687.316479:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.316535:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.316544:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592113664 00000100:00100000:2.0:1746143687.316590:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592113792 00000100:00100000:2.0:1746143687.316597:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592113792 00000100:00100000:2.0:1746143687.316659:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9275 00000100:00100000:2.0:1746143687.316667:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592113792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143687.316688:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143687.316709:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc21a00/0xe984082ccd724d40 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0fa4 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.316742:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fc21a00/0xe984082ccd724d40 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fa4 expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.316751:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc21a00/0xe984082ccd724d40 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fa4 expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.316766:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc21a00, rc 0) 00000100:00100000:2.0:1746143687.316821:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592113792:12345-192.168.202.48@tcp:101:cat.0 Request processed in 154us (284us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143687.316828:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9275 00000100:00100000:3.0:1746143687.316874:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592113664 00002000:00100000:3.0:1746143687.316913:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3616767) req@ffff88008f7c1c00 x1830963592113664/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.316921:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c1c00 with x1830963592113664 ext(3145728->3616767) 00010000:00010000:3.0:1746143687.316928:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 39 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.316937:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 39 pid: 4581 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746143687.316943:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7c1c00 00000100:00100000:3.0:1746143687.316966:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 800 00000100:00100000:3.0:1746143687.316971:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963592113664:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143687.320150:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.320290:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592113920 00000100:00100000:3.0:1746143687.320298:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592113920 00010000:00010000:3.0:1746143687.322355:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351bc000/0xe984082ccd724cbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3620864->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f34 expref: 41 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746143687.322413:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4739 00000100:00100000:3.0:1746143687.322427:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963592113920:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.322444:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143687.322466:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801351bc000/0xe984082ccd724cbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3620864->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f34 expref: 41 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.322477:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801351bc000/0xe984082ccd724cbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3620864->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f34 expref: 41 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.322500:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351bc000/0xe984082ccd724cbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3620864->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f34 expref: 41 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.322516:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143687.322566:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963592113920:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 146us (2438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.322572:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4739 00000100:00100000:1.0:1746143687.326083:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.326279:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.326338:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592114048 00000100:00100000:2.0:1746143687.326347:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592114048 00000100:00100000:2.0:1746143687.326390:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9276 00000100:00100000:2.0:1746143687.326398:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28221:x1830963592114048:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143687.326421:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143687.326438:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc21e00/0xe984082ccd724d47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0fab expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.326464:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.326467:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.326475:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc21e00/0xe984082ccd724d47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fab expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.326490:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fc21e00/0xe984082ccd724d47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fab expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.326500:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc21e00, rc 0) 00000100:00100000:2.0:1746143687.326541:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28221:x1830963592114048:12345-192.168.202.48@tcp:101:cat.0 Request processed in 143us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143687.326546:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9276 00000100:00100000:3.0:1746143687.327311:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592114304 00000100:00100000:3.0:1746143687.327315:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592114304 00000100:00100000:3.0:1746143687.327349:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3328 00000100:00100000:3.0:1746143687.327355:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:28216:x1830963592114304:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143687.329173:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:28216:x1830963592114304:12345-192.168.202.48@tcp:35:cat.0 Request processed in 781us (1857us total) trans 8589942306 rc 0/0 00000100:00100000:3.0:1746143687.329185:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3328 00000100:00100000:0.0:1746143687.338386:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.339011:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592114688 00000100:00100000:1.0:1746143687.339021:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592114688 00002000:00100000:1.0:1746143687.339063:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f7c2d80 x1830963592114688/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.339073:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c2d80 with x1830963592114688 ext(2097152->3145727) 00002000:00010000:1.0:1746143687.339079:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7c2d80 00000100:00100000:3.0:1746143687.339704:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963592113664:12345-192.168.202.48@tcp:4:cat.0 Request processed in 22728us (23232us total) trans 17179872392 rc 0/0 00000100:00100000:3.0:1746143687.339713:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 800 00002000:00100000:3.0:1746143687.339721:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3616767) req@ffff88008f7c1c00 x1830963592113664/t17179872392(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/448 e 0 to 0 dl 1746143698 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.339733:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c1c00 with x1830963592113664 ext(3145728->3616767) 00010000:00010000:3.0:1746143687.339741:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 40 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.339755:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 40 pid: 4581 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746143687.339761:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7c1c00 00000100:00100000:3.0:1746143687.339791:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3337 00000100:00100000:3.0:1746143687.339798:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592114688:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143687.340356:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.340796:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592114816 00000100:00100000:1.0:1746143687.340802:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592114816 00002000:00100000:1.0:1746143687.340834:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2883583) req@ffff88008f7c2a00 x1830963592114816/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.340842:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c2a00 with x1830963592114816 ext(2097152->2883583) 00002000:00010000:1.0:1746143687.340846:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7c2a00 00000100:00100000:1.0:1746143687.340860:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3338 00000100:00100000:1.0:1746143687.340865:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1963:x1830963592114816:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143687.347387:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.348256:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592114944 00000100:00100000:3.0:1746143687.348268:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592114944 00010000:00010000:3.0:1746143687.348306:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 40 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746143687.348333:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4740 00000100:00100000:3.0:1746143687.348341:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963592114944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.348355:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143687.348373:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143685 -> 1746143687 00010000:00010000:3.0:1746143687.348379:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 40 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.348390:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 40 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.348419:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b145000/0xe984082ccd724c91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->3620863] (req 3145728->3616767) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f1f expref: 40 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.348434:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143687.348436:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143687.348444:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 20 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143687.348452:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 20 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143687.348486:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 20 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143687.348497:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593680512:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143687.349980:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5823240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143687.359418:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1963:x1830963592114816:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18540us (19050us total) trans 0 rc 786432/786432 00000100:00100000:1.0:1746143687.359430:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3338 00002000:00100000:1.0:1746143687.359441:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2883583) req@ffff88008f7c2a00 x1830963592114816/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 786432/786432 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.359451:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c2a00 with x1830963592114816 ext(2097152->2883583) 00002000:00010000:1.0:1746143687.359458:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7c2a00 00000100:00100000:3.0:1746143687.359550:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593680512:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143687.359569:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143687.359588:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1963:x1830963592114944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 11248us (12213us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.359596:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4740 00000100:00100000:0.0:1746143687.362482:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.362609:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592115200 00000100:00100000:1.0:1746143687.362619:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592115200 00002000:00100000:1.0:1746143687.362662:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3756032->3760127) req@ffff88008f7c3800 x1830963592115200/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.362672:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c3800 with x1830963592115200 ext(3756032->3760127) 00002000:00010000:1.0:1746143687.362678:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7c3800 00000100:00100000:1.0:1746143687.362696:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3339 00000100:00100000:1.0:1746143687.362704:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592115200:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143687.362880:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592115200:12345-192.168.202.48@tcp:3:cat.0 Request processed in 176us (407us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143687.362888:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3339 00002000:00100000:1.0:1746143687.362898:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3756032->3760127) req@ffff88008f7c3800 x1830963592115200/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/4536 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.362913:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c3800 with x1830963592115200 ext(3756032->3760127) 00002000:00010000:1.0:1746143687.362916:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7c3800 00000100:00100000:3.0:1746143687.363515:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592114688:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23715us (25140us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143687.363522:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3337 00002000:00100000:3.0:1746143687.363528:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f7c2d80 x1830963592114688/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.363536:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c2d80 with x1830963592114688 ext(2097152->3145727) 00002000:00010000:3.0:1746143687.363539:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7c2d80 00000100:00100000:0.0:1746143687.365748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.365837:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592115456 00000100:00100000:3.0:1746143687.365846:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592115456 00000100:00100000:3.0:1746143687.366443:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3329 00000100:00100000:3.0:1746143687.366452:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28208:x1830963592115456:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143687.369080:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28208:x1830963592115456:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 2616us (3327us total) trans 8589942307 rc 0/0 00000100:00100000:3.0:1746143687.369092:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3329 00000100:00100000:0.0:1746143687.371517:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.371552:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.371591:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.371663:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592115840 00000100:00100000:2.0:1746143687.371674:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592115840 00002000:00100000:2.0:1746143687.371722:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f7c1180 x1830963592115840/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.371731:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c1180 with x1830963592115840 ext(3145728->4194303) 00002000:00010000:2.0:1746143687.371736:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7c1180 00000100:00100000:2.0:1746143687.371751:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592115968 00000100:00100000:2.0:1746143687.371753:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592115968 00002000:00100000:2.0:1746143687.371762:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (3760128->4194303) req@ffff88008f7c1500 x1830963592115968/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.371769:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c1500 with x1830963592115968 ext(3760128->4194303) 00002000:00010000:2.0:1746143687.371772:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7c1500 00000100:00100000:2.0:1746143687.371779:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592116096 00000100:00100000:2.0:1746143687.371780:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592116096 00002000:00100000:2.0:1746143687.371787:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800930dc380 x1830963592116096/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.371793:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc380 with x1830963592116096 ext(4194304->4898815) 00002000:00010000:2.0:1746143687.371795:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dc380 00000100:00100000:2.0:1746143687.371805:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3340 00000100:00100000:2.0:1746143687.371811:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1962:x1830963592115840:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143687.373119:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3341 00000100:00100000:2.0:1746143687.373130:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963592115968:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143687.373692:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3342 00000100:00100000:1.0:1746143687.373700:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963592116096:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143687.385418:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1962:x1830963592115840:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13596us (13899us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143687.385430:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3340 00002000:00100000:2.0:1746143687.385443:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f7c1180 x1830963592115840/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.385454:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c1180 with x1830963592115840 ext(3145728->4194303) 00002000:00010000:2.0:1746143687.385460:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7c1180 00000100:00100000:3.0:1746143687.385787:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963592115968:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12657us (14231us total) trans 0 rc 434176/434176 00000100:00100000:3.0:1746143687.385794:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3341 00002000:00100000:3.0:1746143687.385800:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3760128->4194303) req@ffff88008f7c1500 x1830963592115968/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 434176/434176 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.385808:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7c1500 with x1830963592115968 ext(3760128->4194303) 00002000:00010000:3.0:1746143687.385811:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7c1500 00000100:00100000:1.0:1746143687.391034:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592116096:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17322us (19428us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143687.391046:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3342 00002000:00100000:1.0:1746143687.391058:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800930dc380 x1830963592116096/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.391067:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc380 with x1830963592116096 ext(4194304->4898815) 00002000:00010000:1.0:1746143687.391072:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dc380 00000100:00100000:2.0:1746143687.391300:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.391413:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592116352 00000100:00100000:1.0:1746143687.391421:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592116352 00000100:00100000:1.0:1746143687.391466:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9277 00000100:00100000:1.0:1746143687.391473:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592116352:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.391492:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.391510:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b103000/0xe984082ccd724d4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0fb2 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143687.391562:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593680640:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143687.391634:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00002000:00010000:1.0:1746143687.393024:0:8497:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime: 1746143685 -> 1746143687 00002000:00010000:1.0:1746143687.393028:0:8497:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime: 1746143685 -> 1746143687 00000100:00100000:1.0:1746143687.393047:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593680640:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143687.393071:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b103000/0xe984082ccd724d4e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fb2 expref: 20 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.393082:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b103000/0xe984082ccd724d4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fb2 expref: 20 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.394263:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b103000, rc 0) 00000100:00100000:1.0:1746143687.394329:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592116352:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2853us (3026us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143687.394337:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9277 00000100:00100000:0.0:1746143687.398840:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.398910:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592116480 00000100:00100000:1.0:1746143687.398921:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592116480 00000100:00100000:1.0:1746143687.399060:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9278 00000100:00100000:1.0:1746143687.399069:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592116480:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.399087:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.399104:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b103400/0xe984082ccd724d55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0fb9 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143687.399184:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593680768:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143687.399352:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143687.400959:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593680768:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143687.400986:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b103400/0xe984082ccd724d55 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fb9 expref: 20 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.400999:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b103400/0xe984082ccd724d55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fb9 expref: 20 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.401025:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b103400, rc 0) 00000100:00100000:1.0:1746143687.401068:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592116480:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1997us (2236us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143687.401076:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9278 00000100:00100000:0.0:1746143687.403127:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.403501:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592116608 00000100:00100000:1.0:1746143687.403509:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592116608 00000100:00100000:1.0:1746143687.403556:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9279 00000100:00100000:1.0:1746143687.403564:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592116608:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.403582:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.403597:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b102000/0xe984082ccd724d5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0fc0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143687.403650:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593680896:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143687.403803:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143687.406424:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593680896:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143687.406457:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b102000/0xe984082ccd724d5c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fc0 expref: 20 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.406471:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b102000/0xe984082ccd724d5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fc0 expref: 20 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.406495:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b102000, rc 0) 00000100:00100000:1.0:1746143687.406534:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592116608:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2970us (3415us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143687.406543:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9279 00000100:00100000:1.0:1746143687.448725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.449009:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592116864 00000100:00100000:0.0:1746143687.449021:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592116864 00000100:00100000:0.0:1746143687.449082:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8217 00000100:00100000:0.0:1746143687.449091:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:28228:x1830963592116864:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143687.449119:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.449152:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd000/0xe984082ccd724d63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0fc7 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.449264:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc200/0xe984082ccd724d6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.450492:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc200/0xe984082ccd724d6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.450505:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc200/0xe984082ccd724d6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452348:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bda00/0xe984082ccd724d71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452360:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bda00/0xe984082ccd724d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452368:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bda00/0xe984082ccd724d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452520:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bde00/0xe984082ccd724d78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452528:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bde00/0xe984082ccd724d78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452533:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bde00/0xe984082ccd724d78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143687.452542:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143687.452623:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc200/0xe984082ccd724d6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452629:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc200/0xe984082ccd724d6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452634:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc200/0xe984082ccd724d6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452640:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801351bc200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143687.452644:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc200/0xe984082ccd724d6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452649:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc200/0xe984082ccd724d6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452660:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143687.452663:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143687.452667:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc200/0xe984082ccd724d6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452672:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc200/0xe984082ccd724d6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452686:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bda00/0xe984082ccd724d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452690:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bda00/0xe984082ccd724d71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452694:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bda00/0xe984082ccd724d71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452698:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801351bda00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143687.452700:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bda00/0xe984082ccd724d71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452704:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bda00/0xe984082ccd724d71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452709:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012b554500) 00010000:00010000:0.0:1746143687.452711:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143687.452713:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bda00/0xe984082ccd724d71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452717:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bda00/0xe984082ccd724d71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.452765:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd000/0xe984082ccd724d63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fc7 expref: 263 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.452777:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bde00/0xe984082ccd724d78 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fc7 expref: 262 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.452783:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:0.0:1746143687.452785:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143687.452787:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bde00, rc 0) 00000100:00100000:0.0:1746143687.452849:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:28228:x1830963592116864:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3758us (4134us total) trans 8589942308 rc 0/0 00000100:00100000:0.0:1746143687.452858:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8217 00000100:00100000:1.0:1746143687.465011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.465065:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592116992 00000100:00100000:0.0:1746143687.465074:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592116992 00000100:00100000:0.0:1746143687.465115:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9280 00000100:00100000:0.0:1746143687.465122:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:28228:x1830963592116992:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143687.465162:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.465177:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0fce expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.465201:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.465207:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143687.465209:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143687.465212:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4050944->4055039] (req 4050944->4055039) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 40 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.465235:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.465247:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 18 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746143687.465259:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593681024:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143687.465322:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.468849:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593681024:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143687.468873:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4050944->4055039] (req 4050944->4055039) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 40 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.468888:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bca00, rc 0) 00000100:00100000:0.0:1746143687.468935:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:28228:x1830963592116992:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3813us (3928us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143687.468942:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9280 00000100:00100000:1.0:1746143687.473840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.474566:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592117120 00000100:00100000:0.0:1746143687.474574:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592117120 00002000:00100000:0.0:1746143687.474615:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3760127) req@ffff880091715880 x1830963592117120/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.474623:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091715880 with x1830963592117120 ext(3145728->3760127) 00010000:00010000:0.0:1746143687.474631:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 19 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746143687.474641:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 19 pid: 12618 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746143687.474651:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091715880 00000100:00100000:0.0:1746143687.474686:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 801 00000100:00100000:0.0:1746143687.474693:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592117120:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143687.494959:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592117120:12345-192.168.202.48@tcp:4:cat.0 Request processed in 20259us (21117us total) trans 17179872393 rc 0/0 00000100:00100000:0.0:1746143687.494969:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 801 00002000:00100000:0.0:1746143687.494978:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3760127) req@ffff880091715880 x1830963592117120/t17179872393(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/448 e 0 to 0 dl 1746143698 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.494986:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091715880 with x1830963592117120 ext(3145728->3760127) 00010000:00010000:0.0:1746143687.494994:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 21 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746143687.495006:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 21 pid: 12618 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746143687.495011:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091715880 00000100:00100000:0.0:1746143687.503933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.504360:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592117248 00000100:00100000:3.0:1746143687.504367:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592117248 00010000:00010000:3.0:1746143687.504396:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 21 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746143687.504419:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4741 00000100:00100000:3.0:1746143687.504425:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963592117248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.504435:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143687.504454:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 21 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.504465:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 21 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.504484:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc20a00/0xe984082ccd724d2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3760127) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f8f expref: 21 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.504496:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143687.504498:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143687.504504:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143687.504511:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143687.504536:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143687.504546:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593681152:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143687.504605:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a58233c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143687.510569:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593681152:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143687.510585:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143687.510615:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963592117248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6190us (6689us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143687.510623:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4741 00000100:00100000:1.0:1746143687.522292:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.522381:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592117504 00000100:00100000:2.0:1746143687.522391:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592117504 00002000:00100000:2.0:1746143687.522431:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4050944->4055039) req@ffff880091716680 x1830963592117504/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.522530:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091716680 with x1830963592117504 ext(4050944->4055039) 00002000:00010000:2.0:1746143687.522535:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091716680 00000100:00100000:2.0:1746143687.522565:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3343 00000100:00100000:2.0:1746143687.522572:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963592117504:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143687.522726:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963592117504:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 154us (439us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143687.522733:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3343 00002000:00100000:2.0:1746143687.522739:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4050944->4055039) req@ffff880091716680 x1830963592117504/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/4536 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.522750:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091716680 with x1830963592117504 ext(4050944->4055039) 00002000:00010000:2.0:1746143687.522753:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091716680 00000100:00100000:0.0:1746143687.535564:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.535595:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.535614:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592117888 00000100:00100000:0.0:1746143687.535620:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592117888 00000100:00100000:0.0:1746143687.535653:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9281 00000100:00100000:0.0:1746143687.535660:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963592117888:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143687.535676:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.535689:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351bcc00/0xe984082ccd724d8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0fd5 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143687.535731:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593681280:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143687.535796:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143687.536488:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592117760 00000100:00100000:3.0:1746143687.536492:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592117760 00000100:00100000:3.0:1746143687.536803:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3330 00000100:00100000:3.0:1746143687.536810:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:28228:x1830963592117760:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143687.536978:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+263:28228:x1830963592117760:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 167us (1416us total) trans 8589942309 rc 0/0 00000100:00100000:3.0:1746143687.536984:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3330 00000100:00100000:0.0:1746143687.539679:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593681280:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143687.539705:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351bcc00/0xe984082ccd724d8d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fd5 expref: 21 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.539715:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351bcc00/0xe984082ccd724d8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fd5 expref: 21 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.539727:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bcc00, rc 0) 00000100:00100000:0.0:1746143687.539759:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963592117888:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4099us (4163us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143687.539766:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9281 00000100:00100000:1.0:1746143687.570303:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.570328:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592118016 00000100:00100000:1.0:1746143687.570335:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592118016 00000100:00100000:1.0:1746143687.570370:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9282 00000100:00100000:1.0:1746143687.570377:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28231:x1830963592118016:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.570391:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.570406:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724d94 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0fdc expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.570430:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.570437:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143687.570439:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143687.570442:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724d94 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fdc expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.570466:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.570476:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 39 pid: 8497 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746143687.570486:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593681408:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143687.570538:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.574947:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.574968:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592118144 00000100:00100000:0.0:1746143687.574974:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592118144 00002000:00100000:0.0:1746143687.575007:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4050944->4055039) req@ffff8800930dca80 x1830963592118144/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 4584/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.575015:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dca80 with x1830963592118144 ext(4050944->4055039) 00010000:00010000:0.0:1746143687.575022:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 40 pid: 8497 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746143687.575039:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 40 pid: 8497 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746143687.575044:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930dca80 00000100:00100000:0.0:1746143687.575060:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 802 00000100:00100000:0.0:1746143687.575066:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963592118144:12345-192.168.202.48@tcp:4:multiop.0 00010000:00010000:1.0:1746143687.575759:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143687.575799:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593681408:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143687.575820:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724d94 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fdc expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.575832:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b102c00, rc 0) 00000100:00100000:1.0:1746143687.575868:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28231:x1830963592118016:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5492us (5570us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143687.575875:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9282 00000100:00100000:0.0:1746143687.576498:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1962:x1830963592118144:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 1431us (1556us total) trans 17179872394 rc 0/0 00000100:00100000:0.0:1746143687.576505:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 802 00002000:00100000:0.0:1746143687.576511:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4050944->4055039) req@ffff8800930dca80 x1830963592118144/t17179872394(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 4584/448 e 0 to 0 dl 1746143698 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.576518:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dca80 with x1830963592118144 ext(4050944->4055039) 00010000:00010000:0.0:1746143687.576523:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 42 pid: 8497 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746143687.576533:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 42 pid: 8497 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746143687.576538:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930dca80 00000100:00100000:1.0:1746143687.578281:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.578302:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592118400 00000100:00100000:0.0:1746143687.578308:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592118400 00000100:00100000:0.0:1746143687.578338:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8218 00000100:00100000:0.0:1746143687.578344:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+263:28235:x1830963592118400:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143687.578361:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.578374:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc600/0xe984082ccd724d9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0fe3 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.578574:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd724da2 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.578585:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd724da2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.578594:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd724da2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143687.578604:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143687.578688:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc600/0xe984082ccd724d9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fe3 expref: 266 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.578700:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd724da2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fe3 expref: 265 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.578707:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:0.0:1746143687.578709:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746143687.578712:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bd600, rc 0) 00000100:00100000:0.0:1746143687.578753:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:28235:x1830963592118400:12345-192.168.202.48@tcp:101:cat.0 Request processed in 408us (475us total) trans 8589942310 rc 0/0 00000100:00100000:0.0:1746143687.578758:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8218 00000100:00100000:1.0:1746143687.581061:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.581319:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592118528 00000100:00100000:2.0:1746143687.581325:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592118528 00010000:00010000:2.0:1746143687.581349:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 42 pid: 8497 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.581370:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4742 00000100:00100000:2.0:1746143687.581376:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1963:x1830963592118528:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143687.581385:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143687.581404:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 42 pid: 8497 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.581414:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 42 pid: 8497 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.581432:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd724d86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4050944->18446744073709551615] (req 4050944->4055039) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fce expref: 42 pid: 8497 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.581444:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.581446:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.581453:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724d94 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fdc expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.581460:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724d94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fdc expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.581486:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724d94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fdc expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143687.581496:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593681536:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143687.581555:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.595918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.595942:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.595953:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.596019:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.596038:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592118912 00000100:00100000:0.0:1746143687.596044:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592118912 00000100:00100000:0.0:1746143687.596074:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8219 00000100:00100000:0.0:1746143687.596080:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28237:x1830963592118912:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143687.596097:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.596110:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd400/0xe984082ccd724db0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ff1 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.596198:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.596209:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bde00/0xe984082ccd724d78 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fc7 expref: 264 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.596215:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.596237:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bde00/0xe984082ccd724d78 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fc7 expref: 264 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.596246:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bde00/0xe984082ccd724d78 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fc7 expref: 264 pid: 21713 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746143687.596255:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593681664:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143687.596314:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.596327:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592118656 00000100:00100000:0.0:1746143687.596329:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592118656 00000100:00100000:0.0:1746143687.596348:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592119040 00000100:00100000:0.0:1746143687.596350:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592119040 00000100:00100000:0.0:1746143687.596361:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9283 00000100:00100000:0.0:1746143687.596365:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1964:x1830963592118656:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143687.596372:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.596380:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351bc200/0xe984082ccd724dbe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0fea expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.596393:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143687.596394:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143687.596400:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351bc200/0xe984082ccd724dbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fea expref: 43 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.596409:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351bc200/0xe984082ccd724dbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fea expref: 43 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.596417:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bc200, rc 0) 00000100:00100000:0.0:1746143687.596432:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1964:x1830963592118656:12345-192.168.202.48@tcp:101:cat.0 Request processed in 66us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143687.596437:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9283 00000100:00100000:0.0:1746143687.596447:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9284 00000100:00100000:0.0:1746143687.596451:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963592119040:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143687.596456:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.596462:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351bd000/0xe984082ccd724dc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0ff8 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143687.596481:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593681792:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143687.596494:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.596515:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593681536:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143687.596525:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143687.596537:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1963:x1830963592118528:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 15162us (15480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143687.596543:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4742 00000100:00100000:0.0:1746143687.596558:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592119296 00000100:00100000:0.0:1746143687.596560:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592119296 00002000:00100000:0.0:1746143687.596575:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800930ded80 x1830963592119296/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.596583:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ded80 with x1830963592119296 ext(3145728->4194303) 00002000:00010000:0.0:1746143687.596587:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930ded80 00000100:00100000:0.0:1746143687.596595:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3344 00000100:00100000:0.0:1746143687.596599:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592119296:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143687.609640:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.609662:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592119424 00000100:00100000:0.0:1746143687.609669:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592119424 00010000:00010000:0.0:1746143687.609698:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bde00/0xe984082ccd724d78 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fc7 expref: 265 pid: 21713 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746143687.609723:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4743 00000100:00100000:0.0:1746143687.609730:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:1964:x1830963592119424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143687.609743:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143687.609748:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bde00/0xe984082ccd724d78 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fc7 expref: 265 pid: 21713 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746143687.609758:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bde00/0xe984082ccd724d78 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fc7 expref: 265 pid: 21713 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746143687.609781:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:0.0:1746143687.609785:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.609794:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.609800:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.609813:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143687.609847:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:1964:x1830963592119424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 118us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143687.609852:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4743 00000100:00100000:0.0:1746143687.609951:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593681792:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143687.609969:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351bd000/0xe984082ccd724dc5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ff8 expref: 39 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.609979:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351bd000/0xe984082ccd724dc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ff8 expref: 39 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.609988:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bd000, rc 0) 00000100:00100000:0.0:1746143687.610008:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963592119040:12345-192.168.202.48@tcp:101:cat.0 Request processed in 13556us (14053us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143687.610015:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9284 00010000:00010000:0.0:1746143687.610061:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bde00/0xe984082ccd724d78 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fc7 expref: 264 pid: 21713 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746143687.610075:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593681664:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143687.610085:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.610091:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.610095:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143687.610110:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143687.614171:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd400/0xe984082ccd724db0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ff1 expref: 28 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.614188:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ff1 expref: 27 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.614196:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:0.0:1746143687.614198:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143687.614201:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bc000, rc 0) 00000100:00100000:0.0:1746143687.614246:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+27:28237:x1830963592118912:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 18165us (18349us total) trans 8589942311 rc 0/0 00000100:00100000:0.0:1746143687.614253:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8219 00000100:00100000:0.0:1746143687.614589:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592119296:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17988us (18569us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143687.614596:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3344 00002000:00100000:0.0:1746143687.614604:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800930ded80 x1830963592119296/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.614613:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ded80 with x1830963592119296 ext(3145728->4194303) 00002000:00010000:0.0:1746143687.614617:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930ded80 00000100:00100000:2.0:1746143687.637758:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.637782:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.637804:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.637869:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592119680 00000100:00100000:0.0:1746143687.637877:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592119680 00000100:00100000:0.0:1746143687.637921:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9285 00000100:00100000:0.0:1746143687.637927:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+29:28237:x1830963592119680:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143687.637941:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143687.638066:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592119808 00000100:00100000:1.0:1746143687.638070:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592119808 00002000:00100000:1.0:1746143687.638093:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009c3f9880 x1830963592119808/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.638102:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830963592119808 ext(4194304->4898815) 00002000:00010000:1.0:1746143687.638106:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9880 00000100:00100000:1.0:1746143687.638126:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592120064 00000100:00100000:1.0:1746143687.638129:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592120064 00002000:00100000:1.0:1746143687.638151:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009c3f8e00 x1830963592120064/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.638157:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8e00 with x1830963592120064 ext(2097152->3145727) 00000100:00100000:2.0:1746143687.638159:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3345 00002000:00010000:1.0:1746143687.638160:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f8e00 00000100:00100000:2.0:1746143687.638165:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592119808:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143687.638170:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3346 00000100:00100000:1.0:1746143687.638174:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1963:x1830963592120064:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:0.0:1746143687.638343:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a0fff expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.638365:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74400/0xe984082ccd724be9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ecb expref: 37 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.638372:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130296c00/0xe984082ccd724cc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f42 expref: 10 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.638379:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xe984082ccd724c2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee7 expref: 30 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.638384:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143687.638385:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143687.638388:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [1949696->2097151] (req 1949696->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.638409:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xe984082ccd724c2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee7 expref: 30 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.638422:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xe984082ccd724c2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee7 expref: 30 pid: 8497 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746143687.638431:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593681920:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143687.638491:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130296c00/0xe984082ccd724cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f42 expref: 10 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.638498:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130296c00/0xe984082ccd724cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f42 expref: 10 pid: 9527 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746143687.638504:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593682048:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143687.638521:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74400/0xe984082ccd724be9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ecb expref: 37 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.638527:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74400/0xe984082ccd724be9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ecb expref: 37 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746143687.638533:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593682176:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143687.638544:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143687.648154:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.648174:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.648188:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.648864:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592120320 00000100:00100000:3.0:1746143687.648871:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592120320 00010000:00010000:3.0:1746143687.648910:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74400/0xe984082ccd724be9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ecb expref: 38 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746143687.648932:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592120192 00000100:00100000:3.0:1746143687.648935:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592120192 00010000:00010000:3.0:1746143687.648944:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130296c00/0xe984082ccd724cc2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f42 expref: 11 pid: 9527 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746143687.648955:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592120448 00000100:00100000:3.0:1746143687.648957:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592120448 00010000:00010000:3.0:1746143687.648964:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xe984082ccd724c2f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee7 expref: 31 pid: 8497 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746143687.648977:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4744 00000100:00100000:3.0:1746143687.648983:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963592120320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.648993:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143687.649011:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74400/0xe984082ccd724be9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ecb expref: 38 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.649020:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74400/0xe984082ccd724be9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ecb expref: 38 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.649039:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143687.649071:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963592120320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 88us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.649077:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4744 00000100:00100000:3.0:1746143687.649096:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4745 00000100:00100000:3.0:1746143687.649100:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592120192:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.649105:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143687.649111:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130296c00/0xe984082ccd724cc2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f42 expref: 11 pid: 9527 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746143687.649118:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130296c00/0xe984082ccd724cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f42 expref: 11 pid: 9527 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746143687.649127:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143687.649155:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592120192:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 37us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.649160:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4745 00000100:00100000:3.0:1746143687.649169:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4746 00000100:00100000:3.0:1746143687.649174:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1962:x1830963592120448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.649179:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143687.649185:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xe984082ccd724c2f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee7 expref: 31 pid: 8497 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746143687.649193:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xe984082ccd724c2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee7 expref: 31 pid: 8497 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746143687.649203:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143687.649205:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143687.649211:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143687.649219:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143687.649242:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143687.649253:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593682304:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143687.649289:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a58230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143687.650360:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592119808:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12192us (12574us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143687.650367:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3345 00002000:00100000:2.0:1746143687.650375:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009c3f9880 x1830963592119808/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 704512/704512 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.650384:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830963592119808 ext(4194304->4898815) 00002000:00010000:2.0:1746143687.650388:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9880 00010000:00010000:0.0:1746143687.650653:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01c9e00/0xe984082ccd724c2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee7 expref: 31 pid: 8497 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746143687.650666:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593681920:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143687.650678:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130296c00/0xe984082ccd724cc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f42 expref: 10 pid: 9527 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746143687.650686:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593682048:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143687.650696:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a74400/0xe984082ccd724be9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ecb expref: 37 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746143687.650703:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593682176:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143687.650721:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.650730:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21fd000, rc 0) 00000100:00100000:0.0:1746143687.650750:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+30:28237:x1830963592119680:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 12823us (12998us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143687.650756:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9285 00000001:00080000:3.0:1746143687.651176:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839656 is committed 00000001:00080000:3.0:1746143687.651186:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839650 is committed 00000001:00080000:3.0:1746143687.651193:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839619 is committed 00000001:00080000:3.0:1746143687.651203:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839654 is committed 00000001:00080000:3.0:1746143687.651221:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839659 is committed 00000001:00080000:3.0:1746143687.651232:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839651 is committed 00000001:00080000:3.0:1746143687.651273:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839658 is committed 00000001:00080000:3.0:1746143687.651298:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839635 is committed 00000100:00100000:1.0:1746143687.665045:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593682304:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143687.665059:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143687.665091:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1962:x1830963592120448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 15916us (16901us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143687.665099:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4746 00000100:00100000:1.0:1746143687.665521:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1963:x1830963592120064:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27345us (27714us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143687.665530:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3346 00002000:00100000:1.0:1746143687.665538:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009c3f8e00 x1830963592120064/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.665547:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8e00 with x1830963592120064 ext(2097152->3145727) 00002000:00010000:1.0:1746143687.665551:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f8e00 00000100:00100000:0.0:1746143687.666390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.666404:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592120704 00000100:00100000:0.0:1746143687.666408:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592120704 00002000:00100000:0.0:1746143687.666432:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1949696->1953791) req@ffff8800930dd180 x1830963592120704/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.666438:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd180 with x1830963592120704 ext(1949696->1953791) 00002000:00010000:0.0:1746143687.666441:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930dd180 00000100:00100000:0.0:1746143687.666454:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3347 00000100:00100000:0.0:1746143687.666459:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963592120704:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143687.666558:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963592120704:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 99us (170us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143687.666563:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3347 00002000:00100000:0.0:1746143687.666568:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1949696->1953791) req@ffff8800930dd180 x1830963592120704/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/4536 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.666574:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd180 with x1830963592120704 ext(1949696->1953791) 00002000:00010000:0.0:1746143687.666577:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930dd180 00000100:00100000:0.0:1746143687.717630:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.717655:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.717677:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.717698:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592120960 00000100:00100000:0.0:1746143687.717704:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592120960 00000100:00100000:0.0:1746143687.717738:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8220 00000100:00100000:0.0:1746143687.717744:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:28239:x1830963592120960:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143687.717763:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.717776:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804600/0xe984082ccd724dda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1006 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.717854:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805800/0xe984082ccd724de1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.717866:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805800/0xe984082ccd724de1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143687.717874:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805800/0xe984082ccd724de1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143687.717883:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143687.717979:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804600/0xe984082ccd724dda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1006 expref: 267 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.717994:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805800/0xe984082ccd724de1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1006 expref: 266 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.718002:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:0.0:1746143687.718004:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143687.718006:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5805800, rc 0) 00000100:00100000:0.0:1746143687.718042:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:28239:x1830963592120960:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 297us (417us total) trans 8589942312 rc 0/0 00000100:00100000:0.0:1746143687.718047:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8220 00000100:00100000:0.0:1746143687.718066:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592121088 00000100:00100000:0.0:1746143687.718069:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592121088 00000100:00100000:0.0:1746143687.718083:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592121216 00000100:00100000:0.0:1746143687.718085:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592121216 00000100:00100000:0.0:1746143687.718096:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9286 00000100:00100000:0.0:1746143687.718100:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28237:x1830963592121088:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143687.718108:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.718116:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a100d expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.718132:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a08a8e00/0xe984082ccd724bf0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed2 expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.718157:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd724cde lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f49 expref: 6 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.718167:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a62df400/0xe984082ccd724c3d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eee expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.718173:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143687.718174:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143687.718177:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [1048576->1134591] (req 1048576->1134591) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.718201:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a62df400/0xe984082ccd724c3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eee expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.718210:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a62df400/0xe984082ccd724c3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eee expref: 10 pid: 25369 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746143687.718220:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095098e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593682432:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143687.718270:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd724cde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f49 expref: 6 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.718278:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd724cde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f49 expref: 6 pid: 8496 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746143687.718285:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095098700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593682560:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143687.718305:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a08a8e00/0xe984082ccd724bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed2 expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.718316:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a08a8e00/0xe984082ccd724bf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed2 expref: 15 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746143687.718323:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593682688:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143687.718336:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.718351:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9287 00000100:00100000:0.0:1746143687.718356:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:28235:x1830963592121216:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143687.718362:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.718367:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd724df6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1014 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.718379:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 10 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.718384:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143687.718385:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143687.718388:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd724df6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1014 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.718399:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 10 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.718406:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 10 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746143687.718418:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095099180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593682816:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143687.718433:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143687.726304:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.726377:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592121344 00000100:00100000:1.0:1746143687.726385:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592121344 00010000:00010000:1.0:1746143687.726413:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a62df400/0xe984082ccd724c3d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eee expref: 11 pid: 25369 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746143687.726436:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4747 00000100:00100000:1.0:1746143687.726442:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592121344:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143687.726451:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143687.726470:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a62df400/0xe984082ccd724c3d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eee expref: 11 pid: 25369 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746143687.726479:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a62df400/0xe984082ccd724c3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eee expref: 11 pid: 25369 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746143687.726500:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143687.726533:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592121344:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143687.726539:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4747 00010000:00010000:0.0:1746143687.727059:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a62df400/0xe984082ccd724c3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0eee expref: 10 pid: 25369 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746143687.727073:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095098e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593682432:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143687.733066:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.733082:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.733104:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.733123:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592121728 00000100:00100000:0.0:1746143687.733129:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592121728 00002000:00100000:0.0:1746143687.733179:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2883584->3145727) req@ffff88009509a680 x1830963592121728/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.733188:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509a680 with x1830963592121728 ext(2883584->3145727) 00010000:00010000:0.0:1746143687.733196:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 10 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746143687.733207:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 10 pid: 4581 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746143687.733213:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009509a680 00000100:00100000:0.0:1746143687.733229:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 803 00000100:00100000:0.0:1746143687.733236:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963592121728:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143687.734355:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592121472 00000100:00100000:0.0:1746143687.734359:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592121472 00010000:00010000:0.0:1746143687.734377:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd724cde lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f49 expref: 7 pid: 8496 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746143687.734392:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592121600 00000100:00100000:0.0:1746143687.734394:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592121600 00010000:00010000:0.0:1746143687.734401:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a08a8e00/0xe984082ccd724bf0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed2 expref: 17 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746143687.734413:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4748 00000100:00100000:0.0:1746143687.734417:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963592121472:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143687.734425:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143687.734438:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd724cde lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f49 expref: 7 pid: 8496 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746143687.734447:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd724cde lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f49 expref: 7 pid: 8496 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746143687.734464:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143687.734480:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963592121472:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 63us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143687.734486:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4748 00000100:00100000:0.0:1746143687.734497:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4749 00000100:00100000:0.0:1746143687.734501:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963592121600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143687.734507:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143687.734512:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a08a8e00/0xe984082ccd724bf0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed2 expref: 17 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746143687.734524:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a08a8e00/0xe984082ccd724bf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed2 expref: 17 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746143687.734533:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143687.734535:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143687.734540:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 11 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.734547:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 11 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.734570:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 11 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143687.734579:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593682944:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143687.734621:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.734724:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095099180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593682816:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143687.734739:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd724df6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1014 expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.734748:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e3ae00, rc 0) 00000100:00100000:0.0:1746143687.734767:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:28235:x1830963592121216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 16411us (17090us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143687.734773:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9287 00010000:00010000:0.0:1746143687.734817:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd724cde lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f49 expref: 6 pid: 8496 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746143687.734827:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095098700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593682560:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143687.734835:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a08a8e00/0xe984082ccd724bf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ed2 expref: 16 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746143687.734842:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009509b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593682688:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143687.734858:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 11 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.734864:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5804400, rc 0) 00000100:00100000:0.0:1746143687.734880:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28237:x1830963592121088:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 16779us (17224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143687.734886:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9286 00000100:00100000:0.0:1746143687.740571:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009509a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593682944:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143687.740588:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143687.740623:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1963:x1830963592121600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6119us (7517us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143687.740634:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4749 00000100:00100000:0.0:1746143687.748222:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.748246:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592121984 00000100:00100000:0.0:1746143687.748253:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592121984 00002000:00100000:0.0:1746143687.748286:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1130496->1134591) req@ffff88009509a300 x1830963592121984/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.748294:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509a300 with x1830963592121984 ext(1130496->1134591) 00002000:00010000:0.0:1746143687.748299:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009509a300 00000100:00100000:0.0:1746143687.748313:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3348 00000100:00100000:0.0:1746143687.748319:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592121984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143687.748455:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592121984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 135us (239us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143687.748460:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3348 00002000:00100000:0.0:1746143687.748464:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1130496->1134591) req@ffff88009509a300 x1830963592121984/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/4536 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.748469:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509a300 with x1830963592121984 ext(1130496->1134591) 00002000:00010000:0.0:1746143687.748472:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009509a300 00000100:00100000:0.0:1746143687.749050:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592121728:12345-192.168.202.48@tcp:4:cat.0 Request processed in 15812us (15964us total) trans 21474839660 rc 0/0 00000100:00100000:0.0:1746143687.749056:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 803 00002000:00100000:0.0:1746143687.749061:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2883584->3145727) req@ffff88009509a680 x1830963592121728/t21474839660(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/448 e 0 to 0 dl 1746143698 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.749068:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509a680 with x1830963592121728 ext(2883584->3145727) 00010000:00010000:0.0:1746143687.749074:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 11 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746143687.749085:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 11 pid: 4581 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746143687.749091:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009509a680 00000100:00100000:1.0:1746143687.762784:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.762858:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.762879:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592122112 00000100:00100000:1.0:1746143687.762885:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592122112 00010000:00010000:1.0:1746143687.762922:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 11 pid: 4581 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746143687.762944:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4750 00000100:00100000:1.0:1746143687.762952:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592122112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143687.762962:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143687.762979:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 11 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746143687.762989:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 11 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746143687.763006:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351bc800/0xe984082ccd724cc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f3b expref: 11 pid: 4581 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746143687.763018:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143687.763020:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143687.763026:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd724df6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1014 expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.763032:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd724df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1014 expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.763057:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd724df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1014 expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143687.763072:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593683072:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143687.763124:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143687.763137:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592122240 00000100:00100000:1.0:1746143687.763155:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592122240 00000100:00100000:1.0:1746143687.766918:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9288 00000100:00100000:1.0:1746143687.766931:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:28239:x1830963592122240:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143687.766944:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.766958:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a101b expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.766980:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.766986:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143687.766988:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143687.766990:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1179648->1650687] (req 1179648->1650687) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.767014:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.767025:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 10 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746143687.767034:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593683200:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143687.767108:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.769706:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593683200:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143687.769735:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1179648->1650687] (req 1179648->1650687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.769750:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b103200, rc 0) 00000100:00100000:1.0:1746143687.770203:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593683072:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143687.770213:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143687.770239:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963592122112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7287us (7459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143687.770249:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4750 00000100:00100000:0.0:1746143687.771592:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:28239:x1830963592122240:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4662us (8731us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143687.771599:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9288 00000100:00100000:1.0:1746143687.773841:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.774158:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592122368 00000100:00100000:0.0:1746143687.774165:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592122368 00002000:00100000:0.0:1746143687.774197:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1134591) req@ffff88008f4ef100 x1830963592122368/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.774206:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ef100 with x1830963592122368 ext(1048576->1134591) 00010000:00010000:0.0:1746143687.774214:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 10 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746143687.774225:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 10 pid: 12618 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746143687.774231:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f4ef100 00000100:00100000:0.0:1746143687.774248:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 804 00000100:00100000:0.0:1746143687.774254:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592122368:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143687.774418:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.774441:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.775574:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592122624 00000100:00100000:0.0:1746143687.775578:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592122624 00002000:00100000:0.0:1746143687.775599:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f4edc00 x1830963592122624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.775611:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4edc00 with x1830963592122624 ext(2097152->3145727) 00002000:00010000:0.0:1746143687.775614:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4edc00 00000100:00100000:0.0:1746143687.775637:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592122880 00000100:00100000:0.0:1746143687.775639:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592122880 00002000:00100000:0.0:1746143687.775651:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f4ed180 x1830963592122880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.775657:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ed180 with x1830963592122880 ext(3145728->4194303) 00002000:00010000:0.0:1746143687.775659:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ed180 00000100:00100000:0.0:1746143687.775670:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3349 00000100:00100000:0.0:1746143687.775675:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963592122624:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143687.776022:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3350 00000100:00100000:3.0:1746143687.776029:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963592122880:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143687.776232:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.776855:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592123136 00000100:00100000:0.0:1746143687.776859:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592123136 00002000:00100000:0.0:1746143687.776877:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f4eea00 x1830963592123136/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.776884:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4eea00 with x1830963592123136 ext(3145728->4194303) 00002000:00010000:0.0:1746143687.776887:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4eea00 00000100:00100000:0.0:1746143687.778030:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3351 00000100:00100000:0.0:1746143687.778036:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1962:x1830963592123136:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143687.784844:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592122368:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10582us (10999us total) trans 21474839661 rc 0/0 00000100:00100000:1.0:1746143687.784854:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 804 00002000:00100000:1.0:1746143687.784865:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1134591) req@ffff88008f4ef100 x1830963592122368/t21474839661(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/448 e 0 to 0 dl 1746143698 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.784874:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ef100 with x1830963592122368 ext(1048576->1134591) 00010000:00010000:1.0:1746143687.784883:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 12 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746143687.784896:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 12 pid: 12618 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746143687.784915:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f4ef100 00000100:00100000:1.0:1746143687.794552:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.796214:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592123264 00000100:00100000:2.0:1746143687.796225:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592123264 00010000:00010000:2.0:1746143687.796257:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 12 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746143687.796282:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4751 00000100:00100000:2.0:1746143687.796288:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592123264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143687.796299:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143687.796314:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143686 -> 1746143687 00002000:00010000:2.0:1746143687.796321:0:7150:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143686 -> 1746143687 00010000:00010000:2.0:1746143687.796327:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 12 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.796339:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 12 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.796361:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804400/0xe984082ccd724def lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1134591) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a100d expref: 12 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746143687.796376:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.796377:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143687.796383:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.796390:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.796418:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143687.796429:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593683328:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143687.796506:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143687.797025:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963592122880:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 20995us (22581us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143687.797034:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3350 00002000:00100000:3.0:1746143687.797042:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f4ed180 x1830963592122880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.797057:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ed180 with x1830963592122880 ext(3145728->4194303) 00002000:00010000:3.0:1746143687.797061:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ed180 00000100:00100000:1.0:1746143687.802260:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.802453:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593683328:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143687.802471:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143687.802523:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592123264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6233us (7977us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.802534:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4751 00000100:00100000:3.0:1746143687.802567:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592123520 00000100:00100000:3.0:1746143687.802573:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592123520 00000100:00100000:2.0:1746143687.802693:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1962:x1830963592123136:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 24656us (26460us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143687.802700:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3351 00002000:00100000:2.0:1746143687.802709:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f4eea00 x1830963592123136/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.802719:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4eea00 with x1830963592123136 ext(3145728->4194303) 00002000:00010000:2.0:1746143687.802723:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4eea00 00002000:00100000:3.0:1746143687.802932:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1179648->1183743) req@ffff88008f4ed880 x1830963592123520/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.802941:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ed880 with x1830963592123520 ext(1179648->1183743) 00002000:00010000:3.0:1746143687.802944:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ed880 00000100:00100000:3.0:1746143687.803032:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3352 00000100:00100000:3.0:1746143687.803039:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963592123520:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143687.803789:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963592123520:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 750us (1536us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143687.803795:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3352 00002000:00100000:3.0:1746143687.803800:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1179648->1183743) req@ffff88008f4ed880 x1830963592123520/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/4536 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.803806:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ed880 with x1830963592123520 ext(1179648->1183743) 00002000:00010000:3.0:1746143687.803809:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ed880 00000100:00100000:0.0:1746143687.806706:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963592122624:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 31025us (32283us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143687.806715:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3349 00002000:00100000:0.0:1746143687.806723:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f4edc00 x1830963592122624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.806739:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4edc00 with x1830963592122624 ext(2097152->3145727) 00002000:00010000:0.0:1746143687.806743:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4edc00 00000100:00100000:1.0:1746143687.819505:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.819522:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.819542:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.819561:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592124160 00000100:00100000:1.0:1746143687.819568:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592124160 00000100:00100000:1.0:1746143687.819600:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9289 00000100:00100000:1.0:1746143687.819605:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963592124160:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.819619:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.819634:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8000/0xe984082ccd724e04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1022 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143687.819682:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f4ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593683456:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143687.819740:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.819789:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592123776 00000100:00100000:0.0:1746143687.819792:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592123776 00002000:00100000:0.0:1746143687.819815:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1646592->1650687) req@ffff88008f4ee300 x1830963592123776/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.819824:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ee300 with x1830963592123776 ext(1646592->1650687) 00002000:00010000:0.0:1746143687.819831:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ee300 00000100:00100000:0.0:1746143687.819840:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592124032 00000100:00100000:0.0:1746143687.819842:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592124032 00002000:00100000:0.0:1746143687.819851:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008f4efb80 x1830963592124032/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.819857:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4efb80 with x1830963592124032 ext(4194304->4898815) 00002000:00010000:0.0:1746143687.819860:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4efb80 00000100:00100000:0.0:1746143687.819867:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3353 00000100:00100000:0.0:1746143687.819871:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592123776:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143687.819996:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592123776:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 123us (495us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143687.820001:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3353 00002000:00100000:0.0:1746143687.820006:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1646592->1650687) req@ffff88008f4ee300 x1830963592123776/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/4536 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.820012:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ee300 with x1830963592123776 ext(1646592->1650687) 00002000:00010000:0.0:1746143687.820015:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f4ee300 00000100:00100000:0.0:1746143687.820027:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3354 00000100:00100000:0.0:1746143687.820031:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1963:x1830963592124032:12345-192.168.202.48@tcp:3:multiop.0 00002000:00010000:2.0:1746143687.826813:0:12618:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime: 1746143686 -> 1746143687 00002000:00010000:2.0:1746143687.826818:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143686 -> 1746143687 00002000:00010000:2.0:1746143687.826820:0:12618:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime: 1746143686 -> 1746143687 00000100:00100000:2.0:1746143687.826838:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f4ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593683456:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143687.826864:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8000/0xe984082ccd724e04 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1022 expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.826878:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8000/0xe984082ccd724e04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1022 expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143687.826887:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a71e8000, rc 0) 00000100:00100000:2.0:1746143687.826944:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963592124160:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7337us (7398us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143687.826951:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9289 00000100:00100000:0.0:1746143687.831749:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1963:x1830963592124032:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 11710us (12218us total) trans 0 rc 704512/704512 00000100:00100000:0.0:1746143687.831759:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3354 00002000:00100000:0.0:1746143687.831769:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008f4efb80 x1830963592124032/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 704512/704512 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143687.831777:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4efb80 with x1830963592124032 ext(4194304->4898815) 00002000:00010000:0.0:1746143687.831782:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4efb80 00000100:00100000:2.0:1746143687.837881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.837956:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592124288 00000100:00100000:0.0:1746143687.837964:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592124288 00000100:00100000:0.0:1746143687.838236:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9290 00000100:00100000:0.0:1746143687.838243:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963592124288:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143687.838258:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.838271:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1029 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143687.838310:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593683584:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143687.838364:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143687.839745:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.839769:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000001:00080000:3.0:1746143687.839810:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872394 is committed 00000001:00080000:3.0:1746143687.839823:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872393 is committed 00000001:00080000:3.0:1746143687.839829:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872366 is committed 00000100:00100000:1.0:1746143687.839833:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009509b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593683584:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143687.839852:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e0b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1029 expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.839862:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1029 expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00000001:00080000:3.0:1746143687.839865:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872386 is committed 00010000:00010000:1.0:1746143687.839870:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7c6800, rc 0) 00000001:00080000:3.0:1746143687.839893:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872387 is committed 00000100:00100000:1.0:1746143687.839895:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963592124288:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1653us (2020us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143687.839913:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9290 00000100:00100000:1.0:1746143687.839928:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592124416 00000100:00100000:1.0:1746143687.839932:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592124416 00000001:00080000:3.0:1746143687.839943:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872369 is committed 00000100:00100000:1.0:1746143687.839948:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592124544 00000100:00100000:1.0:1746143687.839949:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592124544 00000100:00100000:1.0:1746143687.839959:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9291 00000100:00100000:1.0:1746143687.839963:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592124416:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.839970:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.839977:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1030 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143687.840017:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9292 00000100:00100000:0.0:1746143687.840023:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592124544:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143687.840029:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143687.840035:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7200/0xe984082ccd724e19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1037 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143687.840055:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143687.840057:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143687.840063:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7200/0xe984082ccd724e19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1037 expref: 14 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.840073:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7200/0xe984082ccd724e19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1037 expref: 14 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143687.840079:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7c7200, rc 0) 00000100:00100000:0.0:1746143687.840095:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592124544:12345-192.168.202.48@tcp:101:cat.0 Request processed in 72us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143687.840100:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9292 00000100:00100000:1.0:1746143687.840242:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593683712:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143687.840462:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.842385:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:1.0:1746143687.842431:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime: 1746143686 -> 1746143687 00000100:00100000:1.0:1746143687.842444:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593683712:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143687.842463:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e12 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1030 expref: 13 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.842472:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1030 expref: 13 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.842480:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1600, rc 0) 00000100:00100000:1.0:1746143687.842503:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592124416:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2540us (2766us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143687.842508:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9291 00000100:00100000:1.0:1746143687.842691:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592124672 00000100:00100000:1.0:1746143687.842696:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592124672 00000100:00100000:1.0:1746143687.843371:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9293 00000100:00100000:1.0:1746143687.843377:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963592124672:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.843389:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.843398:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e0000/0xe984082ccd724e20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a103e expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143687.843429:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593683840:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143687.843483:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143687.845692:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593683840:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143687.845720:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957e0000/0xe984082ccd724e20 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a103e expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.845731:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957e0000/0xe984082ccd724e20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a103e expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143687.845739:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0000, rc 0) 00000100:00100000:1.0:1746143687.845882:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963592124672:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2503us (3499us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143687.845889:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9293 00000100:00100000:0.0:1746143687.851806:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.851888:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592124928 00000100:00100000:2.0:1746143687.851907:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592124928 00002000:00100000:2.0:1746143687.851948:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1949695) req@ffff880095098e00 x1830963592124928/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.851957:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098e00 with x1830963592124928 ext(1048576->1949695) 00002000:00010000:2.0:1746143687.851962:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095098e00 00000100:00100000:2.0:1746143687.851992:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3355 00000100:00100000:2.0:1746143687.851999:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592124928:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143687.866970:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592124928:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14960us (15161us total) trans 0 rc 901120/901120 00000100:00100000:2.0:1746143687.866981:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3355 00002000:00100000:2.0:1746143687.866991:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1949695) req@ffff880095098e00 x1830963592124928/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 901120/901120 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143687.867000:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098e00 with x1830963592124928 ext(1048576->1949695) 00002000:00010000:2.0:1746143687.867005:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095098e00 00000100:00100000:0.0:1746143687.877767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.877872:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592125056 00000100:00100000:1.0:1746143687.877881:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592125056 00000100:00100000:1.0:1746143687.877949:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9294 00000100:00100000:1.0:1746143687.877957:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28245:x1830963592125056:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143687.877974:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143687.877990:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1045 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.878018:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 15 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.878025:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143687.878026:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143687.878029:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e27 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1045 expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.878053:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 15 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143687.878063:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 15 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746143687.878073:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593683968:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143687.878186:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143687.880579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143687.880647:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592125184 00000100:00100000:2.0:1746143687.880654:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592125184 00002000:00100000:2.0:1746143687.880688:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1179648->1650687) req@ffff880095099c00 x1830963592125184/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143687.880692:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593683968:192.168.202.48@tcp:104: 00002000:00100000:2.0:1746143687.880698:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099c00 with x1830963592125184 ext(1179648->1650687) 00010000:00010000:2.0:1746143687.880705:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 16 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746143687.880713:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e27 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1045 expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143687.880715:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 16 pid: 12618 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746143687.880721:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095099c00 00010000:00010000:1.0:1746143687.880725:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1600, rc 0) 00000100:00100000:1.0:1746143687.880769:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28245:x1830963592125056:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2813us (3012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143687.880775:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9294 00000100:00100000:2.0:1746143687.881354:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 805 00000100:00100000:2.0:1746143687.881362:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963592125184:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143687.900952:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963592125184:12345-192.168.202.48@tcp:4:cat.0 Request processed in 19576us (20364us total) trans 21474839662 rc 0/0 00000100:00100000:3.0:1746143687.900967:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 805 00002000:00100000:3.0:1746143687.900983:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1179648->1650687) req@ffff880095099c00 x1830963592125184/t21474839662(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:83/0 lens 488/448 e 0 to 0 dl 1746143698 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.900992:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099c00 with x1830963592125184 ext(1179648->1650687) 00010000:00010000:3.0:1746143687.901004:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 18 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.901020:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 18 pid: 12618 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746143687.901027:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095099c00 00000100:00100000:0.0:1746143687.905093:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.905261:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592125312 00000100:00100000:3.0:1746143687.905269:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592125312 00010000:00010000:3.0:1746143687.905298:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 18 pid: 12618 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746143687.905329:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4752 00000100:00100000:3.0:1746143687.905335:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963592125312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143687.905346:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143687.905363:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 18 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.905373:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 18 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.905390:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b103200/0xe984082ccd724dfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1179648->1650687) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a101b expref: 18 pid: 12618 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746143687.905406:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143687.905407:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143687.905413:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1045 expref: 12 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143687.905419:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1045 expref: 12 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143687.905443:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1045 expref: 12 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143687.905451:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593684096:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143687.905663:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5823f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143687.909301:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593684096:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143687.909321:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143687.909356:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963592125312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4019us (4269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143687.909365:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4752 00000100:00100000:0.0:1746143687.910559:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143687.910624:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592125568 00000100:00100000:3.0:1746143687.910632:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592125568 00002000:00100000:3.0:1746143687.910669:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880095099880 x1830963592125568/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.910677:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099880 with x1830963592125568 ext(1048576->2097151) 00002000:00010000:3.0:1746143687.910682:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095099880 00000100:00100000:3.0:1746143687.910697:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3356 00000100:00100000:3.0:1746143687.910702:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592125568:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143687.922220:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592125568:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11507us (11654us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143687.922231:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3356 00002000:00100000:3.0:1746143687.922241:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880095099880 x1830963592125568/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.922249:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099880 with x1830963592125568 ext(1048576->2097151) 00002000:00010000:3.0:1746143687.922254:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095099880 00000100:00100000:0.0:1746143687.940223:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143687.940265:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143687.940477:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592125824 00000100:00100000:1.0:1746143687.940485:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592125824 00002000:00100000:1.0:1746143687.940521:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009509ad80 x1830963592125824/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.940535:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509ad80 with x1830963592125824 ext(2097152->3145727) 00002000:00010000:1.0:1746143687.940539:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009509ad80 00000100:00100000:1.0:1746143687.940760:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592125952 00000100:00100000:1.0:1746143687.940764:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592125952 00002000:00100000:1.0:1746143687.940777:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880095098a80 x1830963592125952/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/0 e 0 to 0 dl 1746143698 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.940783:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098a80 with x1830963592125952 ext(3145728->4194303) 00002000:00010000:1.0:1746143687.940785:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095098a80 00000100:00100000:1.0:1746143687.940850:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3357 00000100:00100000:1.0:1746143687.940857:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592125824:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143687.945515:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3358 00000100:00100000:2.0:1746143687.945528:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592125952:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143687.965074:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592125824:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24209us (24848us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143687.965084:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3357 00002000:00100000:1.0:1746143687.965095:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009509ad80 x1830963592125824/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143687.965103:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509ad80 with x1830963592125824 ext(2097152->3145727) 00002000:00010000:1.0:1746143687.965108:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009509ad80 00000100:00100000:3.0:1746143687.990546:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592125952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 45013us (50271us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143687.990556:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3358 00002000:00100000:3.0:1746143687.990566:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880095098a80 x1830963592125952/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:83/0 lens 488/440 e 0 to 0 dl 1746143698 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143687.990576:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098a80 with x1830963592125952 ext(3145728->4194303) 00002000:00010000:3.0:1746143687.990581:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095098a80 00000100:00100000:2.0:1746143688.008305:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.008456:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592126208 00000100:00100000:1.0:1746143688.008464:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592126208 00000100:00100000:1.0:1746143688.008511:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9295 00000100:00100000:1.0:1746143688.008517:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28249:x1830963592126208:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143688.008533:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.008548:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a104c expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.008572:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724d94 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fdc expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.008580:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351bc200/0xe984082ccd724dbe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fea expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.008586:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc21e00/0xe984082ccd724d47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fab expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.008591:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143688.008593:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143688.008596:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3051520->3145727] (req 3051520->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.008621:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc21e00/0xe984082ccd724d47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fab expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.008631:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc21e00/0xe984082ccd724d47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fab expref: 10 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746143688.008641:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593684224:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143688.008740:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351bc200/0xe984082ccd724dbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fea expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.008747:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351bc200/0xe984082ccd724dbe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fea expref: 19 pid: 12618 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746143688.008760:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593684352:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143688.008791:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724d94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fdc expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.008797:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724d94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fdc expref: 10 pid: 8497 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746143688.008803:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593684480:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143688.008818:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143688.013068:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.013116:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.013229:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592126464 00000100:00100000:1.0:1746143688.013237:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592126464 00000100:00100000:1.0:1746143688.013563:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592126336 00000100:00100000:1.0:1746143688.013566:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592126336 00000100:00100000:2.0:1746143688.013571:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9296 00000100:00100000:2.0:1746143688.013580:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592126464:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143688.013595:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143688.013610:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd724e35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a105a expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.013628:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.013630:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.013637:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd724e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a105a expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.013650:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd724e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a105a expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.013660:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d520200, rc 0) 00000100:00100000:1.0:1746143688.013721:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9297 00000100:00100000:1.0:1746143688.013726:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592126336:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143688.013732:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.013739:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd724e3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1053 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143688.013854:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593684608:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143688.013887:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592126464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 306us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.013893:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9296 00000100:00100000:1.0:1746143688.014613:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143688.016460:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593684224:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143688.016470:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593684352:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143688.016478:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593684480:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143688.016503:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3051520->3145727] (req 3051520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.016517:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7c7800, rc 0) 00000100:00100000:1.0:1746143688.016549:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28249:x1830963592126208:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8031us (8251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.016556:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9295 00000100:00100000:1.0:1746143688.017414:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593684608:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143688.017434:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd724e3c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1053 expref: 19 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.017443:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd724e3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1053 expref: 19 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.017471:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7c7a00, rc 0) 00000100:00100000:1.0:1746143688.019313:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963592126336:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5579us (6189us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143688.019323:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9297 00000100:00100000:0.0:1746143688.026067:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.026159:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592126720 00000100:00100000:3.0:1746143688.026167:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592126720 00000100:00100000:0.0:1746143688.026181:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.026251:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592126592 00000100:00100000:1.0:1746143688.026256:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592126592 00010000:00010000:1.0:1746143688.026284:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc21e00/0xe984082ccd724d47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fab expref: 10 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746143688.026308:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4753 00000100:00100000:1.0:1746143688.026314:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963592126592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143688.026331:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143688.026334:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724d94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fdc expref: 11 pid: 8497 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746143688.026350:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fc21e00/0xe984082ccd724d47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fab expref: 11 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746143688.026357:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4754 00010000:00010000:1.0:1746143688.026361:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fc21e00/0xe984082ccd724d47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fab expref: 11 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746143688.026363:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592126720:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143688.026370:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143688.026381:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc21e00/0xe984082ccd724d47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fab expref: 11 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.026385:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724d94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fdc expref: 11 pid: 8497 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.026393:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724d94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fdc expref: 10 pid: 8497 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.026490:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b102c00/0xe984082ccd724d94 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fdc expref: 10 pid: 8497 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746143688.026539:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143688.026574:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963592126592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 259us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.026580:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4753 00010000:00010000:3.0:1746143688.026618:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143688.026636:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1964:x1830963592126720:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 273us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.026642:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4754 00000100:00100000:0.0:1746143688.029798:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.029990:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592126848 00000100:00100000:3.0:1746143688.029996:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592126848 00010000:00010000:3.0:1746143688.030023:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351bc200/0xe984082ccd724dbe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fea expref: 20 pid: 12618 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746143688.030056:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4755 00000100:00100000:3.0:1746143688.030064:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963592126848:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143688.030074:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143688.030091:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801351bc200/0xe984082ccd724dbe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fea expref: 20 pid: 12618 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746143688.030101:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801351bc200/0xe984082ccd724dbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fea expref: 20 pid: 12618 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746143688.030118:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351bc200/0xe984082ccd724dbe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fea expref: 20 pid: 12618 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746143688.030130:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.030132:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.030246:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 7 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.030256:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 7 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.030283:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 7 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143688.030294:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593684736:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143688.032866:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a58233c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143688.032906:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593684736:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143688.032927:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143688.032961:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963592126848:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2896us (3168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.032971:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4755 00000100:00100000:0.0:1746143688.034213:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.034339:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592127104 00000100:00100000:3.0:1746143688.034345:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592127104 00002000:00100000:3.0:1746143688.034389:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3051520->3055615) req@ffff8800935a0000 x1830963592127104/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.034398:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0000 with x1830963592127104 ext(3051520->3055615) 00002000:00010000:3.0:1746143688.034403:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a0000 00000100:00100000:3.0:1746143688.034428:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3359 00000100:00100000:3.0:1746143688.034435:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1964:x1830963592127104:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143688.035824:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1964:x1830963592127104:12345-192.168.202.48@tcp:3:cat.0 Request processed in 1385us (1611us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143688.035832:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3359 00002000:00100000:3.0:1746143688.035839:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3051520->3055615) req@ffff8800935a0000 x1830963592127104/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/4536 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.035846:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0000 with x1830963592127104 ext(3051520->3055615) 00002000:00010000:3.0:1746143688.035849:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a0000 00000100:00100000:0.0:1746143688.037797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.038014:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592127232 00000100:00100000:1.0:1746143688.038022:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592127232 00000100:00100000:1.0:1746143688.038070:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9298 00000100:00100000:1.0:1746143688.038078:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:28256:x1830963592127232:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143688.038093:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.038107:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1061 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.038133:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 12 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.038165:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143688.038167:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143688.038268:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e43 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1061 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.038297:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 12 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.038308:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 12 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746143688.038319:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593684864:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143688.038834:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143688.040097:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593684864:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143688.040116:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e43 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1061 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.040129:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7c6800, rc 0) 00000100:00100000:1.0:1746143688.040182:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:28256:x1830963592127232:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2103us (2390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.040190:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9298 00000100:00100000:0.0:1746143688.041001:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.041459:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592127360 00000100:00100000:1.0:1746143688.041465:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592127360 00000100:00100000:1.0:1746143688.041799:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9299 00000100:00100000:1.0:1746143688.041807:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28249:x1830963592127360:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143688.041819:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.041830:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1068 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.041852:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd724df6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1014 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.041858:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7200/0xe984082ccd724e19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1037 expref: 14 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.041863:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143688.041864:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143688.041866:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.041885:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7200/0xe984082ccd724e19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1037 expref: 14 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.041894:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7200/0xe984082ccd724e19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1037 expref: 14 pid: 25369 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746143688.041913:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593684992:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143688.041990:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd724df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1014 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.041997:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd724df6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1014 expref: 18 pid: 8497 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746143688.042004:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593685120:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143688.042020:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143688.046117:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.046182:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593684992:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143688.046192:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593685120:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143688.046215:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.046230:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7c7000, rc 0) 00000100:00100000:1.0:1746143688.046266:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28249:x1830963592127360:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4461us (5267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.046273:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9299 00000100:00100000:3.0:1746143688.047518:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592127488 00000100:00100000:3.0:1746143688.047527:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592127488 00002000:00100000:3.0:1746143688.047563:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1949696->2097151) req@ffff8800935a2a00 x1830963592127488/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.047570:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a2a00 with x1830963592127488 ext(1949696->2097151) 00010000:00010000:3.0:1746143688.047577:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 14 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.047586:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 14 pid: 12618 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746143688.047596:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935a2a00 00000100:00100000:3.0:1746143688.047611:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 806 00000100:00100000:3.0:1746143688.047617:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592127488:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143688.047929:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.048006:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.048022:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592127616 00000100:00100000:2.0:1746143688.048025:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592127616 00010000:00010000:2.0:1746143688.048040:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7200/0xe984082ccd724e19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1037 expref: 16 pid: 25369 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746143688.048053:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592127744 00000100:00100000:2.0:1746143688.048055:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592127744 00010000:00010000:2.0:1746143688.048063:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd724df6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1014 expref: 19 pid: 8497 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.048074:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4756 00000100:00100000:2.0:1746143688.048079:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592127616:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.048088:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.048101:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7200/0xe984082ccd724e19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1037 expref: 16 pid: 25369 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746143688.048108:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7200/0xe984082ccd724e19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1037 expref: 16 pid: 25369 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746143688.048125:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7200/0xe984082ccd724e19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1037 expref: 16 pid: 25369 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746143688.048158:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.048181:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1962:x1830963592127616:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 102us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.048187:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4756 00000100:00100000:2.0:1746143688.048200:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4757 00000100:00100000:2.0:1746143688.048204:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963592127744:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.048210:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.048217:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd724df6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1014 expref: 19 pid: 8497 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.048224:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd724df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1014 expref: 19 pid: 8497 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.048235:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd724df6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1014 expref: 19 pid: 8497 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.048246:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.048248:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.048253:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.048260:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.048285:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.048294:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593685248:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143688.048341:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143688.053709:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593685248:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143688.053729:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.053765:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963592127744:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5559us (5757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.053774:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4757 00000100:00100000:0.0:1746143688.055457:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.056444:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592128000 00000100:00100000:1.0:1746143688.056451:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592128000 00002000:00100000:1.0:1746143688.056484:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2629632->2633727) req@ffff8800935a2300 x1830963592128000/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143688.056493:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a2300 with x1830963592128000 ext(2629632->2633727) 00002000:00010000:1.0:1746143688.056497:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a2300 00000100:00100000:1.0:1746143688.056523:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3360 00000100:00100000:1.0:1746143688.056531:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592128000:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143688.057003:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592127488:12345-192.168.202.48@tcp:4:cat.0 Request processed in 9385us (10892us total) trans 21474839663 rc 0/0 00000100:00100000:3.0:1746143688.057011:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 806 00002000:00100000:3.0:1746143688.057016:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1949696->2097151) req@ffff8800935a2a00 x1830963592127488/t21474839663(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/448 e 0 to 0 dl 1746143699 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.057023:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a2a00 with x1830963592127488 ext(1949696->2097151) 00010000:00010000:3.0:1746143688.057029:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 16 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.057041:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 16 pid: 12618 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746143688.057047:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935a2a00 00000100:00100000:1.0:1746143688.057801:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592128000:12345-192.168.202.48@tcp:3:cat.0 Request processed in 1269us (2346us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143688.057807:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3360 00002000:00100000:1.0:1746143688.057813:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2629632->2633727) req@ffff8800935a2300 x1830963592128000/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/4536 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143688.057819:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a2300 with x1830963592128000 ext(2629632->2633727) 00002000:00010000:1.0:1746143688.057823:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a2300 00000100:00100000:0.0:1746143688.066628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.066821:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592128128 00000100:00100000:2.0:1746143688.066830:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592128128 00010000:00010000:2.0:1746143688.066862:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 15 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.066885:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4758 00000100:00100000:2.0:1746143688.066894:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592128128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.066918:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.066938:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 15 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.066948:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 15 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.066966:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fd000/0xe984082ccd724dd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fff expref: 15 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.066998:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.068267:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.068280:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1061 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.068289:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1061 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.068320:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1061 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.068331:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593685376:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143688.068421:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143688.073496:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593685376:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143688.073515:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.073551:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592128128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6658us (6929us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.073919:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4758 00000100:00100000:0.0:1746143688.086649:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.087311:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.087545:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592128384 00000100:00100000:1.0:1746143688.087553:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592128384 00002000:00100000:1.0:1746143688.087592:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800935a3b80 x1830963592128384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143688.087600:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3b80 with x1830963592128384 ext(1048576->2097151) 00002000:00010000:1.0:1746143688.087605:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a3b80 00000100:00100000:1.0:1746143688.087633:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592128640 00000100:00100000:1.0:1746143688.087635:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592128640 00002000:00100000:1.0:1746143688.087646:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800935a1180 x1830963592128640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143688.087652:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a1180 with x1830963592128640 ext(1048576->2097151) 00002000:00010000:1.0:1746143688.087656:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a1180 00000100:00100000:1.0:1746143688.087669:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3361 00000100:00100000:1.0:1746143688.087674:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592128384:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143688.088566:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3362 00000100:00100000:3.0:1746143688.088574:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592128640:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143688.112701:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592128384:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25017us (26050us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143688.113009:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3361 00002000:00100000:2.0:1746143688.113020:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800935a3b80 x1830963592128384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.113029:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3b80 with x1830963592128384 ext(1048576->2097151) 00002000:00010000:2.0:1746143688.113034:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a3b80 00000100:00100000:0.0:1746143688.118625:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.118789:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592128768 00000100:00100000:1.0:1746143688.118797:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592128768 00000100:00100000:1.0:1746143688.118841:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9300 00000100:00100000:1.0:1746143688.118848:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:28252:x1830963592128768:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143688.118862:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.118877:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a106f expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.118909:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 7 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.118920:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143688.118922:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143688.118925:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [4096000->4194303] (req 4096000->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.118950:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 7 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.118961:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 7 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746143688.118971:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593685504:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143688.119044:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143688.119743:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592128640:12345-192.168.202.48@tcp:3:cat.0 Request processed in 31169us (32431us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143688.119751:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3362 00002000:00100000:3.0:1746143688.119759:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800935a1180 x1830963592128640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.119772:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a1180 with x1830963592128640 ext(1048576->2097151) 00002000:00010000:3.0:1746143688.119776:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a1180 00000100:00100000:1.0:1746143688.123826:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593685504:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143688.123852:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [4096000->4194303] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.123867:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7c6600, rc 0) 00000100:00100000:1.0:1746143688.125035:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28252:x1830963592128768:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6183us (6412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.125045:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9300 00000100:00100000:0.0:1746143688.126782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.127114:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592128896 00000100:00100000:3.0:1746143688.127121:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592128896 00002000:00100000:3.0:1746143688.127176:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3051520->3145727) req@ffff8800935a3100 x1830963592128896/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.127184:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3100 with x1830963592128896 ext(3051520->3145727) 00010000:00010000:3.0:1746143688.127192:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 8 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.127202:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 8 pid: 12618 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746143688.127209:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800935a3100 00000100:00100000:3.0:1746143688.129285:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 807 00000100:00100000:3.0:1746143688.129304:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1962:x1830963592128896:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143688.133747:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1962:x1830963592128896:12345-192.168.202.48@tcp:4:cat.0 Request processed in 4443us (6963us total) trans 17179872395 rc 0/0 00000100:00100000:3.0:1746143688.133758:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 807 00002000:00100000:3.0:1746143688.133767:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3051520->3145727) req@ffff8800935a3100 x1830963592128896/t17179872395(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/448 e 0 to 0 dl 1746143699 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.133775:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3100 with x1830963592128896 ext(3051520->3145727) 00010000:00010000:3.0:1746143688.133783:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 10 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.133800:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 10 pid: 12618 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746143688.133806:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800935a3100 00000100:00100000:0.0:1746143688.136108:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.138201:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592129024 00000100:00100000:2.0:1746143688.138213:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592129024 00010000:00010000:2.0:1746143688.138254:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 10 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.138283:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4759 00000100:00100000:2.0:1746143688.138290:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1962:x1830963592129024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.138303:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.138323:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 10 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.138332:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 10 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.138352:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7800/0xe984082ccd724e2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3051520->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a104c expref: 10 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.138381:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.138383:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.138390:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.138396:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.138423:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.138432:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593685632:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143688.138514:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143688.139504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.139679:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592129152 00000100:00100000:0.0:1746143688.139684:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592129152 00000100:00100000:0.0:1746143688.139719:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9301 00000100:00100000:0.0:1746143688.139725:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592129152:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143688.139738:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143688.139749:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd724e58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1076 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143688.139780:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593685760:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143688.139829:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143688.140276:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.140322:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592129280 00000100:00100000:1.0:1746143688.140325:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592129280 00000100:00100000:1.0:1746143688.141308:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9302 00000100:00100000:1.0:1746143688.141317:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963592129280:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143688.141327:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.141339:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6a00/0xe984082ccd724e5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a107d expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143688.141367:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593685888:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143688.141403:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143688.142181:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593685632:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143688.142195:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.142223:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1962:x1830963592129024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3933us (6122us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.142230:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4759 00000100:00100000:0.0:1746143688.143254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.143336:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593685760:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143688.143356:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd724e58 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1076 expref: 21 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.143366:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd724e58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1076 expref: 21 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.143380:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336a200, rc 0) 00000100:00100000:2.0:1746143688.143403:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592129152:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3678us (3901us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143688.143409:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9301 00000100:00100000:3.0:1746143688.143489:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592129536 00000100:00100000:3.0:1746143688.143494:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592129536 00002000:00100000:3.0:1746143688.143521:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4096000->4100095) req@ffff8800935a1c00 x1830963592129536/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.143530:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a1c00 with x1830963592129536 ext(4096000->4100095) 00002000:00010000:3.0:1746143688.143534:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a1c00 00000100:00100000:3.0:1746143688.143546:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3363 00000100:00100000:3.0:1746143688.143551:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963592129536:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143688.144286:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593685888:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143688.144448:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963592129536:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 896us (1196us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143688.144455:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3363 00002000:00100000:3.0:1746143688.144460:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4096000->4100095) req@ffff8800935a1c00 x1830963592129536/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/4536 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.144466:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a1c00 with x1830963592129536 ext(4096000->4100095) 00002000:00010000:3.0:1746143688.144469:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a1c00 00010000:00010000:1.0:1746143688.144736:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6a00/0xe984082ccd724e5f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a107d expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.144749:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6a00/0xe984082ccd724e5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a107d expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.144774:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7c6a00, rc 0) 00000100:00100000:1.0:1746143688.144800:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963592129280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3484us (4523us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143688.144805:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9302 00000100:00100000:0.0:1746143688.151978:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.152202:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.152302:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592129664 00000100:00100000:3.0:1746143688.152310:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592129664 00000100:00100000:3.0:1746143688.152875:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592129792 00000100:00100000:3.0:1746143688.152879:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592129792 00000100:00100000:2.0:1746143688.152991:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9303 00000100:00100000:2.0:1746143688.153000:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592129664:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143688.153017:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143688.153031:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd724e66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1084 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.153049:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.153051:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.153058:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd724e66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1084 expref: 15 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.153071:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd724e66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1084 expref: 15 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.153081:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d520000, rc 0) 00000100:00100000:2.0:1746143688.153133:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592129664:12345-192.168.202.48@tcp:101:cat.0 Request processed in 135us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.153155:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9303 00000100:00100000:2.0:1746143688.153169:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9304 00000100:00100000:2.0:1746143688.153175:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963592129792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143688.153184:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143688.153193:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d520a00/0xe984082ccd724e6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a108b expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.153225:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593686016:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143688.153272:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143688.155230:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.156354:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592129920 00000100:00100000:1.0:1746143688.156362:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592129920 00000100:00100000:1.0:1746143688.156396:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9305 00000100:00100000:1.0:1746143688.156402:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:28252:x1830963592129920:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143688.156417:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.156431:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1092 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.156457:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.156464:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143688.156465:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143688.156468:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->3813375] (req 3145728->3813375) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 19 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.156492:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.156502:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 14 pid: 4581 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746143688.156512:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593686144:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143688.156905:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593686016:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143688.156931:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d520a00/0xe984082ccd724e6d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a108b expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.156941:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d520a00/0xe984082ccd724e6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a108b expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.156958:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d520a00, rc 0) 00000100:00100000:2.0:1746143688.156989:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963592129792:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3814us (4787us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143688.156995:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9304 00000100:00100000:0.0:1746143688.158078:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143688.158089:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593686272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143688.158123:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.158302:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143688.158672:0:8498:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593686272 00000100:00100000:3.0:1746143688.158679:0:8498:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593686272 00000100:00100000:3.0:1746143688.158716:0:8498:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1746143688.158722:0:8498:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1830963593686272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746143688.158738:0:8498:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 312147968 pending 6815744 free 3852468224 avail 3826253824 00000100:00100000:3.0:1746143688.158769:0:8498:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1830963593686272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.158774:0:8498:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:0.0:1746143688.158841:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143688.158999:0:3292:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839651 gen 2 00000004:00080000:1.0:1746143688.159004:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bf0a80, transno 21474839625 00000004:00080000:1.0:1746143688.159018:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0361c00, transno 21474839626 00000004:00080000:1.0:1746143688.159021:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bf1880, transno 21474839627 00000004:00080000:1.0:1746143688.159023:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0360000, transno 21474839628 00000004:00080000:1.0:1746143688.159025:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0362680, transno 21474839629 00000004:00080000:1.0:1746143688.159027:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0362d80, transno 21474839630 00000004:00080000:1.0:1746143688.159030:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0361f80, transno 21474839631 00000004:00080000:1.0:1746143688.159032:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0361880, transno 21474839632 00000004:00080000:1.0:1746143688.159034:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f532300, transno 21474839636 00000004:00080000:1.0:1746143688.159037:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f533b80, transno 21474839637 00000004:00080000:1.0:1746143688.159039:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f530e00, transno 21474839638 00000004:00080000:1.0:1746143688.159041:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f530000, transno 21474839639 00000004:00080000:1.0:1746143688.159043:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f531c00, transno 21474839640 00000004:00080000:1.0:1746143688.159045:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f532a00, transno 21474839641 00000004:00080000:1.0:1746143688.159047:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f531500, transno 21474839642 00000004:00080000:1.0:1746143688.159048:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f532680, transno 21474839643 00000004:00080000:1.0:1746143688.159050:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bf3800, transno 21474839644 00000004:00080000:1.0:1746143688.159052:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bf3480, transno 21474839645 00000004:00080000:1.0:1746143688.159054:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bf2300, transno 21474839646 00000004:00080000:1.0:1746143688.159056:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bf1500, transno 21474839647 00000004:00080000:1.0:1746143688.159058:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f532d80, transno 21474839648 00000004:00080000:1.0:1746143688.159060:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bf0700, transno 21474839649 00000004:00080000:1.0:1746143688.159062:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f9c00, transno 21474839650 00000004:00080000:1.0:1746143688.159064:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bf1c00, transno 21474839651 00000100:00100000:1.0:1746143688.159073:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593686272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746143688.159498:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593686144:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143688.159515:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->3813375] (req 3145728->3813375) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 19 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.159529:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7c6200, rc 0) 00000100:00100000:1.0:1746143688.159556:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:28252:x1830963592129920:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3154us (4332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.159562:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9305 00000004:00080000:3.0:1746143688.159987:0:14800:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 24 done 00000100:00100000:0.0:1746143688.165992:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.167222:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592130048 00000100:00100000:3.0:1746143688.167232:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592130048 00002000:00100000:3.0:1746143688.167271:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2633727) req@ffff8801305cbb80 x1830963592130048/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.167279:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cbb80 with x1830963592130048 ext(2097152->2633727) 00010000:00010000:3.0:1746143688.167287:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 15 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.167299:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 15 pid: 4581 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746143688.167306:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305cbb80 00000100:00100000:3.0:1746143688.167338:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 808 00000100:00100000:3.0:1746143688.167344:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592130048:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143688.169183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.169302:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592130304 00000100:00100000:3.0:1746143688.169307:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592130304 00002000:00100000:3.0:1746143688.169333:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094c0d500 x1830963592130304/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.169346:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d500 with x1830963592130304 ext(2097152->3145727) 00002000:00010000:3.0:1746143688.169349:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0d500 00000100:00100000:3.0:1746143688.169708:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3364 00000100:00100000:3.0:1746143688.169715:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592130304:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143688.171701:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.172427:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592130560 00000100:00100000:2.0:1746143688.172436:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592130560 00002000:00100000:2.0:1746143688.172472:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8801305c8e00 x1830963592130560/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.172481:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8e00 with x1830963592130560 ext(1048576->2097151) 00002000:00010000:2.0:1746143688.172486:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8e00 00000100:00100000:2.0:1746143688.172517:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3365 00000100:00100000:2.0:1746143688.172524:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592130560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143688.173859:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b20e2be-dc58-49ff-81b7-9c0574412294:3294:1830963593686400:0@lo:400:kworker.0 00000100:00100000:2.0:1746143688.173912:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143688.173945:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830963593686912:0@lo:400:kworker.0 00000100:00100000:2.0:1746143688.173964:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143688.173979:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746143688.173984:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1830963593686528:0@lo:400:kworker.0 00000100:00100000:2.0:1746143688.173997:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143688.174013:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593686784:0@lo:400:kworker.0 00000100:00100000:2.0:1746143688.174030:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143688.174041:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746143688.174045:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1830963593686656:0@lo:400:kworker.0 00000100:00100000:2.0:1746143688.174060:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143688.174078:0:14761:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593686400 00000100:00100000:2.0:1746143688.174081:0:14761:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593686400 00000100:00100000:2.0:1746143688.174105:0:14761:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1746143688.174109:0:14761:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3294:x1830963593686400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143688.174136:0:14761:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3294:x1830963593686400:12345-0@lo:400:kworker.0 Request processed in 27us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.174154:0:14761:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1746143688.174184:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b20e2be-dc58-49ff-81b7-9c0574412294:3294:1830963593686400:0@lo:400:kworker.0 00000100:00100000:3.0:1746143688.174260:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593686912 00000100:00100000:3.0:1746143688.174265:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593686912 00000100:00100000:3.0:1746143688.174286:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593686528 00000100:00100000:3.0:1746143688.174287:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593686528 00000100:00100000:3.0:1746143688.174304:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593686656 00000100:00100000:3.0:1746143688.174306:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593686656 00000100:00100000:3.0:1746143688.174317:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1746143688.174322:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830963593686912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143688.174352:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830963593686912:12345-0@lo:400:kworker.0 Request processed in 30us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.174357:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1746143688.174366:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1746143688.174370:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830963593686528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143688.174389:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830963593686528:12345-0@lo:400:kworker.0 Request processed in 18us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.174393:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1746143688.174404:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1746143688.174408:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1830963593686656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143688.174427:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1830963593686656:12345-0@lo:400:kworker.0 Request processed in 19us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.174431:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1746143688.174443:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143688.175123:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593686784 00000100:00100000:1.0:1746143688.175154:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593686784 00000100:00100000:1.0:1746143688.175190:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1746143688.175194:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3293:x1830963593686784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143688.175224:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3293:x1830963593686784:12345-0@lo:400:kworker.0 Request processed in 30us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.175229:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1746143688.177081:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3293:1830963593686656:0@lo:400:kworker.0 00000100:00100000:2.0:1746143688.177093:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872387 gen 2 00000004:00080000:2.0:1746143688.177099:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6df80, transno 17179872358 00000004:00080000:2.0:1746143688.177108:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6c380, transno 17179872359 00000004:00080000:2.0:1746143688.177111:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6c000, transno 17179872360 00000004:00080000:2.0:1746143688.177113:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6f800, transno 17179872361 00000004:00080000:2.0:1746143688.177116:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe3800, transno 17179872362 00000004:00080000:2.0:1746143688.177118:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6e300, transno 17179872363 00000004:00080000:2.0:1746143688.177120:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6c700, transno 17179872364 00000004:00080000:2.0:1746143688.177122:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6f100, transno 17179872365 00000004:00080000:2.0:1746143688.177124:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6dc00, transno 17179872366 00000004:00080000:2.0:1746143688.177126:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe0a80, transno 17179872370 00000004:00080000:2.0:1746143688.177128:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe0380, transno 17179872371 00000004:00080000:2.0:1746143688.177130:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094760e00, transno 17179872372 00000004:00080000:2.0:1746143688.177132:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe3100, transno 17179872373 00000004:00080000:2.0:1746143688.177134:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe1180, transno 17179872374 00000004:00080000:2.0:1746143688.177136:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe1880, transno 17179872375 00000004:00080000:2.0:1746143688.177155:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe0000, transno 17179872376 00000004:00080000:2.0:1746143688.177157:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094763480, transno 17179872377 00000004:00080000:2.0:1746143688.177159:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f185500, transno 17179872378 00000004:00080000:2.0:1746143688.177161:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f185180, transno 17179872379 00000004:00080000:2.0:1746143688.177163:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ae300, transno 17179872380 00000004:00080000:2.0:1746143688.177165:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f184e00, transno 17179872381 00000004:00080000:2.0:1746143688.177166:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0af100, transno 17179872382 00000004:00080000:2.0:1746143688.177168:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0aea00, transno 17179872383 00000004:00080000:2.0:1746143688.177170:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ad180, transno 17179872384 00000004:00080000:2.0:1746143688.177172:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f184380, transno 17179872385 00000004:00080000:2.0:1746143688.177174:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0adc00, transno 17179872386 00000004:00080000:2.0:1746143688.177175:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0afb80, transno 17179872387 00000100:00100000:2.0:1746143688.177179:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593686784:0@lo:400:kworker.0 00000100:00100000:2.0:1746143688.177215:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1830963593686528:0@lo:400:kworker.0 00000100:00100000:2.0:1746143688.177224:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830963593686912:0@lo:400:kworker.0 00000100:00080000:3.0:1746143688.177308:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746143688.179648:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 27 done 00000100:00100000:0.0:1746143688.189563:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143688.189582:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593687040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143688.189638:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143688.190161:0:8499:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593687040 00000100:00100000:2.0:1746143688.190168:0:8499:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593687040 00000100:00100000:2.0:1746143688.190207:0:8499:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1746143688.190213:0:8499:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1830963593687040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746143688.190234:0:8499:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 337444864 pending 1703936 free 3849322496 avail 3829399552 00000100:00100000:2.0:1746143688.190285:0:8499:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1830963593687040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.190291:0:8499:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1746143688.190381:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593687040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746143688.196341:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592130560:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23809us (24637us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143688.196350:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3365 00002000:00100000:2.0:1746143688.196361:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8801305c8e00 x1830963592130560/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.196370:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8e00 with x1830963592130560 ext(1048576->2097151) 00002000:00010000:2.0:1746143688.196375:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8e00 00000100:00100000:2.0:1746143688.198826:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592130304:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29103us (29639us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143688.198835:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3364 00002000:00100000:2.0:1746143688.198845:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094c0d500 x1830963592130304/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.198854:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d500 with x1830963592130304 ext(2097152->3145727) 00002000:00010000:2.0:1746143688.198859:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0d500 00000100:00100000:3.0:1746143688.201477:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592130048:12345-192.168.202.48@tcp:4:cat.0 Request processed in 34127us (35484us total) trans 21474839664 rc 0/0 00000100:00100000:3.0:1746143688.201487:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 808 00002000:00100000:3.0:1746143688.201496:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2633727) req@ffff8801305cbb80 x1830963592130048/t21474839664(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/448 e 0 to 0 dl 1746143699 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.201505:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cbb80 with x1830963592130048 ext(2097152->2633727) 00010000:00010000:3.0:1746143688.201513:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 17 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.201527:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 17 pid: 4581 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746143688.201533:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305cbb80 00000100:00100000:0.0:1746143688.209074:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.209173:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592130688 00000100:00100000:1.0:1746143688.209181:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592130688 00000100:00100000:1.0:1746143688.209233:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9306 00000100:00100000:1.0:1746143688.209240:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28261:x1830963592130688:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143688.209256:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.209271:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093238000/0xe984082ccd724e7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1099 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.209297:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.209304:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143688.209306:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143688.209309:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093238000/0xe984082ccd724e7b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1099 expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.209332:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.209343:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 19 pid: 4581 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746143688.209359:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593687168:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143688.209435:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143688.213516:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593687168:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143688.213542:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093238000/0xe984082ccd724e7b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1099 expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.213626:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093238000, rc 0) 00000100:00100000:1.0:1746143688.214052:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28261:x1830963592130688:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4810us (4983us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.214059:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9306 00000100:00100000:0.0:1746143688.215197:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.215238:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.215312:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592130944 00000100:00100000:2.0:1746143688.215318:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592130944 00010000:00010000:2.0:1746143688.215349:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 17 pid: 4581 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.215369:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4760 00000100:00100000:2.0:1746143688.215375:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592130944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.215385:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.215404:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 17 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.215412:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 17 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.215429:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7000/0xe984082ccd724e4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2633727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1068 expref: 17 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.215443:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.215444:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.215450:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3813375) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.215457:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3813375) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.215479:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3813375) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.215489:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593687296:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143688.215549:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cc840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143688.215739:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592130816 00000100:00100000:3.0:1746143688.215744:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592130816 00002000:00100000:3.0:1746143688.215768:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4096000->4194303) req@ffff8801305c8380 x1830963592130816/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.215776:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8380 with x1830963592130816 ext(4096000->4194303) 00010000:00010000:3.0:1746143688.215781:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 20 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.215790:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 20 pid: 4581 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746143688.215795:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305c8380 00000100:00100000:3.0:1746143688.215999:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 809 00000100:00100000:3.0:1746143688.216005:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592130816:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143688.219860:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593687296:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143688.219879:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143688.219933:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592130944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4556us (4693us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.219943:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4760 00000100:00100000:3.0:1746143688.221018:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592130816:12345-192.168.202.48@tcp:4:cat.0 Request processed in 5011us (5820us total) trans 17179872396 rc 0/0 00000100:00100000:3.0:1746143688.221025:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 809 00002000:00100000:3.0:1746143688.221033:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4096000->4194303) req@ffff8801305c8380 x1830963592130816/t17179872396(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/448 e 0 to 0 dl 1746143699 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.221041:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8380 with x1830963592130816 ext(4096000->4194303) 00010000:00010000:3.0:1746143688.221049:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 22 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.221061:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 22 pid: 4581 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746143688.221066:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305c8380 00000100:00100000:0.0:1746143688.222091:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.222172:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592131200 00000100:00100000:3.0:1746143688.222179:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592131200 00002000:00100000:3.0:1746143688.222208:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3809280->3813375) req@ffff8801305ca680 x1830963592131200/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.222216:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305ca680 with x1830963592131200 ext(3809280->3813375) 00002000:00010000:3.0:1746143688.222220:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305ca680 00000100:00100000:3.0:1746143688.222762:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3366 00000100:00100000:3.0:1746143688.222770:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963592131200:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143688.224005:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963592131200:12345-192.168.202.48@tcp:3:cat.0 Request processed in 1232us (1913us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143688.224013:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3366 00002000:00100000:3.0:1746143688.224020:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3809280->3813375) req@ffff8801305ca680 x1830963592131200/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/4536 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.224027:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305ca680 with x1830963592131200 ext(3809280->3813375) 00002000:00010000:3.0:1746143688.224031:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305ca680 00000100:00100000:0.0:1746143688.240114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.240192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.240720:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592131456 00000100:00100000:2.0:1746143688.240728:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592131456 00002000:00100000:2.0:1746143688.240770:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8801305c9180 x1830963592131456/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.240777:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9180 with x1830963592131456 ext(2097152->3145727) 00002000:00010000:2.0:1746143688.240783:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c9180 00000100:00100000:2.0:1746143688.240809:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592131712 00000100:00100000:2.0:1746143688.240812:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592131712 00002000:00100000:2.0:1746143688.240824:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4095999) req@ffff8801305cb100 x1830963592131712/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.240830:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cb100 with x1830963592131712 ext(3145728->4095999) 00010000:00010000:2.0:1746143688.240836:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 22 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.240847:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 22 pid: 4581 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746143688.240852:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305cb100 00000100:00100000:2.0:1746143688.240870:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 810 00000100:00100000:2.0:1746143688.240877:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592131712:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143688.241628:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3367 00000100:00100000:3.0:1746143688.241638:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592131456:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143688.244439:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.245815:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592131968 00000100:00100000:0.0:1746143688.245823:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592131968 00002000:00100000:0.0:1746143688.245863:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3813376->4194303) req@ffff8800930df800 x1830963592131968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143688.245872:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df800 with x1830963592131968 ext(3813376->4194303) 00002000:00010000:0.0:1746143688.245877:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930df800 00000100:00100000:0.0:1746143688.245915:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3368 00000100:00100000:0.0:1746143688.245922:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592131968:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143688.261890:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592131968:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15961us (17451us total) trans 0 rc 380928/380928 00000100:00100000:1.0:1746143688.261907:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3368 00002000:00100000:1.0:1746143688.261916:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3813376->4194303) req@ffff8800930df800 x1830963592131968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 380928/380928 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143688.261924:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df800 with x1830963592131968 ext(3813376->4194303) 00002000:00010000:1.0:1746143688.261929:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930df800 00000100:00100000:3.0:1746143688.262247:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592131456:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20611us (22139us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143688.262253:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3367 00002000:00100000:3.0:1746143688.262258:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8801305c9180 x1830963592131456/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.262264:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9180 with x1830963592131456 ext(2097152->3145727) 00002000:00010000:3.0:1746143688.262267:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c9180 00000100:00100000:2.0:1746143688.273970:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592131712:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33085us (33768us total) trans 0 rc 950272/950272 00000100:00100000:2.0:1746143688.273980:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 810 00002000:00100000:2.0:1746143688.273991:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4095999) req@ffff8801305cb100 x1830963592131712/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:H/200/0 rc 950272/950272 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.274005:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cb100 with x1830963592131712 ext(3145728->4095999) 00010000:00010000:2.0:1746143688.274013:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 22 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.274025:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 22 pid: 4581 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746143688.274031:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305cb100 00000100:00100000:0.0:1746143688.279441:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.279511:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592132096 00000100:00100000:1.0:1746143688.279519:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592132096 00000100:00100000:1.0:1746143688.279569:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9307 00000100:00100000:1.0:1746143688.279576:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28256:x1830963592132096:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143688.279590:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.279604:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7bde00/0xe984082ccd724e82 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10a0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.279625:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143688.279627:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143688.279631:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7bde00/0xe984082ccd724e82 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a0 expref: 23 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.279640:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7bde00/0xe984082ccd724e82 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a0 expref: 23 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.279650:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7bde00, rc 0) 00000100:00100000:1.0:1746143688.279696:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28256:x1830963592132096:12345-192.168.202.48@tcp:101:cat.0 Request processed in 120us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.279702:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9307 00000100:00100000:0.0:1746143688.285423:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.288991:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592132224 00000100:00100000:3.0:1746143688.289001:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592132224 00010000:00010000:3.0:1746143688.289038:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 23 pid: 4581 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746143688.289087:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4761 00000100:00100000:3.0:1746143688.289094:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592132224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143688.289105:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143688.289125:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 23 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.289136:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 23 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.289181:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6600/0xe984082ccd724e51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a106f expref: 23 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.289210:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.289211:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.289218:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093238000/0xe984082ccd724e7b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1099 expref: 9 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.289225:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093238000/0xe984082ccd724e7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1099 expref: 9 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.289232:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.289233:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.289236:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7bde00/0xe984082ccd724e82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a0 expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.289242:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7bde00/0xe984082ccd724e82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a0 expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.289268:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7bde00/0xe984082ccd724e82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a0 expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143688.289279:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593687424:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143688.289377:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093238000/0xe984082ccd724e7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1099 expref: 9 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143688.289385:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593687552:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143688.289401:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5823b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143688.295681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.295723:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.295794:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592132480 00000100:00100000:2.0:1746143688.295801:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592132480 00002000:00100000:2.0:1746143688.295840:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8801305c8700 x1830963592132480/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.295849:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8700 with x1830963592132480 ext(3145728->4194303) 00002000:00010000:2.0:1746143688.295853:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c8700 00000100:00100000:2.0:1746143688.295879:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592132736 00000100:00100000:2.0:1746143688.295882:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592132736 00002000:00100000:2.0:1746143688.295903:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8801305c8000 x1830963592132736/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.295909:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8000 with x1830963592132736 ext(2097152->3145727) 00002000:00010000:2.0:1746143688.295912:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c8000 00000100:00100000:2.0:1746143688.295933:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3369 00000100:00100000:2.0:1746143688.295940:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592132480:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143688.295940:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3370 00000100:00100000:1.0:1746143688.295949:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1962:x1830963592132736:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143688.296081:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593687424:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143688.296089:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593687552:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143688.296103:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143688.296157:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592132224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7063us (10740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.296164:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4761 00000100:00100000:2.0:1746143688.316420:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592132480:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20474us (20740us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143688.316433:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3369 00002000:00100000:2.0:1746143688.316442:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8801305c8700 x1830963592132480/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.316451:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8700 with x1830963592132480 ext(3145728->4194303) 00002000:00010000:2.0:1746143688.316455:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c8700 00000100:00100000:1.0:1746143688.325025:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1962:x1830963592132736:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29068us (29293us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143688.325034:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3370 00002000:00100000:1.0:1746143688.325043:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8801305c8000 x1830963592132736/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143688.325052:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8000 with x1830963592132736 ext(2097152->3145727) 00002000:00010000:1.0:1746143688.325058:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c8000 00000100:00100000:0.0:1746143688.328215:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.328312:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592132864 00000100:00100000:2.0:1746143688.328319:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592132864 00000100:00100000:2.0:1746143688.328407:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9308 00000100:00100000:2.0:1746143688.328414:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28261:x1830963592132864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143688.328429:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143688.328443:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090744200/0xe984082ccd724e89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10a7 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.328468:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3813375) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.328474:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143688.328476:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143688.328479:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090744200/0xe984082ccd724e89 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a7 expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.328502:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3813375) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.328513:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3813375) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 18 pid: 25369 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.328528:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593687680:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143688.329656:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.329756:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cc840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143688.329861:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592133120 00000100:00100000:3.0:1746143688.329867:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592133120 00002000:00100000:3.0:1746143688.329904:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8801305cb480 x1830963592133120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.329911:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cb480 with x1830963592133120 ext(4194304->4898815) 00002000:00010000:3.0:1746143688.329915:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305cb480 00000100:00100000:3.0:1746143688.329939:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3371 00000100:00100000:3.0:1746143688.329945:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592133120:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143688.342065:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592133120:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12112us (12402us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143688.342074:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3371 00002000:00100000:3.0:1746143688.342083:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8801305cb480 x1830963592133120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.342090:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cb480 with x1830963592133120 ext(4194304->4898815) 00002000:00010000:3.0:1746143688.342095:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305cb480 00000100:00100000:2.0:1746143688.343255:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593687680:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.343280:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090744200/0xe984082ccd724e89 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a7 expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.343294:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744200, rc 0) 00000100:00100000:2.0:1746143688.343316:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28261:x1830963592132864:12345-192.168.202.48@tcp:101:cat.0 Request processed in 14903us (15109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.343322:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9308 00000100:00100000:3.0:1746143688.343388:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.345252:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592133248 00000100:00100000:2.0:1746143688.345261:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592133248 00002000:00100000:2.0:1746143688.345299:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3813375) req@ffff8800930d0380 x1830963592133248/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.345307:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0380 with x1830963592133248 ext(3145728->3813375) 00010000:00010000:2.0:1746143688.345315:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 19 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.345327:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 19 pid: 25369 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746143688.345333:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d0380 00000100:00100000:2.0:1746143688.346593:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 811 00000100:00100000:2.0:1746143688.346603:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592133248:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143688.347415:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.354089:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592133376 00000100:00100000:2.0:1746143688.354100:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592133376 00000100:00100000:2.0:1746143688.354166:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9309 00000100:00100000:2.0:1746143688.354174:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592133376:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143688.354193:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143688.354210:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090745000/0xe984082ccd724e90 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10ae expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.354257:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593687808:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143688.354347:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cc840 going to sleep for 11 seconds 00002000:00010000:2.0:1746143688.361526:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143687 -> 1746143688 00000100:00100000:2.0:1746143688.361544:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593687808:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143688.361571:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090745000/0xe984082ccd724e90 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10ae expref: 22 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.361584:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090745000/0xe984082ccd724e90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10ae expref: 22 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.361598:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090745000, rc 0) 00000100:00100000:2.0:1746143688.361635:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592133376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7461us (14220us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143688.361642:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9309 00000100:00100000:3.0:1746143688.369472:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592133248:12345-192.168.202.48@tcp:4:cat.0 Request processed in 22864us (26076us total) trans 21474839665 rc 0/0 00000100:00100000:3.0:1746143688.369483:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 811 00002000:00100000:3.0:1746143688.369494:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3813375) req@ffff8800930d0380 x1830963592133248/t21474839665(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/448 e 0 to 0 dl 1746143699 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.369502:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0380 with x1830963592133248 ext(3145728->3813375) 00010000:00010000:3.0:1746143688.369511:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 21 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.369525:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 21 pid: 25369 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746143688.369531:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d0380 00000100:00100000:0.0:1746143688.370548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.372535:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592133504 00000100:00100000:3.0:1746143688.372546:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592133504 00000100:00100000:3.0:1746143688.375891:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9310 00000100:00100000:3.0:1746143688.375917:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592133504:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143688.375935:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143688.375957:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129dc0000/0xe984082ccd724e97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10b5 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143688.376004:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593687936:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143688.376090:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a58233c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143688.377421:0:25369:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff8800930d1c00 x1830963593687936) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 22 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.377448:0:25369:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3813375) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 22 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.377464:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6200/0xe984082ccd724e74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3813375) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1092 expref: 22 pid: 25369 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746143688.378447:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593687936:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143688.378465:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.378467:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.378472:0:25369:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090744200/0xe984082ccd724e89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a7 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.378479:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090744200/0xe984082ccd724e89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a7 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.378505:0:25369:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090744200/0xe984082ccd724e89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a7 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143688.378837:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593688064:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143688.379204:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.379375:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592133632 00000100:00100000:0.0:1746143688.379384:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592133632 00000100:00100000:0.0:1746143688.379420:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 564 00000100:00100000:0.0:1746143688.379425:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592133632:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143688.379434:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143688.379436:0:7149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie e984082ccd724e74) 00010000:00010000:0.0:1746143688.379438:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143688.379458:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592133632:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 33us (255us total) trans 0 rc 116/116 00000100:00100000:0.0:1746143688.379463:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 564 00000100:00100000:3.0:1746143688.380045:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a58233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143688.381975:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593688064:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143688.382006:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129dc0000/0xe984082ccd724e97 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10b5 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.382028:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129dc0000/0xe984082ccd724e97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10b5 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.382047:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dc0000, rc 0) 00000100:00100000:2.0:1746143688.383422:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592133504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7506us (12871us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143688.383430:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9310 00000100:00100000:0.0:1746143688.403735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.403775:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.403825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.403848:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592133888 00000100:00100000:0.0:1746143688.403854:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592133888 00002000:00100000:0.0:1746143688.403891:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009bfe3800 x1830963592133888/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143688.403928:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3800 with x1830963592133888 ext(2097152->3145727) 00002000:00010000:0.0:1746143688.403932:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe3800 00000100:00100000:0.0:1746143688.403948:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592134144 00000100:00100000:0.0:1746143688.403950:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592134144 00002000:00100000:0.0:1746143688.403961:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009bfe0a80 x1830963592134144/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143688.403967:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0a80 with x1830963592134144 ext(3145728->4194303) 00002000:00010000:0.0:1746143688.403969:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe0a80 00000100:00100000:0.0:1746143688.403976:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592134400 00000100:00100000:0.0:1746143688.403978:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592134400 00002000:00100000:0.0:1746143688.403987:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009bfe0380 x1830963592134400/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143688.403993:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0380 with x1830963592134400 ext(3145728->4194303) 00002000:00010000:0.0:1746143688.403996:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0380 00000100:00100000:0.0:1746143688.404020:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3372 00000100:00100000:0.0:1746143688.404026:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592133888:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143688.404240:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3373 00000100:00100000:3.0:1746143688.404247:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592134144:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143688.405285:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3374 00000100:00100000:3.0:1746143688.405291:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592134400:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143688.430268:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592133888:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26234us (26532us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143688.430277:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3372 00002000:00100000:2.0:1746143688.430287:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009bfe3800 x1830963592133888/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.430295:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3800 with x1830963592133888 ext(2097152->3145727) 00002000:00010000:2.0:1746143688.430300:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe3800 00000100:00100000:3.0:1746143688.433880:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592134144:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29626us (30096us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143688.433906:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3373 00002000:00100000:3.0:1746143688.433915:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009bfe0a80 x1830963592134144/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.433924:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0a80 with x1830963592134144 ext(3145728->4194303) 00002000:00010000:3.0:1746143688.433929:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe0a80 00000100:00100000:3.0:1746143688.440873:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592134400:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35573us (37038us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143688.440883:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3374 00002000:00100000:3.0:1746143688.440903:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009bfe0380 x1830963592134400/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.440912:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0380 with x1830963592134400 ext(3145728->4194303) 00002000:00010000:3.0:1746143688.440917:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0380 00000100:00100000:0.0:1746143688.470629:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.470732:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592134656 00000100:00100000:3.0:1746143688.470740:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592134656 00002000:00100000:3.0:1746143688.470780:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009bfe3100 x1830963592134656/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.470788:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3100 with x1830963592134656 ext(4194304->4898815) 00002000:00010000:3.0:1746143688.470793:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3100 00000100:00100000:3.0:1746143688.470822:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3375 00000100:00100000:3.0:1746143688.470828:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592134656:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143688.482185:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592134656:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11348us (11554us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143688.482195:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3375 00002000:00100000:3.0:1746143688.482205:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009bfe3100 x1830963592134656/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/440 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.482214:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3100 with x1830963592134656 ext(4194304->4898815) 00002000:00010000:3.0:1746143688.482220:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3100 00000100:00100000:1.0:1746143688.484852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.485576:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592134784 00000100:00100000:2.0:1746143688.485586:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592134784 00000100:00100000:2.0:1746143688.485642:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9311 00000100:00100000:2.0:1746143688.485649:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28263:x1830963592134784:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143688.485666:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143688.485683:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10bc expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.485710:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090744200/0xe984082ccd724e89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a7 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.485722:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.485724:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.485727:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3260416->4194303] (req 3260416->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.485754:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090744200/0xe984082ccd724e89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a7 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.485766:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090744200/0xe984082ccd724e89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a7 expref: 18 pid: 25369 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.485777:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593688192:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143688.485880:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cc840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143688.490016:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.490069:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.490214:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593688192:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.490239:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3260416->4194303] (req 3260416->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.490253:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744600, rc 0) 00000100:00100000:2.0:1746143688.490302:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28263:x1830963592134784:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4653us (5456us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.490309:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9311 00000100:00100000:2.0:1746143688.490331:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592134912 00000100:00100000:2.0:1746143688.490335:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592134912 00000100:00100000:2.0:1746143688.490364:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9312 00000100:00100000:2.0:1746143688.490369:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592134912:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143688.490381:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143688.490391:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724ea5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10c3 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.490404:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.490410:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724ea5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10c3 expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.490417:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724ea5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10c3 expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.490433:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744a00, rc 0) 00000100:00100000:2.0:1746143688.490446:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592134912:12345-192.168.202.48@tcp:101:cat.0 Request processed in 78us (439us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143688.490450:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9312 00000100:00100000:2.0:1746143688.490473:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592135040 00000100:00100000:2.0:1746143688.490475:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592135040 00010000:00010000:2.0:1746143688.490486:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090744200/0xe984082ccd724e89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a7 expref: 18 pid: 25369 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.490499:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4762 00000100:00100000:2.0:1746143688.490503:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592135040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.490509:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.490525:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090744200/0xe984082ccd724e89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a7 expref: 18 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.490534:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090744200/0xe984082ccd724e89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a7 expref: 18 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.490547:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090744200/0xe984082ccd724e89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a7 expref: 18 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.490553:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.490555:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.490560:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.490567:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.490594:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.490604:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593688320:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143688.490654:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cc840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143688.493713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.493857:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592135168 00000100:00100000:1.0:1746143688.493865:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592135168 00000100:00100000:1.0:1746143688.493926:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9313 00000100:00100000:1.0:1746143688.493933:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592135168:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143688.493947:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.493962:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5806c00/0xe984082ccd724eac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10ca expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143688.494000:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593688448:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143688.494072:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143688.494220:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593688320:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143688.494235:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.494254:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592135040:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3750us (4184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.494261:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4762 00000100:00100000:3.0:1746143688.495878:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.495928:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.496045:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592135424 00000100:00100000:0.0:1746143688.496051:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592135424 00002000:00100000:0.0:1746143688.496081:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3260416->3264511) req@ffff8800930d0000 x1830963592135424/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143688.496089:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0000 with x1830963592135424 ext(3260416->3264511) 00002000:00010000:0.0:1746143688.496093:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d0000 00000100:00100000:0.0:1746143688.496107:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3376 00000100:00100000:0.0:1746143688.496112:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592135424:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143688.496258:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592135424:12345-192.168.202.48@tcp:3:cat.0 Request processed in 146us (384us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143688.496265:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3376 00002000:00100000:0.0:1746143688.496269:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3260416->3264511) req@ffff8800930d0000 x1830963592135424/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/4536 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143688.496276:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0000 with x1830963592135424 ext(3260416->3264511) 00002000:00010000:0.0:1746143688.496279:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d0000 00000100:00100000:2.0:1746143688.496615:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592135552 00000100:00100000:2.0:1746143688.496618:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592135552 00000100:00100000:2.0:1746143688.496642:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9314 00000100:00100000:2.0:1746143688.496647:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28267:x1830963592135552:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143688.496657:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143688.496669:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10d1 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.496688:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093238000/0xe984082ccd724e7b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1099 expref: 9 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.496696:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7bde00/0xe984082ccd724e82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a0 expref: 23 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.496701:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.496703:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.496705:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2457600->2559999] (req 2457600->2559999) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.496728:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7bde00/0xe984082ccd724e82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a0 expref: 23 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.496738:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7bde00/0xe984082ccd724e82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a0 expref: 23 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.496747:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593688576:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.496800:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093238000/0xe984082ccd724e7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1099 expref: 9 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.496807:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093238000/0xe984082ccd724e7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1099 expref: 9 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.496818:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593688704:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143688.496835:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cc840 going to sleep for 11 seconds 00002000:00010000:1.0:1746143688.497559:0:12618:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime: 1746143687 -> 1746143688 00002000:00010000:1.0:1746143688.497563:0:12618:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime: 1746143687 -> 1746143688 00000100:00100000:1.0:1746143688.497577:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593688448:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143688.497602:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5806c00/0xe984082ccd724eac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10ca expref: 18 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.497611:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5806c00/0xe984082ccd724eac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10ca expref: 18 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.497632:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5806c00, rc 0) 00000100:00100000:1.0:1746143688.497655:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592135168:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3720us (3946us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143688.497661:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9313 00000100:00100000:2.0:1746143688.501380:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593688576:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143688.501392:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593688704:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.501418:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2457600->2559999] (req 2457600->2559999) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.501433:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744e00, rc 0) 00000100:00100000:2.0:1746143688.501471:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28267:x1830963592135552:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4824us (5542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.501479:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9314 00000100:00100000:2.0:1746143688.505025:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.505265:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592135680 00000100:00100000:0.0:1746143688.505273:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592135680 00010000:00010000:0.0:1746143688.505304:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7bde00/0xe984082ccd724e82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a0 expref: 23 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746143688.505339:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4763 00000100:00100000:0.0:1746143688.505345:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592135680:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143688.505356:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143688.505374:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7bde00/0xe984082ccd724e82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a0 expref: 23 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.505383:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7bde00/0xe984082ccd724e82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a0 expref: 23 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.505403:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7bde00/0xe984082ccd724e82 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10a0 expref: 23 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.505430:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143688.505478:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592135680:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 133us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143688.505483:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4763 00000100:00100000:1.0:1746143688.507088:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.507133:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592135808 00000100:00100000:2.0:1746143688.507167:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592135808 00000100:00100000:2.0:1746143688.508213:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9315 00000100:00100000:2.0:1746143688.508222:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28263:x1830963592135808:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143688.508238:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143688.508252:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10d8 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.508271:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.508273:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.508276:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->4276223] (req 4194304->4276223) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 11 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.508290:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->4276223] (req 4194304->4276223) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 11 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.508298:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744c00, rc 0) 00000100:00100000:2.0:1746143688.508343:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28263:x1830963592135808:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 122us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.508348:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9315 00000100:00100000:0.0:1746143688.514030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.514121:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592135936 00000100:00100000:2.0:1746143688.514128:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592135936 00010000:00010000:2.0:1746143688.514170:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093238000/0xe984082ccd724e7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1099 expref: 11 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.514202:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4764 00000100:00100000:2.0:1746143688.514209:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592135936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.514220:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.514239:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093238000/0xe984082ccd724e7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1099 expref: 11 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.514249:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093238000/0xe984082ccd724e7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1099 expref: 11 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.514268:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093238000/0xe984082ccd724e7b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1099 expref: 11 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.514292:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.514294:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.514300:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.514306:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.514313:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.514314:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.514317:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 10 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.514323:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 10 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.514350:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 10 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.514360:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593688832:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143688.514438:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.514445:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593688960:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143688.514459:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cc840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143688.517811:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593688960:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143688.519214:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.520124:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592136192 00000100:00100000:2.0:1746143688.520131:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592136192 00002000:00100000:2.0:1746143688.520193:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2457600->2461695) req@ffff88009bef4700 x1830963592136192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.520201:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef4700 with x1830963592136192 ext(2457600->2461695) 00002000:00010000:2.0:1746143688.520205:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef4700 00000100:00100000:2.0:1746143688.520225:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3377 00000100:00100000:2.0:1746143688.520230:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592136192:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143688.520387:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592136192:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 156us (1176us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143688.520393:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3377 00002000:00100000:2.0:1746143688.520397:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2457600->2461695) req@ffff88009bef4700 x1830963592136192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/4536 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.520403:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef4700 with x1830963592136192 ext(2457600->2461695) 00002000:00010000:2.0:1746143688.520406:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef4700 00000100:00100000:3.0:1746143688.520488:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593688832:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143688.520505:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143688.520525:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592135936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6317us (6504us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.520531:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4764 00000100:00100000:0.0:1746143688.521913:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.521955:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592136448 00000100:00100000:2.0:1746143688.521960:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592136448 00002000:00100000:2.0:1746143688.521980:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4272128->4276223) req@ffff88009bef6a00 x1830963592136448/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.521988:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef6a00 with x1830963592136448 ext(4272128->4276223) 00002000:00010000:2.0:1746143688.521991:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef6a00 00000100:00100000:2.0:1746143688.522015:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3378 00000100:00100000:2.0:1746143688.522021:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592136448:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143688.522130:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592136448:12345-192.168.202.48@tcp:3:cat.0 Request processed in 108us (217us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143688.522135:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3378 00002000:00100000:2.0:1746143688.522159:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4272128->4276223) req@ffff88009bef6a00 x1830963592136448/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/4536 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.522166:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef6a00 with x1830963592136448 ext(4272128->4276223) 00002000:00010000:2.0:1746143688.522168:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef6a00 00000100:00100000:2.0:1746143688.523443:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.523694:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592136704 00000100:00100000:0.0:1746143688.523699:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592136704 00002000:00100000:0.0:1746143688.523720:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2555904->2559999) req@ffff880130fd6a00 x1830963592136704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143688.523727:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6a00 with x1830963592136704 ext(2555904->2559999) 00002000:00010000:0.0:1746143688.523730:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd6a00 00000100:00100000:0.0:1746143688.523801:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3379 00000100:00100000:0.0:1746143688.523807:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592136704:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143688.524913:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592136704:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 1104us (1471us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143688.524919:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3379 00002000:00100000:0.0:1746143688.524925:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2555904->2559999) req@ffff880130fd6a00 x1830963592136704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/4536 e 0 to 0 dl 1746143699 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143688.524931:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6a00 with x1830963592136704 ext(2555904->2559999) 00002000:00010000:0.0:1746143688.524934:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd6a00 00000100:00100000:1.0:1746143688.542319:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.542494:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592136832 00000100:00100000:2.0:1746143688.542502:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592136832 00000100:00100000:2.0:1746143688.542832:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8221 00000100:00100000:2.0:1746143688.542840:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28271:x1830963592136832:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143688.542860:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143688.542875:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090745000/0xe984082ccd724ec1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10df expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.542938:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd724ec8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.542950:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd724ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.542962:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd724ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.542974:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd724ecf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.542980:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd724ecf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.542986:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd724ecf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.543240:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.543249:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ff1 expref: 26 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.543256:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805800/0xe984082ccd724de1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1006 expref: 265 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.543261:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.543283:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805800/0xe984082ccd724de1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1006 expref: 265 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.543291:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805800/0xe984082ccd724de1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1006 expref: 265 pid: 21713 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.543301:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593689088:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.543374:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ff1 expref: 26 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.543381:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ff1 expref: 26 pid: 21713 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.543387:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593689216:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143688.543405:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cc9c0 going to sleep for 11 seconds 00000100:00080000:3.0:1746143688.544032:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143688.548107:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.548175:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.548360:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593689088:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143688.548370:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593689216:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.548391:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:1.0:1746143688.549513:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592137088 00000100:00100000:1.0:1746143688.549520:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592137088 00000100:00100000:1.0:1746143688.549568:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592137344 00000100:00100000:1.0:1746143688.549571:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592137344 00000100:00100000:2.0:1746143688.549576:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3331 00000100:00100000:2.0:1746143688.549583:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:23699:x1830963592137088:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143688.549590:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3332 00000100:00100000:1.0:1746143688.549594:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+27:23698:x1830963592137344:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143688.550129:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+28:23698:x1830963592137344:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 532us (1952us total) trans 8589942314 rc 0/0 00000100:00100000:1.0:1746143688.550135:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3332 00000100:00080000:3.0:1746143688.550667:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143688.550707:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:23699:x1830963592137088:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 1123us (2605us total) trans 8589942313 rc 0/0 00000100:00100000:2.0:1746143688.550714:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3331 00000100:00100000:0.0:1746143688.552069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.553491:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592137472 00000100:00100000:3.0:1746143688.553498:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592137472 00010000:00010000:3.0:1746143688.553529:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ff1 expref: 28 pid: 21713 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746143688.553560:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4765 00000100:00100000:3.0:1746143688.553567:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1965:x1830963592137472:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143688.553577:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143688.553582:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ff1 expref: 28 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.553591:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ff1 expref: 28 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.553608:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd724db7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ff1 expref: 28 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.553963:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143688.553968:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143688.553976:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143688.553980:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143688.553985:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143688.554199:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963592137472:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 631us (2131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.554206:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4765 00000100:00100000:0.0:1746143688.555085:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.555284:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592137600 00000100:00100000:3.0:1746143688.555290:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592137600 00010000:00010000:3.0:1746143688.555309:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805800/0xe984082ccd724de1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1006 expref: 267 pid: 21713 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746143688.555323:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4766 00000100:00100000:3.0:1746143688.555328:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:1964:x1830963592137600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143688.555336:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143688.555340:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805800/0xe984082ccd724de1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1006 expref: 267 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.555347:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805800/0xe984082ccd724de1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1006 expref: 267 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.555359:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5805800/0xe984082ccd724de1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1006 expref: 267 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.555367:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143688.555370:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143688.555376:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143688.555380:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143688.555406:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143688.555436:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:1964:x1830963592137600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 106us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.555441:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4766 00010000:00010000:2.0:1746143688.556724:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556732:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:2.0:1746143688.556770:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:2.0:1746143688.556774:0:20509:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143688.556789:0:20509:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556800:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556808:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd724ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556813:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd724ec8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556818:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd724ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556825:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090745400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143688.556829:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd724ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556834:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd724ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556842:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143688.556844:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143688.556847:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd724ec8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556851:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd724ec8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556865:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd724ecf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556870:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd724ecf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556874:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd724ecf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556877:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090745a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143688.556879:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd724ecf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556883:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd724ecf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556889:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093484200) 00010000:00010000:2.0:1746143688.556901:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143688.556904:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd724ecf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556908:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd724ecf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.556938:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090745000/0xe984082ccd724ec1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10df expref: 14 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.556948:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10df expref: 13 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.556953:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143688.556954:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143688.556956:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744a00, rc 0) 00000100:00100000:2.0:1746143688.558316:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28271:x1830963592136832:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 14791us (15319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.558326:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8221 00000100:00100000:0.0:1746143688.561367:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.561410:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.561431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.561469:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.561527:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592137728 00000100:00100000:1.0:1746143688.561535:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592137728 00000100:00100000:1.0:1746143688.561575:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592137856 00000100:00100000:1.0:1746143688.561576:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592137856 00000100:00100000:1.0:1746143688.561586:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592137984 00000100:00100000:1.0:1746143688.561587:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592137984 00000100:00100000:1.0:1746143688.561597:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592138112 00000100:00100000:1.0:1746143688.561598:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592138112 00000100:00100000:1.0:1746143688.561610:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9316 00000100:00100000:1.0:1746143688.561616:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592137728:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143688.561630:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.561643:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5806600/0xe984082ccd724edd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10e6 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.561661:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143688.561662:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143688.561669:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5806600/0xe984082ccd724edd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10e6 expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.561680:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5806600/0xe984082ccd724edd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10e6 expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.561694:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5806600, rc 0) 00000100:00100000:1.0:1746143688.561725:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592137728:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 110us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.561730:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9316 00000100:00100000:1.0:1746143688.561741:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9317 00000100:00100000:1.0:1746143688.561745:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592137856:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143688.561750:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.561754:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5807c00/0xe984082ccd724ee4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10ed expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.561761:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143688.561762:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143688.561765:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5807c00/0xe984082ccd724ee4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10ed expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.561771:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5807c00/0xe984082ccd724ee4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10ed expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.561777:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5807c00, rc 0) 00000100:00100000:1.0:1746143688.561786:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592137856:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 42us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.561791:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9317 00000100:00100000:1.0:1746143688.561915:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9318 00000100:00100000:1.0:1746143688.561919:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592137984:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143688.561928:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.561934:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5806a00/0xe984082ccd724eeb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10f4 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143688.561962:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593689344:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143688.562004:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143688.562018:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9319 00000100:00100000:1.0:1746143688.562023:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592138112:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143688.562027:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.562032:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd724ef2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a10fb expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143688.562047:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593689472:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143688.562060:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ecc0 going to sleep for 11 seconds 00000100:00080000:0.0:1746143688.562792:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143688.562796:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1746143688.565300:0:12618:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime: 1746143687 -> 1746143688 00002000:00010000:1.0:1746143688.565306:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime: 1746143687 -> 1746143688 00002000:00010000:1.0:1746143688.565307:0:12618:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime: 1746143687 -> 1746143688 00000100:00100000:1.0:1746143688.565326:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593689344:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143688.565356:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5806a00/0xe984082ccd724eeb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10f4 expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.565368:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5806a00/0xe984082ccd724eeb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10f4 expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143688.565490:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593689472:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143688.565507:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd724ef2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10fb expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143688.565515:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd724ef2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10fb expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143688.565527:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009808a800, rc 0) 00000100:00100000:0.0:1746143688.565565:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592138112:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3540us (4094us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143688.565572:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9319 00010000:00010000:1.0:1746143688.565845:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5806a00, rc 0) 00000100:00100000:1.0:1746143688.565869:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592137984:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3948us (4437us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143688.565873:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9318 00000100:00100000:2.0:1746143688.571379:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.571461:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592138368 00000100:00100000:0.0:1746143688.571469:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592138368 00000100:00100000:0.0:1746143688.571507:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8222 00000100:00100000:0.0:1746143688.571514:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28271:x1830963592138368:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143688.571532:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143688.571548:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08200/0xe984082ccd724ef9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1102 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.571636:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143688.571653:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10df expref: 14 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.571659:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143688.571684:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10df expref: 14 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.571699:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10df expref: 14 pid: 20509 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746143688.571710:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593689600:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143688.573047:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143688.576756:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593689600:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.576783:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143688.577374:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143688.577499:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.577713:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592138496 00000100:00100000:0.0:1746143688.577718:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592138496 00010000:00010000:0.0:1746143688.577744:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10df expref: 15 pid: 20509 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746143688.578351:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4767 00000100:00100000:0.0:1746143688.578358:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1965:x1830963592138496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143688.578369:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143688.578374:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10df expref: 15 pid: 20509 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.578384:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10df expref: 15 pid: 20509 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.578401:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd724ed6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10df expref: 15 pid: 20509 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.578417:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:0.0:1746143688.578421:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143688.578428:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143688.578434:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143688.578458:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143688.578493:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1965:x1830963592138496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 135us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143688.578500:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4767 00010000:00010000:2.0:1746143688.578544:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143688.578550:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:2.0:1746143688.578567:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143688.578689:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08200/0xe984082ccd724ef9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1102 expref: 15 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.578705:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1102 expref: 14 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.578711:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143688.578713:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143688.578715:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c08600, rc 0) 00000100:00100000:2.0:1746143688.578737:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:28271:x1830963592138368:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 7224us (7372us total) trans 8589942315 rc 0/0 00000100:00100000:2.0:1746143688.578743:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8222 00000100:00100000:2.0:1746143688.582570:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.582622:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592138624 00000100:00100000:0.0:1746143688.582631:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592138624 00000100:00100000:0.0:1746143688.582676:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8223 00000100:00100000:0.0:1746143688.582684:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:28271:x1830963592138624:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143688.582702:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143688.582716:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09c00/0xe984082ccd724f0e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1109 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.582801:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd724f15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143688.582813:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1102 expref: 15 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.582818:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd724f15 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143688.582844:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1102 expref: 15 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.582854:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1102 expref: 15 pid: 20509 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746143688.582868:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593689728:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143688.582957:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143688.584550:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593689728:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143688.584566:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd724f15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:2.0:1746143688.585019:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.585421:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592138752 00000100:00100000:3.0:1746143688.585425:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592138752 00010000:00010000:3.0:1746143688.585449:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1102 expref: 16 pid: 20509 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746143688.585468:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4768 00000100:00100000:3.0:1746143688.585474:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:1962:x1830963592138752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143688.585484:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143688.585489:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1102 expref: 16 pid: 20509 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.585497:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1102 expref: 16 pid: 20509 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.585513:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd724f00 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1102 expref: 16 pid: 20509 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.585528:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143688.585532:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd724f15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143688.585540:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd724f15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143688.585545:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd724f15 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143688.585573:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143688.585600:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd724f15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:3.0:1746143688.585605:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1962:x1830963592138752:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 130us (587us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143688.585607:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd724f15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:3.0:1746143688.585614:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4768 00000004:00200000:1.0:1746143688.585645:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:1.0:1746143688.585649:0:20509:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143688.585662:0:20509:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd724f15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143688.585686:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09c00/0xe984082ccd724f0e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1109 expref: 15 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.585717:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd724f15 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1109 expref: 14 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.585723:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:1.0:1746143688.585725:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143688.585727:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c09e00, rc 0) 00000100:00100000:1.0:1746143688.585751:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:28271:x1830963592138624:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3068us (3189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.585756:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8223 00000100:00100000:2.0:1746143688.588185:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.588253:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592139008 00000100:00100000:1.0:1746143688.588262:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592139008 00000100:00100000:2.0:1746143688.588294:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.588300:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9320 00000100:00100000:1.0:1746143688.588307:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592139008:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143688.588329:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.588346:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e93b600/0xe984082ccd724f1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1117 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143688.588391:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593689856:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143688.588478:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143688.588903:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592138880 00000100:00100000:0.0:1746143688.588907:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592138880 00000100:00100000:0.0:1746143688.588932:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9321 00000100:00100000:0.0:1746143688.588937:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592138880:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143688.588945:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143688.588953:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5806c00/0xe984082ccd724f23 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1110 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143688.588977:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593689984:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143688.589004:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143688.590235:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593689856:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143688.590257:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e93b600/0xe984082ccd724f1c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1117 expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.590267:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e93b600/0xe984082ccd724f1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1117 expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.590275:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e93b600, rc 0) 00000100:00100000:1.0:1746143688.590313:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592139008:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2006us (2133us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143688.590319:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9320 00000100:00100000:0.0:1746143688.593523:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593689984:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143688.593553:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5806c00/0xe984082ccd724f23 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1110 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143688.593567:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5806c00/0xe984082ccd724f23 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1110 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143688.593592:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5806c00, rc 0) 00000100:00100000:0.0:1746143688.593629:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592138880:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4691us (5334us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143688.593636:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9321 00000100:00100000:0.0:1746143688.596906:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.598044:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592139264 00000100:00100000:1.0:1746143688.598052:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592139264 00000100:00100000:1.0:1746143688.598340:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8224 00000100:00100000:1.0:1746143688.598349:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:28271:x1830963592139264:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143688.598367:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143688.598384:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009808aa00/0xe984082ccd724f2a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a111e expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.598476:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009808bc00/0xe984082ccd724f31 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143688.598490:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009808bc00/0xe984082ccd724f31 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143688.598499:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009808bc00/0xe984082ccd724f31 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143688.598512:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143688.598615:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009808aa00/0xe984082ccd724f2a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a111e expref: 17 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.598627:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009808bc00/0xe984082ccd724f31 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a111e expref: 16 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.598634:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:1.0:1746143688.598636:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143688.598638:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009808bc00, rc 0) 00000100:00100000:1.0:1746143688.598693:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:28271:x1830963592139264:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 345us (1800us total) trans 8589942316 rc 0/0 00000100:00100000:1.0:1746143688.598699:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8224 00000100:00100000:0.0:1746143688.601716:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.602056:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592139392 00000100:00100000:0.0:1746143688.602059:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.602063:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592139392 00000100:00100000:2.0:1746143688.602635:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592139648 00000100:00100000:2.0:1746143688.602639:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592139648 00000100:00100000:0.0:1746143688.602645:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9322 00000100:00100000:0.0:1746143688.602653:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592139392:12345-192.168.202.48@tcp:1:lfs.0 00000100:00100000:2.0:1746143688.602672:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9323 00000100:00100000:2.0:1746143688.602676:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592139648:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143688.602687:0:8496:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.602693:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.602702:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1045 expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.602702:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a962c00/0xe984082ccd7246ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c08 expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143688.602709:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd7247eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c5c expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.602713:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5807c00/0xe984082ccd724ee4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10ed expref: 8 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143688.602715:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d53aa00/0xe984082ccd7247ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c47 expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.602720:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd724e35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a105a expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143688.602720:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143688.602721:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.602724:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143688.602724:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.602725:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.602727:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.602746:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd724e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a105a expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143688.602746:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d53aa00/0xe984082ccd7247ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c47 expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.602757:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd724e35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a105a expref: 19 pid: 8497 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746143688.602757:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d53aa00/0xe984082ccd7247ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c47 expref: 9 pid: 6929 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.602767:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593690240:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143688.602767:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593690112:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143688.602837:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd7247eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c5c expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.602845:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd7247eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c5c expref: 21 pid: 8497 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746143688.602856:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593690368:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143688.603837:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5807c00/0xe984082ccd724ee4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10ed expref: 8 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143688.603846:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5807c00/0xe984082ccd724ee4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10ed expref: 8 pid: 12618 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746143688.603853:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593690496:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143688.603882:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1045 expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.603888:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1045 expref: 16 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746143688.603919:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593690624:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143688.603936:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2dc00 going to sleep for 11 seconds 00010000:00010000:0.0:1746143688.603992:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a962c00/0xe984082ccd7246ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c08 expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143688.603999:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a962c00/0xe984082ccd7246ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c08 expref: 8 pid: 21542 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746143688.604006:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593690752:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143688.604023:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143688.604049:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.604102:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.604126:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.604183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.604320:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592139904 00000100:00100000:1.0:1746143688.604325:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592139904 00000100:00100000:1.0:1746143688.604347:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592139520 00000100:00100000:1.0:1746143688.604349:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592139520 00000100:00100000:1.0:1746143688.604360:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592139776 00000100:00100000:1.0:1746143688.604361:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592139776 00000100:00100000:1.0:1746143688.604372:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592140032 00000100:00100000:1.0:1746143688.604374:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592140032 00000100:00100000:1.0:1746143688.604388:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9324 00000100:00100000:1.0:1746143688.604393:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592139904:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143688.604419:0:12618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.604431:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.604438:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 9 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.604451:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143688.604453:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143688.604455:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 5/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.604472:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 9 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.604480:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 9 pid: 25369 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746143688.604488:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593690880:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143688.604536:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.604545:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 21 pid: 25369 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746143688.604556:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593691008:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143688.604572:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143688.604585:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9325 00000100:00100000:1.0:1746143688.604591:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592139520:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143688.604607:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.604616:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1061 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.604621:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5806600/0xe984082ccd724edd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10e6 expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.604627:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd724e66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1084 expref: 16 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.604631:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143688.604632:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143688.604634:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.604648:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd724e66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1084 expref: 16 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.604655:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd724e66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1084 expref: 16 pid: 8497 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746143688.604663:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593691136:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143688.604685:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5806600/0xe984082ccd724edd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10e6 expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143688.604692:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5806600/0xe984082ccd724edd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10e6 expref: 10 pid: 12618 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746143688.604698:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593691264:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143688.604717:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1061 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.604724:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1061 expref: 19 pid: 4581 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746143688.604730:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593691392:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143688.604743:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52fc900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143688.604809:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9326 00000100:00100000:2.0:1746143688.604817:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592139776:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143688.604834:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.604842:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c94a400/0xe984082ccd724c59 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f03 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.604852:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b102a00/0xe984082ccd724cd0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f50 expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.604857:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c94b200/0xe984082ccd724c83 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f11 expref: 21 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.604861:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.604862:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.604863:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.604877:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c94b200/0xe984082ccd724c83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f11 expref: 21 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.604883:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c94b200/0xe984082ccd724c83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f11 expref: 21 pid: 8497 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746143688.604889:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593691520:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.604924:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b102a00/0xe984082ccd724cd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f50 expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.604931:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b102a00/0xe984082ccd724cd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f50 expref: 10 pid: 8497 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746143688.604937:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593691648:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.604954:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c94a400/0xe984082ccd724c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f03 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.604960:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c94a400/0xe984082ccd724c59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f03 expref: 9 pid: 8497 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.604966:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593691776:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143688.604991:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143688.605007:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9327 00000100:00100000:2.0:1746143688.605012:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592140032:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143688.605026:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.605034:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.605038:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143688.605039:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143688.605041:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.605054:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.605061:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 16 pid: 25369 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.605072:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593691904:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143688.605086:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143688.609344:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593690240:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143688.609356:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593690496:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143688.609363:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593690624:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143688.609388:0:15784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.609459:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593690112:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143688.624073:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.624099:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592140672 00000100:00100000:0.0:1746143688.624105:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592140672 00010000:00010000:0.0:1746143688.624133:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a962c00/0xe984082ccd7246ef lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c08 expref: 11 pid: 21542 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746143688.624179:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4769 00000100:00100000:0.0:1746143688.624185:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592140672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143688.624196:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143688.624214:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a962c00/0xe984082ccd7246ef lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c08 expref: 11 pid: 21542 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746143688.624223:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a962c00/0xe984082ccd7246ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c08 expref: 11 pid: 21542 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746143688.624242:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143688.624271:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592140672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 87us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143688.624277:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4769 00000100:00100000:0.0:1746143688.624304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.624316:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592140928 00000100:00100000:0.0:1746143688.624319:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592140928 00002000:00100000:0.0:1746143688.624337:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2457600->2559999) req@ffff8800930c1c00 x1830963592140928/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143688.624344:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c1c00 with x1830963592140928 ext(2457600->2559999) 00010000:00010000:0.0:1746143688.624349:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 22 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.624361:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 22 pid: 25369 timeout: 867 lvb_type: 0 00002000:00010000:0.0:1746143688.624366:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930c1c00 00000100:00100000:0.0:1746143688.624374:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 812 00000100:00100000:0.0:1746143688.624378:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592140928:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143688.624524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.624532:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592141184 00000100:00100000:0.0:1746143688.624534:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592141184 00010000:00010000:0.0:1746143688.624544:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5806600/0xe984082ccd724edd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10e6 expref: 11 pid: 12618 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746143688.624557:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4770 00000100:00100000:0.0:1746143688.624561:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592141184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143688.624567:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143688.624578:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5806600/0xe984082ccd724edd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10e6 expref: 11 pid: 12618 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746143688.624585:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5806600/0xe984082ccd724edd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10e6 expref: 11 pid: 12618 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746143688.624596:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143688.624604:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593691136:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143688.624608:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592141184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (84us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143688.624614:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5806600/0xe984082ccd724edd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10e6 expref: 11 pid: 12618 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746143688.624614:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4770 00000100:00100000:1.0:1746143688.624629:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593691264:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143688.624637:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593691392:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143688.624656:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143688.624661:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143688.624666:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592141440 00000100:00100000:0.0:1746143688.624668:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592141440 00010000:00010000:0.0:1746143688.624677:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94b200/0xe984082ccd724c83 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f11 expref: 24 pid: 8497 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746143688.624689:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4771 00000100:00100000:1.0:1746143688.624690:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593690880:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143688.624693:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592141440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143688.624698:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593691008:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143688.624698:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143688.624706:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c94b200/0xe984082ccd724c83 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f11 expref: 24 pid: 8497 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746143688.624709:0:12618:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.624713:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c94b200/0xe984082ccd724c83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f11 expref: 24 pid: 8497 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746143688.624723:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143688.624735:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592141440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 42us (78us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143688.624795:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c94b200/0xe984082ccd724c83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f11 expref: 24 pid: 8497 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746143688.624815:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593691520:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143688.624824:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593691648:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143688.624830:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593691776:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143688.624846:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.624936:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593690368:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.624944:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a962c00/0xe984082ccd7246ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c08 expref: 10 pid: 21542 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746143688.624956:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593690752:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.624970:0:8496:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143688.626415:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4771 00000100:00100000:0.0:1746143688.626473:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.627475:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592140928:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 3092us (3166us total) trans 17179872397 rc 0/0 00000100:00100000:0.0:1746143688.627482:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 812 00002000:00100000:0.0:1746143688.627490:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2457600->2559999) req@ffff8800930c1c00 x1830963592140928/t17179872397(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:84/0 lens 488/448 e 0 to 0 dl 1746143699 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143688.627497:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c1c00 with x1830963592140928 ext(2457600->2559999) 00010000:00010000:0.0:1746143688.627506:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 23 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.627516:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 23 pid: 25369 timeout: 867 lvb_type: 0 00002000:00010000:0.0:1746143688.627521:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930c1c00 00000100:00100000:0.0:1746143688.627554:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.627568:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592141696 00000100:00100000:0.0:1746143688.627573:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592141696 00010000:00010000:0.0:1746143688.627588:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94a400/0xe984082ccd724c59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f03 expref: 10 pid: 8497 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746143688.627612:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592140544 00000100:00100000:0.0:1746143688.627614:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592140544 00010000:00010000:0.0:1746143688.627621:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d53aa00/0xe984082ccd7247ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c47 expref: 11 pid: 6929 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746143688.627633:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4772 00000100:00100000:0.0:1746143688.627637:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592141696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143688.627646:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143688.627656:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c94a400/0xe984082ccd724c59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f03 expref: 11 pid: 8497 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.627663:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c94a400/0xe984082ccd724c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f03 expref: 11 pid: 8497 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.627677:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c94a400/0xe984082ccd724c59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f03 expref: 11 pid: 8497 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.627690:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143688.627702:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592141696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 64us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143688.627706:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4772 00000100:00100000:0.0:1746143688.627713:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4773 00000100:00100000:0.0:1746143688.627717:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963592140544:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143688.627722:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143688.627728:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d53aa00/0xe984082ccd7247ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c47 expref: 9 pid: 6929 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.627734:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d53aa00/0xe984082ccd7247ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c47 expref: 9 pid: 6929 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.627742:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d53aa00/0xe984082ccd7247ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c47 expref: 9 pid: 6929 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.627749:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143688.627759:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1965:x1830963592140544:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 42us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143688.627763:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4773 00000100:00100000:0.0:1746143688.627798:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.627806:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592140800 00000100:00100000:0.0:1746143688.627808:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592140800 00002000:00100000:0.0:1746143688.627822:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4276223) req@ffff8800930c3b80 x1830963592140800/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143688.627833:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c3b80 with x1830963592140800 ext(4194304->4276223) 00010000:00010000:0.0:1746143688.627837:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 8 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.627843:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 8 pid: 25369 timeout: 867 lvb_type: 0 00002000:00010000:0.0:1746143688.627847:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930c3b80 00000100:00100000:0.0:1746143688.627857:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 813 00000100:00100000:0.0:1746143688.627861:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1965:x1830963592140800:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143688.627984:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.627993:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592141056 00000100:00100000:0.0:1746143688.627995:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592141056 00010000:00010000:0.0:1746143688.628006:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd724e66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1084 expref: 17 pid: 8497 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746143688.628207:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.628222:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592141312 00000100:00100000:2.0:1746143688.628225:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592141312 00010000:00010000:2.0:1746143688.628240:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1061 expref: 20 pid: 4581 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.628254:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4774 00000100:00100000:2.0:1746143688.628260:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592141312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.628266:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.628277:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1061 expref: 20 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.628288:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1061 expref: 20 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.628299:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6800/0xe984082ccd724e43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1061 expref: 20 pid: 4581 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.628308:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.628322:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592141312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 62us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.628326:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4774 00000100:00100000:2.0:1746143688.628348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.628356:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592141568 00000100:00100000:2.0:1746143688.628359:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592141568 00010000:00010000:2.0:1746143688.628368:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b102a00/0xe984082ccd724cd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f50 expref: 10 pid: 8497 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746143688.628377:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4775 00000100:00100000:2.0:1746143688.628380:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592141568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.628386:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.628393:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b102a00/0xe984082ccd724cd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f50 expref: 10 pid: 8497 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746143688.628400:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b102a00/0xe984082ccd724cd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f50 expref: 10 pid: 8497 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746143688.628414:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b102a00/0xe984082ccd724cd0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0f50 expref: 10 pid: 8497 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746143688.628422:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.628424:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.628427:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.628433:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.628450:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.628464:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592141568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 83us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.628469:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4775 00010000:00010000:2.0:1746143688.628483:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.628490:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.628504:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.628511:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.628521:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.628527:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090745400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143688.628530:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.628536:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.628545:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.628550:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090745400/0xe984082ccd724f5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.628578:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592139776:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 23763us (24451us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.628584:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9326 00000100:00100000:2.0:1746143688.628626:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.628634:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592140160 00000100:00100000:2.0:1746143688.628637:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592140160 00010000:00010000:2.0:1746143688.628647:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd724e35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a105a expref: 19 pid: 8497 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746143688.628657:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4776 00000100:00100000:2.0:1746143688.628661:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963592140160:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.628667:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.628675:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd724e35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a105a expref: 19 pid: 8497 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746143688.628681:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd724e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a105a expref: 19 pid: 8497 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746143688.628691:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd724e35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a105a expref: 19 pid: 8497 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746143688.628700:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.628712:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963592140160:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 50us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.628717:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4776 00000100:00100000:2.0:1746143688.628742:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593691904:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.628755:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.628776:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.628784:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592140416 00000100:00100000:2.0:1746143688.628787:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592140416 00010000:00010000:2.0:1746143688.628795:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1045 expref: 18 pid: 12618 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.628804:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4777 00000100:00100000:2.0:1746143688.628807:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592140416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.628812:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.628818:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1045 expref: 18 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.628825:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1045 expref: 18 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.628835:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd724e27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1045 expref: 18 pid: 12618 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.628844:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.628856:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592140416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 48us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.628861:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4777 00000100:00100000:2.0:1746143688.628883:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.628912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.628921:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592140288 00000100:00100000:2.0:1746143688.628923:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592140288 00010000:00010000:2.0:1746143688.628933:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5807c00/0xe984082ccd724ee4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10ed expref: 10 pid: 12618 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746143688.628943:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4778 00000100:00100000:2.0:1746143688.628947:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592140288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.628953:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.628959:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5807c00/0xe984082ccd724ee4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10ed expref: 10 pid: 12618 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746143688.628970:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5807c00/0xe984082ccd724ee4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10ed expref: 10 pid: 12618 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746143688.628979:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5807c00/0xe984082ccd724ee4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10ed expref: 10 pid: 12618 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746143688.628986:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.628987:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.628990:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.628995:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.629005:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.629017:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592140288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 70us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.629022:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4778 00000100:00100000:2.0:1746143688.629035:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592141952 00000100:00100000:2.0:1746143688.629037:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592141952 00002000:00100000:2.0:1746143688.629050:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3260416->4194303) req@ffff88013691bb80 x1830963592141952/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/0 e 0 to 0 dl 1746143699 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143688.629056:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691bb80 with x1830963592141952 ext(3260416->4194303) 00010000:00010000:2.0:1746143688.629060:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 17 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.629071:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 17 pid: 25369 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746143688.629076:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013691bb80 00000100:00100000:2.0:1746143688.629090:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 814 00000100:00100000:2.0:1746143688.629094:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592141952:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:3.0:1746143688.629423:0:15784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.629430:0:15784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.629444:0:15784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.629450:0:15784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.629455:0:15784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.629459:0:15784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090744a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143688.629461:0:15784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.629470:0:15784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.629478:0:15784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.629483:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd724f46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143688.629515:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592139648:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 26838us (27456us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.629520:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9323 00000100:00100000:2.0:1746143688.630527:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.631029:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592141824 00000100:00100000:0.0:1746143688.631034:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592141824 00010000:00010000:0.0:1746143688.631051:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd7247eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c5c expref: 23 pid: 8497 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746143688.631309:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4779 00000100:00100000:0.0:1746143688.631316:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592141056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143688.631324:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143688.631336:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd724e66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1084 expref: 18 pid: 8497 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746143688.631345:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd724e66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1084 expref: 18 pid: 8497 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746143688.631358:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd724e66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1084 expref: 18 pid: 8497 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746143688.631369:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143688.631370:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143688.631374:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.631380:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.631395:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143688.631411:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592141056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 97us (3427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143688.631417:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4779 00000100:00100000:0.0:1746143688.631458:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4780 00000100:00100000:0.0:1746143688.631463:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592141824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143688.631468:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143688.631479:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd7247eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c5c expref: 23 pid: 8497 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.631486:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd7247eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c5c expref: 23 pid: 8497 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.631497:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd7247eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c5c expref: 23 pid: 8497 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.631505:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143688.631506:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143688.631508:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.631514:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.631759:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143688.631772:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592141824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 309us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143688.631777:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4780 00010000:00010000:2.0:1746143688.633046:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.633059:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.633079:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.633085:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.633091:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.633096:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ee0400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143688.633099:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.633109:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.633118:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.633123:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee0400/0xe984082ccd724f3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.633178:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592139392:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 30525us (31468us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.633185:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9322 00010000:00010000:1.0:1746143688.633397:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.633405:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.633419:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.633423:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.633428:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.633433:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbc6400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143688.633435:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.633444:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.633452:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.633457:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd724f54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143688.634419:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592140800:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6554us (6616us total) trans 17179872398 rc 0/0 00000100:00100000:0.0:1746143688.634427:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 813 00002000:00100000:0.0:1746143688.634434:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4276223) req@ffff8800930c3b80 x1830963592140800/t17179872398(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/448 e 0 to 0 dl 1746143699 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143688.634442:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c3b80 with x1830963592140800 ext(4194304->4276223) 00010000:00010000:0.0:1746143688.634448:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 10 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.634458:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 10 pid: 25369 timeout: 867 lvb_type: 0 00002000:00010000:0.0:1746143688.634464:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930c3b80 00000100:00100000:1.0:1746143688.634619:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592139520:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 30027us (30516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.634626:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9325 00000100:00100000:2.0:1746143688.638265:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.638295:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592142080 00000100:00100000:2.0:1746143688.638523:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592142080 00010000:00010000:2.0:1746143688.638620:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 22 pid: 25369 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.638698:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4781 00000100:00100000:2.0:1746143688.638706:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592142080:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.638719:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.638743:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 22 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.638754:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 22 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.638778:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724eb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2457600->2559999) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d1 expref: 22 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.638795:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.639236:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592142080:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 530us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.639243:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4781 00000100:00100000:0.0:1746143688.648359:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.648964:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592142208 00000100:00100000:3.0:1746143688.648971:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592142208 00010000:00010000:3.0:1746143688.649002:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 10 pid: 25369 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746143688.649032:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4782 00000100:00100000:3.0:1746143688.649039:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592142208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143688.649053:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143688.649075:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 10 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.649086:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 10 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.649111:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd724eba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10d8 expref: 10 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.649561:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.649563:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.649567:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.649575:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.649732:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143688.649775:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963592142208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 736us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.649781:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4782 00010000:00010000:1.0:1746143688.649834:0:12618:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.649842:0:12618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.649860:0:12618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.649866:0:12618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.649872:0:12618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.649881:0:12618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e93be00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143688.649884:0:12618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.649900:0:12618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.649909:0:12618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.649915:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e93be00/0xe984082ccd724f4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143688.649961:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1964:x1830963592139904:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 45567us (45911us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.649967:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9324 00000100:00100000:3.0:1746143688.654420:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592141952:12345-192.168.202.48@tcp:4:cat.0 Request processed in 25318us (25529us total) trans 21474839666 rc 0/0 00000100:00100000:3.0:1746143688.654430:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 814 00002000:00100000:3.0:1746143688.654440:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3260416->4194303) req@ffff88013691bb80 x1830963592141952/t21474839666(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:84/0 lens 488/448 e 0 to 0 dl 1746143699 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143688.654447:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691bb80 with x1830963592141952 ext(3260416->4194303) 00010000:00010000:3.0:1746143688.654456:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 17 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.654468:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 17 pid: 25369 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746143688.654475:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013691bb80 00000100:00100000:0.0:1746143688.658733:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.658804:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592142336 00000100:00100000:2.0:1746143688.658812:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592142336 00010000:00010000:2.0:1746143688.658840:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 17 pid: 25369 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.658874:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4783 00000100:00100000:2.0:1746143688.658880:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592142336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.658900:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.658919:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 17 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.658930:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 17 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.658948:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd724e9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3260416->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a10bc expref: 17 pid: 25369 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.658960:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.658963:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.658967:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.658974:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.658994:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.659026:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592142336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 146us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.659031:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4783 00010000:00010000:0.0:1746143688.659179:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.659186:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.659204:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.659210:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.659215:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.659221:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d520e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143688.659223:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.659229:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.659237:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.659242:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd724f62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143688.659288:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1964:x1830963592140032:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 54275us (55104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143688.659293:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9327 00000100:00100000:0.0:1746143688.660698:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.660795:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592142592 00000100:00100000:2.0:1746143688.660800:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592142592 00000100:00100000:2.0:1746143688.660837:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8225 00000100:00100000:2.0:1746143688.660843:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:28271:x1830963592142592:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:2.0:1746143688.660881:0:21713:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.660913:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd724f15 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1109 expref: 16 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.660926:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143688.660929:0:21713:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143688.660954:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143688.660964:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c7f expref: 26 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.660971:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 26 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.660980:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c9b expref: 265 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.660987:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9800/0xe984082ccd724c21 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee0 expref: 26 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.660992:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd724da2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fe3 expref: 265 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.660998:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f600/0xe984082ccd7248c4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d19 expref: 26 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.661003:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd724934 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d51 expref: 265 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.661008:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 10/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143688.661033:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd724934 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d51 expref: 265 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.661043:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd724934 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d51 expref: 265 pid: 14763 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.661054:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692032:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.661124:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f600/0xe984082ccd7248c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d19 expref: 26 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.661134:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f600/0xe984082ccd7248c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d19 expref: 26 pid: 14764 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.661161:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692160:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.661188:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd724da2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fe3 expref: 265 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.661194:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd724da2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fe3 expref: 265 pid: 21713 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.661200:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692288:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.661214:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9800/0xe984082ccd724c21 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee0 expref: 26 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.661219:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9800/0xe984082ccd724c21 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee0 expref: 26 pid: 21713 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.661224:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692416:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.661251:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c9b expref: 265 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.661257:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c9b expref: 265 pid: 21713 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.661263:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692544:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.661276:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 26 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.661282:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 26 pid: 14763 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.661287:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692672:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.661299:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c7f expref: 26 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.661304:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c7f expref: 26 pid: 14764 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.661309:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692800:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143688.661320:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143688.663446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.663465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.663476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.663550:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592143104 00000100:00100000:2.0:1746143688.663555:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592143104 00000100:00100000:2.0:1746143688.663586:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3333 00000100:00100000:2.0:1746143688.663592:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:23699:x1830963592143104:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143688.663762:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:23699:x1830963592143104:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 169us (294us total) trans 8589942317 rc 0/0 00000100:00100000:2.0:1746143688.663768:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3333 00000100:00100000:2.0:1746143688.663808:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592142720 00000100:00100000:2.0:1746143688.663811:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592142720 00010000:00010000:2.0:1746143688.663825:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f600/0xe984082ccd7248c4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d19 expref: 27 pid: 14764 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.663843:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592142848 00000100:00100000:2.0:1746143688.663845:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592142848 00010000:00010000:2.0:1746143688.663853:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd724934 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d51 expref: 267 pid: 14763 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.663865:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4784 00000100:00100000:2.0:1746143688.663869:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1963:x1830963592142720:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.663876:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.663880:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f600/0xe984082ccd7248c4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d19 expref: 27 pid: 14764 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.663887:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f600/0xe984082ccd7248c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d19 expref: 27 pid: 14764 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.663913:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143688.663916:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143688.663923:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.663938:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1963:x1830963592142720:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 68us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.663943:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4784 00000100:00100000:2.0:1746143688.663953:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4785 00000100:00100000:2.0:1746143688.663957:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:1963:x1830963592142848:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.663962:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.663965:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd724934 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d51 expref: 267 pid: 14763 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.663973:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd724934 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d51 expref: 267 pid: 14763 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.663982:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143688.663984:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143688.663988:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.664000:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:1963:x1830963592142848:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 43us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.664004:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4785 00010000:00010000:3.0:1746143688.664406:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5fe00/0xe984082ccd724934 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d51 expref: 266 pid: 14763 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746143688.664432:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692032:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143688.664441:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a630f600/0xe984082ccd7248c4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0d19 expref: 26 pid: 14764 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746143688.664448:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692160:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143688.664455:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692288:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143688.664460:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692416:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143688.665573:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.665603:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.665626:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.665651:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.665756:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592143360 00000100:00100000:3.0:1746143688.665757:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692544:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143688.665761:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592143360 00000100:00100000:3.0:1746143688.665765:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692672:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143688.665774:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593692800:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143688.665789:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3334 00000100:00100000:1.0:1746143688.665794:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:23698:x1830963592143360:12345-192.168.202.48@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1746143688.665804:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:2.0:1746143688.666050:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592143488 00000100:00100000:2.0:1746143688.666054:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592143488 00010000:00010000:2.0:1746143688.666069:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c9b expref: 266 pid: 21713 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.666089:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592143616 00000100:00100000:2.0:1746143688.666090:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592143616 00000100:00100000:3.0:1746143688.666092:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592143744 00000100:00100000:3.0:1746143688.666095:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592143744 00010000:00010000:2.0:1746143688.666098:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 29 pid: 14763 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.666109:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c7f expref: 29 pid: 14764 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.666112:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4786 00000100:00100000:2.0:1746143688.666116:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:1964:x1830963592143488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.666123:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143688.666125:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4787 00010000:00010000:2.0:1746143688.666127:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c9b expref: 266 pid: 21713 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746143688.666130:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1965:x1830963592143616:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143688.666160:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.666160:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c9b expref: 266 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.666165:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 29 pid: 14763 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.666174:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd724831 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c9b expref: 266 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.666181:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 29 pid: 14763 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.666191:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd72482a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c94 expref: 29 pid: 14763 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.666207:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143688.666210:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143688.666216:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143688.666242:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1965:x1830963592143616:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 111us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.666247:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4787 00000100:00100000:3.0:1746143688.666260:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4788 00000100:00100000:3.0:1746143688.666265:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963592143744:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143688.666271:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143688.666274:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c7f expref: 27 pid: 14764 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.666279:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c7f expref: 27 pid: 14764 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.666288:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25b600/0xe984082ccd724815 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0c7f expref: 27 pid: 14764 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746143688.666295:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143688.666298:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143688.666302:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143688.666327:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592143744:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 61us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.666333:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4788 00000100:00100000:1.0:1746143688.666375:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+25:23698:x1830963592143360:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 580us (803us total) trans 8589942318 rc 0/0 00000100:00100000:1.0:1746143688.666380:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3334 00010000:00010000:2.0:1746143688.666432:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143688.666435:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143688.666440:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.666456:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:1964:x1830963592143488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 339us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.666462:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4786 00000100:00100000:0.0:1746143688.666665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.666937:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592143872 00000100:00100000:2.0:1746143688.666940:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592143872 00010000:00010000:2.0:1746143688.666952:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd724da2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fe3 expref: 265 pid: 21713 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.666966:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4789 00000100:00100000:2.0:1746143688.666971:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:1965:x1830963592143872:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143688.666976:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143688.666980:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd724da2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fe3 expref: 265 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.666988:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd724da2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fe3 expref: 265 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.667002:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd724da2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0fe3 expref: 265 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746143688.667010:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143688.667013:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143688.667018:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143688.667035:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:1965:x1830963592143872:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 64us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.667040:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4789 00000100:00100000:1.0:1746143688.669908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.669991:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592144000 00000100:00100000:0.0:1746143688.670000:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592144000 00010000:00010000:0.0:1746143688.670031:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9800/0xe984082ccd724c21 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee0 expref: 25 pid: 21713 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746143688.670101:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4790 00000100:00100000:0.0:1746143688.670108:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963592144000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143688.670121:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143688.670126:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9800/0xe984082ccd724c21 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee0 expref: 25 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.670162:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9800/0xe984082ccd724c21 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee0 expref: 25 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.670180:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01c9800/0xe984082ccd724c21 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a0ee0 expref: 25 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746143688.670419:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:0.0:1746143688.670423:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143688.670431:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143688.670436:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143688.670554:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143688.670598:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963592144000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 489us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143688.670604:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4790 00010000:00010000:2.0:1746143688.670757:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143688.670765:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000040:00080000:2.0:1746143688.671396:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2239, 88 off187968 00000004:00080000:2.0:1746143688.671403:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767681263213ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143688.671427:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2193, 88 off183744 00000004:00080000:2.0:1746143688.671431:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767681291395ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143688.671454:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2194, 88 off183832 00000004:00080000:2.0:1746143688.671457:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767681317181ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143688.671464:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2240, 88 off188056 00000004:00080000:2.0:1746143688.671466:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767681326033ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143688.671472:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2241, 88 off188144 00000004:00080000:2.0:1746143688.671474:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767681334285ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143688.671480:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2195, 88 off183920 00000004:00080000:2.0:1746143688.671483:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767681343098ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143688.671489:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2196, 88 off184008 00000004:00080000:2.0:1746143688.671491:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767681351446ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143688.671497:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2197, 88 off184096 00000004:00080000:2.0:1746143688.671499:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767681359825ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143688.671505:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2242, 88 off188232 00000004:00080000:2.0:1746143688.671508:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767681368006ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143688.671513:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2198, 88 off184184 00000004:00080000:2.0:1746143688.671516:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767681376091ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143688.671521:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2243, 88 off188320 00000004:00080000:2.0:1746143688.671523:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767681383753ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143688.671529:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2199, 88 off184272 00000004:00080000:2.0:1746143688.671532:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767681392020ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143688.671559:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2245, 88 off188504 00000004:00080000:2.0:1746143688.671562:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767681422075ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143688.671569:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2246, 88 off188592 00000004:00080000:2.0:1746143688.671572:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767681432698ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143688.671578:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2247, 88 off188680 00000004:00080000:2.0:1746143688.671581:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767681441391ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143688.671587:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2248, 88 off188768 00000004:00080000:2.0:1746143688.671589:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767681449501ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143688.671596:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2200, 88 off184360 00000004:00080000:2.0:1746143688.671598:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767681458426ns, next at 718087967394ns, rc = 0 00000001:00080000:0.0:1746143688.697979:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942312 is committed 00000001:00080000:0.0:1746143688.697987:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942311 is committed 00000001:00080000:0.0:1746143688.697998:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942318 is committed 00000001:00080000:0.0:1746143688.698005:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942316 is committed 00000001:00080000:0.0:1746143688.698022:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942319 is committed 00000004:00080000:0.0:1746143688.698027:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1546 committed 00000004:00080000:0.0:1746143688.698033:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1593 committed 00000004:00080000:0.0:1746143688.698039:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1592 committed 00000004:00080000:0.0:1746143688.698041:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1591 committed 00000004:00080000:0.0:1746143688.698044:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1590 committed 00000004:00080000:0.0:1746143688.698046:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1545 committed 00000004:00080000:0.0:1746143688.698047:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1589 committed 00000004:00080000:0.0:1746143688.698049:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1544 committed 00000004:00080000:0.0:1746143688.698051:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1588 committed 00000004:00080000:0.0:1746143688.698052:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1543 committed 00000004:00080000:0.0:1746143688.698053:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1542 committed 00000004:00080000:0.0:1746143688.698054:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1541 committed 00000004:00080000:0.0:1746143688.698056:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1587 committed 00000004:00080000:0.0:1746143688.698057:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1586 committed 00000004:00080000:0.0:1746143688.698058:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1540 committed 00000004:00080000:0.0:1746143688.698059:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1539 committed 00000004:00080000:0.0:1746143688.698061:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1585 committed 00000001:00080000:0.0:1746143688.698064:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942317 is committed 00000004:00010000:2.0:1746143688.698351:0:21713:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800930c0380 reply state ffff88009554e000 transno 8589942319 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:2.0:1746143688.698360:0:21713:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746143688.698446:0:21713:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143688.698459:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28271:x1830963592142592:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 37613us (37761us total) trans 8589942319 rc 0/0 00000100:00100000:2.0:1746143688.698467:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8225 00000100:00100000:3.0:1746143688.712507:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593693312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143688.712563:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.712674:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593693184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.712697:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.712808:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593693312 00000100:00100000:1.0:1746143688.712814:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593693312 00000100:00100000:1.0:1746143688.712844:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593693184 00000100:00100000:1.0:1746143688.712846:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593693184 00000100:00100000:1.0:1746143688.712861:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9328 00000100:00100000:1.0:1746143688.712866:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3295:x1830963593693312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.713081:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3295:x1830963593693312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 214us (517us total) trans 21474839667 rc 0/0 00000100:00100000:1.0:1746143688.713087:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9328 00000100:00100000:1.0:1746143688.713101:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9329 00000100:00100000:1.0:1746143688.713105:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3294:x1830963593693184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.713210:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3294:x1830963593693184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (511us total) trans 21474839668 rc 0/0 00000100:00100000:1.0:1746143688.713215:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9329 00000100:00100000:0.0:1746143688.714474:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593692928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143688.714511:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143688.714553:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593692928 00000100:00100000:0.0:1746143688.714557:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593692928 00000100:00100000:0.0:1746143688.714622:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9330 00000100:00100000:0.0:1746143688.714627:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3292:x1830963593692928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143688.714876:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3292:x1830963593692928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 247us (364us total) trans 21474839669 rc 0/0 00000100:00100000:0.0:1746143688.714881:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9330 00000100:00100000:1.0:1746143688.715047:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.715206:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592144128 00000100:00100000:0.0:1746143688.715210:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592144128 00000100:00100000:0.0:1746143688.715231:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8226 00000100:00100000:0.0:1746143688.715235:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28271:x1830963592144128:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143688.715249:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143688.715263:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1125 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.715306:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143688.715313:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.715327:0:21713:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143688.715337:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.715348:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:0.0:1746143688.715350:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143688.715352:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.715357:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c176a00, rc 0) 00000100:00100000:0.0:1746143688.715384:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28271:x1830963592144128:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 148us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143688.715389:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8226 00010000:00010000:3.0:1746143688.715750:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143688.715758:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143688.715763:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143688.715768:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bd2d200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143688.715771:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143688.715776:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143688.715786:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:3.0:1746143688.715789:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143688.715792:0:3278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.715799:0:3278:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.715806:0:3278:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.715829:0:3278:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143688.715838:0:3278:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3278:1830963593694976:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143688.715884:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593693056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143688.715918:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143688.715935:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593693056 00000100:00100000:3.0:1746143688.715938:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593693056 00000100:00100000:3.0:1746143688.715953:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9331 00000100:00100000:3.0:1746143688.715957:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3293:x1830963593693056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143688.716095:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3293:x1830963593693056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 138us (177us total) trans 17179872399 rc 0/0 00000100:00100000:3.0:1746143688.716100:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9331 00000100:00100000:0.0:1746143688.719695:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000004:00080000:1.0:1746143688.719934:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d3b80/2, rc 0, transno 21474839668 00000100:00100000:1.0:1746143688.719942:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593693184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.719950:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593693696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.719985:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.720017:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593694208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.720034:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.720047:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593694720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.720059:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.720072:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746143688.720077:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593694336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.720089:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.720099:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593694848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.720109:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.720128:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593693696 00000100:00100000:1.0:1746143688.720133:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593693696 00000100:00100000:1.0:1746143688.720176:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593694208 00000100:00100000:1.0:1746143688.720178:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593694208 00000100:00100000:1.0:1746143688.720187:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593694720 00000100:00100000:1.0:1746143688.720189:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593694720 00000100:00100000:1.0:1746143688.720199:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593694336 00000100:00100000:1.0:1746143688.720200:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593694336 00000100:00100000:1.0:1746143688.720208:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593694848 00000100:00100000:1.0:1746143688.720209:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593694848 00000100:00100000:1.0:1746143688.720220:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9332 00000100:00100000:1.0:1746143688.720225:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3294:x1830963593693696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.720414:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3294:x1830963593693696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 187us (428us total) trans 21474839670 rc 0/0 00000100:00100000:1.0:1746143688.720420:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9332 00000100:00100000:1.0:1746143688.720433:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9333 00000100:00100000:1.0:1746143688.720437:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3294:x1830963593694208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.720558:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3294:x1830963593694208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (522us total) trans 17179872400 rc 0/0 00000100:00100000:1.0:1746143688.720564:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9333 00000100:00100000:1.0:1746143688.720575:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9334 00000100:00100000:1.0:1746143688.720580:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3294:x1830963593694720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.720691:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3294:x1830963593694720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (629us total) trans 17179872401 rc 0/0 00000100:00100000:1.0:1746143688.720697:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9334 00000100:00100000:1.0:1746143688.720707:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9335 00000100:00100000:1.0:1746143688.720712:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3294:x1830963593694336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143688.720798:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143688.720800:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746143688.720802:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143688.720803:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746143688.720805:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143688.720826:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3294:x1830963593694336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (735us total) trans 17179872402 rc 0/0 00000100:00100000:1.0:1746143688.720830:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9335 00000100:00100000:1.0:1746143688.720838:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9336 00000100:00100000:1.0:1746143688.720842:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3294:x1830963593694848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.720931:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3294:x1830963593694848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (820us total) trans 17179872403 rc 0/0 00000100:00100000:1.0:1746143688.720935:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9336 00000004:00080000:1.0:1746143688.720961:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7ce680/2, rc 0, transno 17179872402 00000100:00100000:1.0:1746143688.720968:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593694336:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143688.720974:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cf100/2, rc 0, transno 17179872403 00000100:00100000:1.0:1746143688.720976:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593694848:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143688.720981:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cd880/2, rc 0, transno 17179872400 00000100:00100000:1.0:1746143688.720983:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593694208:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143688.720989:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cdc00/2, rc 0, transno 17179872401 00000100:00100000:1.0:1746143688.720991:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593694720:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143688.720997:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d0a80/2, rc 0, transno 21474839670 00000100:00100000:1.0:1746143688.721000:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593693696:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143688.721071:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cc700/2, rc 0, transno 17179872399 00000100:00100000:1.0:1746143688.721073:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593693056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.721078:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593693568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.721094:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.721103:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593694080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.721115:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.721124:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593694592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.721135:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.721170:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746143688.721175:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593695104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.721188:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.721202:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593693568 00000100:00100000:1.0:1746143688.721204:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593693568 00000100:00100000:1.0:1746143688.721217:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593694080 00000100:00100000:1.0:1746143688.721219:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593694080 00000100:00100000:1.0:1746143688.721223:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593694592 00000100:00100000:1.0:1746143688.721225:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593694592 00000100:00100000:1.0:1746143688.721229:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593695104 00000100:00100000:1.0:1746143688.721230:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593695104 00000100:00100000:1.0:1746143688.721235:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9337 00000100:00100000:1.0:1746143688.721238:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3293:x1830963593693568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143688.721336:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:1.0:1746143688.721339:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:1.0:1746143688.721340:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143688.721342:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:1.0:1746143688.721344:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:1.0:1746143688.721361:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3293:x1830963593693568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (267us total) trans 21474839671 rc 0/0 00000100:00100000:1.0:1746143688.721366:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9337 00000100:00100000:1.0:1746143688.721373:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9338 00000100:00100000:1.0:1746143688.721377:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963593694080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.721451:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593694080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (335us total) trans 17179872404 rc 0/0 00000100:00100000:1.0:1746143688.721455:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9338 00000100:00100000:1.0:1746143688.721461:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9339 00000100:00100000:1.0:1746143688.721464:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963593694592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.721520:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593694592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (384us total) trans 17179872405 rc 0/0 00000100:00100000:1.0:1746143688.721525:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9339 00000100:00100000:1.0:1746143688.721531:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9340 00000100:00100000:1.0:1746143688.721534:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963593695104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.721589:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593695104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (400us total) trans 17179872406 rc 0/0 00000100:00100000:1.0:1746143688.721593:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9340 00000004:00080000:1.0:1746143688.721608:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7c2680/2, rc 0, transno 17179872406 00000100:00100000:1.0:1746143688.721611:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593695104:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143688.721616:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d3100/2, rc 0, transno 21474839671 00000100:00100000:1.0:1746143688.721618:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593693568:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143688.721622:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cc000/2, rc 0, transno 17179872404 00000100:00100000:1.0:1746143688.721625:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593694080:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143688.721629:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cd500/2, rc 0, transno 17179872405 00000100:00100000:1.0:1746143688.721631:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593694592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143688.721736:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d2300/2, rc 0, transno 21474839669 00000100:00100000:0.0:1746143688.721739:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593692928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143688.721744:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593693440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143688.721763:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143688.721779:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593693952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143688.721792:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143688.721802:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593694464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143688.721815:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143688.721838:0:3278:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143688.721851:0:3278:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3278:1830963593694976:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143688.721871:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143688.721879:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd724f69 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143688.721911:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593693440 00000100:00100000:0.0:1746143688.721913:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593693440 00000100:00100000:0.0:1746143688.721928:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593693952 00000100:00100000:0.0:1746143688.721929:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593693952 00000100:00100000:0.0:1746143688.721937:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593694464 00000100:00100000:0.0:1746143688.721938:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593694464 00000100:00100000:0.0:1746143688.721945:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9341 00000100:00100000:0.0:1746143688.721949:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3292:x1830963593693440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143688.722027:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143688.722029:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143688.722031:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143688.722032:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143688.722033:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143688.722056:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3292:x1830963593693440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (292us total) trans 21474839672 rc 0/0 00000100:00100000:0.0:1746143688.722060:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9341 00000100:00100000:0.0:1746143688.722072:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9342 00000100:00100000:0.0:1746143688.722077:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3292:x1830963593693952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143688.722169:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3292:x1830963593693952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (375us total) trans 21474839673 rc 0/0 00000100:00100000:0.0:1746143688.722173:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9342 00000100:00100000:0.0:1746143688.722183:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9343 00000100:00100000:0.0:1746143688.722187:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963593694464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143688.722260:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963593694464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (443us total) trans 17179872407 rc 0/0 00000100:00100000:0.0:1746143688.722265:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9343 00000004:00080000:0.0:1746143688.722283:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d2a00/2, rc 0, transno 21474839672 00000100:00100000:0.0:1746143688.722287:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593693440:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143688.722292:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d1c00/2, rc 0, transno 21474839673 00000100:00100000:0.0:1746143688.722293:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593693952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143688.722299:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cc380/2, rc 0, transno 17179872407 00000100:00100000:0.0:1746143688.722301:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593694464:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143688.723191:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d3800/2, rc 0, transno 21474839667 00000100:00100000:3.0:1746143688.723196:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593693312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143688.723201:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593693824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143688.723226:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143688.723265:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593693824 00000100:00100000:3.0:1746143688.723269:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593693824 00000100:00100000:3.0:1746143688.726213:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9344 00000100:00100000:3.0:1746143688.726230:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963593693824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143688.726445:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963593693824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 222us (3218us total) trans 21474839674 rc 0/0 00000100:00100000:3.0:1746143688.726451:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9344 00000004:00080000:3.0:1746143688.726637:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d2680/2, rc 0, transno 21474839674 00000100:00100000:3.0:1746143688.726642:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593693824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143688.726726:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592144256 00000100:00100000:2.0:1746143688.726732:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592144256 00000100:00100000:1.0:1746143688.727860:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3335 00000100:00100000:1.0:1746143688.727869:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28271:x1830963592144256:12345-192.168.202.48@tcp:49:lfs.0 00000100:00100000:1.0:1746143688.730884:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28271:x1830963592144256:12345-192.168.202.48@tcp:49:lfs.0 Request processed in 3007us (11185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.730904:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3335 00000100:00100000:0.0:1746143688.733222:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.733969:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592144384 00000100:00100000:1.0:1746143688.733978:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592144384 00000100:00100000:0.0:1746143688.735094:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8227 00000100:00100000:0.0:1746143688.735105:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28271:x1830963592144384:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143688.735122:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143688.735137:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd724f77 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a112c expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.735227:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ac00/0xe984082ccd724f7e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143688.735241:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ac00/0xe984082ccd724f7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143688.735251:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ac00/0xe984082ccd724f7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143688.735273:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:0.0:1746143688.735277:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143688.735289:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ac00/0xe984082ccd724f7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143688.735310:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd724f77 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a112c expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.735322:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ac00/0xe984082ccd724f7e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a112c expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.735329:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:0.0:1746143688.735331:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143688.735333:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c25ac00, rc 0) 00000100:00100000:0.0:1746143688.735391:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28271:x1830963592144384:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 288us (2174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143688.735397:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8227 00000100:00100000:0.0:1746143688.746009:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.746099:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592144512 00000100:00100000:2.0:1746143688.746107:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592144512 00000100:00100000:2.0:1746143688.746185:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9345 00000100:00100000:2.0:1746143688.746192:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1965:x1830963592144512:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143688.746208:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143688.746223:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd724f85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1133 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143688.746246:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409c4, atime: 0x681409c4, ctime: 0x681409c4, blocks: 0x809 00010000:00010000:2.0:1746143688.746264:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.746265:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.746273:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd724f85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1133 expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.746287:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd724f85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1133 expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.746297:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e5200, rc 0) 00000100:00100000:2.0:1746143688.746336:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963592144512:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 143us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.746342:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9345 00000100:00100000:0.0:1746143688.750844:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.751015:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.751804:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592144768 00000100:00100000:3.0:1746143688.751812:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592144768 00000100:00100000:0.0:1746143688.751818:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.751833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.751847:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592145024 00000100:00100000:3.0:1746143688.751849:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592145024 00000100:00100000:0.0:1746143688.751854:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.767517:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592144640 00000100:00100000:2.0:1746143688.767525:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592144896 00000100:00100000:3.0:1746143688.767530:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592144640 00000100:00100000:2.0:1746143688.767530:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592144896 00000100:00100000:3.0:1746143688.767575:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592145152 00000100:00100000:3.0:1746143688.767577:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592145152 00000100:00100000:2.0:1746143688.767591:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9346 00000100:00100000:2.0:1746143688.767599:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592144768:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:3.0:1746143688.767601:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9347 00000100:00100000:3.0:1746143688.767605:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592145024:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143688.767613:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143688.767613:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143688.767630:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724f93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a114f expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.767630:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5400/0xe984082ccd724f8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1141 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143688.767649:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 4897312, mtime: 0x681409c8, atime: 0x681409c7, ctime: 0x681409c8, blocks: 0x15a5 00002000:00010000:2.0:1746143688.767649:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34b:0x0] initial LVB size: 2097152, mtime: 0x681409c7, atime: 0x681409c6, ctime: 0x681409c7, blocks: 0x821 00010000:00010000:3.0:1746143688.767665:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.767665:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.767667:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.767667:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.767674:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724f93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a114f expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.767674:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5400/0xe984082ccd724f8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1141 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143688.767687:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724f93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a114f expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.767687:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5400/0xe984082ccd724f8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1141 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143688.767694:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744e00, rc 0) 00010000:00010000:2.0:1746143688.767694:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e5400, rc 0) 00000100:00100000:2.0:1746143688.767739:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592144768:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 141us (16903us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.767742:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592145024:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 137us (16728us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.767745:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9346 00000100:00100000:3.0:1746143688.767747:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9347 00000100:00100000:3.0:1746143688.767758:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9348 00000100:00100000:2.0:1746143688.767760:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9349 00000100:00100000:3.0:1746143688.767762:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592144640:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:2.0:1746143688.767764:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592144896:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143688.767768:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143688.767768:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143688.767774:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090745400/0xe984082ccd724f9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a113a expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.767774:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5600/0xe984082ccd724fa1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1148 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143688.767783:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34a:0x0] initial LVB size: 2097152, mtime: 0x681409c7, atime: 0x681409c7, ctime: 0x681409c7, blocks: 0x821 00002000:00010000:2.0:1746143688.767783:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409c6, atime: 0x681409c6, ctime: 0x681409c6, blocks: 0x821 00010000:00010000:3.0:1746143688.767790:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.767790:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.767791:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.767791:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.767794:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090745400/0xe984082ccd724f9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a113a expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.767794:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5600/0xe984082ccd724fa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1148 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143688.767802:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090745400/0xe984082ccd724f9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a113a expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143688.767802:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5600/0xe984082ccd724fa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1148 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143688.767808:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090745400, rc 0) 00010000:00010000:2.0:1746143688.767808:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e5600, rc 0) 00000100:00100000:3.0:1746143688.767821:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592144640:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 59us (16003us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143688.767821:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592144896:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 57us (15987us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.767826:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9348 00000100:00100000:2.0:1746143688.767828:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9349 00000100:00100000:3.0:1746143688.767834:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9350 00000100:00100000:3.0:1746143688.767838:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592145152:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143688.767843:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143688.767850:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090744c00/0xe984082ccd724fa8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1156 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143688.767858:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409c8, atime: 0x681409c8, ctime: 0x681409c8, blocks: 0x1029 00010000:00010000:3.0:1746143688.767863:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.767864:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.767867:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090744c00/0xe984082ccd724fa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1156 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143688.767874:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090744c00/0xe984082ccd724fa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1156 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143688.767879:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744c00, rc 0) 00000100:00100000:3.0:1746143688.767902:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592145152:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 63us (16047us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143688.767907:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9350 00000100:00100000:0.0:1746143688.774441:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.774523:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592145408 00000100:00100000:3.0:1746143688.774531:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592145408 00000100:00100000:3.0:1746143688.774582:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3380 00000100:00100000:3.0:1746143688.774589:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592145408:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143688.774621:0:8502:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6dc00/0xe984082ccd724faf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.774632:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.774633:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.774637:0:8502:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6dc00/0xe984082ccd724faf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.774647:0:8502:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6dc00/0xe984082ccd724faf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143688.780444:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.782702:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592145664 00000100:00100000:2.0:1746143688.782712:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592145664 00000100:00100000:2.0:1746143688.782783:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3381 00000100:00100000:2.0:1746143688.782791:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592145664:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143688.782822:0:26144:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5c00/0xe984082ccd724fb6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.782834:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.782835:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.782840:0:26144:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5c00/0xe984082ccd724fb6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.782850:0:26144:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5c00/0xe984082ccd724fb6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143688.785597:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.787294:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592145920 00000100:00100000:3.0:1746143688.787303:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592145920 00000100:00100000:2.0:1746143688.788513:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3382 00000100:00100000:2.0:1746143688.788525:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592145920:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143688.788558:0:21518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5e00/0xe984082ccd724fbd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.788570:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.788572:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.788576:0:21518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5e00/0xe984082ccd724fbd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.788587:0:21518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5e00/0xe984082ccd724fbd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143688.791432:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143688.794831:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592146176 00000100:00100000:3.0:1746143688.794842:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592146176 00000100:00100000:1.0:1746143688.798221:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3383 00000100:00100000:1.0:1746143688.798237:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592146176:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143688.798274:0:8501:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012caac000/0xe984082ccd724fc4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.798286:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143688.798288:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143688.798292:0:8501:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012caac000/0xe984082ccd724fc4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.798302:0:8501:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012caac000/0xe984082ccd724fc4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143688.799282:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.799350:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.800320:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592146432 00000100:00100000:2.0:1746143688.800327:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592146432 00000100:00100000:2.0:1746143688.800364:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592146816 00000100:00100000:2.0:1746143688.800367:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592146816 00000100:00100000:2.0:1746143688.800384:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3384 00000100:00100000:2.0:1746143688.800390:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1962:x1830963592146432:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143688.800411:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4c00/0xe984082ccd724fcb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.800420:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.800422:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143688.800425:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4c00/0xe984082ccd724fcb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.800433:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4c00/0xe984082ccd724fcb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143688.801718:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3385 00000100:00100000:3.0:1746143688.801727:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1962:x1830963592146816:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143688.801748:0:31339:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724fd2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.801756:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.801757:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.801760:0:31339:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724fd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.801768:0:31339:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724fd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143688.803446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.803583:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.803679:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592146944 00000100:00100000:1.0:1746143688.803686:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592146944 00000100:00100000:1.0:1746143688.803724:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592147200 00000100:00100000:1.0:1746143688.803726:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592147200 00000100:00100000:1.0:1746143688.803745:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3386 00000100:00100000:1.0:1746143688.803750:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1963:x1830963592146944:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143688.803774:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093bfba00/0xe984082ccd724fd9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.803784:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143688.803785:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143688.803789:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfba00/0xe984082ccd724fd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.803797:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bfba00/0xe984082ccd724fd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143688.804966:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3387 00000100:00100000:0.0:1746143688.804973:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1962:x1830963592147200:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143688.804991:0:8500:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801351bd200/0xe984082ccd724fe0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.804999:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143688.805508:0:8502:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6dc00/0xe984082ccd724faf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.805516:0:8502:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6dc00/0xe984082ccd724faf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.805522:0:8502:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6dc00/0xe984082ccd724faf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.805532:0:8502:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1e6dc00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143688.805535:0:8502:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6dc00/0xe984082ccd724faf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.805541:0:8502:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6dc00/0xe984082ccd724faf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.805556:0:8502:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6dc00/0xe984082ccd724faf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.805561:0:8502:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6dc00/0xe984082ccd724faf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143688.805629:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1962:x1830963592145408:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 31039us (31195us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143688.805635:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3380 00010000:00010000:0.0:1746143688.810388:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143688.810397:0:8500:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bd200/0xe984082ccd724fe0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.810415:0:8500:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351bd200/0xe984082ccd724fe0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.811304:0:26144:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5c00/0xe984082ccd724fb6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.811314:0:26144:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5c00/0xe984082ccd724fb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.811320:0:26144:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5c00/0xe984082ccd724fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.811326:0:26144:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4e5c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143688.811329:0:26144:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5c00/0xe984082ccd724fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.811336:0:26144:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5c00/0xe984082ccd724fb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.811348:0:26144:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5c00/0xe984082ccd724fb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.811354:0:26144:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5c00/0xe984082ccd724fb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143688.811404:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1962:x1830963592145664:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 28610us (30965us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143688.811412:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3381 00010000:00010000:2.0:1746143688.822262:0:21518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5e00/0xe984082ccd724fbd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.822276:0:21518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5e00/0xe984082ccd724fbd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.822283:0:21518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5e00/0xe984082ccd724fbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.822289:0:21518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4e5e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143688.822292:0:21518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5e00/0xe984082ccd724fbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.822299:0:21518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5e00/0xe984082ccd724fbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.822314:0:21518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5e00/0xe984082ccd724fbd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.822320:0:21518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5e00/0xe984082ccd724fbd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.822410:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963592145920:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 33883us (36815us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143688.822418:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3382 00010000:00010000:3.0:1746143688.832107:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4c00/0xe984082ccd724fcb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.832120:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4c00/0xe984082ccd724fcb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.832126:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4c00/0xe984082ccd724fcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.832132:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4e4c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143688.832135:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4c00/0xe984082ccd724fcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.832157:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4c00/0xe984082ccd724fcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.832172:0:8501:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012caac000/0xe984082ccd724fc4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.832173:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4c00/0xe984082ccd724fcb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.832178:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4c00/0xe984082ccd724fcb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.832181:0:8501:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012caac000/0xe984082ccd724fc4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.832187:0:8501:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012caac000/0xe984082ccd724fc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.832192:0:8501:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012caac000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143688.832195:0:8501:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012caac000/0xe984082ccd724fc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.832201:0:8501:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012caac000/0xe984082ccd724fc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.832215:0:8501:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012caac000/0xe984082ccd724fc4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.832221:0:8501:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012caac000/0xe984082ccd724fc4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143688.832249:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963592146432:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 31854us (32965us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143688.832257:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3384 00000100:00100000:1.0:1746143688.832318:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592146176:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 34086us (40890us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143688.832325:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3383 00010000:00010000:3.0:1746143688.851599:0:31339:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724fd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.851612:0:31339:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724fd2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.851620:0:31339:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.851626:0:31339:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009133d200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143688.851630:0:31339:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.851637:0:31339:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724fd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.851653:0:31339:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724fd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143688.851662:0:31339:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd724fd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143688.851768:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592146816:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 50037us (52412us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143688.851776:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3385 00010000:00010000:1.0:1746143688.856497:0:31338:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093bfba00/0xe984082ccd724fd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.856511:0:31338:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfba00/0xe984082ccd724fd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.856518:0:31338:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093bfba00/0xe984082ccd724fd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.856525:0:31338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bfba00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143688.856529:0:31338:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfba00/0xe984082ccd724fd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.856536:0:31338:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bfba00/0xe984082ccd724fd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.856553:0:31338:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093bfba00/0xe984082ccd724fd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.856564:0:31338:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bfba00/0xe984082ccd724fd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143688.856651:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592146944:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 52895us (53205us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143688.856659:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3386 00010000:00010000:2.0:1746143688.863964:0:8500:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801351bd200/0xe984082ccd724fe0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.863982:0:8500:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bd200/0xe984082ccd724fe0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.863989:0:8500:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801351bd200/0xe984082ccd724fe0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.863997:0:8500:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801351bd200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143688.864000:0:8500:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801351bd200/0xe984082ccd724fe0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.864007:0:8500:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801351bd200/0xe984082ccd724fe0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.864024:0:8500:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801351bd200/0xe984082ccd724fe0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.864030:0:8500:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351bd200/0xe984082ccd724fe0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143688.867332:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592147200:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 62337us (63727us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143688.867350:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3387 00000100:00100000:0.0:1746143688.876249:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143688.878397:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592147456 00000100:00100000:1.0:1746143688.878412:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592147456 00000100:00100000:1.0:1746143688.878503:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8228 00000100:00100000:1.0:1746143688.878511:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28271:x1830963592147456:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:1.0:1746143688.878564:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143688.878595:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ac00/0xe984082ccd724f7e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a112c expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143688.878629:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:1.0:1746143688.878634:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143688.878686:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd724fe7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143688.878699:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd724fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143688.878707:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd724fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00010000:1.0:1746143688.878903:0:20509:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009445aa00 reply state ffff88009e622000 transno 8589942320 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd724fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:1.0:1746143688.878914:0:20509:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746143688.879012:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28271:x1830963592147456:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 500us (2776us total) trans 8589942320 rc 0/0 00000100:00100000:1.0:1746143688.879018:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8228 00000100:00100000:0.0:1746143688.883302:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.883330:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.883344:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.883357:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.883376:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.883473:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.883514:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592147712 00000100:00100000:0.0:1746143688.883524:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592147712 00000100:00100000:3.0:1746143688.883532:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592147584 00000100:00100000:3.0:1746143688.883537:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592147584 00000100:00100000:0.0:1746143688.883559:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9351 00000100:00100000:0.0:1746143688.883566:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592147712:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:3.0:1746143688.883568:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592147840 00000100:00100000:3.0:1746143688.883570:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592147840 00000100:00100000:3.0:1746143688.883582:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592148096 00000100:00100000:3.0:1746143688.883584:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592148096 00000100:00100000:3.0:1746143688.883593:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592147968 00000100:00100000:3.0:1746143688.883595:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592147968 00000100:00100000:3.0:1746143688.883604:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592148224 00000100:00100000:3.0:1746143688.883605:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592148224 00000100:00100000:3.0:1746143688.883614:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9352 00000100:00100000:3.0:1746143688.883620:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592147584:12345-192.168.202.48@tcp:2:lfs.0 00010000:00010000:1.0:1746143688.883668:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd724fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143688.883681:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd724fe7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143688.883689:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd724fe7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143688.883696:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bfa800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143688.883701:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd724fe7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143688.883708:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd724fe7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143688.883727:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:1.0:1746143688.883729:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143688.883733:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd724fe7 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143688.883738:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd724fe7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00000100:00100000:1.0:1746143688.883763:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9353 00000100:00100000:1.0:1746143688.883769:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592147840:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143688.883778:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143688.883778:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143688.883780:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143684 -> 1746143688 00002000:00010000:0.0:1746143688.883780:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143687 -> 1746143688 00002000:00010000:3.0:1746143688.883782:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143684 -> 1746143688 00002000:00010000:0.0:1746143688.883782:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143687 -> 1746143688 00002000:00010000:3.0:1746143688.883784:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143684 -> 1746143688 00002000:00010000:0.0:1746143688.883784:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143687 -> 1746143688 00002000:00010000:0.0:1746143688.883785:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:3.0:1746143688.883786:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1746143688.883828:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592147712:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 262us (539us total) trans 21474839675 rc 0/0 00000100:00100000:0.0:1746143688.883834:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9351 00002000:00010000:1.0:1746143688.883847:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746143688.883848:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9354 00002000:00010000:1.0:1746143688.883850:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143687 -> 1746143688 00002000:00010000:1.0:1746143688.883851:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143686 -> 1746143688 00002000:00010000:1.0:1746143688.883853:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143687 -> 1746143688 00000100:00100000:0.0:1746143688.883853:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592148096:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:1.0:1746143688.883855:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:0.0:1746143688.883921:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:0.0:1746143688.883924:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00002000:00010000:0.0:1746143688.883925:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143687 -> 1746143688 00002000:00010000:0.0:1746143688.883927:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:0.0:1746143688.883929:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5541 -> 5541 00000100:00100000:2.0:1746143688.883934:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9355 00000100:00100000:2.0:1746143688.883940:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963592147968:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:3.0:1746143688.883977:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1965:x1830963592147584:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 355us (645us total) trans 17179872408 rc 0/0 00000100:00100000:3.0:1746143688.883983:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9352 00000100:00100000:3.0:1746143688.883995:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9356 00000100:00100000:3.0:1746143688.883999:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592148224:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:2.0:1746143688.884010:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143688.884013:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143686 -> 1746143688 00002000:00010000:2.0:1746143688.884014:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143686 -> 1746143688 00002000:00010000:2.0:1746143688.884016:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143686 -> 1746143688 00002000:00010000:2.0:1746143688.884017:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746143688.884034:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963592147968:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 95us (657us total) trans 17179872410 rc 0/0 00000100:00100000:2.0:1746143688.884040:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9355 00002000:00010000:3.0:1746143688.884057:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143688.884060:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143688.884061:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143688.884063:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143688.884065:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746143688.884080:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963592148224:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 80us (607us total) trans 21474839677 rc 0/0 00000100:00100000:3.0:1746143688.884085:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9356 00000100:00100000:1.0:1746143688.884124:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592147840:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 355us (778us total) trans 21474839676 rc 0/0 00000100:00100000:0.0:1746143688.884124:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592148096:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 271us (766us total) trans 17179872409 rc 0/0 00000100:00100000:1.0:1746143688.884130:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9353 00000100:00100000:0.0:1746143688.884132:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9354 00000100:00100000:0.0:1746143688.889324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.889403:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592148480 00000100:00100000:2.0:1746143688.889411:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592148480 00000100:00100000:2.0:1746143688.889461:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3336 00000100:00100000:2.0:1746143688.889469:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28271:x1830963592148480:12345-192.168.202.48@tcp:35:lfs.0 00000004:00010000:2.0:1746143688.889524:0:14766:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x2d6:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009808bc00/0xe984082ccd724f31 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a111e expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.889572:0:14766:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14766 initiator: MDT0 00010000:00010000:2.0:1746143688.889582:0:14766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.889589:0:14766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14766 initiator: MDT0 00010000:00010000:2.0:1746143688.889618:0:14766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143688.889630:0:14766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 9 pid: 21713 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746143688.889648:0:14766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14766:1830963593695232:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143688.889752:0:14766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143688.895883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.896508:0:14766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14766:1830963593695232:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143688.896534:0:14766:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14766 initiator: MDT0 00000100:00100000:1.0:1746143688.897257:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592148608 00000100:00100000:1.0:1746143688.897264:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592148608 00010000:00010000:1.0:1746143688.897296:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 10 pid: 21713 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746143688.897324:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4791 00000100:00100000:1.0:1746143688.897331:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592148608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143688.897342:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143688.897347:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 10 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746143688.897357:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 10 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746143688.897374:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd724f70 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1125 expref: 10 pid: 21713 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746143688.897394:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:1.0:1746143688.897399:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14766 initiator: MDT0 00010000:00010000:1.0:1746143688.897409:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14766 initiator: MDT0 00010000:00010000:1.0:1746143688.897415:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14766 initiator: MDT0 00010000:00010000:1.0:1746143688.897446:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143688.897721:0:14766:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14766 initiator: MDT0 00010000:00010000:3.0:1746143688.897728:0:14766:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14766 initiator: MDT0 00000040:00080000:3.0:1746143688.900358:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2249, 88 off188856 00000004:00080000:3.0:1746143688.900368:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767910228011ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143688.900420:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2201, 88 off184448 00000004:00080000:3.0:1746143688.900424:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767910283960ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143688.900452:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2202, 88 off184536 00000004:00080000:3.0:1746143688.900455:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767910315705ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143688.900463:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2250, 88 off188944 00000004:00080000:3.0:1746143688.900465:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767910325750ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143688.900472:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2251, 88 off189032 00000004:00080000:3.0:1746143688.900474:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767910334643ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143688.900480:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2203, 88 off184624 00000004:00080000:3.0:1746143688.900483:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767910343731ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143688.900490:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2204, 88 off184712 00000004:00080000:3.0:1746143688.900492:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767910352343ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143688.900498:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2205, 88 off184800 00000004:00080000:3.0:1746143688.900501:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767910360900ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143688.900507:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2252, 88 off189120 00000004:00080000:3.0:1746143688.900509:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767910369548ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143688.900515:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2206, 88 off184888 00000004:00080000:3.0:1746143688.900518:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767910378036ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143688.900524:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2253, 88 off189208 00000004:00080000:3.0:1746143688.900526:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767910386503ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143688.900532:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2207, 88 off184976 00000004:00080000:3.0:1746143688.900537:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767910396953ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143688.900543:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2254, 88 off189296 00000004:00080000:3.0:1746143688.900546:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767910406061ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143688.900552:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2255, 88 off189384 00000004:00080000:3.0:1746143688.900554:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767910414846ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143688.900561:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2256, 88 off189472 00000004:00080000:3.0:1746143688.900563:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767910423313ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143688.900569:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2257, 88 off189560 00000004:00080000:3.0:1746143688.900572:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767910431896ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143688.900578:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2208, 88 off185064 00000004:00080000:3.0:1746143688.900580:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767910440348ns, next at 718087967394ns, rc = 0 00000100:00100000:1.0:1746143688.903539:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592148608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6201us (7658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143688.903552:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4791 00000001:00080000:0.0:1746143688.937375:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942320 is committed 00000001:00080000:0.0:1746143688.937388:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942321 is committed 00000004:00080000:0.0:1746143688.937393:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1554 committed 00000004:00080000:0.0:1746143688.937401:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1602 committed 00000004:00080000:0.0:1746143688.937406:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1601 committed 00000004:00080000:0.0:1746143688.937407:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1600 committed 00000004:00080000:0.0:1746143688.937409:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1599 committed 00000004:00080000:0.0:1746143688.937410:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1553 committed 00000004:00080000:0.0:1746143688.937411:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1598 committed 00000004:00080000:0.0:1746143688.937413:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1552 committed 00000004:00080000:0.0:1746143688.937414:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1597 committed 00000004:00080000:0.0:1746143688.937416:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1551 committed 00000004:00080000:0.0:1746143688.937417:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1550 committed 00000004:00080000:0.0:1746143688.937418:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1549 committed 00000004:00080000:0.0:1746143688.937419:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1596 committed 00000004:00080000:0.0:1746143688.937420:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1595 committed 00000004:00080000:0.0:1746143688.937422:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1548 committed 00000004:00080000:0.0:1746143688.937423:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1547 committed 00000004:00080000:0.0:1746143688.937425:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1594 committed 00000100:00100000:0.0:1746143688.937523:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593695744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143688.937575:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143688.937613:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593696256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143688.937627:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143688.937640:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143688.937644:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593695360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143688.937656:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143688.937666:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593695872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143688.937677:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143688.937694:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593695744 00000100:00100000:0.0:1746143688.937700:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593695744 00000100:00100000:0.0:1746143688.937727:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593696256 00000100:00100000:0.0:1746143688.937729:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593696256 00000100:00100000:0.0:1746143688.937736:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593695360 00000100:00100000:0.0:1746143688.937737:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593695360 00000100:00100000:0.0:1746143688.937743:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593695872 00000100:00100000:0.0:1746143688.937745:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593695872 00000100:00100000:0.0:1746143688.937755:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9357 00000100:00100000:0.0:1746143688.937761:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963593695744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143688.937928:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143688.937931:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143688.937933:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143688.937934:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143688.937936:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143688.937963:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3292:x1830963593695744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 202us (387us total) trans 17179872411 rc 0/0 00000100:00100000:0.0:1746143688.937969:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9357 00000100:00100000:0.0:1746143688.937981:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9358 00000100:00100000:0.0:1746143688.937985:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963593696256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143688.938052:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3292:x1830963593696256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (424us total) trans 17179872412 rc 0/0 00000100:00100000:0.0:1746143688.938057:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9358 00000100:00100000:0.0:1746143688.938065:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9359 00000100:00100000:0.0:1746143688.938069:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963593695360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143688.938135:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143688.938155:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00002000:00010000:0.0:1746143688.938157:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143688 -> 1746143688 00002000:00010000:0.0:1746143688.938159:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:0.0:1746143688.938161:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2057 -> 2057 00000004:00080000:0.0:1746143688.938208:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009445b100/2, rc 0, transno 17179872411 00000100:00100000:0.0:1746143688.938214:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593695744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143688.938220:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd4e00/2, rc 0, transno 17179872412 00000100:00100000:0.0:1746143688.938223:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593696256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143688.938243:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143688.938248:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593696384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143688.938265:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143688.938294:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593696384 00000100:00100000:0.0:1746143688.938297:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593696384 00000100:00100000:0.0:1746143688.938313:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9360 00000100:00100000:0.0:1746143688.938317:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963593695872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143688.938397:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963593695872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (718us total) trans 17179872414 rc 0/0 00000100:00100000:0.0:1746143688.938402:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9360 00000100:00100000:0.0:1746143688.938411:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9361 00000100:00100000:0.0:1746143688.938415:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963593696384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143688.938490:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963593696384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (224us total) trans 17179872415 rc 0/0 00000100:00100000:0.0:1746143688.938496:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9361 00000004:00080000:0.0:1746143688.938514:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cdf80/2, rc 0, transno 17179872415 00000100:00100000:0.0:1746143688.938517:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593696384:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143688.938523:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094459180/2, rc 0, transno 17179872414 00000100:00100000:0.0:1746143688.938525:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593695872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143688.938544:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963593695360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 475us (887us total) trans 17179872413 rc 0/0 00000100:00100000:0.0:1746143688.938553:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9359 00000004:00080000:0.0:1746143688.938566:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094458e00/2, rc 0, transno 17179872413 00000100:00100000:0.0:1746143688.938570:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593695360:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746143688.938653:0:14766:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009445b480 reply state ffff880093ecdc00 transno 8589942321 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14766 initiator: MDT0 00000100:00100000:2.0:1746143688.938663:0:14766:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746143688.938670:0:14766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:2.0:1746143688.938673:0:14766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143688.938679:0:14766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009808bc00/0xe984082ccd724f31 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a111e expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1746143688.938777:0:14766:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143688.938786:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28271:x1830963592148480:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 49318us (49472us total) trans 8589942321 rc 0/0 00000100:00100000:2.0:1746143688.938793:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3336 00000100:00100000:1.0:1746143688.938860:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593695488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.938883:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.938913:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593696000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.938927:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.938938:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746143688.938942:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593695616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.938955:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.938963:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593696128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.938973:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.938989:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593695488 00000100:00100000:1.0:1746143688.938992:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593695488 00000100:00100000:1.0:1746143688.939003:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593696000 00000100:00100000:1.0:1746143688.939005:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593696000 00000100:00100000:1.0:1746143688.939011:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593695616 00000100:00100000:1.0:1746143688.939012:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593695616 00000100:00100000:1.0:1746143688.939017:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593696128 00000100:00100000:1.0:1746143688.939018:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593696128 00000100:00100000:1.0:1746143688.939025:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9362 00000100:00100000:1.0:1746143688.939030:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963593695488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143688.939112:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143688.939115:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00002000:00010000:1.0:1746143688.939117:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143688 -> 1746143688 00002000:00010000:1.0:1746143688.939119:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:1.0:1746143688.939121:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143688.939162:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3294:x1830963593695488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (278us total) trans 17179872416 rc 0/0 00000100:00100000:1.0:1746143688.939167:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9362 00000100:00100000:1.0:1746143688.939176:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9363 00000100:00100000:1.0:1746143688.939180:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963593696000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.939243:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3294:x1830963593696000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (315us total) trans 17179872417 rc 0/0 00000100:00100000:1.0:1746143688.939248:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9363 00000100:00100000:1.0:1746143688.939255:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9364 00000100:00100000:1.0:1746143688.939259:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963593695616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143688.939318:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:1.0:1746143688.939321:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00002000:00010000:1.0:1746143688.939323:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143688 -> 1746143688 00002000:00010000:1.0:1746143688.939324:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:1.0:1746143688.939326:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5541 -> 5541 00000100:00100000:1.0:1746143688.939341:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3294:x1830963593695616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (385us total) trans 17179872418 rc 0/0 00000100:00100000:1.0:1746143688.939345:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9364 00000100:00100000:1.0:1746143688.939352:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9365 00000100:00100000:1.0:1746143688.939357:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963593696128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143688.939420:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3294:x1830963593696128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (446us total) trans 17179872419 rc 0/0 00000100:00100000:1.0:1746143688.939425:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9365 00000004:00080000:1.0:1746143688.939459:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009445b800/2, rc 0, transno 17179872418 00000100:00100000:1.0:1746143688.939462:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593695616:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143688.939468:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd7b80/2, rc 0, transno 17179872419 00000100:00100000:1.0:1746143688.939470:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593696128:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143688.939475:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009445ad80/2, rc 0, transno 17179872416 00000100:00100000:1.0:1746143688.939478:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593695488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143688.939483:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd4700/2, rc 0, transno 17179872417 00000100:00100000:1.0:1746143688.939485:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593696000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143688.939713:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593696640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143688.939736:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143688.939759:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593697152:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143688.939773:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143688.939783:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746143688.939786:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593696512:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143688.939801:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143688.939809:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593697024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143688.939821:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143688.939840:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593696640 00000100:00100000:3.0:1746143688.939843:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593696640 00000100:00100000:3.0:1746143688.939860:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593697152 00000100:00100000:3.0:1746143688.939861:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593697152 00000100:00100000:3.0:1746143688.939867:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593696512 00000100:00100000:3.0:1746143688.939868:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593696512 00000100:00100000:3.0:1746143688.939874:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593697024 00000100:00100000:3.0:1746143688.939877:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593697024 00000100:00100000:3.0:1746143688.939884:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9366 00000100:00100000:3.0:1746143688.939899:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3295:x1830963593696640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143688.940013:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143688.940015:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143688.940017:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143688.940019:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143688.940020:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143688.940041:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3295:x1830963593696640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 153us (304us total) trans 21474839678 rc 0/0 00000100:00100000:3.0:1746143688.940045:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9366 00000100:00100000:3.0:1746143688.940054:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9367 00000100:00100000:3.0:1746143688.940058:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3295:x1830963593697152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143688.940124:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3295:x1830963593697152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (349us total) trans 21474839679 rc 0/0 00000100:00100000:3.0:1746143688.940129:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9367 00000100:00100000:3.0:1746143688.940136:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9368 00000100:00100000:3.0:1746143688.940161:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3295:x1830963593696512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143688.940223:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143688.940225:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143688.940227:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143688.940229:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143688.940230:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143688.940247:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3295:x1830963593696512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (445us total) trans 21474839680 rc 0/0 00000100:00100000:3.0:1746143688.940252:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9368 00000100:00100000:3.0:1746143688.940259:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9369 00000100:00100000:3.0:1746143688.940263:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3295:x1830963593697024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143688.940320:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:3.0:1746143688.940323:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:3.0:1746143688.940325:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143688.940327:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:3.0:1746143688.940328:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:3.0:1746143688.940343:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3295:x1830963593697024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (521us total) trans 21474839681 rc 0/0 00000100:00100000:3.0:1746143688.940347:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9369 00000004:00080000:3.0:1746143688.940379:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935a0700/2, rc 0, transno 21474839680 00000100:00100000:3.0:1746143688.940383:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593696512:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143688.940389:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935a1500/2, rc 0, transno 21474839681 00000100:00100000:3.0:1746143688.940392:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593697024:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143688.940398:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935a1f80/2, rc 0, transno 21474839678 00000100:00100000:3.0:1746143688.940400:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593696640:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143688.940405:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935a2d80/2, rc 0, transno 21474839679 00000100:00100000:3.0:1746143688.940408:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593697152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.940468:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593696896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.940488:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.940503:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593697408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.940514:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.940524:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143688.940528:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593696768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.940540:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.940547:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593697280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.940558:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143688.940572:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593696896 00000100:00100000:1.0:1746143688.940575:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593696896 00000100:00100000:1.0:1746143688.940584:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593697408 00000100:00100000:1.0:1746143688.940586:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593697408 00000100:00100000:1.0:1746143688.940591:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593696768 00000100:00100000:1.0:1746143688.940592:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593696768 00000100:00100000:1.0:1746143688.940597:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593697280 00000100:00100000:1.0:1746143688.940598:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593697280 00000100:00100000:1.0:1746143688.940605:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9370 00000100:00100000:1.0:1746143688.940608:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3293:x1830963593696896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143688.940672:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143688.940674:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:1.0:1746143688.940676:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:1.0:1746143688.940677:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:1.0:1746143688.940679:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143688.940697:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963593696896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (209us total) trans 21474839682 rc 0/0 00000100:00100000:1.0:1746143688.940702:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9370 00000100:00100000:1.0:1746143688.940710:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9371 00000100:00100000:1.0:1746143688.940714:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3293:x1830963593697408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.940775:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963593697408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (259us total) trans 21474839683 rc 0/0 00000100:00100000:1.0:1746143688.940779:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9371 00000100:00100000:1.0:1746143688.940787:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9372 00000100:00100000:1.0:1746143688.940790:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3293:x1830963593696768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143688.940848:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143688.940851:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00002000:00010000:1.0:1746143688.940852:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143688 -> 1746143688 00002000:00010000:1.0:1746143688.940854:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:1.0:1746143688.940856:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746143688.940873:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963593696768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (332us total) trans 21474839684 rc 0/0 00000100:00100000:1.0:1746143688.940878:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9372 00000100:00100000:1.0:1746143688.940886:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9373 00000100:00100000:1.0:1746143688.940900:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3293:x1830963593697280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143688.940968:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963593697280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (408us total) trans 21474839685 rc 0/0 00000100:00100000:1.0:1746143688.940972:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9373 00000004:00080000:1.0:1746143688.940996:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935a0a80/2, rc 0, transno 21474839684 00000100:00100000:1.0:1746143688.941000:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593696768:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143688.941005:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935a3480/2, rc 0, transno 21474839685 00000100:00100000:1.0:1746143688.941008:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593697280:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143688.941013:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935a3800/2, rc 0, transno 21474839682 00000100:00100000:1.0:1746143688.941016:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593696896:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143688.941021:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935a2680/2, rc 0, transno 21474839683 00000100:00100000:1.0:1746143688.941023:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593697408:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143688.941331:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14766 initiator: MDT0 00010000:00010000:0.0:1746143688.941341:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14766 initiator: MDT0 00010000:00010000:0.0:1746143688.941347:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14766 initiator: MDT0 00010000:00010000:0.0:1746143688.941352:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4e4000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143688.941355:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14766 initiator: MDT0 00010000:00010000:0.0:1746143688.941361:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14766 initiator: MDT0 00010000:00010000:0.0:1746143688.941376:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5ab00) 00010000:00010000:0.0:1746143688.941379:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143688.941382:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14766 initiator: MDT0 00010000:00010000:0.0:1746143688.941386:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd724fee lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14766 initiator: MDT0 00000100:00100000:2.0:1746143688.957356:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143688.957591:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592148736 00000100:00100000:0.0:1746143688.957600:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592148736 00000100:00100000:0.0:1746143688.957900:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8229 00000100:00100000:0.0:1746143688.957909:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:28271:x1830963592148736:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143688.957930:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143688.957946:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd724ff5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a115d expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.957995:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd724ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a115d expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.958007:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd724ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a115d expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143688.958020:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:0.0:1746143688.958023:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143688.958026:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bdc00, rc 0) 00000100:00100000:0.0:1746143688.958062:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28271:x1830963592148736:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 154us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143688.958068:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8229 00000100:00100000:0.0:1746143688.968505:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143688.968594:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592148992 00000100:00100000:2.0:1746143688.968602:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592148992 00000100:00100000:2.0:1746143688.968647:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3337 00000100:00100000:2.0:1746143688.968654:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28271:x1830963592148992:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1746143688.968897:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28271:x1830963592148992:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 234us (399us total) trans 8589942322 rc 0/0 00000100:00100000:2.0:1746143688.968908:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3337 00000100:00100000:2.0:1746143689.004481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.004529:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.005154:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592149248 00000100:00100000:1.0:1746143689.005162:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592149248 00000100:00100000:1.0:1746143689.005195:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592149504 00000100:00100000:1.0:1746143689.005197:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592149504 00000100:00100000:1.0:1746143689.005212:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8230 00000100:00100000:1.0:1746143689.005218:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:28279:x1830963592149248:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143689.005237:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.005250:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb800/0xe984082ccd724ffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1164 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.005346:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725003 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005356:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005366:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005376:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd72500a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005381:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd72500a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005386:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd72500a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005479:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb600/0xe984082ccd725011 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005485:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb600/0xe984082ccd725011 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005491:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb600/0xe984082ccd725011 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143689.005498:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143689.005564:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005569:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725003 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005578:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725003 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005583:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bfa800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143689.005586:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725003 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005591:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725003 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005601:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143689.005603:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143689.005607:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.005611:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143689.005697:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8231 00000100:00100000:0.0:1746143689.005706:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+6:28280:x1830963592149504:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143689.005716:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143689.005722:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd72501f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a116b expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.005759:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd725026 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005766:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd725026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005775:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd725026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005782:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd72502d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005787:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd72502d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005791:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd72502d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005833:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd725034 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005839:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd725034 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005844:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd725034 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143689.005850:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143689.005885:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd725026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005899:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd725026 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005903:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd725026 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005907:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801351bd200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143689.005909:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd725026 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005914:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd725026 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005920:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143689.005922:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143689.005925:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd725026 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.005929:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd725026 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.010162:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd72500a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.010176:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd72500a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.010182:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd72500a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.010188:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bfaa00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143689.010191:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd72500a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.010196:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd72500a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.010215:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74500) 00010000:00010000:1.0:1746143689.010217:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143689.010220:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd72500a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.010225:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd72500a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143689.010283:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb800/0xe984082ccd724ffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1164 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.010298:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb600/0xe984082ccd725011 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1164 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.010304:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143689.010306:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143689.010308:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfb600, rc 0) 00000100:00100000:1.0:1746143689.010372:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28279:x1830963592149248:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5153us (5895us total) trans 8589942323 rc 0/0 00000100:00100000:1.0:1746143689.010380:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8230 00010000:00010000:0.0:1746143689.010695:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd72502d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.010702:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd72502d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.010706:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd72502d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.010710:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801351bc000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143689.010712:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd72502d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.010717:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd72502d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.010724:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74500) 00010000:00010000:0.0:1746143689.010726:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143689.010728:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd72502d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.010732:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bc000/0xe984082ccd72502d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143689.010906:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd600/0xe984082ccd72501f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a116b expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.010916:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd725034 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a116b expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.010921:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:0.0:1746143689.010923:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143689.010925:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bca00, rc 0) 00000100:00100000:0.0:1746143689.010960:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28280:x1830963592149504:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5255us (6429us total) trans 8589942324 rc 0/0 00000100:00100000:0.0:1746143689.010966:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8231 00000100:00100000:0.0:1746143689.020977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.021030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.021097:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592149760 00000100:00100000:1.0:1746143689.021105:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592149760 00000100:00100000:1.0:1746143689.021160:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592150016 00000100:00100000:1.0:1746143689.021163:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592150016 00000100:00100000:1.0:1746143689.021192:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8232 00000100:00100000:1.0:1746143689.021199:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28284:x1830963592149760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143689.021220:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.021237:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd725042 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1172 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.021320:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725049 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143689.021331:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725049 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143689.021341:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725049 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143689.021350:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143689.021444:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfaa00/0xe984082ccd725042 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1172 expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.021461:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725049 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1172 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.021467:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143689.021469:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143689.021471:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfa800, rc 0) 00000100:00100000:1.0:1746143689.021508:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28284:x1830963592149760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 309us (539us total) trans 8589942325 rc 0/0 00000100:00100000:1.0:1746143689.021514:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8232 00000100:00100000:1.0:1746143689.021527:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8233 00000100:00100000:1.0:1746143689.021532:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28283:x1830963592150016:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143689.021541:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.021546:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa600/0xe984082ccd725057 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1179 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.021578:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd72505e lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143689.021584:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd72505e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143689.021662:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd72505e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143689.021671:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143689.021713:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa600/0xe984082ccd725057 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1179 expref: 245 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.021722:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd72505e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1179 expref: 244 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.021727:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143689.021729:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143689.021731:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfac00, rc 0) 00000100:00100000:1.0:1746143689.021750:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28283:x1830963592150016:12345-192.168.202.48@tcp:101:cat.0 Request processed in 217us (720us total) trans 8589942326 rc 0/0 00000100:00100000:1.0:1746143689.021754:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8233 00000100:00100000:0.0:1746143689.023785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.023908:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592150144 00000100:00100000:2.0:1746143689.023914:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592150144 00000100:00100000:2.0:1746143689.023965:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9374 00000100:00100000:2.0:1746143689.023972:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28284:x1830963592150144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143689.023984:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.023997:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd72506c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1180 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.024014:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.024016:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.024022:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd72506c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1180 expref: 10 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.024034:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd72506c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1180 expref: 10 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.024042:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e5c00, rc 0) 00000100:00100000:2.0:1746143689.024070:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28284:x1830963592150144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 99us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.024075:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9374 00000100:00080000:0.0:1746143689.024192:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143689.029036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.029395:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592150272 00000100:00100000:0.0:1746143689.029403:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592150272 00000100:00100000:0.0:1746143689.029460:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9375 00000100:00100000:0.0:1746143689.029467:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28283:x1830963592150272:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143689.029484:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143689.029498:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd725073 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1187 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.029519:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.029520:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.029526:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd725073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1187 expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.029540:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd725073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1187 expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.029549:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091025400, rc 0) 00000100:00100000:0.0:1746143689.029585:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28283:x1830963592150272:12345-192.168.202.48@tcp:101:cat.0 Request processed in 118us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143689.029591:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9375 00000100:00100000:0.0:1746143689.029669:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.029797:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592150528 00000100:00100000:2.0:1746143689.029802:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592150528 00002000:00100000:2.0:1746143689.029828:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800930c0700 x1830963592150528/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.029842:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0700 with x1830963592150528 ext(0->1048575) 00002000:00010000:2.0:1746143689.029846:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c0700 00000100:00100000:2.0:1746143689.029858:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3388 00000100:00100000:2.0:1746143689.029862:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963592150528:12345-192.168.202.48@tcp:3:cat.0 00000100:00080000:1.0:1746143689.033097:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143689.041840:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.042057:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592150784 00000100:00100000:2.0:1746143689.042065:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592150784 00002000:00100000:2.0:1746143689.042099:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800930c1880 x1830963592150784/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.042106:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c1880 with x1830963592150784 ext(0->1048575) 00002000:00010000:2.0:1746143689.042110:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c1880 00000100:00100000:2.0:1746143689.042167:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3389 00000100:00100000:2.0:1746143689.042174:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592150784:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143689.054764:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963592150528:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24893us (25087us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143689.054773:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3388 00002000:00100000:2.0:1746143689.054782:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800930c0700 x1830963592150528/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.054790:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0700 with x1830963592150528 ext(0->1048575) 00002000:00010000:2.0:1746143689.054795:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c0700 00000100:00100000:2.0:1746143689.060839:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592150784:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18657us (18998us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143689.060848:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3389 00002000:00100000:2.0:1746143689.060859:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800930c1880 x1830963592150784/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.060869:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c1880 with x1830963592150784 ext(0->1048575) 00002000:00010000:2.0:1746143689.060874:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c1880 00000100:00100000:0.0:1746143689.061782:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.064759:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592151040 00000100:00100000:2.0:1746143689.064771:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592151040 00000100:00100000:2.0:1746143689.064914:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8234 00000100:00100000:2.0:1746143689.064922:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28279:x1830963592151040:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143689.064943:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.064946:0:21713:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746143689.064968:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfac00/0xe984082ccd72505e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1179 expref: 244 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.065005:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb600/0xe984082ccd725011 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1164 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.065013:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143689.065017:0:21713:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143689.065027:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a000/0xe984082ccd72507a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a118e expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.065073:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.065082:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd724ff5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a115d expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.065222:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725049 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1172 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.065234:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd725034 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a116b expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.065239:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.065262:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd725034 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a116b expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.065271:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd725034 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a116b expref: 9 pid: 21713 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.065280:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593697536:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.067023:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725049 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1172 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.067034:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725049 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1172 expref: 9 pid: 14762 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.067043:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593697664:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.068835:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd724ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a115d expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.068847:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd724ff5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a115d expref: 7 pid: 20509 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.068857:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593697792:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143689.071198:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143689.071244:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593697536:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143689.071342:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.071396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.071646:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592151296 00000100:00100000:3.0:1746143689.071654:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592151296 00000100:00100000:3.0:1746143689.071706:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9376 00000100:00100000:3.0:1746143689.071716:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28284:x1830963592151296:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143689.071732:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.071749:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009133d000/0xe984082ccd725088 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1195 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.071772:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.071774:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.071785:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009133d000/0xe984082ccd725088 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1195 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.071801:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009133d000/0xe984082ccd725088 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1195 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.071811:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133d000, rc 0) 00000100:00100000:3.0:1746143689.071857:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28284:x1830963592151296:12345-192.168.202.48@tcp:101:cat.0 Request processed in 142us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.071863:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9376 00000100:00100000:3.0:1746143689.071911:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593697664:192.168.202.48@tcp:104: 00000100:00080000:0.0:1746143689.072268:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143689.072443:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592151168 00000100:00100000:1.0:1746143689.072448:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592151168 00010000:00010000:1.0:1746143689.072469:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd725034 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a116b expref: 10 pid: 21713 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.072498:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4792 00000100:00100000:1.0:1746143689.072503:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1962:x1830963592151168:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.072512:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143689.072517:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd725034 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a116b expref: 10 pid: 21713 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.072525:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd725034 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a116b expref: 10 pid: 21713 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.072539:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd725034 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a116b expref: 10 pid: 21713 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.072651:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143689.072657:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.072663:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.072668:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.072792:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1962:x1830963592151168:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 288us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.072798:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4792 00000100:00100000:0.0:1746143689.077533:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.079218:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.079243:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592151424 00000100:00100000:2.0:1746143689.079250:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592151424 00000100:00100000:0.0:1746143689.079258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143689.079282:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725049 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1172 expref: 9 pid: 14762 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.079308:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592151680 00000100:00100000:2.0:1746143689.079310:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592151680 00010000:00010000:2.0:1746143689.079319:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd724ff5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a115d expref: 8 pid: 20509 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.079335:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4793 00000100:00100000:1.0:1746143689.079344:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963592151424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.079355:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143689.079361:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725049 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1172 expref: 9 pid: 14762 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.079371:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725049 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1172 expref: 9 pid: 14762 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.079387:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd725049 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1172 expref: 9 pid: 14762 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.079408:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593697792:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143689.079414:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143689.079419:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.079425:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.079430:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143689.079436:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:1.0:1746143689.079463:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1964:x1830963592151424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 121us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.079535:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4794 00000100:00100000:2.0:1746143689.079542:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592151680:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143689.079549:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143689.079553:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd724ff5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a115d expref: 8 pid: 20509 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.079561:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd724ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a115d expref: 8 pid: 20509 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.079572:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd724ff5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a115d expref: 8 pid: 20509 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.079584:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143689.079587:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.079593:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.079599:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.079613:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.081500:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4793 00000100:00100000:1.0:1746143689.081530:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592151552 00000100:00100000:1.0:1746143689.081536:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592151552 00000100:00100000:1.0:1746143689.081561:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8235 00000100:00100000:1.0:1746143689.081566:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28284:x1830963592151552:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143689.081590:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.081603:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a119c expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.081647:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.081658:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.081671:0:14762:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.081681:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.081690:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143689.081692:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143689.081694:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.081700:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfa200, rc 0) 00000100:00100000:2.0:1746143689.081838:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963592151680:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2295us (2577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.081845:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4794 00010000:00010000:2.0:1746143689.081866:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.081873:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00000004:02000000:2.0:1746143689.081917:0:21713:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000100:00100000:1.0:1746143689.082035:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28284:x1830963592151552:12345-192.168.202.48@tcp:101:cat.0 Request processed in 468us (2823us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.082040:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8235 00000100:00100000:3.0:1746143689.085069:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.085645:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592151808 00000100:00100000:0.0:1746143689.085651:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592151808 00000100:00100000:0.0:1746143689.085716:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9377 00000100:00100000:0.0:1746143689.085723:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:28283:x1830963592151808:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143689.085737:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143689.085751:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd725096 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11a3 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.085770:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.085771:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.085779:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd725096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11a3 expref: 19 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.085791:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd725096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11a3 expref: 19 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.085805:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744600, rc 0) 00000100:00100000:0.0:1746143689.085840:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:28283:x1830963592151808:12345-192.168.202.48@tcp:101:cat.0 Request processed in 118us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143689.085846:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9377 00000100:00080000:1.0:1746143689.086266:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1746143689.089584:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2258, 88 off189648 00000004:00080000:2.0:1746143689.089594:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768099454150ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143689.089649:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2209, 88 off185152 00000004:00080000:2.0:1746143689.089654:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768099514042ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143689.089678:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2210, 88 off185240 00000004:00080000:2.0:1746143689.089681:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768099541115ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143689.089710:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2259, 88 off189736 00000004:00080000:2.0:1746143689.089713:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768099573160ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143689.089722:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2260, 88 off189824 00000004:00080000:2.0:1746143689.089725:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768099585002ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143689.089731:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2211, 88 off185328 00000004:00080000:2.0:1746143689.089734:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768099594269ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143689.089739:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2212, 88 off185416 00000004:00080000:2.0:1746143689.089742:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768099602773ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143689.089749:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2213, 88 off185504 00000004:00080000:2.0:1746143689.089751:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768099611710ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143689.089757:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2261, 88 off189912 00000004:00080000:2.0:1746143689.089760:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768099620289ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143689.090425:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2214, 88 off185592 00000004:00080000:2.0:1746143689.090430:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768100290515ns, next at 718087967394ns, rc = 0 00000100:00100000:1.0:1746143689.090539:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.090565:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592151936 00000100:00100000:1.0:1746143689.090571:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592151936 00000100:00100000:1.0:1746143689.091302:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8236 00000100:00100000:1.0:1746143689.091310:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28283:x1830963592151936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143689.091324:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.091338:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11aa expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1746143689.091492:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2262, 88 off190000 00000004:00080000:2.0:1746143689.091497:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768101357145ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143689.091518:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2215, 88 off185680 00000004:00080000:2.0:1746143689.091520:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768101380646ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143689.091624:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2263, 88 off190088 00000004:00080000:2.0:1746143689.091627:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768101487223ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143689.091634:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2264, 88 off190176 00000004:00080000:2.0:1746143689.091637:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768101496985ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143689.091644:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2265, 88 off190264 00000004:00080000:2.0:1746143689.091646:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768101506573ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143689.091653:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2266, 88 off190352 00000004:00080000:2.0:1746143689.091656:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768101516493ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143689.091664:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2216, 88 off185768 00000004:00080000:2.0:1746143689.091666:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768101526900ns, next at 718087967394ns, rc = 0 00010000:00010000:0.0:1746143689.091899:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11aa expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.091911:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11aa expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.091921:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:0.0:1746143689.091923:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143689.091927:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.091932:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfa800, rc 0) 00000100:00100000:0.0:1746143689.093031:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:28283:x1830963592151936:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1720us (2494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143689.093038:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8236 00010000:00010000:3.0:1746143689.114829:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a118e expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.114840:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143689.114843:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746143689.114847:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746143689.114849:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942324 is committed 00010000:00010000:3.0:1746143689.114855:0:21713:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 7 pid: 14762 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746143689.114858:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942326 is committed 00010000:00010000:3.0:1746143689.114861:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 7 pid: 14762 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746143689.114862:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942325 is committed 00000001:00080000:0.0:1746143689.114869:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942327 is committed 00000004:00080000:0.0:1746143689.114872:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1562 committed 00000004:00080000:0.0:1746143689.114880:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1611 committed 00000004:00080000:0.0:1746143689.114896:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1610 committed 00000004:00080000:0.0:1746143689.114899:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1609 committed 00000004:00080000:0.0:1746143689.114900:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1608 committed 00000004:00080000:0.0:1746143689.114902:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1561 committed 00000004:00080000:0.0:1746143689.114903:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1607 committed 00000004:00080000:0.0:1746143689.114905:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1560 committed 00000004:00080000:0.0:1746143689.114906:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1606 committed 00000004:00080000:0.0:1746143689.114908:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1559 committed 00000004:00080000:0.0:1746143689.114909:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1558 committed 00000004:00080000:0.0:1746143689.114911:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1557 committed 00000004:00080000:0.0:1746143689.114912:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1605 committed 00000004:00080000:0.0:1746143689.114914:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1604 committed 00000004:00080000:0.0:1746143689.114916:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1556 committed 00000004:00080000:0.0:1746143689.114918:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1555 committed 00000004:00080000:0.0:1746143689.114919:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1603 committed 00000001:00080000:0.0:1746143689.114923:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942322 is committed 00010000:00010000:3.0:1746143689.114977:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11aa expref: 243 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.114986:0:21713:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11aa expref: 243 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.114992:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11aa expref: 243 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.115024:0:21713:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11aa expref: 243 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143689.115036:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593697920:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143689.115121:0:21713:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 6 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143689.115126:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746143689.115129:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593698176:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143689.115152:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593698048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143689.115167:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c388300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143689.115188:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143689.115210:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593698304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143689.115224:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143689.115235:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593698944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143689.115246:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143689.115256:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593699328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143689.115263:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593698048 00000100:00100000:3.0:1746143689.115269:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593698048 00000100:00100000:2.0:1746143689.115269:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143689.115283:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593699840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143689.115294:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593698304 00000100:00100000:3.0:1746143689.115296:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593698304 00000100:00100000:2.0:1746143689.115297:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143689.115306:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593698944 00000100:00100000:3.0:1746143689.115308:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593698944 00000100:00100000:2.0:1746143689.115308:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1746143689.115312:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593698688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143689.115316:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593699328 00000100:00100000:3.0:1746143689.115317:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593699328 00000100:00100000:2.0:1746143689.115323:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143689.115329:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593699840 00000100:00100000:2.0:1746143689.115333:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593699200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143689.115342:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143689.115350:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593699712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143689.115359:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143689.115371:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593698432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143689.115376:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593699840 00000100:00100000:2.0:1746143689.115380:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143689.115385:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593698816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143689.115390:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593698688 00000100:00100000:3.0:1746143689.115392:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593698688 00000100:00100000:2.0:1746143689.115394:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143689.115398:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593699200 00000100:00100000:3.0:1746143689.115399:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593699200 00000100:00100000:2.0:1746143689.115399:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593699456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143689.115404:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593699712 00000100:00100000:3.0:1746143689.115406:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593699712 00000100:00100000:2.0:1746143689.115407:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143689.115412:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593698432 00000100:00100000:3.0:1746143689.115413:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593698432 00000100:00100000:2.0:1746143689.115413:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1746143689.115416:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593698560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143689.115419:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593698816 00000100:00100000:3.0:1746143689.115420:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593698816 00000100:00100000:2.0:1746143689.115425:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143689.115427:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593699456 00000100:00100000:3.0:1746143689.115429:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593699456 00000100:00100000:2.0:1746143689.115430:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593699072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143689.115435:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593698560 00000100:00100000:3.0:1746143689.115436:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593698560 00000100:00100000:2.0:1746143689.115439:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143689.115442:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593699072 00000100:00100000:2.0:1746143689.115443:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593699584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143689.115444:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593699072 00000100:00100000:3.0:1746143689.115452:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9378 00000100:00100000:2.0:1746143689.115455:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143689.115457:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963593698048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143689.115466:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593699584 00000100:00100000:2.0:1746143689.115469:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593699584 00000100:00100000:2.0:1746143689.115481:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9379 00000100:00100000:2.0:1746143689.115485:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963593698304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143689.115513:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9380 00000100:00100000:3.0:1746143689.115517:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963593698944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143689.115584:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9381 00000100:00100000:2.0:1746143689.115588:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963593699328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143689.115632:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3295:x1830963593698944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (383us total) trans 17179872420 rc 0/0 00000100:00100000:3.0:1746143689.115638:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9380 00000100:00100000:3.0:1746143689.115650:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9382 00000100:00100000:3.0:1746143689.115655:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3295:x1830963593699840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143689.115660:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143689.115662:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143689.115664:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143689.115666:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143689.115667:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143689.115684:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3295:x1830963593699328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (414us total) trans 21474839686 rc 0/0 00000100:00100000:2.0:1746143689.115689:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9381 00000100:00100000:2.0:1746143689.115697:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9383 00000100:00100000:2.0:1746143689.115700:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3295:x1830963593698688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143689.115736:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3295:x1830963593699840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (437us total) trans 21474839687 rc 0/0 00000100:00100000:3.0:1746143689.115741:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9382 00000100:00100000:3.0:1746143689.115751:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9384 00000100:00100000:3.0:1746143689.115755:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963593699200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143689.115759:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3295:x1830963593698688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (434us total) trans 17179872422 rc 0/0 00000100:00100000:2.0:1746143689.115763:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9383 00000100:00100000:2.0:1746143689.115770:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9385 00000100:00100000:2.0:1746143689.115774:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963593699712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143689.115820:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143689.115822:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143689.115824:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143689.115826:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143689.115827:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746143689.115840:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593700096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143689.115842:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3295:x1830963593699712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (481us total) trans 21474839689 rc 0/0 00000100:00100000:2.0:1746143689.115847:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9385 00000100:00100000:3.0:1746143689.115848:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3295:x1830963593699200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (504us total) trans 21474839688 rc 0/0 00000100:00100000:3.0:1746143689.115854:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9384 00000100:00100000:2.0:1746143689.115856:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9386 00000100:00100000:2.0:1746143689.115860:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963593698432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143689.115860:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143689.115863:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9387 00000100:00100000:3.0:1746143689.115867:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3292:x1830963593698816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143689.115869:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746143689.115873:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593699968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143689.115898:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143689.115913:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593700096 00000100:00100000:1.0:1746143689.115916:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593700096 00000100:00100000:1.0:1746143689.115926:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593699968 00000100:00100000:1.0:1746143689.115928:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593699968 00000100:00100000:1.0:1746143689.115935:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9388 00002000:00010000:2.0:1746143689.115937:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:2.0:1746143689.115939:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00000100:00100000:1.0:1746143689.115939:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963593699456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143689.115941:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143689.115943:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143689.115943:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:2.0:1746143689.115944:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5541 -> 5541 00002000:00010000:3.0:1746143689.115946:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143689.115947:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143689.115949:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143689.115951:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746143689.115963:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3292:x1830963593698432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (581us total) trans 17179872423 rc 0/0 00000100:00100000:2.0:1746143689.115967:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9386 00000100:00100000:3.0:1746143689.115971:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963593698816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (575us total) trans 21474839690 rc 0/0 00000100:00100000:2.0:1746143689.115976:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9389 00000100:00100000:2.0:1746143689.115980:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3292:x1830963593698560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143689.115988:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9387 00000100:00100000:3.0:1746143689.115998:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9390 00000100:00100000:3.0:1746143689.116002:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3292:x1830963593699072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143689.116036:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9391 00000100:00100000:3.0:1746143689.116040:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3292:x1830963593699584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143689.116075:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9392 00000100:00100000:3.0:1746143689.116080:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3293:x1830963593700096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143689.116096:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9393 00000100:00100000:0.0:1746143689.116102:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3293:x1830963593699968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143689.116223:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143689.116226:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00000100:00100000:0.0:1746143689.116226:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3293:x1830963593699968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 125us (339us total) trans 17179872425 rc 0/0 00002000:00010000:3.0:1746143689.116228:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143689.116229:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143689.116231:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1746143689.116232:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9393 00000100:00100000:3.0:1746143689.116252:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3295:x1830963593698048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 795us (1064us total) trans 17179872426 rc 0/0 00000100:00100000:3.0:1746143689.116257:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9378 00000004:00080000:0.0:1746143689.116269:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930df100/2, rc 0, transno 17179872425 00000100:00100000:0.0:1746143689.116276:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593699968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143689.116296:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3293:x1830963593700096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 216us (435us total) trans 17179872424 rc 0/0 00000100:00100000:3.0:1746143689.116301:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9392 00000004:00080000:0.0:1746143689.116307:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dea00/2, rc 0, transno 17179872424 00000100:00100000:0.0:1746143689.116310:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593700096:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143689.116612:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:1.0:1746143689.116615:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:1.0:1746143689.116616:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143689.116618:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:1.0:1746143689.116619:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:1.0:1746143689.116639:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963593699456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 699us (1230us total) trans 21474839691 rc 0/0 00000100:00100000:1.0:1746143689.116644:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9388 00000100:00100000:1.0:1746143689.116663:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593700224:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143689.116945:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143689.117097:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143689.117099:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143689.117101:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:3.0:1746143689.117102:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746143689.117238:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143689.117240:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746143689.117241:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143689.117242:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746143689.117244:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143689.117251:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963593699072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1247us (1810us total) trans 21474839692 rc 0/0 00000100:00100000:3.0:1746143689.117255:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9390 00000100:00100000:2.0:1746143689.117260:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3292:x1830963593698560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1280us (1834us total) trans 17179872427 rc 0/0 00000100:00100000:2.0:1746143689.117265:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9389 00000004:00080000:2.0:1746143689.117296:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dfb80/2, rc 0, transno 17179872427 00000100:00100000:2.0:1746143689.117300:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593698560:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143689.117308:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f532300/2, rc 0, transno 21474839692 00000100:00100000:2.0:1746143689.117311:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593699072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143689.117317:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f531c00/2, rc 0, transno 21474839693 00000100:00100000:3.0:1746143689.117319:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963593699584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1279us (1863us total) trans 21474839693 rc 0/0 00000100:00100000:2.0:1746143689.117320:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593699584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143689.117324:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9391 00000004:00080000:2.0:1746143689.117326:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dd880/2, rc 0, transno 17179872423 00000100:00100000:2.0:1746143689.117328:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593698432:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143689.117334:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0361880/2, rc 0, transno 21474839690 00000100:00100000:2.0:1746143689.117336:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593698816:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143689.117342:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f530000/2, rc 0, transno 21474839691 00000100:00100000:2.0:1746143689.117345:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593699456:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143689.117372:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143689.117374:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143688 -> 1746143688 00002000:00010000:2.0:1746143689.117375:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143688 -> 1746143688 00002000:00010000:2.0:1746143689.117377:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143688 -> 1746143688 00002000:00010000:2.0:1746143689.117378:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143689.117392:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143689.117394:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3295:x1830963593698304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1908us (2168us total) trans 17179872421 rc 0/0 00000100:00100000:2.0:1746143689.117398:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9379 00000100:00100000:3.0:1746143689.117547:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593700224 00000100:00100000:3.0:1746143689.117551:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593700224 00000100:00100000:3.0:1746143689.117567:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9394 00000100:00100000:3.0:1746143689.117571:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963593700224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143689.117705:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3294:x1830963593700224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (311us total) trans 17179872428 rc 0/0 00000100:00100000:3.0:1746143689.117710:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9394 00000004:00080000:1.0:1746143689.117751:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c23480/2, rc 0, transno 17179872428 00000100:00100000:1.0:1746143689.117754:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593700224:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143689.118132:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dce00/2, rc 0, transno 17179872422 00000100:00100000:2.0:1746143689.118136:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593698688:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143689.118506:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f533b80/2, rc 0, transno 21474839688 00000100:00100000:2.0:1746143689.118510:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593699200:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143689.118521:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f532a00/2, rc 0, transno 21474839689 00000100:00100000:2.0:1746143689.118523:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593699712:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143689.118530:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f531500/2, rc 0, transno 21474839687 00000100:00100000:2.0:1746143689.118532:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593699840:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143689.118541:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930de680/2, rc 0, transno 17179872421 00000100:00100000:2.0:1746143689.118544:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593698304:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143689.118550:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dc000/2, rc 0, transno 17179872420 00000100:00100000:2.0:1746143689.118552:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593698944:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143689.118558:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f530e00/2, rc 0, transno 21474839686 00000100:00100000:2.0:1746143689.118560:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593699328:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143689.118567:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930de300/2, rc 0, transno 17179872426 00000100:00100000:2.0:1746143689.118570:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593698048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143689.119595:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593697920:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143689.119912:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.119949:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.119971:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.120039:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0361f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593698176:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143689.120071:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a000/0xe984082ccd72507a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a118e expref: 243 pid: 21713 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746143689.120085:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a118e expref: 242 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.120113:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e4c00, rc 0) 00000100:00100000:3.0:1746143689.120160:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28279:x1830963592151040:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 55239us (58380us total) trans 8589942327 rc 0/0 00000100:00100000:3.0:1746143689.120167:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8234 00000100:00100000:3.0:1746143689.120190:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592152320 00000100:00100000:3.0:1746143689.120194:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592152320 00000100:00100000:3.0:1746143689.120215:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8237 00000100:00100000:3.0:1746143689.120220:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+7:28280:x1830963592152320:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143689.120232:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.120241:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd7250a4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11b1 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.120273:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd7250a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b1 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143689.120323:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592152192 00000100:00100000:1.0:1746143689.120326:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592152192 00000100:00100000:1.0:1746143689.120345:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592152064 00000100:00100000:1.0:1746143689.120347:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592152064 00000100:00100000:1.0:1746143689.120358:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3338 00000100:00100000:1.0:1746143689.120362:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28284:x1830963592152192:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:0.0:1746143689.120383:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3339 00000100:00100000:0.0:1746143689.120389:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28283:x1830963592152064:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:1.0:1746143689.120416:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28284:x1830963592152192:12345-192.168.202.48@tcp:49:cat.0 Request processed in 53us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143689.120418:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28283:x1830963592152064:12345-192.168.202.48@tcp:49:cat.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.120422:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3338 00000100:00100000:0.0:1746143689.120424:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3339 00010000:00010000:3.0:1746143689.120740:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd7250a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b1 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.120754:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143689.120757:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143689.120759:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bdc00, rc 0) 00000100:00100000:3.0:1746143689.120791:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28280:x1830963592152320:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 569us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.120796:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8237 00000100:00100000:1.0:1746143689.124668:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.124775:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592152448 00000100:00100000:2.0:1746143689.124782:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592152448 00000100:00100000:2.0:1746143689.124824:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 565 00000100:00100000:2.0:1746143689.124830:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1963:x1830963592152448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143689.124840:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143689.124859:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bdc00/0xe984082ccd7250a4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b1 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.124870:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143689.124874:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143689.124927:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+7:1963:x1830963592152448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.124933:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 565 00000100:00100000:0.0:1746143689.127088:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.127173:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592152576 00000100:00100000:2.0:1746143689.127178:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592152576 00000100:00100000:2.0:1746143689.127219:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9395 00000100:00100000:2.0:1746143689.127225:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28279:x1830963592152576:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143689.127241:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.127254:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11b8 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.127276:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724f93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a114f expref: 11 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.127282:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.127283:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.127287:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3031040->3145727] (req 3031040->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.127310:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724f93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a114f expref: 11 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.127321:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724f93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a114f expref: 11 pid: 21542 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746143689.127331:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593700352:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143689.127398:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143689.128935:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593700352:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.128953:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3031040->3145727] (req 3031040->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.128965:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0700800, rc 0) 00000100:00100000:2.0:1746143689.129487:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28279:x1830963592152576:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2260us (2401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.129495:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9395 00000100:00100000:0.0:1746143689.132069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.132595:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.132735:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592152960 00000100:00100000:2.0:1746143689.132743:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592152960 00002000:00100000:2.0:1746143689.132778:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a5c21880 x1830963592152960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.132787:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21880 with x1830963592152960 ext(1048576->2097151) 00002000:00010000:2.0:1746143689.132791:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c21880 00000100:00100000:1.0:1746143689.132982:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592152704 00000100:00100000:1.0:1746143689.132986:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592152704 00010000:00010000:1.0:1746143689.133005:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724f93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a114f expref: 12 pid: 21542 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746143689.133025:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4795 00000100:00100000:1.0:1746143689.133031:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592152704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.133042:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143689.133061:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724f93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a114f expref: 12 pid: 21542 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746143689.133070:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724f93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a114f expref: 12 pid: 21542 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746143689.133086:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090744e00/0xe984082ccd724f93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a114f expref: 12 pid: 21542 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746143689.133098:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.133100:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.133106:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.133113:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.133152:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143689.133162:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593700480:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143689.133215:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc23780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143689.133391:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3390 00000100:00100000:2.0:1746143689.133398:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963592152960:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143689.134729:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.137293:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592153088 00000100:00100000:2.0:1746143689.137305:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592153088 00000100:00100000:0.0:1746143689.137740:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.137771:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9396 00000100:00100000:2.0:1746143689.137779:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28280:x1830963592153088:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143689.137795:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.137810:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11bf expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.137834:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.137841:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143689.137843:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143689.137846:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2183168->2830335] (req 2183168->2830335) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 11 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.137871:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.137883:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 22 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.137905:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593700608:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143689.139912:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143689.140520:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592153344 00000100:00100000:3.0:1746143689.140528:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592153344 00002000:00100000:3.0:1746143689.140563:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a5c20700 x1830963592153344/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.140571:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20700 with x1830963592153344 ext(1048576->2097151) 00002000:00010000:3.0:1746143689.140576:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c20700 00000100:00100000:3.0:1746143689.140605:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3391 00000100:00100000:3.0:1746143689.140612:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592153344:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143689.143400:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.143513:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592153600 00000100:00100000:2.0:1746143689.143520:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592153600 00002000:00100000:2.0:1746143689.143551:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3031040->3035135) req@ffff8800a5c20e00 x1830963592153600/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.143559:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20e00 with x1830963592153600 ext(3031040->3035135) 00010000:00010000:2.0:1746143689.143568:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 23 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.143578:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 23 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746143689.143584:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c20e00 00000100:00100000:2.0:1746143689.143600:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 815 00000100:00100000:2.0:1746143689.143606:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592153600:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143689.143730:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592153600:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 123us (337us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143689.143735:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 815 00002000:00100000:2.0:1746143689.143740:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3031040->3035135) req@ffff8800a5c20e00 x1830963592153600/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.143752:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20e00 with x1830963592153600 ext(3031040->3035135) 00010000:00010000:2.0:1746143689.143756:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 23 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.143764:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 23 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746143689.143768:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c20e00 00000100:00100000:2.0:1746143689.143805:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593700608:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.143821:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2183168->2830335] (req 2183168->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 11 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.143832:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0700000, rc 0) 00000100:00100000:2.0:1746143689.143850:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28280:x1830963592153088:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6072us (9125us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.143855:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9396 00000100:00100000:1.0:1746143689.144020:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593700480:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143689.144032:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.144051:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592152704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 11020us (11990us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.144058:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4795 00000100:00100000:3.0:1746143689.146401:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963592152960:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12996us (13799us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143689.146411:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3390 00002000:00100000:3.0:1746143689.146419:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a5c21880 x1830963592152960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.146428:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21880 with x1830963592152960 ext(1048576->2097151) 00002000:00010000:3.0:1746143689.146433:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c21880 00000100:00100000:3.0:1746143689.152948:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592153344:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12329us (15205us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143689.152958:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3391 00002000:00100000:3.0:1746143689.152969:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a5c20700 x1830963592153344/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.152977:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20700 with x1830963592153344 ext(1048576->2097151) 00002000:00010000:3.0:1746143689.152982:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c20700 00000100:00100000:0.0:1746143689.153723:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.153964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.154009:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592153856 00000100:00100000:2.0:1746143689.154016:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592153856 00002000:00100000:2.0:1746143689.154044:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3031040->3145727) req@ffff8800a5c22a00 x1830963592153856/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.154051:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22a00 with x1830963592153856 ext(3031040->3145727) 00010000:00010000:2.0:1746143689.154058:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 23 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.154070:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 23 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746143689.154076:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c22a00 00000100:00100000:2.0:1746143689.154089:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 816 00000100:00100000:2.0:1746143689.154094:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592153856:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143689.154654:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592153984 00000100:00100000:3.0:1746143689.154659:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592153984 00000100:00100000:3.0:1746143689.154694:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9397 00000100:00100000:3.0:1746143689.154700:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:28279:x1830963592153984:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143689.154712:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.154727:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11c6 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.154749:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090744c00/0xe984082ccd724fa8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1156 expref: 11 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143689.154756:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.154757:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.154760:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->2408447] (req 2097152->2408447) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.154787:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090744c00/0xe984082ccd724fa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1156 expref: 11 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143689.154797:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090744c00/0xe984082ccd724fa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1156 expref: 11 pid: 21542 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746143689.154806:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593700736:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143689.155303:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143689.160529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.160768:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593700736:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143689.160793:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->2408447] (req 2097152->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.160808:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cab8000, rc 0) 00000100:00100000:3.0:1746143689.160853:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28279:x1830963592153984:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6153us (7131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.160861:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9397 00000100:00100000:3.0:1746143689.160882:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592154112 00000100:00100000:3.0:1746143689.160894:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592154112 00000100:00100000:3.0:1746143689.160914:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9398 00000100:00100000:3.0:1746143689.161858:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28284:x1830963592154112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143689.161873:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.161896:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd7250c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11cd expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.161911:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.161913:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.161918:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd7250c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11cd expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.161929:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd7250c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11cd expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.161935:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cab9200, rc 0) 00000100:00100000:3.0:1746143689.161957:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28284:x1830963592154112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1037us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.161963:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9398 00000100:00100000:0.0:1746143689.162093:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.162481:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592154368 00000100:00100000:1.0:1746143689.162486:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592154368 00010000:00010000:1.0:1746143689.162506:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090744c00/0xe984082ccd724fa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1156 expref: 12 pid: 21542 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746143689.162537:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4796 00000100:00100000:1.0:1746143689.162542:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592154368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.162551:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143689.162567:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090744c00/0xe984082ccd724fa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1156 expref: 12 pid: 21542 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746143689.162580:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090744c00/0xe984082ccd724fa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1156 expref: 12 pid: 21542 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746143689.162596:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090744c00/0xe984082ccd724fa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1156 expref: 12 pid: 21542 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746143689.162610:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.162611:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143689.162614:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143689.162615:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.162622:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143689.162670:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592154240 00000100:00100000:2.0:1746143689.162674:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592154240 00000100:00100000:2.0:1746143689.162693:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9399 00000100:00100000:2.0:1746143689.162698:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28283:x1830963592154240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143689.162705:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.162711:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd7250c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11d4 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.162722:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.162724:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.162727:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd7250c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11d4 expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.162735:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd7250c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11d4 expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.162740:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0701c00, rc 0) 00000100:00100000:2.0:1746143689.162761:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28283:x1830963592154240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 63us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.162766:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9399 00010000:00010000:1.0:1746143689.162810:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143689.162821:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593700864:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143689.162860:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc23780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143689.163327:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592153856:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 9231us (9361us total) trans 17179872429 rc 0/0 00000100:00100000:3.0:1746143689.163333:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 816 00002000:00100000:3.0:1746143689.163340:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3031040->3145727) req@ffff8800a5c22a00 x1830963592153856/t17179872429(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/448 e 0 to 0 dl 1746143700 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.163354:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22a00 with x1830963592153856 ext(3031040->3145727) 00010000:00010000:3.0:1746143689.163361:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 25 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.163371:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 25 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746143689.163376:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c22a00 00000100:00100000:0.0:1746143689.167824:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.167917:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593700864:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143689.167935:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.167975:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592154368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5431us (5881us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.167984:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4796 00000100:00100000:3.0:1746143689.168178:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592154624 00000100:00100000:3.0:1746143689.168184:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592154624 00002000:00100000:3.0:1746143689.168218:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a5c21180 x1830963592154624/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.168226:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21180 with x1830963592154624 ext(1048576->2097151) 00002000:00010000:3.0:1746143689.168231:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c21180 00000100:00100000:3.0:1746143689.168255:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3392 00000100:00100000:3.0:1746143689.168262:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592154624:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143689.168343:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.169589:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.169653:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592154880 00000100:00100000:2.0:1746143689.169658:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592154880 00002000:00100000:2.0:1746143689.169681:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009c3f9500 x1830963592154880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.169689:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9500 with x1830963592154880 ext(1048576->2097151) 00002000:00010000:2.0:1746143689.169692:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9500 00000100:00100000:2.0:1746143689.169712:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3393 00000100:00100000:2.0:1746143689.169717:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963592154880:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143689.171353:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.171536:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592155008 00000100:00100000:1.0:1746143689.171543:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592155008 00010000:00010000:1.0:1746143689.171571:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 25 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.171607:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4797 00000100:00100000:1.0:1746143689.171615:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592155008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.171625:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143689.171643:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 25 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.171653:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 25 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.171672:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700800/0xe984082ccd7250ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11b8 expref: 25 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.171700:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.171702:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.171709:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 10 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.171717:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 10 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.171745:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 10 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143689.171756:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593700992:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143689.171822:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc23780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143689.172121:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592155264 00000100:00100000:2.0:1746143689.172125:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592155264 00002000:00100000:2.0:1746143689.172274:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2404352->2408447) req@ffff88009c3fa300 x1830963592155264/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.172282:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa300 with x1830963592155264 ext(2404352->2408447) 00002000:00010000:2.0:1746143689.172287:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fa300 00000100:00100000:2.0:1746143689.172356:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3394 00000100:00100000:2.0:1746143689.172362:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592155264:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143689.172673:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592155264:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 310us (1324us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143689.172679:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3394 00002000:00100000:2.0:1746143689.172684:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2404352->2408447) req@ffff88009c3fa300 x1830963592155264/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.172691:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa300 with x1830963592155264 ext(2404352->2408447) 00002000:00010000:2.0:1746143689.172694:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fa300 00000100:00100000:1.0:1746143689.176280:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593700992:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143689.176298:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.176344:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592155008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4730us (6756us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.176353:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4797 00000100:00100000:0.0:1746143689.176832:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.176922:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592155520 00000100:00100000:2.0:1746143689.176929:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592155520 00002000:00100000:2.0:1746143689.176961:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2183168->2187263) req@ffff88009c3fb480 x1830963592155520/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.176971:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb480 with x1830963592155520 ext(2183168->2187263) 00002000:00010000:2.0:1746143689.176975:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb480 00000100:00100000:2.0:1746143689.176991:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3395 00000100:00100000:2.0:1746143689.176997:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592155520:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143689.177122:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592155520:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 125us (291us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143689.177128:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3395 00002000:00100000:2.0:1746143689.177132:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2183168->2187263) req@ffff88009c3fb480 x1830963592155520/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.177158:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb480 with x1830963592155520 ext(2183168->2187263) 00002000:00010000:2.0:1746143689.177161:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb480 00000100:00100000:3.0:1746143689.179593:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592154624:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 11324us (11768us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143689.179601:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3392 00002000:00100000:3.0:1746143689.179610:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a5c21180 x1830963592154624/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.179618:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21180 with x1830963592154624 ext(1048576->2097151) 00002000:00010000:3.0:1746143689.179622:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c21180 00000100:00100000:0.0:1746143689.181667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.181788:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592155776 00000100:00100000:3.0:1746143689.181796:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592155776 00000100:00100000:3.0:1746143689.182158:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3340 00000100:00100000:3.0:1746143689.182166:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28279:x1830963592155776:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143689.182239:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963592154880:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12521us (13897us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143689.182428:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28279:x1830963592155776:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 262us (766us total) trans 8589942328 rc 0/0 00000100:00100000:3.0:1746143689.182434:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3340 00000100:00100000:2.0:1746143689.182623:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3393 00002000:00100000:2.0:1746143689.182631:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009c3f9500 x1830963592154880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.182639:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9500 with x1830963592154880 ext(1048576->2097151) 00002000:00010000:2.0:1746143689.182644:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9500 00000100:00100000:2.0:1746143689.186646:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.186715:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592155904 00000100:00100000:3.0:1746143689.186725:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592155904 00000100:00100000:3.0:1746143689.186773:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9400 00000100:00100000:3.0:1746143689.186781:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28284:x1830963592155904:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143689.186796:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.186812:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5200/0xe984082ccd7250ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11db expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.186837:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.186839:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.186845:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5200/0xe984082ccd7250ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11db expref: 12 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.186857:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5200/0xe984082ccd7250ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11db expref: 12 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.186867:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f5200, rc 0) 00000100:00100000:3.0:1746143689.186920:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28284:x1830963592155904:12345-192.168.202.48@tcp:101:cat.0 Request processed in 140us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.186926:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9400 00000100:00100000:0.0:1746143689.187605:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.187673:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592156160 00000100:00100000:2.0:1746143689.187677:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592156160 00002000:00100000:2.0:1746143689.187700:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (2826240->2830335) req@ffff880093bf0a80 x1830963592156160/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.187712:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf0a80 with x1830963592156160 ext(2826240->2830335) 00002000:00010000:2.0:1746143689.187717:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf0a80 00000100:00100000:2.0:1746143689.187741:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3396 00000100:00100000:2.0:1746143689.187747:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592156160:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143689.188571:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592156160:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 822us (965us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143689.188576:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3396 00002000:00100000:2.0:1746143689.188581:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (2826240->2830335) req@ffff880093bf0a80 x1830963592156160/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.188587:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf0a80 with x1830963592156160 ext(2826240->2830335) 00002000:00010000:2.0:1746143689.188590:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf0a80 00000100:00100000:0.0:1746143689.192001:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.192078:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.192165:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592156544 00000100:00100000:3.0:1746143689.192174:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592156544 00000100:00100000:3.0:1746143689.192209:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3341 00000100:00100000:3.0:1746143689.192216:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+7:28280:x1830963592156544:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143689.192242:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592156288 00000100:00100000:2.0:1746143689.192246:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592156288 00000100:00100000:2.0:1746143689.192269:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9401 00000100:00100000:2.0:1746143689.192273:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28283:x1830963592156288:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143689.192282:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.192296:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0700e00/0xe984082ccd7250d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11e2 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.192312:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.192314:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.192319:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700e00/0xe984082ccd7250d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e2 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.192332:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0700e00/0xe984082ccd7250d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e2 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.192340:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0700e00, rc 0) 00000100:00100000:2.0:1746143689.192377:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28283:x1830963592156288:12345-192.168.202.48@tcp:101:cat.0 Request processed in 103us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.192382:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9401 00000100:00100000:3.0:1746143689.192474:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28280:x1830963592156544:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 258us (395us total) trans 8589942329 rc 0/0 00000100:00100000:3.0:1746143689.192480:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3341 00000100:00100000:0.0:1746143689.196831:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.196870:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.196917:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592156800 00000100:00100000:3.0:1746143689.196925:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592156800 00000100:00100000:2.0:1746143689.196949:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592157056 00000100:00100000:2.0:1746143689.196952:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592157056 00002000:00100000:3.0:1746143689.196958:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880093bf3480 x1830963592156800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.196965:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880093bf2300 x1830963592157056/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.196968:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf3480 with x1830963592156800 ext(1048576->2097151) 00002000:00100000:2.0:1746143689.196970:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf2300 with x1830963592157056 ext(1048576->2097151) 00002000:00010000:3.0:1746143689.196972:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf3480 00002000:00010000:2.0:1746143689.196973:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf2300 00000100:00100000:3.0:1746143689.196998:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3397 00000100:00100000:3.0:1746143689.197005:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592156800:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143689.197611:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3398 00000100:00100000:2.0:1746143689.197617:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592157056:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143689.208113:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592157056:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 10488us (11234us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143689.209386:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3398 00002000:00100000:2.0:1746143689.209398:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880093bf2300 x1830963592157056/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.209407:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf2300 with x1830963592157056 ext(1048576->2097151) 00002000:00010000:2.0:1746143689.209411:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf2300 00000100:00100000:3.0:1746143689.212154:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592156800:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 15134us (15314us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143689.212163:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3397 00002000:00100000:3.0:1746143689.212172:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880093bf3480 x1830963592156800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.212180:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf3480 with x1830963592156800 ext(1048576->2097151) 00002000:00010000:3.0:1746143689.212184:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf3480 00000100:00100000:0.0:1746143689.219236:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.219380:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592157312 00000100:00100000:3.0:1746143689.219388:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592157312 00002000:00100000:3.0:1746143689.219426:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880093bf1500 x1830963592157312/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 504/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.219435:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf1500 with x1830963592157312 ext(2097152->3145727) 00002000:00010000:3.0:1746143689.219440:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf1500 00000100:00100000:3.0:1746143689.219524:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3399 00000100:00100000:3.0:1746143689.219531:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592157312:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143689.219857:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.220072:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592157440 00000100:00100000:2.0:1746143689.220076:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592157440 00000100:00100000:2.0:1746143689.221284:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9402 00000100:00100000:2.0:1746143689.221293:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28283:x1830963592157440:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143689.221306:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.221320:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7250dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11e9 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.221344:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 13 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.221351:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143689.221353:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143689.221357:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7250dc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e9 expref: 26 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.221380:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 13 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.221390:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 13 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.221402:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593701120:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143689.221479:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143689.224654:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593701120:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.224678:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7250dc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e9 expref: 26 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143689.224686:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592157312:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5154us (5455us total) trans 0 rc 401408/401408 00010000:00010000:2.0:1746143689.224691:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0700400, rc 0) 00000100:00100000:3.0:1746143689.224693:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3399 00002000:00100000:3.0:1746143689.224701:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880093bf1500 x1830963592157312/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 504/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 401408/401408 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143689.224705:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28283:x1830963592157440:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3414us (4849us total) trans 0 rc 0/0 00002000:00100000:3.0:1746143689.224709:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf1500 with x1830963592157312 ext(2097152->3145727) 00000100:00100000:2.0:1746143689.224711:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9402 00010000:00010000:3.0:1746143689.224715:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 12 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.224725:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 12 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746143689.224730:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bf1500 00000100:00100000:0.0:1746143689.225103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.225168:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592157568 00000100:00100000:3.0:1746143689.225174:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592157568 00002000:00100000:3.0:1746143689.225387:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2183168->2830335) req@ffff880093bf1c00 x1830963592157568/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.225394:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf1c00 with x1830963592157568 ext(2183168->2830335) 00010000:00010000:3.0:1746143689.225399:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 12 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.225412:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 12 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746143689.225417:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bf1c00 00000100:00100000:3.0:1746143689.225440:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 817 00000100:00100000:3.0:1746143689.225445:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592157568:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143689.228408:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.228496:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592157696 00000100:00100000:2.0:1746143689.228503:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592157696 00000100:00100000:2.0:1746143689.228531:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9403 00000100:00100000:2.0:1746143689.228537:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28284:x1830963592157696:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143689.228550:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.228563:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd7250e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11f0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.228583:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.228589:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143689.228591:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143689.228594:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd7250e3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f0 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.228618:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.228627:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 20 pid: 4581 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.228638:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593701248:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143689.228715:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143689.231069:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593701248:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143689.231093:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd7250e3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f0 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.231106:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0701a00, rc 0) 00000100:00100000:3.0:1746143689.231221:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28284:x1830963592157696:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2682us (2818us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.231229:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9403 00000100:00100000:0.0:1746143689.231529:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.232523:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592157824 00000100:00100000:2.0:1746143689.232530:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592157824 00002000:00100000:2.0:1746143689.232566:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2408447) req@ffff88008f4ee680 x1830963592157824/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.232574:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ee680 with x1830963592157824 ext(2097152->2408447) 00010000:00010000:2.0:1746143689.232582:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 21 pid: 4581 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.232592:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 21 pid: 4581 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746143689.232600:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f4ee680 00000100:00100000:2.0:1746143689.232848:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 818 00000100:00100000:2.0:1746143689.232856:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592157824:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143689.237547:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592157568:12345-192.168.202.48@tcp:4:cat.0 Request processed in 12091us (12434us total) trans 17179872430 rc 0/0 00000100:00100000:3.0:1746143689.237558:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 817 00002000:00100000:3.0:1746143689.237568:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2183168->2830335) req@ffff880093bf1c00 x1830963592157568/t17179872430(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/448 e 0 to 0 dl 1746143700 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.237576:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf1c00 with x1830963592157568 ext(2183168->2830335) 00010000:00010000:3.0:1746143689.237586:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 14 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.237602:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 14 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746143689.237609:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bf1c00 00000100:00100000:2.0:1746143689.239110:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592157824:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6250us (7577us total) trans 21474839694 rc 0/0 00000100:00100000:2.0:1746143689.239118:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 818 00002000:00100000:2.0:1746143689.239124:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2408447) req@ffff88008f4ee680 x1830963592157824/t21474839694(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/448 e 0 to 0 dl 1746143700 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.239132:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ee680 with x1830963592157824 ext(2097152->2408447) 00010000:00010000:2.0:1746143689.239458:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 23 pid: 4581 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.239471:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 23 pid: 4581 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746143689.239477:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f4ee680 00000100:00100000:0.0:1746143689.239840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.239912:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592157952 00000100:00100000:1.0:1746143689.239918:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592157952 00010000:00010000:1.0:1746143689.239939:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 14 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.239973:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4798 00000100:00100000:1.0:1746143689.239979:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592157952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.239989:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143689.240004:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 14 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.240013:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 14 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.240030:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700000/0xe984082ccd7250b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2830335) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11bf expref: 14 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.240051:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.240053:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.240059:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7250dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e9 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.240071:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7250dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e9 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.240095:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7250dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e9 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143689.240104:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593701376:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143689.240172:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc23780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143689.241444:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.241612:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592158080 00000100:00100000:3.0:1746143689.241617:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592158080 00010000:00010000:3.0:1746143689.241636:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 23 pid: 4581 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.241668:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4799 00000100:00100000:3.0:1746143689.241674:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592158080:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143689.241683:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143689.241738:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593701376:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143689.241753:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.241773:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592157952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1794us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.241780:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4798 00010000:00010000:3.0:1746143689.243460:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 23 pid: 4581 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.243474:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 23 pid: 4581 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.243493:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cab8000/0xe984082ccd7250b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11c6 expref: 23 pid: 4581 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.243510:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.243511:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.243516:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd7250e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f0 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.243526:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd7250e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f0 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.243854:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd7250e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f0 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143689.243866:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593701504:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143689.244249:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143689.244706:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.244767:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592158336 00000100:00100000:2.0:1746143689.244777:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592158336 00002000:00100000:2.0:1746143689.244807:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f4ec000 x1830963592158336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.244816:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ec000 with x1830963592158336 ext(2097152->3145727) 00002000:00010000:2.0:1746143689.244820:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4ec000 00000100:00100000:2.0:1746143689.244847:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3400 00000100:00100000:2.0:1746143689.244854:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592158336:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143689.250947:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.251186:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593701504:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143689.251203:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143689.251256:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592158080:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9581us (9813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.251265:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4799 00000100:00100000:2.0:1746143689.252182:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592158592 00000100:00100000:2.0:1746143689.252189:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592158592 00002000:00100000:2.0:1746143689.252223:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880095098700 x1830963592158592/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.252231:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098700 with x1830963592158592 ext(2097152->3145727) 00002000:00010000:2.0:1746143689.252235:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095098700 00000100:00100000:2.0:1746143689.252261:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3401 00000100:00100000:2.0:1746143689.252268:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592158592:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143689.252999:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592158336:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8143us (8292us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143689.253005:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3400 00002000:00100000:3.0:1746143689.253011:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f4ec000 x1830963592158336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.253018:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ec000 with x1830963592158336 ext(2097152->3145727) 00002000:00010000:3.0:1746143689.253020:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f4ec000 00000100:00100000:0.0:1746143689.256920:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.257003:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592158720 00000100:00100000:3.0:1746143689.257010:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592158720 00000100:00100000:3.0:1746143689.257047:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9404 00000100:00100000:3.0:1746143689.257055:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28283:x1830963592158720:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143689.257070:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.257086:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7250ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11f7 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.257109:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.257111:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.257117:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7250ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f7 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.257129:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7250ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f7 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.257159:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095728c00, rc 0) 00000100:00100000:3.0:1746143689.257211:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28283:x1830963592158720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 156us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.257216:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9404 00000100:00100000:2.0:1746143689.263647:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592158592:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11372us (12699us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143689.263657:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3401 00002000:00100000:2.0:1746143689.263668:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880095098700 x1830963592158592/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.263676:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098700 with x1830963592158592 ext(2097152->3145727) 00002000:00010000:2.0:1746143689.263681:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095098700 00000100:00100000:0.0:1746143689.282182:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.282228:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.282248:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592159232 00000100:00100000:3.0:1746143689.282260:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592159232 00002000:00100000:3.0:1746143689.282298:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880095099f80 x1830963592159232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.282307:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099f80 with x1830963592159232 ext(2097152->3145727) 00002000:00010000:3.0:1746143689.282312:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095099f80 00000100:00100000:3.0:1746143689.282368:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3402 00000100:00100000:3.0:1746143689.282375:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592159232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143689.286577:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592158848 00000100:00100000:2.0:1746143689.286587:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592158848 00000100:00100000:2.0:1746143689.286643:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9405 00000100:00100000:2.0:1746143689.286650:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28284:x1830963592158848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143689.286666:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.286681:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd7250f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a11fe expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.286701:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.286702:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.286709:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd7250f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11fe expref: 14 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.286721:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd7250f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11fe expref: 14 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.286730:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0701600, rc 0) 00000100:00100000:2.0:1746143689.286776:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28284:x1830963592158848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 127us (4602us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.286782:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9405 00000100:00100000:0.0:1746143689.291476:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.291562:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592159360 00000100:00100000:2.0:1746143689.291569:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592159360 00002000:00100000:2.0:1746143689.291606:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009509b480 x1830963592159360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.291615:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509b480 with x1830963592159360 ext(3145728->4194303) 00002000:00010000:2.0:1746143689.291619:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009509b480 00000100:00100000:2.0:1746143689.291651:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3403 00000100:00100000:2.0:1746143689.291657:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592159360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143689.309072:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.309447:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592159232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27071us (27216us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143689.309460:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3402 00002000:00100000:3.0:1746143689.309470:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880095099f80 x1830963592159232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.309479:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099f80 with x1830963592159232 ext(2097152->3145727) 00002000:00010000:3.0:1746143689.309484:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095099f80 00000100:00100000:3.0:1746143689.314087:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592159616 00000100:00100000:3.0:1746143689.314096:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592159616 00002000:00100000:3.0:1746143689.314130:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880095099500 x1830963592159616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.314152:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099500 with x1830963592159616 ext(3145728->4194303) 00002000:00010000:3.0:1746143689.314156:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095099500 00000100:00100000:3.0:1746143689.314173:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3404 00000100:00100000:3.0:1746143689.314179:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592159616:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143689.316634:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592159360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24970us (25161us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143689.316643:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3403 00002000:00100000:2.0:1746143689.316652:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009509b480 x1830963592159360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.316660:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509b480 with x1830963592159360 ext(3145728->4194303) 00002000:00010000:2.0:1746143689.316665:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009509b480 00000100:00100000:0.0:1746143689.319660:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.319707:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.319769:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592159872 00000100:00100000:1.0:1746143689.319778:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592159872 00000100:00100000:2.0:1746143689.319798:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592160128 00000100:00100000:2.0:1746143689.319802:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592160128 00002000:00100000:1.0:1746143689.319815:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880090767b80 x1830963592159872/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.319820:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880090764a80 x1830963592160128/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.319824:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767b80 with x1830963592159872 ext(3145728->4194303) 00002000:00100000:2.0:1746143689.319827:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764a80 with x1830963592160128 ext(3145728->4194303) 00002000:00010000:1.0:1746143689.319829:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090767b80 00002000:00010000:2.0:1746143689.319831:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090764a80 00000100:00100000:1.0:1746143689.319857:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3405 00000100:00100000:1.0:1746143689.319864:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592159872:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143689.319872:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3406 00000100:00100000:2.0:1746143689.319878:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592160128:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143689.330743:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592159616:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16556us (21670us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143689.330754:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3404 00002000:00100000:3.0:1746143689.330764:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880095099500 x1830963592159616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.330773:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099500 with x1830963592159616 ext(3145728->4194303) 00002000:00010000:3.0:1746143689.330778:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095099500 00000100:00100000:0.0:1746143689.332737:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.333245:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592160384 00000100:00100000:3.0:1746143689.333252:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592160384 00000100:00100000:3.0:1746143689.333293:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8238 00000100:00100000:3.0:1746143689.333300:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28289:x1830963592160384:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143689.333320:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.333337:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5600/0xe984082ccd7250f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1205 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.333449:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2c200/0xe984082ccd7250ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333460:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2c200/0xe984082ccd7250ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333470:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2c200/0xe984082ccd7250ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333481:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2d800/0xe984082ccd725106 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333487:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2d800/0xe984082ccd725106 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333492:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2d800/0xe984082ccd725106 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333581:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72510d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333587:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72510d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333592:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72510d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143689.333599:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143689.333670:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2c200/0xe984082ccd7250ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333679:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2c200/0xe984082ccd7250ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333684:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2c200/0xe984082ccd7250ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333688:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c2c200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143689.333692:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2c200/0xe984082ccd7250ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333697:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2c200/0xe984082ccd7250ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333705:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143689.333707:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143689.333710:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2c200/0xe984082ccd7250ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333714:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2c200/0xe984082ccd7250ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333745:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2d800/0xe984082ccd725106 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333750:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2d800/0xe984082ccd725106 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333754:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2d800/0xe984082ccd725106 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333758:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c2d800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143689.333760:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2d800/0xe984082ccd725106 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333767:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2d800/0xe984082ccd725106 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333772:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5e000) 00010000:00010000:3.0:1746143689.333774:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143689.333776:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2d800/0xe984082ccd725106 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333781:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c2d800/0xe984082ccd725106 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.333813:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5600/0xe984082ccd7250f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1205 expref: 246 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.333824:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72510d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1205 expref: 245 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.333830:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143689.333832:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143689.333834:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900cb000, rc 0) 00000100:00100000:3.0:1746143689.333871:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28289:x1830963592160384:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 571us (1139us total) trans 8589942330 rc 0/0 00000100:00100000:3.0:1746143689.333877:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8238 00000100:00100000:2.0:1746143689.335347:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592160128:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15464us (15634us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143689.335355:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3406 00002000:00100000:2.0:1746143689.335364:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880090764a80 x1830963592160128/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.335374:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764a80 with x1830963592160128 ext(3145728->4194303) 00002000:00010000:2.0:1746143689.335378:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090764a80 00000100:00100000:0.0:1746143689.343795:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.345085:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592160640 00000100:00100000:1.0:1746143689.345093:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592160640 00000100:00100000:1.0:1746143689.345600:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8239 00000100:00100000:1.0:1746143689.345608:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28290:x1830963592160640:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143689.345949:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.345966:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792200/0xe984082ccd72511b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a120c expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.346058:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792c00/0xe984082ccd725122 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346069:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792c00/0xe984082ccd725122 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346078:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792c00/0xe984082ccd725122 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346090:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792800/0xe984082ccd725129 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346096:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792800/0xe984082ccd725129 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346100:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792800/0xe984082ccd725129 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346205:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd725130 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346212:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd725130 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346218:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd725130 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143689.346226:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143689.346297:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792c00/0xe984082ccd725122 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346303:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792c00/0xe984082ccd725122 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346308:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792c00/0xe984082ccd725122 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346313:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5792c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143689.346316:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792c00/0xe984082ccd725122 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346321:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792c00/0xe984082ccd725122 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346331:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143689.346333:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143689.346336:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792c00/0xe984082ccd725122 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.346340:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792c00/0xe984082ccd725122 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00000100:00100000:3.0:1746143689.346666:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592159872:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26800us (27009us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143689.346675:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3405 00002000:00100000:3.0:1746143689.346683:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880090767b80 x1830963592159872/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.346697:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767b80 with x1830963592159872 ext(3145728->4194303) 00002000:00010000:3.0:1746143689.346701:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090767b80 00010000:00010000:1.0:1746143689.347266:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792800/0xe984082ccd725129 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.347273:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792800/0xe984082ccd725129 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.347278:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792800/0xe984082ccd725129 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.347282:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5792800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143689.347285:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792800/0xe984082ccd725129 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.347292:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792800/0xe984082ccd725129 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.347299:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74200) 00010000:00010000:1.0:1746143689.347301:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143689.347304:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792800/0xe984082ccd725129 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.347308:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792800/0xe984082ccd725129 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.347350:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792200/0xe984082ccd72511b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a120c expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.347361:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd725130 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a120c expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.347367:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143689.347368:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143689.347370:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5793200, rc 0) 00000100:00100000:1.0:1746143689.348281:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28290:x1830963592160640:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2669us (4489us total) trans 8589942331 rc 0/0 00000100:00100000:1.0:1746143689.348416:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8239 00000100:00100000:3.0:1746143689.351318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.352674:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592160896 00000100:00100000:0.0:1746143689.352683:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592160896 00002000:00100000:0.0:1746143689.352726:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008f532680 x1830963592160896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143689.352735:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f532680 with x1830963592160896 ext(4194304->4898815) 00002000:00010000:0.0:1746143689.352740:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f532680 00000100:00100000:0.0:1746143689.352776:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3407 00000100:00100000:0.0:1746143689.352783:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592160896:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143689.362006:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.362106:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592161024 00000100:00100000:3.0:1746143689.362113:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592161024 00000100:00100000:3.0:1746143689.362190:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9406 00000100:00100000:3.0:1746143689.362197:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28290:x1830963592161024:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143689.362214:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.362230:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1213 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.362254:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090745400/0xe984082ccd724f9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a113a expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143689.362263:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd725096 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11a3 expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.362269:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009133d000/0xe984082ccd725088 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1195 expref: 20 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.363659:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.363661:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.363667:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [1892352->1974271] (req 1892352->1974271) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.363696:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009133d000/0xe984082ccd725088 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1195 expref: 20 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.363707:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009133d000/0xe984082ccd725088 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1195 expref: 20 pid: 9527 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.363723:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593701632:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143689.363823:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd725096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11a3 expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.363831:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd725096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11a3 expref: 22 pid: 15784 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.363838:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593701760:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143689.363860:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090745400/0xe984082ccd724f9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a113a expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143689.363868:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090745400/0xe984082ccd724f9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a113a expref: 10 pid: 21542 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746143689.363875:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593701888:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143689.363904:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143689.366366:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.366434:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592161280 00000100:00100000:2.0:1746143689.366442:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592161280 00002000:00100000:2.0:1746143689.366479:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880090766a00 x1830963592161280/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.366489:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766a00 with x1830963592161280 ext(4194304->4898815) 00002000:00010000:2.0:1746143689.366493:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090766a00 00000100:00100000:2.0:1746143689.366526:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3408 00000100:00100000:2.0:1746143689.366532:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592161280:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143689.367012:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593701888:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143689.367958:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.368007:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593701760:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143689.368062:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593701632:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143689.368089:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [1892352->1974271] (req 1892352->1974271) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.368103:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095729e00, rc 0) 00000100:00100000:3.0:1746143689.368151:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28290:x1830963592161024:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5937us (6136us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.368159:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9406 00000100:00100000:1.0:1746143689.368320:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592160896:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15535us (17006us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143689.368327:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3407 00002000:00100000:1.0:1746143689.368333:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88008f532680 x1830963592160896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.368345:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f532680 with x1830963592160896 ext(4194304->4898815) 00002000:00010000:1.0:1746143689.368349:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f532680 00000100:00100000:2.0:1746143689.368849:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592161408 00000100:00100000:2.0:1746143689.368853:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592161408 00010000:00010000:2.0:1746143689.368872:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090745400/0xe984082ccd724f9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a113a expref: 11 pid: 21542 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746143689.368908:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4800 00000100:00100000:2.0:1746143689.368913:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592161408:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143689.368922:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143689.368938:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090745400/0xe984082ccd724f9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a113a expref: 11 pid: 21542 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746143689.368947:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090745400/0xe984082ccd724f9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a113a expref: 11 pid: 21542 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746143689.368966:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090745400/0xe984082ccd724f9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a113a expref: 11 pid: 21542 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746143689.368979:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143689.369005:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592161408:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 92us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.369012:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4800 00000100:00100000:0.0:1746143689.372609:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.372653:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.374421:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592161536 00000100:00100000:2.0:1746143689.374431:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592161536 00000100:00100000:1.0:1746143689.374449:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592161664 00000100:00100000:1.0:1746143689.374454:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592161664 00010000:00010000:2.0:1746143689.374463:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd725096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11a3 expref: 23 pid: 15784 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.374470:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009133d000/0xe984082ccd725088 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1195 expref: 20 pid: 9527 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.374530:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4801 00000100:00100000:2.0:1746143689.374537:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592161536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143689.374543:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4802 00010000:00010000:2.0:1746143689.374549:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143689.374549:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592161664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.374556:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143689.374567:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd725096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11a3 expref: 23 pid: 15784 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.374568:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009133d000/0xe984082ccd725088 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1195 expref: 20 pid: 9527 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.374578:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009133d000/0xe984082ccd725088 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1195 expref: 20 pid: 9527 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.374665:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd725096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11a3 expref: 23 pid: 15784 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.374684:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd725096 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11a3 expref: 23 pid: 15784 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.374701:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143689.374739:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592161536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 202us (2136us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.374745:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4801 00010000:00010000:1.0:1746143689.374972:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009133d000/0xe984082ccd725088 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1195 expref: 20 pid: 9527 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.374986:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.374988:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.374994:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.375001:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.375032:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143689.375042:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593702016:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143689.375097:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc23780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143689.380069:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.380100:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592161280:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13566us (13738us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143689.380103:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592161792 00000100:00100000:2.0:1746143689.380109:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3408 00000100:00100000:1.0:1746143689.380109:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592161792 00002000:00100000:2.0:1746143689.380118:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880090766a00 x1830963592161280/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.380127:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766a00 with x1830963592161280 ext(4194304->4898815) 00002000:00010000:2.0:1746143689.380132:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090766a00 00000100:00100000:1.0:1746143689.380159:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9407 00000100:00100000:1.0:1746143689.380166:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592161792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143689.380178:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.380192:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5792600/0xe984082ccd725145 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a121a expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143689.380375:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593702144:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143689.380434:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc23300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143689.381121:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305ca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593702016:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143689.381134:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1746143689.381639:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime: 1746143688 -> 1746143689 00002000:00010000:2.0:1746143689.381644:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143688 -> 1746143689 00002000:00010000:2.0:1746143689.381646:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime: 1746143688 -> 1746143689 00000100:00100000:2.0:1746143689.381661:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593702144:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143689.381677:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5792600/0xe984082ccd725145 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a121a expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.381688:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5792600/0xe984082ccd725145 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a121a expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.381696:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5792600, rc 0) 00000100:00100000:2.0:1746143689.381717:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592161792:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1552us (1654us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143689.381723:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9407 00000100:00100000:1.0:1746143689.382563:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592161664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8011us (9906us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.382572:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4802 00000100:00100000:0.0:1746143689.388602:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.388970:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.389049:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592162176 00000100:00100000:3.0:1746143689.389056:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592162176 00000100:00100000:3.0:1746143689.389089:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9408 00000100:00100000:3.0:1746143689.389095:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592162176:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143689.389110:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.389125:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a95e3c00/0xe984082ccd72514c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1221 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143689.389190:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593702272:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143689.389261:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21570c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143689.389858:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592162048 00000100:00100000:2.0:1746143689.389862:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592162048 00002000:00100000:2.0:1746143689.389899:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1892352->1896447) req@ffff880093f03800 x1830963592162048/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.389907:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03800 with x1830963592162048 ext(1892352->1896447) 00002000:00010000:2.0:1746143689.389911:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f03800 00000100:00100000:2.0:1746143689.389934:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3409 00000100:00100000:2.0:1746143689.389939:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592162048:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143689.390966:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592162048:12345-192.168.202.48@tcp:3:cat.0 Request processed in 1023us (2368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143689.390973:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3409 00002000:00100000:2.0:1746143689.390979:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1892352->1896447) req@ffff880093f03800 x1830963592162048/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.390986:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03800 with x1830963592162048 ext(1892352->1896447) 00002000:00010000:2.0:1746143689.390989:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f03800 00000100:00100000:0.0:1746143689.391520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.391696:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593702272:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143689.391718:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a95e3c00/0xe984082ccd72514c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1221 expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143689.391728:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a95e3c00/0xe984082ccd72514c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1221 expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143689.391752:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e3c00, rc 0) 00000100:00100000:3.0:1746143689.391777:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592162176:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2682us (2808us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143689.391784:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9408 00000100:00100000:2.0:1746143689.392167:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592162432 00000100:00100000:2.0:1746143689.392171:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592162432 00000100:00100000:2.0:1746143689.392196:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3342 00000100:00100000:2.0:1746143689.392201:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28284:x1830963592162432:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143689.392339:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28284:x1830963592162432:12345-192.168.202.48@tcp:35:cat.0 Request processed in 137us (819us total) trans 8589942332 rc 0/0 00000100:00100000:2.0:1746143689.392345:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3342 00000100:00100000:2.0:1746143689.399399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.399460:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592162688 00000100:00100000:3.0:1746143689.399468:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592162688 00000100:00100000:3.0:1746143689.399514:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3343 00000100:00100000:3.0:1746143689.399521:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28283:x1830963592162688:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143689.399760:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:28283:x1830963592162688:12345-192.168.202.48@tcp:35:cat.0 Request processed in 239us (368us total) trans 8589942333 rc 0/0 00000100:00100000:3.0:1746143689.399766:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3343 00000100:00100000:0.0:1746143689.400006:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.400066:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592162944 00000100:00100000:2.0:1746143689.400070:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592162944 00002000:00100000:2.0:1746143689.400095:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1970176->1974271) req@ffff880093f02300 x1830963592162944/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.400103:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02300 with x1830963592162944 ext(1970176->1974271) 00002000:00010000:2.0:1746143689.400107:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02300 00000100:00100000:2.0:1746143689.400121:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3410 00000100:00100000:2.0:1746143689.400126:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592162944:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143689.400240:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592162944:12345-192.168.202.48@tcp:3:cat.0 Request processed in 113us (234us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143689.400245:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3410 00002000:00100000:2.0:1746143689.400250:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1970176->1974271) req@ffff880093f02300 x1830963592162944/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.400256:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02300 with x1830963592162944 ext(1970176->1974271) 00002000:00010000:2.0:1746143689.400258:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02300 00000100:00100000:0.0:1746143689.409214:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.409306:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592163200 00000100:00100000:2.0:1746143689.409314:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592163200 00000100:00100000:2.0:1746143689.409364:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3344 00000100:00100000:2.0:1746143689.409372:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28290:x1830963592163200:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143689.409564:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28290:x1830963592163200:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 192us (357us total) trans 8589942334 rc 0/0 00000100:00100000:2.0:1746143689.409570:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3344 00000100:00100000:3.0:1746143689.456826:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.456869:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592163328 00000100:00100000:0.0:1746143689.456877:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592163328 00000100:00100000:0.0:1746143689.456935:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9409 00000100:00100000:0.0:1746143689.456942:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28289:x1830963592163328:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143689.456959:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143689.456975:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1228 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.456998:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5400/0xe984082ccd724f8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1141 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143689.457006:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd7250c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11d4 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.457013:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd7250c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11cd expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.457024:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.457026:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.457029:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [1277952->1949695] (req 1277952->1949695) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.457054:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd7250c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11cd expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.457065:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd7250c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11cd expref: 18 pid: 4581 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746143689.457075:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593702400:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143689.457189:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd7250c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11d4 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.457196:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd7250c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11d4 expref: 23 pid: 21542 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746143689.457203:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593702528:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143689.457235:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5400/0xe984082ccd724f8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1141 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143689.457243:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5400/0xe984082ccd724f8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1141 expref: 9 pid: 4581 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746143689.457259:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593702656:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143689.457279:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143689.464296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.464336:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.464430:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592163456 00000100:00100000:1.0:1746143689.464439:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592163456 00010000:00010000:1.0:1746143689.464470:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5400/0xe984082ccd724f8c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1141 expref: 10 pid: 4581 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746143689.464498:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592163584 00000100:00100000:1.0:1746143689.464500:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592163584 00010000:00010000:1.0:1746143689.464508:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd7250c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11cd expref: 19 pid: 4581 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.464522:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4803 00000100:00100000:1.0:1746143689.464528:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592163456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.464539:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143689.464559:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5400/0xe984082ccd724f8c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1141 expref: 10 pid: 4581 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746143689.464569:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5400/0xe984082ccd724f8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1141 expref: 10 pid: 4581 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746143689.464591:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.464626:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592163456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 97us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.464632:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4803 00000100:00100000:1.0:1746143689.464653:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4804 00000100:00100000:1.0:1746143689.464658:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592163584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.464664:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143689.464671:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd7250c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11cd expref: 19 pid: 4581 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.464684:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd7250c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11cd expref: 19 pid: 4581 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.464695:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.464706:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592163584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 48us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.464711:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4804 00010000:00010000:2.0:1746143689.465175:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd7250c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11cd expref: 18 pid: 4581 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.465191:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593702400:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143689.465202:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593702528:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.465210:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4e5400/0xe984082ccd724f8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1141 expref: 9 pid: 4581 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746143689.465218:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593702656:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.465241:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1277952->1949695] (req 1277952->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.465254:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94b200, rc 0) 00000100:00100000:2.0:1746143689.465284:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28289:x1830963592163328:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8343us (8465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.465291:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9409 00000100:00100000:0.0:1746143689.466263:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.466361:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592163712 00000100:00100000:2.0:1746143689.466365:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592163712 00010000:00010000:2.0:1746143689.466384:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd7250c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11d4 expref: 23 pid: 21542 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.466412:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4805 00000100:00100000:2.0:1746143689.466418:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592163712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143689.466426:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143689.466438:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd7250c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11d4 expref: 23 pid: 21542 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.466447:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd7250c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11d4 expref: 23 pid: 21542 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.466461:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701c00/0xe984082ccd7250c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11d4 expref: 23 pid: 21542 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.466470:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.466471:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.466477:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.466488:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.466512:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143689.466522:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593702784:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143689.466706:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143689.469026:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.469115:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592163968 00000100:00100000:1.0:1746143689.469121:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592163968 00002000:00100000:1.0:1746143689.469177:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34b:0x0] (1277952->1282047) req@ffff880093f01f80 x1830963592163968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.469185:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01f80 with x1830963592163968 ext(1277952->1282047) 00002000:00010000:1.0:1746143689.469189:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01f80 00000100:00100000:1.0:1746143689.469211:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3411 00000100:00100000:1.0:1746143689.469218:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592163968:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143689.469353:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592163968:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 134us (330us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143689.469358:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3411 00002000:00100000:1.0:1746143689.469363:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34b:0x0] (1277952->1282047) req@ffff880093f01f80 x1830963592163968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.469370:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01f80 with x1830963592163968 ext(1277952->1282047) 00002000:00010000:1.0:1746143689.469372:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01f80 00000100:00100000:2.0:1746143689.469545:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593702784:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143689.469559:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143689.469594:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592163712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3175us (3333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.469601:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4805 00000100:00100000:0.0:1746143689.477750:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.477811:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592164224 00000100:00100000:3.0:1746143689.477819:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592164224 00002000:00100000:3.0:1746143689.477857:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1945600->1949695) req@ffff880093f00a80 x1830963592164224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.477865:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00a80 with x1830963592164224 ext(1945600->1949695) 00002000:00010000:3.0:1746143689.477870:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00a80 00000100:00100000:3.0:1746143689.477906:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3412 00000100:00100000:3.0:1746143689.477913:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592164224:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143689.478079:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592164224:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 166us (336us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143689.478086:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3412 00002000:00100000:3.0:1746143689.478091:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1945600->1949695) req@ffff880093f00a80 x1830963592164224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.478098:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00a80 with x1830963592164224 ext(1945600->1949695) 00002000:00010000:3.0:1746143689.478101:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00a80 00000100:00100000:0.0:1746143689.480330:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.482456:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592164480 00000100:00100000:3.0:1746143689.482465:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592164480 00000100:00100000:3.0:1746143689.482519:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3345 00000100:00100000:3.0:1746143689.482525:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:28289:x1830963592164480:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143689.482725:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:28289:x1830963592164480:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 199us (2400us total) trans 8589942335 rc 0/0 00000100:00100000:3.0:1746143689.482731:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3345 00000100:00100000:0.0:1746143689.535076:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.537319:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592164736 00000100:00100000:1.0:1746143689.537330:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592164736 00000100:00100000:1.0:1746143689.539172:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8240 00000100:00100000:1.0:1746143689.539187:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28300:x1830963592164736:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143689.539208:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.539225:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793400/0xe984082ccd72515a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a122f expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.539305:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725161 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.539317:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725161 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.539327:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725161 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143689.539336:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143689.539425:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793400/0xe984082ccd72515a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a122f expref: 15 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.539467:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725161 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a122f expref: 14 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.539475:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143689.539477:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143689.539480:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5793800, rc 0) 00000100:00100000:1.0:1746143689.539524:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28300:x1830963592164736:12345-192.168.202.48@tcp:101:cat.0 Request processed in 342us (4455us total) trans 8589942336 rc 0/0 00000100:00100000:1.0:1746143689.539529:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8240 00000100:00100000:0.0:1746143689.542421:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.542866:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592164992 00000100:00100000:1.0:1746143689.542873:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592164992 00000100:00100000:1.0:1746143689.542925:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8241 00000100:00100000:1.0:1746143689.542931:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:28303:x1830963592164992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143689.542949:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.542962:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792800/0xe984082ccd72516f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1236 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.543044:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792200/0xe984082ccd725176 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.543055:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792200/0xe984082ccd725176 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.543064:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792200/0xe984082ccd725176 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143689.543073:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143689.543204:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792800/0xe984082ccd72516f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1236 expref: 250 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.543226:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792200/0xe984082ccd725176 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1236 expref: 249 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.543233:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143689.543235:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143689.543238:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5792200, rc 0) 00000100:00100000:1.0:1746143689.543278:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:28303:x1830963592164992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 347us (864us total) trans 8589942337 rc 0/0 00000100:00100000:1.0:1746143689.543284:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8241 00000100:00100000:0.0:1746143689.544791:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.544831:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.544893:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592165248 00000100:00100000:3.0:1746143689.544898:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592165248 00000100:00100000:3.0:1746143689.544922:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8242 00000100:00100000:3.0:1746143689.544927:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28302:x1830963592165248:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143689.544937:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.544946:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2400/0xe984082ccd725184 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a123d expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.544998:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.545007:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72510d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1205 expref: 248 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.545013:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd725130 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a120c expref: 15 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.545018:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.545040:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd725130 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a120c expref: 15 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.545050:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd725130 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a120c expref: 15 pid: 21713 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.545059:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593702912:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143689.545120:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72510d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1205 expref: 248 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.545126:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72510d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1205 expref: 248 pid: 14764 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.545132:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593703040:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143689.545167:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143689.545187:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592165376 00000100:00100000:3.0:1746143689.545189:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592165376 00000100:00100000:3.0:1746143689.545206:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9410 00000100:00100000:3.0:1746143689.545210:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592165376:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143689.545216:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.545224:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095176e00/0xe984082ccd725192 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1244 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143689.545245:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593703168:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143689.545261:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143689.548810:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.549040:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592165504 00000100:00100000:3.0:1746143689.549047:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592165504 00000100:00100000:3.0:1746143689.549087:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9411 00000100:00100000:3.0:1746143689.549094:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592165504:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143689.549108:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.549124:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd725199 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a124b expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143689.549180:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593703296:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143689.549255:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143689.550973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.550994:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.551046:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592165632 00000100:00100000:3.0:1746143689.551051:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592165632 00010000:00010000:3.0:1746143689.551076:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd725130 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a120c expref: 16 pid: 21713 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.551098:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592165760 00000100:00100000:3.0:1746143689.551101:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592165760 00010000:00010000:3.0:1746143689.551109:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72510d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1205 expref: 249 pid: 14764 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.551122:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4806 00000100:00100000:3.0:1746143689.551127:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592165632:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143689.551154:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143689.551159:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd725130 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a120c expref: 16 pid: 21713 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.551168:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd725130 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a120c expref: 16 pid: 21713 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.551185:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143689.551189:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.551195:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.551198:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143689.551226:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592165632:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 99us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.551231:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4806 00000100:00100000:3.0:1746143689.551244:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4807 00000100:00100000:3.0:1746143689.551248:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1964:x1830963592165760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143689.551255:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143689.551258:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72510d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1205 expref: 249 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.551264:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72510d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1205 expref: 249 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.551272:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143689.551275:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.551280:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.551285:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.551295:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143689.551307:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1964:x1830963592165760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 58us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.551315:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4807 00000100:00100000:3.0:1746143689.551360:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593703296:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143689.551375:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd725199 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a124b expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143689.551385:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd725199 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a124b expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143689.551397:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009500a000, rc 0) 00000100:00100000:3.0:1746143689.551419:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592165504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2324us (2617us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143689.551425:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9411 00010000:00010000:3.0:1746143689.551446:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793200/0xe984082ccd725130 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a120c expref: 15 pid: 21713 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.551464:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593702912:192.168.202.48@tcp:104: 00002000:00010000:2.0:1746143689.551466:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime: 1746143688 -> 1746143689 00002000:00010000:2.0:1746143689.551470:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime: 1746143688 -> 1746143689 00010000:00010000:3.0:1746143689.551471:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72510d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1205 expref: 248 pid: 14764 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746143689.551471:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime: 1746143688 -> 1746143689 00000100:00100000:3.0:1746143689.551477:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593703040:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143689.551480:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593703168:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143689.551488:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.551494:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.551496:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095176e00/0xe984082ccd725192 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1244 expref: 19 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143689.551500:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.551505:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095176e00/0xe984082ccd725192 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1244 expref: 19 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.551516:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095176e00, rc 0) 00000004:00200000:3.0:1746143689.551520:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000100:00100000:2.0:1746143689.551535:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592165376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6324us (6704us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143689.551540:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9410 00010000:00010000:3.0:1746143689.551928:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2400/0xe984082ccd725184 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a123d expref: 16 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.551940:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a123d expref: 15 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.551946:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143689.551948:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143689.551950:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e2a00, rc 0) 00000100:00100000:3.0:1746143689.552018:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28302:x1830963592165248:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7090us (7233us total) trans 8589942338 rc 0/0 00000100:00100000:3.0:1746143689.552025:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8242 00000100:00100000:0.0:1746143689.559081:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.559114:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592166016 00000100:00100000:0.0:1746143689.559121:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592166016 00002000:00100000:0.0:1746143689.559177:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008e63c700 x1830963592166016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143689.559186:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63c700 with x1830963592166016 ext(0->1048575) 00002000:00010000:0.0:1746143689.559190:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e63c700 00000100:00100000:1.0:1746143689.559231:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3413 00000100:00100000:1.0:1746143689.559240:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963592166016:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143689.570751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.570801:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.571126:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592166400 00000100:00100000:3.0:1746143689.571134:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592166400 00002000:00100000:3.0:1746143689.571192:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008e63f800 x1830963592166400/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 504/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.571202:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63f800 with x1830963592166400 ext(1048576->2097151) 00002000:00010000:3.0:1746143689.571207:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e63f800 00000100:00100000:3.0:1746143689.571221:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592166528 00000100:00100000:3.0:1746143689.571223:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592166528 00002000:00100000:3.0:1746143689.571235:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008e63ed80 x1830963592166528/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.571242:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63ed80 with x1830963592166528 ext(0->1048575) 00002000:00010000:3.0:1746143689.571245:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e63ed80 00000100:00100000:3.0:1746143689.571261:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3414 00000100:00100000:3.0:1746143689.571267:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592166400:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143689.572096:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3415 00000100:00100000:0.0:1746143689.572106:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592166528:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143689.580806:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963592166016:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21558us (21724us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143689.580816:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3413 00010000:00010000:3.0:1746143689.580998:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00100000:1.0:1746143689.581611:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008e63c700 x1830963592166016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.581624:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63c700 with x1830963592166016 ext(0->1048575) 00002000:00010000:1.0:1746143689.581630:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e63c700 00000100:00100000:2.0:1746143689.597079:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.597772:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592166656 00000100:00100000:0.0:1746143689.597781:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592166656 00000100:00100000:0.0:1746143689.597903:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9412 00000100:00100000:0.0:1746143689.597912:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28302:x1830963592166656:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143689.597927:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143689.597942:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1252 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.597966:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7250dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e9 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.597974:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd7250f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11fe expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.597980:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.597981:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.597984:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3108864->3145727] (req 3108864->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.598010:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd7250f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11fe expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.598021:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd7250f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11fe expref: 17 pid: 21542 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746143689.598031:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593703424:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143689.598815:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592166528:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26708us (28010us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143689.598824:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3415 00002000:00100000:1.0:1746143689.598832:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008e63ed80 x1830963592166528/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.598839:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63ed80 with x1830963592166528 ext(0->1048575) 00002000:00010000:1.0:1746143689.598843:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e63ed80 00010000:00010000:3.0:1746143689.598940:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7250dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e9 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.598951:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7250dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e9 expref: 25 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.598959:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593703552:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143689.599007:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143689.605114:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592166400:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33837us (34362us total) trans 0 rc 966656/966656 00000100:00100000:3.0:1746143689.605288:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3414 00002000:00100000:3.0:1746143689.605301:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008e63f800 x1830963592166400/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 504/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 966656/966656 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.605310:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63f800 with x1830963592166400 ext(1048576->2097151) 00002000:00010000:3.0:1746143689.605315:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e63f800 00000100:00100000:3.0:1746143689.607360:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593703424:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143689.607371:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593703552:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143689.607432:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3108864->3145727] (req 3108864->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.607452:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0700600, rc 0) 00000100:00100000:3.0:1746143689.607489:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28302:x1830963592166656:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 9578us (10416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.607496:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9412 00000100:00100000:2.0:1746143689.608053:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.608113:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592166784 00000100:00100000:1.0:1746143689.608119:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592166784 00010000:00010000:1.0:1746143689.608163:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd7250f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11fe expref: 15 pid: 21542 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.608192:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4808 00000100:00100000:1.0:1746143689.608198:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592166784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.608209:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143689.608228:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd7250f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11fe expref: 15 pid: 21542 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.608237:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd7250f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11fe expref: 15 pid: 21542 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.608254:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0701600/0xe984082ccd7250f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11fe expref: 15 pid: 21542 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.608270:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.608292:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592166784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 94us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.608297:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4808 00000100:00100000:2.0:1746143689.612705:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.612756:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.612918:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592166912 00000100:00100000:0.0:1746143689.612926:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592166912 00010000:00010000:0.0:1746143689.612955:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7250dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e9 expref: 26 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746143689.612987:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4809 00000100:00100000:0.0:1746143689.612995:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592166912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143689.613006:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143689.613026:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7250dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e9 expref: 26 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746143689.613037:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7250dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e9 expref: 26 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746143689.613056:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7250dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e9 expref: 26 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746143689.613083:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.613085:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.613092:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 13 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.613099:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 13 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.613126:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 13 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143689.613157:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593703680:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143689.613222:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143689.613312:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592167040 00000100:00100000:3.0:1746143689.613315:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592167040 00000100:00100000:3.0:1746143689.613336:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9413 00000100:00100000:3.0:1746143689.613341:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28303:x1830963592167040:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143689.613352:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.613361:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd7251ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1259 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.613376:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.613381:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143689.613382:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143689.613385:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd7251ae lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1259 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.613399:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.613407:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 17 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.613419:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593703808:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143689.613448:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143689.623536:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.623697:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593703680:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143689.623715:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143689.623748:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592166912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10754us (10991us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.623757:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4809 00000100:00100000:3.0:1746143689.624818:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592167296 00000100:00100000:3.0:1746143689.624825:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592167296 00002000:00100000:3.0:1746143689.624856:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3108864->3112959) req@ffff88008e63f100 x1830963592167296/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.624864:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63f100 with x1830963592167296 ext(3108864->3112959) 00002000:00010000:3.0:1746143689.624868:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e63f100 00000100:00100000:3.0:1746143689.624900:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3416 00000100:00100000:3.0:1746143689.624906:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592167296:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143689.625051:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592167296:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 144us (1523us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143689.625056:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3416 00002000:00100000:3.0:1746143689.625060:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3108864->3112959) req@ffff88008e63f100 x1830963592167296/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.625067:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63f100 with x1830963592167296 ext(3108864->3112959) 00002000:00010000:3.0:1746143689.625069:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e63f100 00000100:00100000:0.0:1746143689.625316:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.625407:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592167552 00000100:00100000:1.0:1746143689.625411:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592167552 00002000:00100000:1.0:1746143689.625427:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1892352->1974271) req@ffff88008e63d500 x1830963592167552/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.625433:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63d500 with x1830963592167552 ext(1892352->1974271) 00010000:00010000:1.0:1746143689.625440:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 18 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.625452:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 18 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:1.0:1746143689.625458:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e63d500 00000100:00100000:1.0:1746143689.625476:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 819 00000100:00100000:1.0:1746143689.625481:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592167552:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143689.626183:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593703808:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143689.626199:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd7251ae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1259 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.626210:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009500a800, rc 0) 00000100:00100000:3.0:1746143689.626237:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28303:x1830963592167040:12345-192.168.202.48@tcp:101:cat.0 Request processed in 12895us (13539us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.626243:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9413 00000100:00100000:0.0:1746143689.626686:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.626758:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592167424 00000100:00100000:3.0:1746143689.626761:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592167424 00000100:00100000:3.0:1746143689.627122:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9414 00000100:00100000:3.0:1746143689.627128:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28300:x1830963592167424:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143689.627137:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.627171:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd7251b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1260 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.627189:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.627196:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143689.627197:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143689.627200:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd7251b5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1260 expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.627219:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.627227:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 22 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.627236:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593703936:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143689.628595:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.628654:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143689.629182:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592167680 00000100:00100000:0.0:1746143689.629188:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592167680 00000100:00100000:0.0:1746143689.629224:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9415 00000100:00100000:0.0:1746143689.629230:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28302:x1830963592167680:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143689.629241:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143689.629253:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1267 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.629271:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd7250e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f0 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.629280:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7250ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f7 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.629285:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.629286:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.629290:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.629311:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7250ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f7 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.629325:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7250ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f7 expref: 22 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746143689.629334:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593704064:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143689.629400:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd7250e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f0 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.629408:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd7250e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f0 expref: 23 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746143689.629420:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593704192:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143689.629439:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143689.632608:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963592167552:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 7118us (7284us total) trans 21474839695 rc 0/0 00000100:00100000:1.0:1746143689.632618:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 819 00002000:00100000:1.0:1746143689.632626:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1892352->1974271) req@ffff88008e63d500 x1830963592167552/t21474839695(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/448 e 0 to 0 dl 1746143700 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.632635:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63d500 with x1830963592167552 ext(1892352->1974271) 00010000:00010000:1.0:1746143689.632643:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 24 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.632654:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 24 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:1.0:1746143689.632660:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e63d500 00000100:00100000:1.0:1746143689.633033:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593704064:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143689.633042:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593704192:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143689.633062:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2457599] (req 2097152->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.633075:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0701800, rc 0) 00000100:00100000:1.0:1746143689.633109:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28302:x1830963592167680:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3879us (4517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.633115:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9415 00000100:00100000:3.0:1746143689.633330:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593703936:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143689.633346:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd7251b5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1260 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.633356:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009500a000, rc 0) 00000100:00100000:3.0:1746143689.633378:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28300:x1830963592167424:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6250us (6692us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.633384:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9414 00000100:00100000:0.0:1746143689.636824:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.636864:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.636922:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.636944:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.637723:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592167936 00000100:00100000:2.0:1746143689.637731:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592167936 00010000:00010000:2.0:1746143689.637765:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd7250e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f0 expref: 22 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.637800:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592168320 00000100:00100000:2.0:1746143689.637803:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592168320 00010000:00010000:2.0:1746143689.637813:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7250ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f7 expref: 23 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.638367:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4810 00000100:00100000:2.0:1746143689.638374:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592167936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143689.638386:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143689.638409:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd7250e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f0 expref: 22 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.638424:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd7250e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f0 expref: 22 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.638443:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701a00/0xe984082ccd7250e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f0 expref: 22 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.638463:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143689.638699:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4811 00000100:00100000:0.0:1746143689.638707:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592168320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143689.638715:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143689.638723:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7250ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f7 expref: 23 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746143689.638731:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7250ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f7 expref: 23 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746143689.638745:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095728c00/0xe984082ccd7250ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11f7 expref: 23 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746143689.638757:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.638759:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143689.638765:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.638772:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.638798:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143689.638808:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131e9ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593704320:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143689.638841:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592168192 00000100:00100000:3.0:1746143689.638845:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592168192 00000100:00100000:0.0:1746143689.638867:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143689.638869:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8243 00000100:00100000:3.0:1746143689.638874:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:28305:x1830963592168192:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143689.638900:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.638911:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd7251c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a126e expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.639000:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd7251ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639009:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd7251ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639017:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd7251ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639028:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a200/0xe984082ccd7251d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639033:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a200/0xe984082ccd7251d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639040:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a200/0xe984082ccd7251d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639132:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2400/0xe984082ccd7251d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639163:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2400/0xe984082ccd7251d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639169:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2400/0xe984082ccd7251d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143689.639178:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143689.639246:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd7251ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00000100:00100000:2.0:1746143689.639248:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592167936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 873us (2323us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143689.639252:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd7251ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00000100:00100000:2.0:1746143689.639254:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4810 00010000:00010000:3.0:1746143689.639257:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd7251ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639261:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009500be00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143689.639264:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd7251ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639269:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd7251ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639276:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143689.639279:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143689.639282:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd7251ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639289:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd7251ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639301:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a200/0xe984082ccd7251d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639305:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a200/0xe984082ccd7251d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639309:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a200/0xe984082ccd7251d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639313:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009500a200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143689.639315:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a200/0xe984082ccd7251d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639319:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a200/0xe984082ccd7251d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639324:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5e000) 00010000:00010000:3.0:1746143689.639326:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143689.639328:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a200/0xe984082ccd7251d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639331:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a200/0xe984082ccd7251d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.639361:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd7251c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a126e expref: 251 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.639370:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2400/0xe984082ccd7251d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a126e expref: 250 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.639380:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143689.639382:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143689.639383:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e2400, rc 0) 00000100:00100000:3.0:1746143689.639404:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:28305:x1830963592168192:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 530us (2588us total) trans 8589942339 rc 0/0 00000100:00100000:3.0:1746143689.639409:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8243 00000100:00100000:1.0:1746143689.639774:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592167808 00000100:00100000:1.0:1746143689.639778:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592167808 00002000:00100000:1.0:1746143689.639802:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1277952->1949695) req@ffff88008e63e680 x1830963592167808/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.639810:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63e680 with x1830963592167808 ext(1277952->1949695) 00010000:00010000:1.0:1746143689.639816:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 23 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.639824:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 23 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:1.0:1746143689.639829:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e63e680 00000100:00100000:1.0:1746143689.639856:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 820 00000100:00100000:1.0:1746143689.639861:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592167808:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143689.641302:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.641404:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592168448 00000100:00100000:1.0:1746143689.641408:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592168448 00010000:00010000:1.0:1746143689.641426:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 21 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.641451:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4812 00000100:00100000:1.0:1746143689.641456:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592168448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.641463:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143689.641475:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 21 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.641485:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 21 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.641501:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72513e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->1974271) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1213 expref: 21 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.641524:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.641526:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.641531:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd7251ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1259 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.641538:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd7251ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1259 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.641563:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd7251ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1259 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143689.641572:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305cad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593704448:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143689.641626:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e919c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143689.650891:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131e9ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593704320:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143689.650916:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.650961:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592168320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12253us (14013us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.650971:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4811 00000100:00100000:1.0:1746143689.651012:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305cad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593704448:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143689.651020:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.651034:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592168448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9578us (9737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.651039:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4812 00000100:00100000:2.0:1746143689.652830:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.653115:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592168704 00000100:00100000:3.0:1746143689.653122:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592168704 00002000:00100000:3.0:1746143689.653178:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2453504->2457599) req@ffff88009bef5500 x1830963592168704/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.653188:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef5500 with x1830963592168704 ext(2453504->2457599) 00002000:00010000:3.0:1746143689.653192:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bef5500 00000100:00100000:3.0:1746143689.654024:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3417 00000100:00100000:3.0:1746143689.654033:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592168704:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143689.654208:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592168704:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 176us (1382us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143689.654214:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3417 00002000:00100000:3.0:1746143689.654220:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2453504->2457599) req@ffff88009bef5500 x1830963592168704/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.654226:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef5500 with x1830963592168704 ext(2453504->2457599) 00002000:00010000:3.0:1746143689.654229:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bef5500 00000100:00100000:1.0:1746143689.658603:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592167808:12345-192.168.202.48@tcp:4:cat.0 Request processed in 18733us (21730us total) trans 21474839696 rc 0/0 00000100:00100000:1.0:1746143689.658616:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 820 00002000:00100000:1.0:1746143689.658625:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1277952->1949695) req@ffff88008e63e680 x1830963592167808/t21474839696(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/448 e 0 to 0 dl 1746143700 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.658635:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e63e680 with x1830963592167808 ext(1277952->1949695) 00010000:00010000:1.0:1746143689.658644:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 24 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.658659:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 24 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:1.0:1746143689.658665:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e63e680 00000100:00100000:3.0:1746143689.662056:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.662304:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592168960 00000100:00100000:1.0:1746143689.662312:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592168960 00002000:00100000:1.0:1746143689.662349:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880094c13800 x1830963592168960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.662357:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13800 with x1830963592168960 ext(1048576->2097151) 00002000:00010000:1.0:1746143689.662361:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c13800 00000100:00100000:1.0:1746143689.662676:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3418 00000100:00100000:1.0:1746143689.662684:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592168960:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143689.664553:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.664627:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592169088 00000100:00100000:2.0:1746143689.664633:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592169088 00010000:00010000:2.0:1746143689.664657:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 25 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.664679:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4813 00000100:00100000:2.0:1746143689.664684:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592169088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143689.664694:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143689.664708:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 25 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.664718:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 25 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.664739:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c94b200/0xe984082ccd725153 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->1949695) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1228 expref: 25 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.664762:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.664763:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.664768:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd7251b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1260 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.664775:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd7251b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1260 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.664798:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd7251b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1260 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143689.664806:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593704576:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143689.664864:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143689.666855:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593704576:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143689.666872:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143689.667117:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592169088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2430us (2566us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.667234:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4813 00000100:00100000:0.0:1746143689.674004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.674058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.674351:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592169216 00000100:00100000:3.0:1746143689.674360:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592169216 00000100:00100000:3.0:1746143689.675263:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9416 00000100:00100000:3.0:1746143689.675273:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28305:x1830963592169216:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143689.675291:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.675305:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1275 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.675334:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.675341:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143689.675342:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143689.675346:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2609152->3026943] (req 2609152->3026943) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 26 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.675371:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.675381:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 19 pid: 21542 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.675393:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593704704:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143689.675453:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143689.675826:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592169472 00000100:00100000:2.0:1746143689.675831:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592169472 00002000:00100000:2.0:1746143689.675856:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880131e9fb80 x1830963592169472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.675871:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9fb80 with x1830963592169472 ext(1048576->2097151) 00002000:00010000:2.0:1746143689.675874:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9fb80 00000100:00100000:2.0:1746143689.675908:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3419 00000100:00100000:2.0:1746143689.675913:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592169472:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143689.678657:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592168960:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15968us (16603us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143689.678667:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3418 00002000:00100000:1.0:1746143689.678675:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880094c13800 x1830963592168960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.678690:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13800 with x1830963592168960 ext(1048576->2097151) 00002000:00010000:1.0:1746143689.678694:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c13800 00000100:00100000:3.0:1746143689.680651:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593704704:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143689.680673:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2609152->3026943] (req 2609152->3026943) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.680694:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5d0a00, rc 0) 00000100:00100000:3.0:1746143689.680738:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28305:x1830963592169216:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5466us (6740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.680746:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9416 00000100:00100000:0.0:1746143689.693656:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.695790:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592169600 00000100:00100000:1.0:1746143689.695800:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592169600 00002000:00100000:1.0:1746143689.695839:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2457599) req@ffff880131e9e680 x1830963592169600/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.695848:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9e680 with x1830963592169600 ext(2097152->2457599) 00010000:00010000:1.0:1746143689.695857:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 22 pid: 21542 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.695869:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 22 pid: 21542 timeout: 868 lvb_type: 0 00002000:00010000:1.0:1746143689.695876:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131e9e680 00000100:00100000:3.0:1746143689.695966:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 821 00000100:00100000:3.0:1746143689.695975:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592169600:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143689.696644:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.699589:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592169728 00000100:00100000:3.0:1746143689.699600:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592169728 00000100:00100000:3.0:1746143689.699645:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9417 00000100:00100000:3.0:1746143689.699653:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28303:x1830963592169728:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143689.699667:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143689.699683:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1e00/0xe984082ccd7251ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a127c expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.699703:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.699705:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.699712:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1e00/0xe984082ccd7251ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a127c expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.699725:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1e00/0xe984082ccd7251ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a127c expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.699733:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5d1e00, rc 0) 00000100:00100000:3.0:1746143689.699754:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28303:x1830963592169728:12345-192.168.202.48@tcp:101:cat.0 Request processed in 103us (3111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.699763:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9417 00000100:00100000:2.0:1746143689.700079:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592169472:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 24165us (26020us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143689.700086:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3419 00002000:00100000:2.0:1746143689.700093:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880131e9fb80 x1830963592169472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.700101:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9fb80 with x1830963592169472 ext(1048576->2097151) 00002000:00010000:2.0:1746143689.700105:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9fb80 00000100:00100000:0.0:1746143689.714373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.714426:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592169984 00000100:00100000:2.0:1746143689.714434:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592169984 00002000:00100000:2.0:1746143689.714477:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880131e9f100 x1830963592169984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.714486:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9f100 with x1830963592169984 ext(1048576->2097151) 00002000:00010000:2.0:1746143689.714490:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9f100 00000100:00100000:2.0:1746143689.714515:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3420 00000100:00100000:2.0:1746143689.714521:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592169984:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143689.717512:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592169600:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 21531us (23855us total) trans 21474839697 rc 0/0 00000100:00100000:3.0:1746143689.717522:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 821 00002000:00100000:3.0:1746143689.717531:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2457599) req@ffff880131e9e680 x1830963592169600/t21474839697(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/448 e 0 to 0 dl 1746143700 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.717540:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9e680 with x1830963592169600 ext(2097152->2457599) 00010000:00010000:3.0:1746143689.717549:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 22 pid: 21542 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.717561:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 22 pid: 21542 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746143689.717567:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131e9e680 00000100:00100000:0.0:1746143689.722137:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.723115:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592170240 00000100:00100000:3.0:1746143689.723124:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592170240 00002000:00100000:3.0:1746143689.723173:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3108863) req@ffff880131e9d880 x1830963592170240/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.723183:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9d880 with x1830963592170240 ext(2097152->3108863) 00002000:00010000:3.0:1746143689.723188:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9d880 00000100:00100000:3.0:1746143689.723215:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3421 00000100:00100000:3.0:1746143689.723222:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592170240:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143689.731829:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592169984:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 17300us (17456us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143689.731839:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3420 00002000:00100000:2.0:1746143689.731848:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880131e9f100 x1830963592169984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.731857:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9f100 with x1830963592169984 ext(1048576->2097151) 00002000:00010000:2.0:1746143689.731862:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9f100 00000100:00100000:0.0:1746143689.733680:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.734302:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592170368 00000100:00100000:2.0:1746143689.734310:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592170368 00010000:00010000:2.0:1746143689.734341:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 22 pid: 21542 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.735193:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4814 00000100:00100000:2.0:1746143689.735201:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592170368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143689.735214:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143689.735230:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143688 -> 1746143689 00002000:00010000:2.0:1746143689.735232:0:7150:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143688 -> 1746143689 00010000:00010000:2.0:1746143689.735237:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 22 pid: 21542 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.735248:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 22 pid: 21542 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.735266:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701800/0xe984082ccd7251bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2457599) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1267 expref: 22 pid: 21542 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.735299:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.735301:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.735308:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.735320:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.735347:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143689.735358:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593704832:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143689.735449:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143689.741341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.741563:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592170624 00000100:00100000:3.0:1746143689.741569:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592170624 00000100:00100000:2.0:1746143689.741579:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593704832:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143689.741596:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143689.741603:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (2609152->2613247) req@ffff880131e9ce00 x1830963592170624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.741611:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9ce00 with x1830963592170624 ext(2609152->2613247) 00002000:00010000:3.0:1746143689.741615:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9ce00 00000100:00100000:2.0:1746143689.741638:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592170368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6437us (7962us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.741646:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4814 00000100:00100000:3.0:1746143689.742055:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3422 00000100:00100000:3.0:1746143689.742064:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592170624:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143689.742306:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592170624:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 242us (971us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143689.742311:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3422 00002000:00100000:3.0:1746143689.742315:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (2609152->2613247) req@ffff880131e9ce00 x1830963592170624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.742322:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9ce00 with x1830963592170624 ext(2609152->2613247) 00002000:00010000:3.0:1746143689.742324:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9ce00 00000100:00100000:2.0:1746143689.742534:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592170240:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19313us (20404us total) trans 0 rc 1011712/1011712 00000100:00100000:2.0:1746143689.742540:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3421 00002000:00100000:2.0:1746143689.742544:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3108863) req@ffff880131e9d880 x1830963592170240/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1011712/1011712 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.742551:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9d880 with x1830963592170240 ext(2097152->3108863) 00002000:00010000:2.0:1746143689.742553:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9d880 00000100:00100000:0.0:1746143689.752230:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.752293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.752319:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592170880 00000100:00100000:2.0:1746143689.752327:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592170880 00000100:00100000:1.0:1746143689.752350:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592171008 00000100:00100000:1.0:1746143689.752357:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592171008 00002000:00100000:2.0:1746143689.752363:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3022848->3026943) req@ffff8800a5d81880 x1830963592170880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.752376:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81880 with x1830963592170880 ext(3022848->3026943) 00002000:00010000:2.0:1746143689.752381:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d81880 00000100:00100000:2.0:1746143689.752395:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3423 00000100:00100000:1.0:1746143689.752396:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9418 00000100:00100000:2.0:1746143689.752401:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592170880:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143689.752402:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28303:x1830963592171008:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143689.752413:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.752425:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7251f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1283 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.752444:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 13 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.752455:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143689.752456:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143689.752459:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7251f4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1283 expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.752482:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 13 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.752492:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 13 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.752502:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593704960:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143689.752547:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592170880:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 144us (324us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143689.752552:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3423 00002000:00100000:2.0:1746143689.752557:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3022848->3026943) req@ffff8800a5d81880 x1830963592170880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.752563:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81880 with x1830963592170880 ext(3022848->3026943) 00002000:00010000:2.0:1746143689.752566:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d81880 00000100:00100000:1.0:1746143689.752637:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e919c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143689.755976:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593704960:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143689.756002:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7251f4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1283 expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.756017:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0700400, rc 0) 00000100:00100000:1.0:1746143689.756067:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28303:x1830963592171008:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3664us (3772us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.756075:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9418 00000100:00100000:2.0:1746143689.756163:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.756309:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.756360:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.756398:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592171136 00000100:00100000:1.0:1746143689.756406:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592171136 00000100:00100000:2.0:1746143689.756423:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592171520 00000100:00100000:2.0:1746143689.756426:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592171520 00000100:00100000:1.0:1746143689.756432:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9419 00000100:00100000:1.0:1746143689.756437:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28300:x1830963592171136:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143689.756447:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3346 00010000:00010000:1.0:1746143689.756449:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143689.756451:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:28305:x1830963592171520:12345-192.168.202.48@tcp:35:multiop.0 00010000:00010000:1.0:1746143689.756462:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0701600/0xe984082ccd7251fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a128a expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.756478:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.756484:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143689.756485:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143689.756488:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701600/0xe984082ccd7251fb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a128a expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.756509:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.756517:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 24 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.756526:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593705088:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143689.756570:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e919c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143689.756589:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:28305:x1830963592171520:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 137us (281us total) trans 8589942340 rc 0/0 00000100:00100000:2.0:1746143689.756594:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3346 00000100:00100000:3.0:1746143689.756682:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592171264 00000100:00100000:3.0:1746143689.756686:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592171264 00002000:00100000:3.0:1746143689.756708:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3108864->3145727) req@ffff88008f0ae300 x1830963592171264/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.756716:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae300 with x1830963592171264 ext(3108864->3145727) 00010000:00010000:3.0:1746143689.756721:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 14 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.756730:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 14 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746143689.756736:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f0ae300 00000100:00100000:3.0:1746143689.756795:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 822 00000100:00100000:3.0:1746143689.756801:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592171264:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143689.759374:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.759398:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592171648 00000100:00100000:0.0:1746143689.759404:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592171648 00002000:00100000:0.0:1746143689.759435:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (2609152->3026943) req@ffff88008f0af100 x1830963592171648/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143689.759443:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0af100 with x1830963592171648 ext(2609152->3026943) 00010000:00010000:0.0:1746143689.759451:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 25 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746143689.759461:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 25 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:0.0:1746143689.759466:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f0af100 00000100:00100000:0.0:1746143689.759482:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 823 00000100:00100000:0.0:1746143689.759488:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592171648:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143689.759829:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592171264:12345-192.168.202.48@tcp:4:cat.0 Request processed in 3027us (3467us total) trans 17179872431 rc 0/0 00000100:00100000:3.0:1746143689.759836:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 822 00002000:00100000:3.0:1746143689.759842:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3108864->3145727) req@ffff88008f0ae300 x1830963592171264/t17179872431(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/448 e 0 to 0 dl 1746143700 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.759849:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae300 with x1830963592171264 ext(3108864->3145727) 00010000:00010000:3.0:1746143689.759855:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 16 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.759863:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 16 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746143689.759869:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f0ae300 00000100:00100000:1.0:1746143689.759970:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593705088:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143689.759990:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701600/0xe984082ccd7251fb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a128a expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.760002:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0701600, rc 0) 00000100:00100000:1.0:1746143689.760023:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28300:x1830963592171136:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3586us (3861us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.760030:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9419 00000100:00100000:0.0:1746143689.767044:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.767216:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592171776 00000100:00100000:3.0:1746143689.767225:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592171776 00010000:00010000:3.0:1746143689.767258:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 16 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.767297:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4815 00000100:00100000:3.0:1746143689.767304:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c29050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592171776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143689.767315:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143689.767330:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143688 -> 1746143689 00002000:00010000:3.0:1746143689.767332:0:7150:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143688 -> 1746143689 00002000:00010000:3.0:1746143689.767335:0:7150:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143688 -> 1746143689 00010000:00010000:3.0:1746143689.767339:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 16 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.767349:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 16 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.767367:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700600/0xe984082ccd7251a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1252 expref: 16 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.767385:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.767387:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.767394:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7251f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1283 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.767401:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7251f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1283 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.767428:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7251f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1283 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143689.767438:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593705216:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143689.767507:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143689.768737:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592171648:12345-192.168.202.48@tcp:4:cat.0 Request processed in 9244us (9368us total) trans 21474839698 rc 0/0 00000100:00100000:2.0:1746143689.768747:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 823 00002000:00100000:2.0:1746143689.768755:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (2609152->3026943) req@ffff88008f0af100 x1830963592171648/t21474839698(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/448 e 0 to 0 dl 1746143700 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.768763:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0af100 with x1830963592171648 ext(2609152->3026943) 00010000:00010000:2.0:1746143689.768770:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 27 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.768782:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 27 pid: 8495 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746143689.768788:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f0af100 00000100:00100000:0.0:1746143689.772505:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.772611:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592171904 00000100:00100000:1.0:1746143689.772620:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592171904 00010000:00010000:1.0:1746143689.772649:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 27 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.772691:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4816 00000100:00100000:1.0:1746143689.772697:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592171904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.772710:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143689.772730:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 27 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.772741:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 27 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.772761:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0a00/0xe984082ccd7251e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->3026943) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1275 expref: 27 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.772787:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.772789:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.772796:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701600/0xe984082ccd7251fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a128a expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.772803:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701600/0xe984082ccd7251fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a128a expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.772832:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0701600/0xe984082ccd7251fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a128a expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143689.772843:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593705344:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143689.772919:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e919c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143689.774100:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593705216:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143689.774115:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143689.774166:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c29050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963592171776:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6862us (7128us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.774178:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4815 00000100:00100000:1.0:1746143689.777754:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593705344:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143689.777772:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.777820:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592171904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5121us (5321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.777829:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4816 00000100:00100000:2.0:1746143689.779582:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.780847:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592172160 00000100:00100000:3.0:1746143689.780858:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592172160 00002000:00100000:3.0:1746143689.780916:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009bef6300 x1830963592172160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.780925:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef6300 with x1830963592172160 ext(2097152->3145727) 00002000:00010000:3.0:1746143689.780930:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef6300 00000100:00100000:3.0:1746143689.780953:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3424 00000100:00100000:3.0:1746143689.780960:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592172160:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143689.786945:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.787054:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592172416 00000100:00100000:2.0:1746143689.787062:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592172416 00002000:00100000:2.0:1746143689.787101:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f0ad180 x1830963592172416/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.787109:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad180 with x1830963592172416 ext(2097152->3145727) 00002000:00010000:2.0:1746143689.787114:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ad180 00000100:00100000:2.0:1746143689.787132:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3425 00000100:00100000:2.0:1746143689.787153:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963592172416:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143689.798619:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592172160:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17652us (19035us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143689.798628:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3424 00002000:00100000:3.0:1746143689.798638:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009bef6300 x1830963592172160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.798647:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef6300 with x1830963592172160 ext(2097152->3145727) 00002000:00010000:3.0:1746143689.798651:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef6300 00000100:00100000:0.0:1746143689.806779:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.807013:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592172544 00000100:00100000:1.0:1746143689.807020:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592172544 00000100:00100000:2.0:1746143689.807379:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963592172416:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20238us (20438us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143689.807388:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3425 00002000:00100000:2.0:1746143689.807397:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f0ad180 x1830963592172416/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143689.807406:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad180 with x1830963592172416 ext(2097152->3145727) 00002000:00010000:2.0:1746143689.807410:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ad180 00000100:00100000:1.0:1746143689.808039:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9420 00000100:00100000:1.0:1746143689.808048:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28303:x1830963592172544:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143689.808062:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.808076:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725202 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1291 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.808097:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.808099:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.808105:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725202 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1291 expref: 27 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.808117:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725202 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1291 expref: 27 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.808125:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091024c00, rc 0) 00000100:00100000:1.0:1746143689.824232:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:28303:x1830963592172544:12345-192.168.202.48@tcp:101:cat.0 Request processed in 16175us (17449us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.824244:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9420 00000100:00100000:0.0:1746143689.824616:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.824659:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.824687:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.824746:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592172672 00000100:00100000:1.0:1746143689.824753:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592172672 00000100:00100000:1.0:1746143689.824782:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9421 00000100:00100000:1.0:1746143689.824788:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28300:x1830963592172672:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143689.824802:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.824815:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091025c00/0xe984082ccd725209 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1298 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.824835:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.824836:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143689.824842:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091025c00/0xe984082ccd725209 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1298 expref: 16 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.824854:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091025c00/0xe984082ccd725209 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1298 expref: 16 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.824862:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091025c00, rc 0) 00000100:00100000:1.0:1746143689.824903:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28300:x1830963592172672:12345-192.168.202.48@tcp:101:cat.0 Request processed in 115us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.824909:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9421 00000100:00100000:2.0:1746143689.824941:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592173056 00000100:00100000:2.0:1746143689.824945:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592173056 00000100:00100000:1.0:1746143689.824958:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592172800 00000100:00100000:1.0:1746143689.824961:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592172800 00000100:00100000:2.0:1746143689.824970:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8244 00000100:00100000:2.0:1746143689.824974:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28309:x1830963592173056:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143689.824989:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.824998:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd725210 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a12a6 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.825079:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d800/0xe984082ccd725217 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825088:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d800/0xe984082ccd725217 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825096:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d800/0xe984082ccd725217 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825108:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c000/0xe984082ccd72521e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825113:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c000/0xe984082ccd72521e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825118:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c000/0xe984082ccd72521e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:1.0:1746143689.825165:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8245 00000100:00100000:1.0:1746143689.825171:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:28310:x1830963592172800:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143689.825181:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.825188:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94b200/0xe984082ccd725225 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a129f expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.825214:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94a400/0xe984082ccd72522c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.825221:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94a400/0xe984082ccd72522c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.825227:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94a400/0xe984082ccd72522c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.825232:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd725233 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.825234:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd72523a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.825239:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd72523a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.825240:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd725233 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.825244:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd72523a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.825246:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd725233 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143689.825255:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143689.825288:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.825295:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a123d expref: 16 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.825300:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.825323:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a123d expref: 17 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.825327:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d800/0xe984082ccd725217 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825333:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d800/0xe984082ccd725217 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143689.825333:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a123d expref: 17 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746143689.825338:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d800/0xe984082ccd725217 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825343:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009133d800 already unused, calling callback (ffffffffa1387690) 00000100:00100000:1.0:1746143689.825344:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593705472:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.825346:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d800/0xe984082ccd725217 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825352:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d800/0xe984082ccd725217 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825360:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143689.825363:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143689.825366:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d800/0xe984082ccd725217 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825370:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d800/0xe984082ccd725217 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825383:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c000/0xe984082ccd72521e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825388:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c000/0xe984082ccd72521e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825392:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c000/0xe984082ccd72521e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825400:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009133c000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143689.825402:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c000/0xe984082ccd72521e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825406:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c000/0xe984082ccd72521e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825411:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a300) 00010000:00010000:2.0:1746143689.825413:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143689.825414:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c000/0xe984082ccd72521e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825418:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c000/0xe984082ccd72521e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143689.825445:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd725210 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12a6 expref: 18 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.825453:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd725233 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12a6 expref: 17 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.825458:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143689.825459:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143689.825461:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.825466:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.825470:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b410e400, rc 0) 00000100:00100000:2.0:1746143689.825493:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28309:x1830963592173056:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 518us (833us total) trans 8589942341 rc 0/0 00000100:00100000:2.0:1746143689.825499:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8244 00000100:00100000:0.0:1746143689.835424:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.835462:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.835593:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592173312 00000100:00100000:3.0:1746143689.835600:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592173312 00002000:00100000:3.0:1746143689.835636:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f0ad500 x1830963592173312/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.835645:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad500 with x1830963592173312 ext(3145728->4194303) 00002000:00010000:3.0:1746143689.835650:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ad500 00000100:00100000:3.0:1746143689.835664:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592173568 00000100:00100000:3.0:1746143689.835666:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592173568 00002000:00100000:3.0:1746143689.835677:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f0adf80 x1830963592173568/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.835683:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0adf80 with x1830963592173568 ext(3145728->4194303) 00002000:00010000:3.0:1746143689.835686:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0adf80 00000100:00100000:3.0:1746143689.835695:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3426 00000100:00100000:3.0:1746143689.835700:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592173312:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143689.836770:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3427 00000100:00100000:2.0:1746143689.836779:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963592173568:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143689.837045:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e919c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143689.837069:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593705472:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143689.837088:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:0.0:1746143689.845478:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.845520:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.845628:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592173824 00000100:00100000:2.0:1746143689.845637:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592173824 00000100:00100000:0.0:1746143689.846011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.846345:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592174080 00000100:00100000:1.0:1746143689.846349:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592174080 00002000:00100000:1.0:1746143689.846377:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f0ae680 x1830963592174080/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.846390:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae680 with x1830963592174080 ext(2097152->3145727) 00002000:00010000:1.0:1746143689.846395:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ae680 00000100:00100000:1.0:1746143689.846407:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592174336 00000100:00100000:1.0:1746143689.846408:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592174336 00002000:00100000:1.0:1746143689.846418:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f0aca80 x1830963592174336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.846424:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0aca80 with x1830963592174336 ext(3145728->4194303) 00002000:00010000:1.0:1746143689.846426:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0aca80 00000100:00100000:1.0:1746143689.846437:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3428 00000100:00100000:1.0:1746143689.846442:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592174080:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143689.847012:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3347 00000100:00100000:3.0:1746143689.847020:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:23699:x1830963592173824:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143689.847222:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:23699:x1830963592173824:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 202us (1751us total) trans 8589942342 rc 0/0 00000100:00100000:3.0:1746143689.847228:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3347 00000100:00100000:3.0:1746143689.847262:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3429 00000100:00100000:3.0:1746143689.847267:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592174336:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143689.847861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.848190:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592174592 00000100:00100000:3.0:1746143689.848194:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592174592 00002000:00100000:3.0:1746143689.848214:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f0ac380 x1830963592174592/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.848222:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ac380 with x1830963592174592 ext(3145728->4194303) 00002000:00010000:3.0:1746143689.848226:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ac380 00000100:00100000:3.0:1746143689.848237:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3430 00000100:00100000:3.0:1746143689.848240:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592174592:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143689.867397:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.868771:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592173312:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33065us (33349us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143689.868785:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3426 00002000:00100000:3.0:1746143689.868795:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f0ad500 x1830963592173312/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.868804:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad500 with x1830963592173312 ext(3145728->4194303) 00002000:00010000:3.0:1746143689.868810:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ad500 00000100:00100000:1.0:1746143689.868920:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592174720 00000100:00100000:1.0:1746143689.868928:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592174720 00010000:00010000:1.0:1746143689.868953:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a123d expref: 18 pid: 14764 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.868977:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4817 00000100:00100000:1.0:1746143689.868983:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592174720:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.868994:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143689.868999:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a123d expref: 18 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.869008:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a123d expref: 18 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.869026:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72518b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a123d expref: 18 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.869042:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143689.869047:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869055:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869061:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869077:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.869094:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592174720:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 110us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.869099:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4817 00010000:00010000:1.0:1746143689.869124:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869133:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143689.869188:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:1.0:1746143689.869193:0:14764:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143689.869205:0:14764:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869214:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869224:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94a400/0xe984082ccd72522c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869229:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94a400/0xe984082ccd72522c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869234:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94a400/0xe984082ccd72522c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869240:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c94a400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143689.869243:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94a400/0xe984082ccd72522c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869249:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94a400/0xe984082ccd72522c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869256:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143689.869258:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143689.869261:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94a400/0xe984082ccd72522c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869266:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94a400/0xe984082ccd72522c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869275:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd72523a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869280:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd72523a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869284:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd72523a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869288:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880000061000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143689.869290:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd72523a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869294:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd72523a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869299:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a300) 00010000:00010000:1.0:1746143689.869301:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143689.869303:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd72523a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869307:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd72523a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.869334:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94b200/0xe984082ccd725225 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a129f expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.869346:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a129f expref: 7 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.869352:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143689.869354:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143689.869356:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880000061400, rc 0) 00000100:00100000:1.0:1746143689.869373:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28310:x1830963592172800:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 44203us (44686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.869379:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8245 00000100:00100000:3.0:1746143689.876843:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963592173568:12345-192.168.202.48@tcp:3:cat.0 Request processed in 40055us (41369us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143689.876853:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3427 00002000:00100000:3.0:1746143689.876864:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f0adf80 x1830963592173568/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.876872:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0adf80 with x1830963592173568 ext(3145728->4194303) 00002000:00010000:3.0:1746143689.876890:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0adf80 00000100:00100000:1.0:1746143689.884204:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592174080:12345-192.168.202.48@tcp:3:cat.0 Request processed in 37753us (38675us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143689.884215:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3428 00002000:00100000:1.0:1746143689.884224:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f0ae680 x1830963592174080/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143689.884232:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae680 with x1830963592174080 ext(2097152->3145727) 00002000:00010000:1.0:1746143689.884237:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ae680 00000100:00100000:0.0:1746143689.899237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.899321:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.900301:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592174976 00000100:00100000:1.0:1746143689.900308:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592174976 00000100:00100000:2.0:1746143689.900661:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592175104 00000100:00100000:2.0:1746143689.900665:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592175104 00000100:00100000:2.0:1746143689.900690:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9422 00000100:00100000:2.0:1746143689.900696:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963592175104:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143689.900710:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.900724:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009133c000/0xe984082ccd72524f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a12b4 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.900741:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.900743:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.900750:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009133c000/0xe984082ccd72524f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12b4 expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.900763:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009133c000/0xe984082ccd72524f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12b4 expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.900772:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133c000, rc 0) 00000100:00100000:2.0:1746143689.900807:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963592175104:12345-192.168.202.48@tcp:101:cat.0 Request processed in 111us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.900812:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9422 00000100:00100000:1.0:1746143689.901584:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8246 00000100:00100000:1.0:1746143689.901592:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:28312:x1830963592174976:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143689.901604:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.901614:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090744c00/0xe984082ccd725256 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a12ad expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.901698:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72525d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901707:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72525d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901716:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72525d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:3.0:1746143689.901717:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592174336:12345-192.168.202.48@tcp:3:cat.0 Request processed in 54448us (55705us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143689.901725:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3429 00010000:00010000:1.0:1746143689.901730:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091025000/0xe984082ccd725264 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00002000:00100000:3.0:1746143689.901734:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f0aca80 x1830963592174336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746143689.901735:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091025000/0xe984082ccd725264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901740:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091025000/0xe984082ccd725264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00002000:00100000:3.0:1746143689.901743:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0aca80 with x1830963592174336 ext(3145728->4194303) 00002000:00010000:3.0:1746143689.901747:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0aca80 00010000:00010000:1.0:1746143689.901828:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091024800/0xe984082ccd72526b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901836:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091024800/0xe984082ccd72526b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901842:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091024800/0xe984082ccd72526b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143689.901849:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143689.901922:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72525d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901928:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72525d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901933:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72525d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901939:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090744e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143689.901942:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72525d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901947:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72525d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901956:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143689.901959:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143689.901962:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72525d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901966:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72525d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901980:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091025000/0xe984082ccd725264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901984:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091025000/0xe984082ccd725264 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901988:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091025000/0xe984082ccd725264 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901992:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091025000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143689.901994:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091025000/0xe984082ccd725264 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.901998:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091025000/0xe984082ccd725264 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.902002:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74e00) 00010000:00010000:1.0:1746143689.902004:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143689.902005:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091025000/0xe984082ccd725264 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.902009:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091025000/0xe984082ccd725264 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.902038:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090744c00/0xe984082ccd725256 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12ad expref: 254 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.902047:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091024800/0xe984082ccd72526b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12ad expref: 253 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.902052:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143689.902054:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143689.902056:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091024800, rc 0) 00000100:00100000:1.0:1746143689.904404:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:28312:x1830963592174976:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2805us (5168us total) trans 8589942343 rc 0/0 00000100:00100000:1.0:1746143689.904413:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8246 00000100:00100000:2.0:1746143689.904929:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.905649:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592174592:12345-192.168.202.48@tcp:3:cat.0 Request processed in 57405us (57787us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143689.905657:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3430 00002000:00100000:0.0:1746143689.905666:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f0ac380 x1830963592174592/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143689.905674:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ac380 with x1830963592174592 ext(3145728->4194303) 00002000:00010000:0.0:1746143689.905678:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ac380 00000100:00100000:0.0:1746143689.905693:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592175360 00000100:00100000:0.0:1746143689.905698:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592175360 00002000:00100000:0.0:1746143689.905720:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009bef4380 x1830963592175360/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143689.905727:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef4380 with x1830963592175360 ext(4194304->4898815) 00002000:00010000:0.0:1746143689.905729:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef4380 00000100:00100000:3.0:1746143689.906843:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3431 00000100:00100000:3.0:1746143689.906853:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592175360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143689.908802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.909433:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.909465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.909481:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592175488 00000100:00100000:2.0:1746143689.909487:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592175488 00000100:00100000:2.0:1746143689.909513:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592175744 00000100:00100000:2.0:1746143689.909515:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592175744 00000100:00100000:2.0:1746143689.909526:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592175616 00000100:00100000:2.0:1746143689.909527:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592175616 00000100:00100000:2.0:1746143689.909541:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9423 00000100:00100000:2.0:1746143689.909547:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592175488:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143689.909560:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.909574:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd725279 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a12bb expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.909591:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.909593:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.909600:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd725279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12bb expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.909613:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd725279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12bb expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.909623:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e6ca00, rc 0) 00000100:00100000:2.0:1746143689.909651:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592175488:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 103us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.909657:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9423 00000100:00100000:2.0:1746143689.909670:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9424 00000100:00100000:2.0:1746143689.909674:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592175744:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143689.909681:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.909689:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cabce00/0xe984082ccd725280 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a12c9 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.909699:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.909700:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.909704:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cabce00/0xe984082ccd725280 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c9 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.909712:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cabce00/0xe984082ccd725280 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c9 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.909718:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cabce00, rc 0) 00000100:00100000:2.0:1746143689.909730:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592175744:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 56us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.909734:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9424 00000100:00100000:2.0:1746143689.909743:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9425 00000100:00100000:2.0:1746143689.909747:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592175616:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143689.909752:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.909758:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cabc000/0xe984082ccd725287 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a12c2 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.909765:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.909766:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.909770:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cabc000/0xe984082ccd725287 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c2 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.909776:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cabc000/0xe984082ccd725287 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c2 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.909783:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cabc000, rc 0) 00000100:00100000:2.0:1746143689.909793:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592175616:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 46us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.909797:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9425 00000100:00100000:2.0:1746143689.909838:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.909849:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592175872 00000100:00100000:2.0:1746143689.909852:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592175872 00000100:00100000:2.0:1746143689.909866:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9426 00000100:00100000:2.0:1746143689.909869:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592175872:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143689.909875:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.909892:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351bca00/0xe984082ccd72528e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a12d0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.909900:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.909901:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.909905:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bca00/0xe984082ccd72528e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d0 expref: 12 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.909913:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351bca00/0xe984082ccd72528e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d0 expref: 12 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.909919:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bca00, rc 0) 00000100:00100000:2.0:1746143689.909933:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592175872:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 62us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.909938:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9426 00000100:00100000:0.0:1746143689.913527:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.913594:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592176128 00000100:00100000:1.0:1746143689.913600:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592176128 00000100:00100000:3.0:1746143689.913608:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592175360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6755us (8678us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143689.913617:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3431 00002000:00100000:3.0:1746143689.913626:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009bef4380 x1830963592175360/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.913635:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef4380 with x1830963592175360 ext(4194304->4898815) 00000100:00100000:1.0:1746143689.913635:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8247 00002000:00010000:3.0:1746143689.913640:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef4380 00000100:00100000:1.0:1746143689.913641:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28310:x1830963592176128:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143689.913656:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143689.913671:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b04c00/0xe984082ccd725295 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a12d7 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.913756:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.913769:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a129f expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.913776:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091024800/0xe984082ccd72526b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12ad expref: 252 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.913782:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.913806:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091024800/0xe984082ccd72526b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12ad expref: 252 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.913816:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091024800/0xe984082ccd72526b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12ad expref: 252 pid: 14764 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.913825:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593705600:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143689.913877:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a129f expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.913894:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a129f expref: 8 pid: 14764 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.913900:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593705728:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143689.913916:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e919c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143689.917086:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593705600:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143689.922188:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.922270:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592176256 00000100:00100000:2.0:1746143689.922277:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592176256 00000100:00100000:2.0:1746143689.922321:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9427 00000100:00100000:2.0:1746143689.922328:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:28312:x1830963592176256:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143689.922344:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.922362:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a12de expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.922386:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd7251ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1259 expref: 28 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.922393:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd725279 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12bb expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.922400:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009133c000/0xe984082ccd72524f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12b4 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.922406:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.922407:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.922410:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [1355776->1441791] (req 1355776->1441791) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 28 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.922436:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009133c000/0xe984082ccd72524f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12b4 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.922445:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009133c000/0xe984082ccd72524f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12b4 expref: 22 pid: 8495 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746143689.922462:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593705856:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.922523:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd725279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12bb expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.922531:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd725279 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12bb expref: 11 pid: 4581 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746143689.922537:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593705984:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.922558:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd7251ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1259 expref: 28 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.922564:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd7251ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1259 expref: 28 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746143689.922570:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593706112:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143689.922584:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143689.922759:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593705728:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143689.922778:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:3.0:1746143689.923209:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.923245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143689.923259:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592176384 00000100:00100000:1.0:1746143689.923263:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592176384 00010000:00010000:1.0:1746143689.923280:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091024800/0xe984082ccd72526b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12ad expref: 253 pid: 14764 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.923301:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592176512 00000100:00100000:1.0:1746143689.923304:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592176512 00000100:00100000:3.0:1746143689.923309:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4818 00010000:00010000:1.0:1746143689.923312:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a129f expref: 9 pid: 14764 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.923316:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:1964:x1830963592176384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143689.923325:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143689.923326:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4819 00010000:00010000:3.0:1746143689.923331:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091024800/0xe984082ccd72526b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12ad expref: 253 pid: 14764 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746143689.923331:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592176512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143689.923337:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143689.923340:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091024800/0xe984082ccd72526b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12ad expref: 253 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.923341:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a129f expref: 9 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.923354:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091024800/0xe984082ccd72526b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12ad expref: 253 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.923378:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a129f expref: 9 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.923386:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143689.923391:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.923397:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.923402:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143689.923409:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880000061400/0xe984082ccd725248 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a129f expref: 9 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746143689.923424:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00000100:00100000:3.0:1746143689.923425:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1964:x1830963592176384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 110us (217us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143689.923428:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:3.0:1746143689.923431:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4818 00010000:00010000:1.0:1746143689.923434:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.923440:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.923451:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143689.923466:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592176512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 135us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143689.923472:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4819 00000100:00100000:3.0:1746143689.923483:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143689.923489:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143689.923494:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:3.0:1746143689.923496:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592176768 00000100:00100000:3.0:1746143689.923499:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592176768 00000004:00200000:1.0:1746143689.923510:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00002000:00100000:3.0:1746143689.923521:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094c10380 x1830963592176768/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.923529:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10380 with x1830963592176768 ext(4194304->4898815) 00002000:00010000:3.0:1746143689.923532:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10380 00000100:00100000:3.0:1746143689.923548:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3432 00000100:00100000:3.0:1746143689.923552:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592176768:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143689.923636:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b04c00/0xe984082ccd725295 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d7 expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.923648:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d7 expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143689.923654:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143689.923656:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143689.923658:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a3200, rc 0) 00000100:00100000:1.0:1746143689.923674:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28310:x1830963592176128:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 10034us (10155us total) trans 8589942344 rc 0/0 00000100:00100000:1.0:1746143689.923680:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8247 00000100:00100000:0.0:1746143689.933506:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.933531:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.933534:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593705856:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143689.933545:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593705984:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143689.933547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.933554:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593706112:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.933581:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [1355776->1441791] (req 1355776->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 28 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.933605:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bd600, rc 0) 00000100:00100000:2.0:1746143689.933641:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28312:x1830963592176256:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 11313us (11461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.933648:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9427 00000100:00100000:3.0:1746143689.933764:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592176896 00000100:00100000:3.0:1746143689.933770:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592176896 00010000:00010000:3.0:1746143689.933793:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009133c000/0xe984082ccd72524f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12b4 expref: 23 pid: 8495 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746143689.933809:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592177024 00000100:00100000:3.0:1746143689.933810:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592177024 00010000:00010000:3.0:1746143689.933818:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd725279 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12bb expref: 12 pid: 4581 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746143689.933828:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592177152 00000100:00100000:3.0:1746143689.933830:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592177152 00010000:00010000:3.0:1746143689.933837:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd7251ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1259 expref: 28 pid: 8495 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.933848:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4820 00000100:00100000:3.0:1746143689.933854:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592176896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143689.933863:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143689.933891:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009133c000/0xe984082ccd72524f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12b4 expref: 23 pid: 8495 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746143689.933899:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009133c000/0xe984082ccd72524f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12b4 expref: 23 pid: 8495 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746143689.933917:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009133c000/0xe984082ccd72524f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12b4 expref: 23 pid: 8495 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746143689.933929:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143689.933948:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592176896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 94us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.933954:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4820 00000100:00100000:3.0:1746143689.933964:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4821 00000100:00100000:3.0:1746143689.933969:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592177024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143689.933975:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143689.933983:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd725279 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12bb expref: 12 pid: 4581 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746143689.933989:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd725279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12bb expref: 12 pid: 4581 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746143689.933998:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd725279 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12bb expref: 12 pid: 4581 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746143689.934016:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143689.934029:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592177024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 59us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.934033:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4821 00000100:00100000:3.0:1746143689.934041:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4822 00000100:00100000:3.0:1746143689.934045:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592177152:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143689.934051:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143689.934056:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd7251ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1259 expref: 28 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.934063:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd7251ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1259 expref: 28 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.934072:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009500a800/0xe984082ccd7251ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1259 expref: 28 pid: 8495 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.934078:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.934080:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143689.934085:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 27 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.934092:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 27 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143689.934112:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 27 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143689.934121:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593706240:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143689.934575:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.934835:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592177280 00000100:00100000:0.0:1746143689.934840:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592177280 00000100:00100000:3.0:1746143689.934850:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21579c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143689.934870:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8248 00000100:00100000:0.0:1746143689.934875:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28310:x1830963592177280:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143689.934899:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143689.934910:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093213800/0xe984082ccd7252b1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a12e5 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.934971:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143689.934983:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d7 expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.934989:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143689.935004:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d7 expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143689.935013:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d7 expref: 9 pid: 14764 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746143689.935020:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593706368:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143689.937287:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592176768:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13725us (13795us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143689.937297:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3432 00002000:00100000:3.0:1746143689.937308:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094c10380 x1830963592176768/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/440 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.937317:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10380 with x1830963592176768 ext(4194304->4898815) 00002000:00010000:3.0:1746143689.937321:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10380 00000100:00100000:0.0:1746143689.937399:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143689.940005:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593706240:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143689.940023:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143689.940070:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592177152:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6023us (6520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.940078:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4822 00000100:00100000:2.0:1746143689.941719:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593706368:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.941736:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:0.0:1746143689.947742:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.948333:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592177536 00000100:00100000:3.0:1746143689.948341:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592177536 00002000:00100000:3.0:1746143689.948384:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1355776->1359871) req@ffff88012fc10e00 x1830963592177536/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.948393:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10e00 with x1830963592177536 ext(1355776->1359871) 00002000:00010000:3.0:1746143689.948397:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10e00 00000100:00100000:3.0:1746143689.948430:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3433 00000100:00100000:3.0:1746143689.948437:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592177536:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143689.949193:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592177536:12345-192.168.202.48@tcp:3:cat.0 Request processed in 755us (1457us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143689.949552:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3433 00002000:00100000:3.0:1746143689.949561:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1355776->1359871) req@ffff88012fc10e00 x1830963592177536/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.949569:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10e00 with x1830963592177536 ext(1355776->1359871) 00002000:00010000:3.0:1746143689.949572:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10e00 00000100:00100000:0.0:1746143689.949704:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.949830:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592177664 00000100:00100000:3.0:1746143689.949834:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592177664 00010000:00010000:3.0:1746143689.949854:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d7 expref: 10 pid: 14764 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746143689.949888:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4823 00000100:00100000:3.0:1746143689.949894:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592177664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143689.949904:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143689.949908:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d7 expref: 10 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.949918:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d7 expref: 10 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.949936:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd72529c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d7 expref: 10 pid: 14764 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746143689.949974:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143689.949978:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.949987:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.949993:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143689.950008:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143689.950039:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592177664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 145us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143689.950045:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4823 00010000:00010000:2.0:1746143689.950306:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.950315:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143689.950352:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:2.0:1746143689.950357:0:14764:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143689.950369:0:14764:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.950396:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093213800/0xe984082ccd7252b1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12e5 expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.950411:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12e5 expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.950417:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143689.950420:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143689.950422:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093212e00, rc 0) 00000100:00100000:2.0:1746143689.950443:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28310:x1830963592177280:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 15568us (15870us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.950449:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8248 00000100:00100000:0.0:1746143689.954623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143689.955405:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.955506:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592177792 00000100:00100000:2.0:1746143689.955515:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592177792 00000100:00100000:3.0:1746143689.955990:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592178048 00000100:00100000:3.0:1746143689.955995:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592178048 00002000:00100000:3.0:1746143689.956020:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1437696->1441791) req@ffff880091717100 x1830963592178048/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/0 e 0 to 0 dl 1746143700 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.956030:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091717100 with x1830963592178048 ext(1437696->1441791) 00002000:00010000:3.0:1746143689.956034:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091717100 00000100:00100000:3.0:1746143689.956235:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3434 00000100:00100000:3.0:1746143689.956241:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592178048:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143689.956400:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592178048:12345-192.168.202.48@tcp:3:cat.0 Request processed in 158us (996us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143689.956406:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3434 00002000:00100000:3.0:1746143689.956411:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1437696->1441791) req@ffff880091717100 x1830963592178048/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:85/0 lens 488/4536 e 0 to 0 dl 1746143700 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143689.956416:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091717100 with x1830963592178048 ext(1437696->1441791) 00002000:00010000:3.0:1746143689.956419:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091717100 00000100:00100000:2.0:1746143689.956639:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9428 00000100:00100000:2.0:1746143689.956647:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592177792:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143689.956657:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.956671:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd7252bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a12ec expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143689.956709:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593706496:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143689.956771:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143689.962824:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593706496:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143689.962855:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd7252bf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12ec expref: 12 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.962867:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d520e00/0xe984082ccd7252bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12ec expref: 12 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.962891:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d520e00, rc 0) 00000100:00100000:2.0:1746143689.962948:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592177792:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 6299us (8330us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143689.962955:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9428 00000100:00100000:0.0:1746143689.967792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.971188:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592178304 00000100:00100000:2.0:1746143689.971198:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592178304 00000100:00100000:2.0:1746143689.971333:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8249 00000100:00100000:2.0:1746143689.971341:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28310:x1830963592178304:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143689.971359:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.971376:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520e00/0xe984082ccd7252c6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a12f3 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143689.971443:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143689.971483:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592178560 00000100:00100000:3.0:1746143689.971487:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592178560 00000100:00100000:3.0:1746143689.971517:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3348 00000100:00100000:3.0:1746143689.971522:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:28312:x1830963592178560:12345-192.168.202.48@tcp:35:multiop.0 00010000:00010000:2.0:1746143689.971654:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520000/0xe984082ccd7252cd lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.971665:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520000/0xe984082ccd7252cd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.971674:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520000/0xe984082ccd7252cd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.971684:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520000/0xe984082ccd7252cd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00000100:00100000:3.0:1746143689.971689:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:28312:x1830963592178560:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 167us (387us total) trans 8589942345 rc 0/0 00010000:00010000:2.0:1746143689.971689:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520000/0xe984082ccd7252cd lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.971693:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520000/0xe984082ccd7252cd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00000100:00100000:3.0:1746143689.971695:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3348 00010000:00010000:2.0:1746143689.971697:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d520000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143689.971700:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520000/0xe984082ccd7252cd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.971707:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520000/0xe984082ccd7252cd lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.971715:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143689.971717:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143689.971720:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520000/0xe984082ccd7252cd lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.971724:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520000/0xe984082ccd7252cd lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143689.971746:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520e00/0xe984082ccd7252c6 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12f3 expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.971753:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520e00/0xe984082ccd7252c6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12f3 expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.971759:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d520e00, rc 0) 00000100:00100000:2.0:1746143689.971777:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28310:x1830963592178304:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 438us (3993us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143689.971782:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8249 00000100:00100000:0.0:1746143689.978281:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.978796:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592178816 00000100:00100000:2.0:1746143689.978804:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592178816 00000100:00100000:2.0:1746143689.978853:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3349 00000100:00100000:2.0:1746143689.978860:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28310:x1830963592178816:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1746143689.980022:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28310:x1830963592178816:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 1159us (1745us total) trans 8589942346 rc 0/0 00000100:00100000:2.0:1746143689.980030:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3349 00000100:00100000:0.0:1746143689.991694:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143689.991825:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592178944 00000100:00100000:2.0:1746143689.991833:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592178944 00000100:00100000:2.0:1746143689.991895:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9429 00000100:00100000:2.0:1746143689.991902:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28309:x1830963592178944:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143689.991921:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143689.991938:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a12fa expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.991965:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7251f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1283 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.991973:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cabce00/0xe984082ccd725280 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c9 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.991980:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091025c00/0xe984082ccd725209 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1298 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.991986:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.991987:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143689.991990:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4112384->4194303] (req 4112384->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.994464:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091025c00/0xe984082ccd725209 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1298 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.994482:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091025c00/0xe984082ccd725209 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1298 expref: 17 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143689.994497:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593706624:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.994606:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cabce00/0xe984082ccd725280 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c9 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143689.994613:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cabce00/0xe984082ccd725280 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c9 expref: 11 pid: 4581 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746143689.994620:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593706752:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.994648:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7251f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1283 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.994656:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7251f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1283 expref: 25 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143689.994663:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593706880:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143689.994679:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143689.997408:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593706624:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143689.997419:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593706752:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143689.997426:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593706880:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143689.997455:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4112384->4194303] (req 4112384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143689.997468:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d520e00, rc 0) 00000100:00100000:2.0:1746143689.997571:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28309:x1830963592178944:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5669us (5883us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143689.997579:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9429 00000100:00100000:0.0:1746143690.003423:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.003537:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.003597:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592179072 00000100:00100000:3.0:1746143690.003605:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592179072 00000100:00100000:2.0:1746143690.003616:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592179200 00000100:00100000:2.0:1746143690.003620:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592179200 00010000:00010000:3.0:1746143690.003648:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cabce00/0xe984082ccd725280 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c9 expref: 12 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746143690.003648:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091025c00/0xe984082ccd725209 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1298 expref: 17 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.003670:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4824 00000100:00100000:3.0:1746143690.003677:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592179072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143690.003680:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4825 00000100:00100000:2.0:1746143690.003685:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592179200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143690.003689:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143690.003692:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143690.003705:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cabce00/0xe984082ccd725280 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c9 expref: 12 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746143690.003706:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091025c00/0xe984082ccd725209 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1298 expref: 17 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.003715:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091025c00/0xe984082ccd725209 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1298 expref: 17 pid: 21542 timeout: 869 lvb_type: 0 00000100:00080000:1.0:1746143690.003760:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746143690.003806:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cabce00/0xe984082ccd725280 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c9 expref: 12 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746143690.003826:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091025c00/0xe984082ccd725209 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1298 expref: 17 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.003829:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cabce00/0xe984082ccd725280 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c9 expref: 12 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746143690.003887:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143690.003887:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143690.003972:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592179072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 292us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.003978:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4824 00000100:00100000:2.0:1746143690.004030:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592179200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 343us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.004036:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4825 00000100:00100000:0.0:1746143690.005418:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.005475:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592179328 00000100:00100000:2.0:1746143690.005480:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592179328 00010000:00010000:2.0:1746143690.005502:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7251f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1283 expref: 26 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.005534:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4826 00000100:00100000:2.0:1746143690.005541:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592179328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143690.005553:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143690.005567:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7251f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1283 expref: 26 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.005577:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7251f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1283 expref: 26 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.005592:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700400/0xe984082ccd7251f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1283 expref: 26 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.005602:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.005604:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.005609:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 15 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.005616:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 15 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.005640:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 15 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143690.005650:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593707008:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143690.006020:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.007064:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593707008:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143690.007080:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143690.007393:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592179328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1851us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.007413:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4826 00000100:00100000:0.0:1746143690.007609:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.007652:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592179584 00000100:00100000:2.0:1746143690.007657:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592179584 00002000:00100000:2.0:1746143690.007686:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (4112384->4116479) req@ffff8800930c1f80 x1830963592179584/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.007695:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c1f80 with x1830963592179584 ext(4112384->4116479) 00002000:00010000:2.0:1746143690.007700:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c1f80 00000100:00100000:2.0:1746143690.007715:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3435 00000100:00100000:2.0:1746143690.007721:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592179584:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143690.007844:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592179584:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 122us (234us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143690.007850:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3435 00002000:00100000:2.0:1746143690.007855:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (4112384->4116479) req@ffff8800930c1f80 x1830963592179584/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/4536 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.007861:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c1f80 with x1830963592179584 ext(4112384->4116479) 00002000:00010000:2.0:1746143690.007864:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c1f80 00000100:00100000:1.0:1746143690.014358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.014449:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592179712 00000100:00100000:2.0:1746143690.014457:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592179712 00000100:00100000:2.0:1746143690.015035:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9430 00000100:00100000:2.0:1746143690.015043:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28309:x1830963592179712:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143690.015059:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.015073:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1301 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.015095:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701600/0xe984082ccd7251fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a128a expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.015107:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351bca00/0xe984082ccd72528e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d0 expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.015113:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725202 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1291 expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.015118:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.015119:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.015122:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->3899391] (req 3145728->3899391) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.015163:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725202 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1291 expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.015172:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725202 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1291 expref: 26 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.015181:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593707136:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.015256:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801351bca00/0xe984082ccd72528e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d0 expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.015262:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801351bca00/0xe984082ccd72528e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d0 expref: 10 pid: 4582 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746143690.015269:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593707264:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.015287:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0701600/0xe984082ccd7251fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a128a expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.015294:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0701600/0xe984082ccd7251fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a128a expref: 23 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.015300:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593707392:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143690.015314:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.017585:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593707136:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143690.017594:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593707264:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143690.017601:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593707392:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.017627:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->3899391] (req 3145728->3899391) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.017641:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bdc00, rc 0) 00000100:00100000:2.0:1746143690.017682:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28309:x1830963592179712:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2640us (3332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.017690:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9430 00000100:00100000:0.0:1746143690.023822:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.023862:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.023898:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592179840 00000100:00100000:2.0:1746143690.023906:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592179840 00000100:00100000:0.0:1746143690.023930:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143690.023944:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bca00/0xe984082ccd72528e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d0 expref: 11 pid: 4582 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746143690.023964:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592179968 00000100:00100000:2.0:1746143690.023966:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592179968 00010000:00010000:2.0:1746143690.023977:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725202 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1291 expref: 27 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.023990:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592180096 00000100:00100000:2.0:1746143690.023992:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592180096 00010000:00010000:2.0:1746143690.023999:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0701600/0xe984082ccd7251fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a128a expref: 23 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.024009:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4827 00000100:00100000:3.0:1746143690.024014:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4828 00000100:00100000:2.0:1746143690.024015:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592179840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143690.024020:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592179968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143690.024026:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143690.024026:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143690.024043:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725202 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1291 expref: 27 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.024044:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801351bca00/0xe984082ccd72528e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d0 expref: 11 pid: 4582 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746143690.024052:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725202 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1291 expref: 27 pid: 21542 timeout: 869 lvb_type: 0 00000100:00080000:0.0:1746143690.024190:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143690.024255:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4829 00000100:00100000:1.0:1746143690.024262:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c28850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592180096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143690.024272:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143690.024473:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801351bca00/0xe984082ccd72528e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d0 expref: 11 pid: 4582 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746143690.024496:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725202 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1291 expref: 27 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.024514:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143690.024544:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0701600/0xe984082ccd7251fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a128a expref: 23 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.024547:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592179968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 528us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.024553:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4828 00010000:00010000:1.0:1746143690.024557:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0701600/0xe984082ccd7251fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a128a expref: 23 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.024567:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0701600/0xe984082ccd7251fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a128a expref: 23 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.024578:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143690.024598:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c28850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592180096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 337us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.024603:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4829 00010000:00010000:2.0:1746143690.024653:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351bca00/0xe984082ccd72528e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12d0 expref: 11 pid: 4582 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746143690.024978:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.024980:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.024987:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.024995:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.025027:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143690.025038:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593707520:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143690.025094:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.028253:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593707520:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143690.028271:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143690.028303:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592179840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4287us (4489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.028312:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4827 00000100:00100000:0.0:1746143690.035260:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.035421:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592180352 00000100:00100000:2.0:1746143690.035430:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592180352 00002000:00100000:2.0:1746143690.035466:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3895296->3899391) req@ffff8800a0362d80 x1830963592180352/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.035475:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0362d80 with x1830963592180352 ext(3895296->3899391) 00002000:00010000:2.0:1746143690.035506:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0362d80 00000100:00100000:2.0:1746143690.035533:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3436 00000100:00100000:2.0:1746143690.035540:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592180352:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143690.035684:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592180352:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 144us (430us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143690.035690:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3436 00002000:00100000:2.0:1746143690.035695:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3895296->3899391) req@ffff8800a0362d80 x1830963592180352/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/4536 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.035708:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0362d80 with x1830963592180352 ext(3895296->3899391) 00002000:00010000:2.0:1746143690.035710:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0362d80 00000100:00100000:0.0:1746143690.038574:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.039481:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592180608 00000100:00100000:3.0:1746143690.039489:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592180608 00000100:00080000:0.0:1746143690.039697:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143690.039740:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3350 00000100:00100000:3.0:1746143690.039748:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28309:x1830963592180608:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143690.041715:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28309:x1830963592180608:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 1962us (3141us total) trans 8589942347 rc 0/0 00000100:00100000:3.0:1746143690.041723:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3350 00000100:00100000:0.0:1746143690.049852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.050849:0:14758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592180736 00000100:00100000:2.0:1746143690.050858:0:14758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592180736 00000100:00100000:2.0:1746143690.050909:0:14758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 171 00000100:00100000:2.0:1746143690.050916:0:14758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1962:x1830963592180736:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1746143690.050986:0:14758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1962:x1830963592180736:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 71us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.050992:0:14758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 171 00000100:00100000:0.0:1746143690.084547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.084644:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592180992 00000100:00100000:2.0:1746143690.084651:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592180992 00000100:00100000:2.0:1746143690.084692:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8250 00000100:00100000:2.0:1746143690.084700:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28321:x1830963592180992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143690.084722:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.084737:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520000/0xe984082ccd7252e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1308 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.084836:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b04c00/0xe984082ccd7252e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.084847:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b04c00/0xe984082ccd7252e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.084857:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b04c00/0xe984082ccd7252e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.084869:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd7252f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.084875:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd7252f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.084893:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd7252f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.084985:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd7252f7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.084993:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd7252f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.084999:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd7252f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143690.085007:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143690.085082:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b04c00/0xe984082ccd7252e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085088:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b04c00/0xe984082ccd7252e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085093:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b04c00/0xe984082ccd7252e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085098:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b04c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143690.085102:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b04c00/0xe984082ccd7252e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085108:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b04c00/0xe984082ccd7252e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085118:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143690.085121:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143690.085124:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b04c00/0xe984082ccd7252e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085129:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b04c00/0xe984082ccd7252e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085349:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd7252f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085354:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd7252f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085358:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd7252f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085362:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801351bca00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143690.085365:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd7252f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085370:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd7252f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085376:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a800) 00010000:00010000:2.0:1746143690.085378:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143690.085380:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd7252f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085383:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bca00/0xe984082ccd7252f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.085418:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520000/0xe984082ccd7252e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1308 expref: 21 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.085433:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd7252f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1308 expref: 20 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.085439:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143690.085441:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143690.085442:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bd200, rc 0) 00000100:00100000:2.0:1746143690.086628:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28321:x1830963592180992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1924us (2083us total) trans 8589942348 rc 0/0 00000100:00100000:2.0:1746143690.086637:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8250 00000100:00100000:0.0:1746143690.092591:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.092783:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592181248 00000100:00100000:3.0:1746143690.092791:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592181248 00000100:00100000:3.0:1746143690.093996:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3351 00000100:00100000:3.0:1746143690.094010:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28321:x1830963592181248:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143690.094236:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28321:x1830963592181248:12345-192.168.202.48@tcp:35:cat.0 Request processed in 227us (1650us total) trans 8589942349 rc 0/0 00000100:00100000:3.0:1746143690.094242:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3351 00000100:00100000:2.0:1746143690.099261:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.099283:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592181376 00000100:00100000:0.0:1746143690.099291:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592181376 00000100:00100000:0.0:1746143690.099337:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9431 00000100:00100000:0.0:1746143690.099344:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963592181376:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143690.099361:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143690.099376:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093213400/0xe984082ccd725305 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a130f expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143690.099423:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593707648:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143690.099518:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.108543:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0362680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593707648:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143690.108575:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093213400/0xe984082ccd725305 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a130f expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.108588:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093213400/0xe984082ccd725305 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a130f expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.108727:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093213400, rc 0) 00000100:00100000:2.0:1746143690.108778:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963592181376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9433us (9523us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143690.108786:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9431 00000100:00100000:0.0:1746143690.117657:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.117697:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.117749:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.117827:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592181632 00000100:00100000:2.0:1746143690.117835:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592181632 00000100:00100000:2.0:1746143690.117867:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592181504 00000100:00100000:2.0:1746143690.117869:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592181504 00000100:00100000:2.0:1746143690.117896:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592181760 00000100:00100000:2.0:1746143690.117898:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592181760 00000100:00100000:2.0:1746143690.117913:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9432 00000100:00100000:2.0:1746143690.117920:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28321:x1830963592181632:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143690.117935:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.117949:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd72530c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a131d expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.117974:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.117980:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143690.117982:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143690.117986:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd72530c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a131d expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.118010:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.118020:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 26 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.118032:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593707776:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.118173:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9433 00000100:00100000:3.0:1746143690.118180:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592181504:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.118187:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.118200:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd725313 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1316 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.118224:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593707904:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143690.118273:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9434 00000100:00100000:0.0:1746143690.118279:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592181760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143690.118286:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143690.118293:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093213400/0xe984082ccd72531a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1324 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143690.118312:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593708032:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143690.118816:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.118838:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.119689:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.127715:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593707776:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.127743:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd72530c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a131d expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.127760:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d520200, rc 0) 00000100:00100000:2.0:1746143690.127803:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28321:x1830963592181632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9882us (10152us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.127811:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9432 00000100:00100000:3.0:1746143690.128247:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.128266:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592181888 00000100:00100000:3.0:1746143690.128271:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592181888 00002000:00100000:3.0:1746143690.128301:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1355776->1441791) req@ffff880094c11180 x1830963592181888/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.128309:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11180 with x1830963592181888 ext(1355776->1441791) 00010000:00010000:3.0:1746143690.128316:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 28 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.128326:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 28 pid: 21542 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746143690.128333:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c11180 00000100:00100000:3.0:1746143690.128350:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 824 00000100:00100000:3.0:1746143690.128356:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592181888:12345-192.168.202.48@tcp:4:cat.0 00002000:00010000:3.0:1746143690.128512:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143688 -> 1746143689 00000100:00100000:3.0:1746143690.128523:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593708032:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143690.128541:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093213400/0xe984082ccd72531a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1324 expref: 29 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.128549:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093213400/0xe984082ccd72531a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1324 expref: 29 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.128560:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093213400, rc 0) 00000100:00100000:3.0:1746143690.128576:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592181760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 10297us (10826us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143690.128580:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9434 00000100:00100000:2.0:1746143690.128789:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593707904:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143690.128805:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd725313 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1316 expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.128813:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd725313 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1316 expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.128824:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744c00, rc 0) 00000100:00100000:2.0:1746143690.128840:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592181504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 10660us (11142us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143690.128844:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9433 00000100:00100000:3.0:1746143690.131896:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592181888:12345-192.168.202.48@tcp:4:cat.0 Request processed in 3531us (3641us total) trans 21474839699 rc 0/0 00000100:00100000:3.0:1746143690.131906:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 824 00002000:00100000:3.0:1746143690.131916:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1355776->1441791) req@ffff880094c11180 x1830963592181888/t21474839699(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/448 e 0 to 0 dl 1746143701 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.131925:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11180 with x1830963592181888 ext(1355776->1441791) 00010000:00010000:3.0:1746143690.131933:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 28 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.131947:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 28 pid: 21542 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746143690.131958:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c11180 00000100:00100000:0.0:1746143690.135504:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.135592:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592182016 00000100:00100000:2.0:1746143690.135602:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592182016 00010000:00010000:2.0:1746143690.135633:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 28 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.136226:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4830 00000100:00100000:1.0:1746143690.136236:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592182016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143690.136248:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143690.136267:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 28 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.136278:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 28 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.136296:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351bd600/0xe984082ccd7252a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1355776->1441791) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12de expref: 28 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.136321:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.136323:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.136329:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd72530c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a131d expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.136338:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd72530c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a131d expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.136366:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd72530c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a131d expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143690.136377:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593708160:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143690.136792:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e919c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.138200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.138277:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592182144 00000100:00100000:3.0:1746143690.138284:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592182144 00000100:00100000:3.0:1746143690.138327:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9435 00000100:00100000:3.0:1746143690.138333:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28324:x1830963592182144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.138346:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.138358:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6000/0xe984082ccd725321 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a132b expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.138376:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.138377:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.138382:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6000/0xe984082ccd725321 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a132b expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.138393:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6000/0xe984082ccd725321 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a132b expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.138401:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7c6000, rc 0) 00000100:00100000:3.0:1746143690.138436:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28324:x1830963592182144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 103us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.138441:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9435 00000100:00100000:1.0:1746143690.139858:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593708160:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143690.139873:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143690.139918:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592182016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3683us (4421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.139925:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4830 00000100:00100000:0.0:1746143690.142908:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.142972:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592182400 00000100:00100000:3.0:1746143690.142979:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592182400 00000100:00100000:0.0:1746143690.142983:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:3.0:1746143690.143062:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008e624e00 x1830963592182400/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.143072:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624e00 with x1830963592182400 ext(1048576->2097151) 00002000:00010000:3.0:1746143690.143077:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e624e00 00000100:00100000:2.0:1746143690.143126:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592182656 00000100:00100000:2.0:1746143690.143129:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592182656 00002000:00100000:2.0:1746143690.143173:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008e626680 x1830963592182656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.143179:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e626680 with x1830963592182656 ext(1048576->2097151) 00002000:00010000:2.0:1746143690.143183:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e626680 00000100:00100000:3.0:1746143690.143313:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3437 00000100:00100000:3.0:1746143690.143321:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592182400:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143690.143503:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3438 00000100:00100000:2.0:1746143690.143509:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592182656:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143690.159817:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592182656:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16299us (16825us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143690.159826:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3438 00002000:00100000:2.0:1746143690.159836:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008e626680 x1830963592182656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.159845:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e626680 with x1830963592182656 ext(1048576->2097151) 00002000:00010000:2.0:1746143690.159850:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e626680 00000100:00100000:3.0:1746143690.170459:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592182400:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27129us (27548us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143690.170471:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3437 00002000:00100000:3.0:1746143690.170482:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008e624e00 x1830963592182400/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.170491:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e624e00 with x1830963592182400 ext(1048576->2097151) 00002000:00010000:3.0:1746143690.170496:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e624e00 00000100:00100000:0.0:1746143690.171928:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.171977:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.172038:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592182784 00000100:00100000:3.0:1746143690.172046:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592182784 00000100:00100000:3.0:1746143690.172076:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592182912 00000100:00100000:3.0:1746143690.172078:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592182912 00000100:00100000:3.0:1746143690.172092:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9436 00000100:00100000:3.0:1746143690.172098:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592182784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.172113:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.172129:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6c00/0xe984082ccd725328 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1332 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.172193:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593708288:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143690.172320:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9437 00000100:00100000:2.0:1746143690.172327:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592182912:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143690.172334:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.172343:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd72532f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1339 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143690.172366:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593708416:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143690.177857:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.177913:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.186007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.186460:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592183168 00000100:00100000:3.0:1746143690.186467:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592183168 00000100:00100000:3.0:1746143690.186515:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8251 00000100:00100000:3.0:1746143690.186522:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28326:x1830963592183168:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143690.186542:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.186555:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095729e00/0xe984082ccd725336 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1340 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.186641:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143690.186653:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12e5 expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.186660:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd7252f7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1308 expref: 22 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.186665:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143690.186690:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd7252f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1308 expref: 22 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.186700:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd7252f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1308 expref: 22 pid: 14764 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.186711:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593708544:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.186787:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12e5 expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.186794:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12e5 expref: 8 pid: 14764 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.186806:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593708672:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.186822:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.187248:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593708416:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143690.187269:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd72532f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1339 expref: 29 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143690.187279:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd72532f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1339 expref: 29 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143690.187292:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e6ca00, rc 0) 00000100:00100000:0.0:1746143690.187314:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592182912:12345-192.168.202.48@tcp:101:cat.0 Request processed in 14987us (15336us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143690.187320:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9437 00000100:00100000:3.0:1746143690.187451:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593708288:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143690.187466:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6c00/0xe984082ccd725328 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1332 expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.187474:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c6c00/0xe984082ccd725328 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1332 expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.187495:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7c6c00, rc 0) 00000100:00100000:3.0:1746143690.187514:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592182784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 15415us (15590us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143690.187519:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9436 00000100:00100000:0.0:1746143690.195348:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.195377:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.195404:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.195419:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.195431:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.195457:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.195534:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592183296 00000100:00100000:2.0:1746143690.195541:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592183296 00010000:00010000:2.0:1746143690.195570:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd7252f7 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1308 expref: 23 pid: 14764 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.195591:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592183424 00000100:00100000:2.0:1746143690.195593:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592183424 00010000:00010000:2.0:1746143690.195618:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12e5 expref: 9 pid: 14764 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.195632:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4831 00000100:00100000:2.0:1746143690.195639:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592183296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143690.195650:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143690.195655:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd7252f7 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1308 expref: 23 pid: 14764 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.195664:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd7252f7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1308 expref: 23 pid: 14764 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.195680:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143690.195684:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.195691:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.195696:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143690.195726:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592183296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 88us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.195732:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4831 00000100:00100000:2.0:1746143690.195744:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4832 00000100:00100000:2.0:1746143690.195748:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592183424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143690.195754:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143690.195758:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12e5 expref: 9 pid: 14764 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.195769:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12e5 expref: 9 pid: 14764 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.195778:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143690.195780:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.195786:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.195792:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143690.195805:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143690.195815:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592183424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 67us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.195820:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4832 00000100:00100000:2.0:1746143690.195835:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592183680 00000100:00100000:2.0:1746143690.195838:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592183680 00002000:00100000:2.0:1746143690.195857:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009ff6f800 x1830963592183680/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.195866:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f800 with x1830963592183680 ext(2097152->3145727) 00002000:00010000:2.0:1746143690.195869:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6f800 00000100:00100000:2.0:1746143690.195894:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592183936 00000100:00100000:2.0:1746143690.195897:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592183936 00002000:00100000:2.0:1746143690.195908:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4112383) req@ffff88009ff6e300 x1830963592183936/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.195914:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6e300 with x1830963592183936 ext(3145728->4112383) 00002000:00010000:2.0:1746143690.195917:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6e300 00000100:00100000:2.0:1746143690.195928:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592184192 00000100:00100000:2.0:1746143690.195930:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592184192 00002000:00100000:2.0:1746143690.195940:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009ff6c700 x1830963592184192/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.195946:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c700 with x1830963592184192 ext(2097152->3145727) 00002000:00010000:2.0:1746143690.195948:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6c700 00000100:00100000:2.0:1746143690.195956:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592184448 00000100:00100000:2.0:1746143690.195957:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592184448 00002000:00100000:2.0:1746143690.195965:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3899392->4194303) req@ffff88009ff6f100 x1830963592184448/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.195971:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f100 with x1830963592184448 ext(3899392->4194303) 00002000:00010000:2.0:1746143690.195973:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6f100 00000100:00100000:2.0:1746143690.195981:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3439 00000100:00100000:2.0:1746143690.195985:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592183680:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143690.197087:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3440 00000100:00100000:2.0:1746143690.197095:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592183936:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143690.198172:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3441 00000100:00100000:2.0:1746143690.198179:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1963:x1830963592184192:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143690.198483:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3442 00000100:00100000:3.0:1746143690.198491:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1963:x1830963592184448:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:3.0:1746143690.198818:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801351bd200/0xe984082ccd7252f7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1308 expref: 22 pid: 14764 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.198837:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593708544:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.198848:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093212e00/0xe984082ccd7252b8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12e5 expref: 8 pid: 14764 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.198861:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593708672:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.198889:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143690.198896:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143690.198901:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143690.198917:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143690.199019:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095729e00/0xe984082ccd725336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1340 expref: 23 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.199029:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1340 expref: 22 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.199036:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143690.199038:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143690.199041:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900cb000, rc 0) 00000100:00100000:3.0:1746143690.199059:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28326:x1830963592183168:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 12538us (13060us total) trans 8589942350 rc 0/0 00000100:00100000:3.0:1746143690.199065:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8251 00000100:00080000:0.0:1746143690.199152:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143690.203848:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.204210:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592184576 00000100:00100000:3.0:1746143690.204218:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592184576 00000100:00100000:3.0:1746143690.204252:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9438 00000100:00100000:3.0:1746143690.204260:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28324:x1830963592184576:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.204274:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.204289:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013013d400/0xe984082ccd72534b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1347 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.204319:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.204326:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143690.204328:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143690.204332:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013d400/0xe984082ccd72534b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1347 expref: 26 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.204356:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.204366:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 19 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.204377:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593708800:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.204432:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.219790:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592183680:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23795us (24376us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143690.219802:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3439 00002000:00100000:2.0:1746143690.219813:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009ff6f800 x1830963592183680/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.219827:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f800 with x1830963592183680 ext(2097152->3145727) 00010000:00010000:2.0:1746143690.219836:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 18 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.219853:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 18 pid: 21542 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746143690.219866:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6f800 00000100:00100000:3.0:1746143690.222626:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593708800:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.222654:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013013d400/0xe984082ccd72534b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1347 expref: 26 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.222668:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013d400, rc 0) 00000100:00100000:3.0:1746143690.222709:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28324:x1830963592184576:12345-192.168.202.48@tcp:101:cat.0 Request processed in 18450us (18868us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.222717:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9438 00000100:00100000:1.0:1746143690.223012:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.223243:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592184704 00000100:00100000:2.0:1746143690.223250:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592184704 00002000:00100000:2.0:1746143690.223291:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4112384->4194303) req@ffff880093f00700 x1830963592184704/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.223299:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00700 with x1830963592184704 ext(4112384->4194303) 00010000:00010000:2.0:1746143690.223304:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 18 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.223315:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 18 pid: 21542 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746143690.223321:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f00700 00000100:00100000:2.0:1746143690.223349:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 825 00000100:00100000:2.0:1746143690.223356:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592184704:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143690.224465:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592183936:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27367us (29040us total) trans 0 rc 966656/966656 00000100:00100000:2.0:1746143690.224475:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3440 00002000:00100000:2.0:1746143690.224482:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4112383) req@ffff88009ff6e300 x1830963592183936/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 966656/966656 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.224488:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6e300 with x1830963592183936 ext(3145728->4112383) 00010000:00010000:2.0:1746143690.224493:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 18 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.224503:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 18 pid: 21542 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746143690.224509:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6e300 00000100:00100000:0.0:1746143690.228941:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.230650:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592184448:12345-192.168.202.48@tcp:3:cat.0 Request processed in 32154us (35186us total) trans 0 rc 294912/294912 00000100:00100000:3.0:1746143690.230660:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3442 00002000:00100000:3.0:1746143690.230670:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3899392->4194303) req@ffff88009ff6f100 x1830963592184448/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 294912/294912 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.230679:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f100 with x1830963592184448 ext(3899392->4194303) 00002000:00010000:3.0:1746143690.230684:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6f100 00000100:00100000:3.0:1746143690.230713:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592184960 00000100:00100000:3.0:1746143690.230719:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592184960 00000100:00100000:3.0:1746143690.230768:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8252 00000100:00100000:3.0:1746143690.230774:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:28328:x1830963592184960:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143690.230790:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.230803:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013c400/0xe984082ccd725352 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a134e expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.230895:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d800/0xe984082ccd725359 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143690.230907:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d800/0xe984082ccd725359 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143690.230916:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d800/0xe984082ccd725359 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143690.230925:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143690.231017:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013c400/0xe984082ccd725352 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a134e expref: 256 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.231049:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d800/0xe984082ccd725359 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a134e expref: 255 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.231060:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143690.231062:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143690.231065:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013d800, rc 0) 00000100:00100000:3.0:1746143690.231085:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:28328:x1830963592184960:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 311us (2155us total) trans 8589942351 rc 0/0 00000100:00100000:3.0:1746143690.231090:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8252 00000100:00080000:0.0:1746143690.236473:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143690.238412:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592184704:12345-192.168.202.48@tcp:4:cat.0 Request processed in 15048us (15393us total) trans 17179872432 rc 0/0 00000100:00100000:3.0:1746143690.238423:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 825 00002000:00100000:3.0:1746143690.238433:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4112384->4194303) req@ffff880093f00700 x1830963592184704/t17179872432(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/448 e 0 to 0 dl 1746143701 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.238443:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00700 with x1830963592184704 ext(4112384->4194303) 00010000:00010000:3.0:1746143690.238452:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 18 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.238465:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 18 pid: 21542 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746143690.238471:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f00700 00000100:00100000:2.0:1746143690.239003:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963592184192:12345-192.168.202.48@tcp:3:cat.0 Request processed in 40820us (43565us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143690.239011:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3441 00002000:00100000:2.0:1746143690.239019:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009ff6c700 x1830963592184192/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.239027:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c700 with x1830963592184192 ext(2097152->3145727) 00002000:00010000:2.0:1746143690.239031:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6c700 00000100:00100000:0.0:1746143690.248291:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.248430:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592185088 00000100:00100000:3.0:1746143690.248441:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592185088 00000100:00100000:3.0:1746143690.248687:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9439 00000100:00100000:3.0:1746143690.248698:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28321:x1830963592185088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.248716:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.248735:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013013ca00/0xe984082ccd725367 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1355 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.248764:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143690.248767:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143690.248772:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013ca00/0xe984082ccd725367 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1355 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.248783:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013013ca00/0xe984082ccd725367 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1355 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.248794:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013ca00, rc 0) 00000100:00100000:3.0:1746143690.250009:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28321:x1830963592185088:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1310us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.250016:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9439 00000100:00100000:2.0:1746143690.254959:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.255084:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592185216 00000100:00100000:1.0:1746143690.255093:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592185216 00010000:00010000:1.0:1746143690.255129:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 19 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.255327:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4833 00000100:00100000:1.0:1746143690.255338:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592185216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143690.255353:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143690.255378:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 19 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.255395:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 19 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.255416:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d520e00/0xe984082ccd7252d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12fa expref: 19 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.255809:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.255812:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.255821:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013013d400/0xe984082ccd72534b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1347 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.255831:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013d400/0xe984082ccd72534b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1347 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.255839:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.255840:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.255844:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013013ca00/0xe984082ccd725367 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1355 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.255851:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013ca00/0xe984082ccd725367 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1355 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.255895:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013013ca00/0xe984082ccd725367 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1355 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143690.255909:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593708928:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143690.256704:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013013d400/0xe984082ccd72534b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1347 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143690.256712:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593709056:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143690.257303:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e919c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143690.267108:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593708928:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143690.267118:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593709056:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143690.267323:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143690.268353:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143690.268419:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592185216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 13077us (13460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.268430:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4833 00000100:00100000:3.0:1746143690.269009:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592185472 00000100:00100000:3.0:1746143690.269018:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592185472 00002000:00100000:3.0:1746143690.269062:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800930c2680 x1830963592185472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.269071:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c2680 with x1830963592185472 ext(3145728->4194303) 00002000:00010000:3.0:1746143690.269075:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c2680 00000100:00100000:3.0:1746143690.269118:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3443 00000100:00100000:3.0:1746143690.269126:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592185472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143690.273112:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.273220:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592185728 00000100:00100000:0.0:1746143690.273228:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592185728 00002000:00100000:0.0:1746143690.273264:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800930c1500 x1830963592185728/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143690.273272:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c1500 with x1830963592185728 ext(2097152->3145727) 00002000:00010000:0.0:1746143690.273277:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c1500 00000100:00100000:0.0:1746143690.273304:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3444 00000100:00100000:0.0:1746143690.273310:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592185728:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143690.288462:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592185472:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19325us (21127us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143690.288474:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3443 00002000:00100000:3.0:1746143690.288487:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800930c2680 x1830963592185472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.288497:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c2680 with x1830963592185472 ext(3145728->4194303) 00002000:00010000:3.0:1746143690.288502:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c2680 00000100:00100000:2.0:1746143690.300204:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592185728:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26876us (27082us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143690.300217:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3444 00002000:00100000:2.0:1746143690.300236:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800930c1500 x1830963592185728/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.300246:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c1500 with x1830963592185728 ext(2097152->3145727) 00002000:00010000:2.0:1746143690.300252:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c1500 00000100:00100000:0.0:1746143690.302327:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.302460:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592185984 00000100:00100000:2.0:1746143690.302470:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592185984 00002000:00100000:2.0:1746143690.302517:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009ff6d180 x1830963592185984/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.302526:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d180 with x1830963592185984 ext(4194304->4898815) 00002000:00010000:2.0:1746143690.302531:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6d180 00000100:00100000:2.0:1746143690.302576:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3445 00000100:00100000:2.0:1746143690.302585:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592185984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143690.310117:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.310249:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592186112 00000100:00100000:3.0:1746143690.310257:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592186112 00000100:00100000:3.0:1746143690.310289:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9440 00000100:00100000:3.0:1746143690.310295:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28324:x1830963592186112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.310311:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.310326:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72536e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a135c expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.310348:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.310355:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143690.310357:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143690.310360:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72536e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a135c expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.310384:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.310395:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 22 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.310406:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593709184:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.311727:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.317026:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592185984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14432us (14695us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143690.317037:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3445 00002000:00100000:2.0:1746143690.317050:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009ff6d180 x1830963592185984/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.317059:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d180 with x1830963592185984 ext(4194304->4898815) 00002000:00010000:2.0:1746143690.317065:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6d180 00000100:00100000:3.0:1746143690.317193:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593709184:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.317220:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72536e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a135c expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.317235:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095729e00, rc 0) 00000100:00100000:3.0:1746143690.317264:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28324:x1830963592186112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6967us (7153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.317270:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9440 00000100:00100000:0.0:1746143690.319069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.319168:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592186240 00000100:00100000:2.0:1746143690.319174:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592186240 00002000:00100000:2.0:1746143690.319207:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3899391) req@ffff880093502680 x1830963592186240/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.319216:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502680 with x1830963592186240 ext(3145728->3899391) 00010000:00010000:2.0:1746143690.319224:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 23 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.319236:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 23 pid: 21542 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746143690.319243:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093502680 00000100:00100000:2.0:1746143690.319270:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 826 00000100:00100000:2.0:1746143690.319276:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1962:x1830963592186240:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143690.324536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.324619:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592186368 00000100:00100000:3.0:1746143690.324627:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592186368 00000100:00100000:3.0:1746143690.324846:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9441 00000100:00100000:3.0:1746143690.324853:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592186368:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.324868:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.324894:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013013c400/0xe984082ccd725375 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1363 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.324936:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593709312:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143690.326503:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00002000:00010000:3.0:1746143690.333074:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143689 -> 1746143690 00000100:00100000:3.0:1746143690.333107:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593709312:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143690.333172:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013013c400/0xe984082ccd725375 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1363 expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.333190:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013013c400/0xe984082ccd725375 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1363 expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.333214:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013c400, rc 0) 00000100:00100000:3.0:1746143690.333272:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592186368:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8416us (8740us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143690.333280:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9441 00000100:00100000:2.0:1746143690.339800:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1962:x1830963592186240:12345-192.168.202.48@tcp:4:cat.0 Request processed in 20516us (20728us total) trans 21474839700 rc 0/0 00000100:00100000:2.0:1746143690.339810:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 826 00002000:00100000:2.0:1746143690.339820:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3899391) req@ffff880093502680 x1830963592186240/t21474839700(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/448 e 0 to 0 dl 1746143701 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.339829:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502680 with x1830963592186240 ext(3145728->3899391) 00010000:00010000:2.0:1746143690.339838:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 25 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.339852:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 25 pid: 21542 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746143690.339859:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093502680 00000100:00100000:0.0:1746143690.340628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.341000:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592186496 00000100:00100000:3.0:1746143690.341008:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592186496 00000100:00100000:3.0:1746143690.341048:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9442 00000100:00100000:3.0:1746143690.341057:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1962:x1830963592186496:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.341074:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.341091:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd72537c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a136a expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.341159:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593709440:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143690.341243:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.354127:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.354281:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592186624 00000100:00100000:1.0:1746143690.354288:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592186624 00010000:00010000:1.0:1746143690.354318:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 27 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.354352:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4834 00000100:00100000:1.0:1746143690.354359:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1962:x1830963592186624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143690.354373:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143690.354393:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 27 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.354404:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 27 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.354428:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.354430:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.354435:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72536e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a135c expref: 28 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.354443:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72536e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a135c expref: 28 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.354469:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72536e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a135c expref: 28 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143690.354480:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593709568:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143690.354690:0:8495:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff880094c12a00 x1830963593709440) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 27 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.354705:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd7252db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1301 expref: 27 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.354715:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593709440:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143690.354736:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd72537c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a136a expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.354751:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd72537c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a136a expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.354757:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091024c00, rc 0) 00000100:00100000:3.0:1746143690.354777:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1962:x1830963592186496:12345-192.168.202.48@tcp:101:cat.0 Request processed in 13722us (14155us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143690.354783:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9442 00000100:00100000:1.0:1746143690.354950:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e919c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143690.365417:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593709568:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143690.365436:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143690.365483:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1962:x1830963592186624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 11123us (11361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.365493:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4834 00000100:00100000:0.0:1746143690.367650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.367684:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.367720:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.367778:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592187008 00000100:00100000:2.0:1746143690.367785:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592187008 00002000:00100000:2.0:1746143690.367821:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012e1e1c00 x1830963592187008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.367836:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e1c00 with x1830963592187008 ext(2097152->3145727) 00002000:00010000:2.0:1746143690.367840:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e1e1c00 00000100:00100000:2.0:1746143690.367864:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592187136 00000100:00100000:2.0:1746143690.367866:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592187136 00002000:00100000:2.0:1746143690.367888:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88012e1e3b80 x1830963592187136/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.367895:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e3b80 with x1830963592187136 ext(3145728->4194303) 00002000:00010000:2.0:1746143690.367898:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e1e3b80 00000100:00100000:2.0:1746143690.367912:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592187392 00000100:00100000:2.0:1746143690.367914:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592187392 00002000:00100000:2.0:1746143690.367926:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88012e1e0380 x1830963592187392/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.367933:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0380 with x1830963592187392 ext(3145728->4194303) 00002000:00010000:2.0:1746143690.367935:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e0380 00000100:00100000:2.0:1746143690.367958:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3446 00000100:00100000:2.0:1746143690.367965:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963592187008:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143690.369049:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3447 00000100:00100000:2.0:1746143690.369056:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963592187136:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143690.370091:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3448 00000100:00100000:0.0:1746143690.370098:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592187392:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143690.392965:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963592187008:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24991us (25314us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143690.392975:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3446 00002000:00100000:0.0:1746143690.392985:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012e1e1c00 x1830963592187008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143690.392993:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e1c00 with x1830963592187008 ext(2097152->3145727) 00002000:00010000:0.0:1746143690.392998:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e1e1c00 00000100:00100000:2.0:1746143690.400211:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592187136:12345-192.168.202.48@tcp:3:cat.0 Request processed in 31146us (32518us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143690.400220:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3447 00002000:00100000:2.0:1746143690.400229:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88012e1e3b80 x1830963592187136/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.400242:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e3b80 with x1830963592187136 ext(3145728->4194303) 00002000:00010000:2.0:1746143690.400247:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e1e3b80 00000100:00100000:0.0:1746143690.401402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.403827:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592187520 00000100:00100000:3.0:1746143690.403838:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592187520 00000100:00100000:3.0:1746143690.403895:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9443 00000100:00100000:3.0:1746143690.403902:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28328:x1830963592187520:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143690.403920:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.403937:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1371 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.403962:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72536e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a135c expref: 30 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.403970:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.403971:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.403974:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3522560->4194303] (req 3522560->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 30 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.403999:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72536e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a135c expref: 30 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.404015:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72536e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a135c expref: 30 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.404025:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593709696:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.404105:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143690.404930:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592187392:12345-192.168.202.48@tcp:3:cat.0 Request processed in 34828us (37204us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143690.404939:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3448 00002000:00100000:1.0:1746143690.404949:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88012e1e0380 x1830963592187392/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.404958:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0380 with x1830963592187392 ext(3145728->4194303) 00002000:00010000:1.0:1746143690.404963:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e0380 00000100:00100000:3.0:1746143690.406981:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593709696:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.407004:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3522560->4194303] (req 3522560->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 30 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.407016:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091024c00, rc 0) 00000100:00100000:3.0:1746143690.407370:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28328:x1830963592187520:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3467us (5971us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.407376:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9443 00000100:00100000:2.0:1746143690.409669:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.409782:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592187648 00000100:00100000:0.0:1746143690.409793:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592187648 00000100:00100000:0.0:1746143690.409838:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9444 00000100:00100000:0.0:1746143690.409846:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28324:x1830963592187648:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143690.409864:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143690.409891:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0700c00/0xe984082ccd72538a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1378 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143690.409912:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143690.409918:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3522560->4194303] (req 3522560->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 31 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143690.409923:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143690.409925:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0700c00/0xe984082ccd72538a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1378 expref: 31 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143690.409956:0:8495:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3522560->4194303] (req 3522560->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 31 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143690.409966:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0700c00/0xe984082ccd72538a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1378 expref: 31 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143690.409974:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0700c00, rc 0) 00000100:00100000:0.0:1746143690.410020:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:28324:x1830963592187648:12345-192.168.202.48@tcp:101:cat.0 Request processed in 176us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143690.410025:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9444 00000100:00100000:0.0:1746143690.410956:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.411048:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592187776 00000100:00100000:1.0:1746143690.411053:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592187776 00010000:00010000:1.0:1746143690.411071:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72536e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a135c expref: 31 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.411787:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4835 00000100:00100000:1.0:1746143690.411794:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592187776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143690.411805:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143690.411824:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72536e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a135c expref: 31 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.411835:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72536e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a135c expref: 31 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.411850:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72536e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a135c expref: 31 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.412154:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.412157:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.412165:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 30 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.412174:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 30 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.412206:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 30 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.412218:0:7150:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 30 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.412229:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593709952:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143690.413314:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e919c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.418704:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.418765:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592188032 00000100:00100000:2.0:1746143690.418773:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592188032 00002000:00100000:2.0:1746143690.418811:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3522560->3526655) req@ffff880094763800 x1830963592188032/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.418820:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763800 with x1830963592188032 ext(3522560->3526655) 00010000:00010000:2.0:1746143690.418829:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 31 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.418842:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 31 pid: 8495 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746143690.418849:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094763800 00000100:00100000:2.0:1746143690.418887:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 827 00000100:00100000:2.0:1746143690.418894:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592188032:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143690.419029:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592188032:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 135us (333us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143690.419035:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 827 00002000:00100000:2.0:1746143690.419040:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3522560->3526655) req@ffff880094763800 x1830963592188032/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/4536 e 0 to 0 dl 1746143701 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.419047:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763800 with x1830963592188032 ext(3522560->3526655) 00010000:00010000:2.0:1746143690.419051:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 31 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.419060:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 31 pid: 8495 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746143690.419065:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094763800 00000100:00100000:1.0:1746143690.419199:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593709952:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143690.419213:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143690.419245:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592187776:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7451us (8289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.419252:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4835 00000100:00100000:0.0:1746143690.426554:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.426626:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.426686:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592188416 00000100:00100000:3.0:1746143690.426694:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592188416 00000100:00100000:3.0:1746143690.426727:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9445 00000100:00100000:3.0:1746143690.426734:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28328:x1830963592188416:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143690.426749:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.426763:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a137f expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.426786:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013013d400/0xe984082ccd72534b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1347 expref: 27 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.426799:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013013ca00/0xe984082ccd725367 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1355 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.426805:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.426807:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.426810:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->4227071] (req 4194304->4227071) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.426834:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013013ca00/0xe984082ccd725367 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1355 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.426844:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013013ca00/0xe984082ccd725367 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1355 expref: 17 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.426855:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593710080:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.426942:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013013d400/0xe984082ccd72534b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1347 expref: 27 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.426950:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013013d400/0xe984082ccd72534b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1347 expref: 27 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.426958:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593710208:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.426976:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.426991:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592188288 00000100:00100000:3.0:1746143690.426994:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592188288 00002000:00100000:3.0:1746143690.427018:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3522560->4194303) req@ffff880094762d80 x1830963592188288/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.427027:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094762d80 with x1830963592188288 ext(3522560->4194303) 00010000:00010000:3.0:1746143690.427034:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 30 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.427042:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 30 pid: 8495 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746143690.427048:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094762d80 00000100:00100000:3.0:1746143690.427059:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 828 00000100:00100000:3.0:1746143690.427064:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592188288:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143690.431593:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593710080:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.435983:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593710208:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.436015:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->4227071] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.436030:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dc0000, rc 0) 00000100:00100000:3.0:1746143690.436068:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:28328:x1830963592188416:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 9333us (9520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.436076:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9445 00000100:00100000:0.0:1746143690.437102:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.437263:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592188544 00000100:00100000:1.0:1746143690.437269:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592188544 00010000:00010000:1.0:1746143690.437290:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013013ca00/0xe984082ccd725367 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1355 expref: 18 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.437319:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4836 00000100:00100000:1.0:1746143690.437324:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592188544:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143690.437334:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143690.437352:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013013ca00/0xe984082ccd725367 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1355 expref: 18 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.437361:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013013ca00/0xe984082ccd725367 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1355 expref: 18 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.437384:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013013ca00/0xe984082ccd725367 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1355 expref: 18 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.437397:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143690.437419:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592188544:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 94us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.437424:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4836 00000100:00100000:1.0:1746143690.441770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.441851:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592188672 00000100:00100000:3.0:1746143690.441859:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592188672 00010000:00010000:3.0:1746143690.441898:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013013d400/0xe984082ccd72534b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1347 expref: 27 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.441926:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4837 00000100:00100000:3.0:1746143690.441932:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592188672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143690.441944:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143690.441964:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013013d400/0xe984082ccd72534b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1347 expref: 27 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.441974:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013013d400/0xe984082ccd72534b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1347 expref: 27 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.441992:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013013d400/0xe984082ccd72534b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1347 expref: 27 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.442017:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.442019:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.442025:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.442032:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.442058:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.442067:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593710336:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143690.442160:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.449316:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963592188288:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 22241us (22679us total) trans 21474839701 rc 0/0 00000100:00100000:3.0:1746143690.449327:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 828 00002000:00100000:3.0:1746143690.449338:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3522560->4194303) req@ffff880094762d80 x1830963592188288/t21474839701(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/448 e 0 to 0 dl 1746143701 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.449346:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094762d80 with x1830963592188288 ext(3522560->4194303) 00010000:00010000:3.0:1746143690.449356:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.449369:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746143690.449375:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094762d80 00000100:00100000:0.0:1746143690.449688:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.449747:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.449760:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593710336:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143690.449780:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143690.449814:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592188672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7881us (8052us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.449821:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4837 00000100:00100000:3.0:1746143690.449969:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592188800 00000100:00100000:3.0:1746143690.449975:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592188800 00000100:00100000:3.0:1746143690.450003:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9446 00000100:00100000:3.0:1746143690.450009:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28326:x1830963592188800:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143690.450021:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.450034:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1386 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.450055:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd7251b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1260 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.450062:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cabc000/0xe984082ccd725287 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c2 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.450072:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1e00/0xe984082ccd7251ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a127c expref: 31 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.450078:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.450079:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.450082:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [1712128->2097151] (req 1712128->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.450105:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1e00/0xe984082ccd7251ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a127c expref: 31 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.450114:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1e00/0xe984082ccd7251ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a127c expref: 31 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.450123:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593710464:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.450200:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cabc000/0xe984082ccd725287 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c2 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.450208:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cabc000/0xe984082ccd725287 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c2 expref: 9 pid: 4581 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746143690.450216:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593710592:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143690.450349:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592189056 00000100:00100000:1.0:1746143690.450353:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592189056 00002000:00100000:1.0:1746143690.450375:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4222976->4227071) req@ffff880094763480 x1830963592189056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.450382:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763480 with x1830963592189056 ext(4222976->4227071) 00002000:00010000:1.0:1746143690.450385:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094763480 00000100:00100000:1.0:1746143690.450410:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3449 00000100:00100000:1.0:1746143690.450416:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592189056:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143690.450788:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592189056:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 371us (1039us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1746143690.450805:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd7251b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1260 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.450818:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd7251b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1260 expref: 25 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.450832:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3449 00002000:00100000:1.0:1746143690.450838:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4222976->4227071) req@ffff880094763480 x1830963592189056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/4536 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.450845:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763480 with x1830963592189056 ext(4222976->4227071) 00002000:00010000:1.0:1746143690.450847:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094763480 00000100:00100000:3.0:1746143690.451072:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593710720:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.451094:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.454267:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593710464:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143690.455435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.455464:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.455480:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592189184 00000100:00100000:1.0:1746143690.455484:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592189184 00010000:00010000:1.0:1746143690.455510:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cabc000/0xe984082ccd725287 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c2 expref: 10 pid: 4581 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746143690.455529:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592189312 00000100:00100000:1.0:1746143690.455530:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592189312 00010000:00010000:1.0:1746143690.455539:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.455552:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4838 00000100:00100000:1.0:1746143690.455558:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592189184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143690.455567:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143690.455586:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cabc000/0xe984082ccd725287 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c2 expref: 10 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746143690.455595:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cabc000/0xe984082ccd725287 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c2 expref: 10 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746143690.455616:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143690.455649:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592189184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 90us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.455655:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4838 00000100:00100000:1.0:1746143690.455677:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4839 00000100:00100000:1.0:1746143690.455681:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592189312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143690.455690:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143690.455696:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143689 -> 1746143690 00002000:00010000:1.0:1746143690.455699:0:7150:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143689 -> 1746143690 00010000:00010000:1.0:1746143690.455703:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.455712:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.455723:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd725383 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3522560->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1371 expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.455738:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.455740:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.455746:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0700c00/0xe984082ccd72538a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1378 expref: 31 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.455754:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0700c00/0xe984082ccd72538a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1378 expref: 31 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.455778:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0700c00/0xe984082ccd72538a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1378 expref: 31 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143690.455788:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593710848:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143690.455834:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143690.456127:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143690.456202:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cabc000/0xe984082ccd725287 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12c2 expref: 9 pid: 4581 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746143690.456216:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593710592:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.456600:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593710720:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.456623:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1712128->2097151] (req 1712128->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.456633:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d53b400, rc 0) 00000100:00100000:3.0:1746143690.456669:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28326:x1830963592188800:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6659us (6981us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.456675:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9446 00000100:00100000:2.0:1746143690.456832:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592189440 00000100:00100000:2.0:1746143690.456836:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592189440 00010000:00010000:2.0:1746143690.456850:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1e00/0xe984082ccd7251ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a127c expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.456871:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4840 00000100:00100000:2.0:1746143690.456884:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592189440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143690.456890:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143690.456903:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1e00/0xe984082ccd7251ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a127c expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.456910:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1e00/0xe984082ccd7251ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a127c expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.456921:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1e00/0xe984082ccd7251ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a127c expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.458085:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143690.458136:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592189440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1256us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.458155:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4840 00000100:00100000:1.0:1746143690.462136:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.463123:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.463161:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592189824 00000100:00100000:1.0:1746143690.463167:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592189824 00002000:00100000:1.0:1746143690.463199:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880090767480 x1830963592189824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.463207:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767480 with x1830963592189824 ext(3145728->4194303) 00002000:00010000:1.0:1746143690.463211:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767480 00000100:00100000:1.0:1746143690.463242:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3450 00000100:00100000:1.0:1746143690.463248:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592189824:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143690.463332:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593710848:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143690.463350:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143690.463384:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963592189312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7701us (7918us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143690.463390:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4839 00000100:00100000:0.0:1746143690.463416:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592189568 00000100:00100000:0.0:1746143690.463418:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592189568 00010000:00010000:0.0:1746143690.463433:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd7251b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1260 expref: 25 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746143690.463462:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4841 00000100:00100000:0.0:1746143690.463467:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592189568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143690.463474:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143690.463488:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd7251b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1260 expref: 25 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746143690.466677:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd7251b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1260 expref: 25 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746143690.466698:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009500a000/0xe984082ccd7251b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1260 expref: 25 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746143690.466730:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143690.466732:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143690.466738:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143690.466745:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143690.466774:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143690.466792:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593710976:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143690.466855:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.477637:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593710976:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143690.477657:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143690.477704:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1963:x1830963592189568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 14235us (15575us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143690.477713:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4841 00000100:00100000:1.0:1746143690.478002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.478196:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592190080 00000100:00100000:0.0:1746143690.478202:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592190080 00002000:00100000:0.0:1746143690.478227:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1712128->1716223) req@ffff880090764380 x1830963592190080/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143690.478235:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764380 with x1830963592190080 ext(1712128->1716223) 00002000:00010000:0.0:1746143690.478239:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090764380 00000100:00100000:0.0:1746143690.478262:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3451 00000100:00100000:2.0:1746143690.478266:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592189824:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 15017us (15143us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143690.478268:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963592190080:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143690.478273:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3450 00002000:00100000:2.0:1746143690.478279:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880090767480 x1830963592189824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.478287:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767480 with x1830963592189824 ext(3145728->4194303) 00002000:00010000:2.0:1746143690.478290:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767480 00000100:00100000:0.0:1746143690.478380:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963592190080:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 111us (377us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143690.478385:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3451 00002000:00100000:0.0:1746143690.479308:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1712128->1716223) req@ffff880090764380 x1830963592190080/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/4536 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143690.479317:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764380 with x1830963592190080 ext(1712128->1716223) 00002000:00010000:0.0:1746143690.479320:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090764380 00000100:00100000:0.0:1746143690.486644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.487408:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.487435:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592190208 00000100:00100000:1.0:1746143690.487446:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592190208 00000100:00100000:1.0:1746143690.487620:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592190336 00000100:00100000:1.0:1746143690.487623:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592190336 00000100:00100000:1.0:1746143690.487653:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9447 00000100:00100000:1.0:1746143690.487659:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592190208:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143690.487673:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143690.487687:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd72539f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a138d expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143690.487727:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593711104:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143690.487788:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.487803:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9448 00000100:00100000:3.0:1746143690.487811:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28326:x1830963592190336:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143690.487819:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.487829:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1394 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.487846:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5600/0xe984082ccd724fa1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1148 expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.487853:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700e00/0xe984082ccd7250d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e2 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.487859:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5200/0xe984082ccd7250ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11db expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.487864:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.487865:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.487868:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1048576->1507327] (req 1048576->1507327) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.487893:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5200/0xe984082ccd7250ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11db expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.487903:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5200/0xe984082ccd7250ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11db expref: 18 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.487909:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593711232:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.487931:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0700e00/0xe984082ccd7250d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e2 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.487935:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0700e00/0xe984082ccd7250d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e2 expref: 25 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.487940:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593711360:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.487951:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5600/0xe984082ccd724fa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1148 expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.487956:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5600/0xe984082ccd724fa1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1148 expref: 10 pid: 4581 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746143690.487960:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593711488:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.488014:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.489589:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593711232:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.489599:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593711360:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.489606:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593711488:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.489629:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1048576->1507327] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.489641:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bca00, rc 0) 00000100:00100000:3.0:1746143690.489685:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28326:x1830963592190336:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1875us (2278us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.489691:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9448 00002000:00010000:1.0:1746143690.489773:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime: 1746143689 -> 1746143690 00002000:00010000:1.0:1746143690.489777:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime: 1746143689 -> 1746143690 00002000:00010000:1.0:1746143690.489778:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime: 1746143689 -> 1746143690 00000100:00100000:1.0:1746143690.489793:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593711104:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143690.489809:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd72539f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a138d expref: 31 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.489818:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090744600/0xe984082ccd72539f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a138d expref: 31 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.489829:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744600, rc 0) 00000100:00100000:1.0:1746143690.489843:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592190208:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2185us (3206us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143690.489848:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9447 00000100:00100000:0.0:1746143690.497809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.497844:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.497863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.497900:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.497998:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592190592 00000100:00100000:3.0:1746143690.498006:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592190592 00010000:00010000:3.0:1746143690.498038:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0700e00/0xe984082ccd7250d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e2 expref: 26 pid: 21542 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.498065:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592190464 00000100:00100000:3.0:1746143690.498067:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592190464 00010000:00010000:3.0:1746143690.498075:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5200/0xe984082ccd7250ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11db expref: 18 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.498085:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592190720 00000100:00100000:3.0:1746143690.498087:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592190720 00010000:00010000:3.0:1746143690.498095:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5600/0xe984082ccd724fa1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1148 expref: 11 pid: 4581 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746143690.498106:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4842 00000100:00100000:3.0:1746143690.498113:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592190592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143690.498123:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143690.498160:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0700e00/0xe984082ccd7250d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e2 expref: 26 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.498169:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0700e00/0xe984082ccd7250d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e2 expref: 26 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.498188:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0700e00/0xe984082ccd7250d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11e2 expref: 26 pid: 21542 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.498204:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143690.498240:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592190592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 126us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.498245:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4842 00000100:00100000:3.0:1746143690.498263:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4843 00000100:00100000:3.0:1746143690.498267:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592190464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143690.498273:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143690.498279:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5200/0xe984082ccd7250ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11db expref: 18 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.498288:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5200/0xe984082ccd7250ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11db expref: 18 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.498297:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5200/0xe984082ccd7250ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11db expref: 18 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.498306:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143690.498316:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592190464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 50us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.498321:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4843 00000100:00100000:3.0:1746143690.498363:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4844 00000100:00100000:3.0:1746143690.498367:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592190720:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143690.498372:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143690.498379:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5600/0xe984082ccd724fa1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1148 expref: 11 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746143690.498386:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5600/0xe984082ccd724fa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1148 expref: 11 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746143690.498397:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5600/0xe984082ccd724fa1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1148 expref: 11 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746143690.498406:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.498408:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.498413:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.498419:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.498443:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.498453:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593711616:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143690.498497:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143690.500715:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592190976 00000100:00100000:1.0:1746143690.500723:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592190976 00002000:00100000:1.0:1746143690.500759:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4227072->4898815) req@ffff8800949f1c00 x1830963592190976/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.500768:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1c00 with x1830963592190976 ext(4227072->4898815) 00002000:00010000:1.0:1746143690.500772:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f1c00 00000100:00100000:1.0:1746143690.501795:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3452 00000100:00100000:1.0:1746143690.501804:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592190976:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143690.510234:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593711616:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143690.510253:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143690.510288:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592190720:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 11919us (12423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.510297:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4844 00000100:00100000:0.0:1746143690.520337:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.520641:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592191232 00000100:00100000:2.0:1746143690.520650:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592191232 00002000:00100000:2.0:1746143690.520683:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1503232->1507327) req@ffff8800949f3800 x1830963592191232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.520692:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3800 with x1830963592191232 ext(1503232->1507327) 00002000:00010000:2.0:1746143690.520696:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f3800 00000100:00100000:2.0:1746143690.521012:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3453 00000100:00100000:2.0:1746143690.521020:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592191232:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143690.521181:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592191232:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 161us (849us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143690.521187:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3453 00002000:00100000:2.0:1746143690.521192:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1503232->1507327) req@ffff8800949f3800 x1830963592191232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/4536 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.521200:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3800 with x1830963592191232 ext(1503232->1507327) 00002000:00010000:2.0:1746143690.521203:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f3800 00000100:00100000:1.0:1746143690.521923:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592190976:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20118us (24020us total) trans 0 rc 671744/671744 00000100:00100000:1.0:1746143690.521930:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3452 00002000:00100000:1.0:1746143690.521936:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4227072->4898815) req@ffff8800949f1c00 x1830963592190976/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 671744/671744 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.521942:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1c00 with x1830963592190976 ext(4227072->4898815) 00002000:00010000:1.0:1746143690.521946:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f1c00 00000100:00100000:0.0:1746143690.528557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.529065:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.529451:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592191360 00000100:00100000:1.0:1746143690.529459:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592191360 00000100:00100000:1.0:1746143690.529486:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592191488 00000100:00100000:1.0:1746143690.529487:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592191488 00000100:00100000:1.0:1746143690.529511:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9449 00000100:00100000:1.0:1746143690.529517:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963592191360:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143690.529533:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143690.529549:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e505800/0xe984082ccd7253ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a139b expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143690.529597:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9450 00000100:00100000:2.0:1746143690.529605:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592191488:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143690.529612:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.529620:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a3c00/0xe984082ccd7253b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13a2 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143690.529661:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593711744:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143690.529717:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143690.529984:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593711872:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143690.530004:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91d80 going to sleep for 11 seconds 00002000:00010000:2.0:1746143690.531472:0:12618:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143688 -> 1746143690 00002000:00010000:2.0:1746143690.531477:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143688 -> 1746143690 00002000:00010000:2.0:1746143690.531478:0:12618:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143688 -> 1746143690 00000100:00100000:2.0:1746143690.531495:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593711744:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143690.531517:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368a3c00/0xe984082ccd7253b4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13a2 expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.531528:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a3c00/0xe984082ccd7253b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13a2 expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.531752:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a3c00, rc 0) 00000100:00100000:2.0:1746143690.531790:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592191488:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2185us (2724us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143690.531797:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9450 00000100:00100000:1.0:1746143690.538009:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593711872:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143690.538036:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e505800/0xe984082ccd7253ad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a139b expref: 31 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.538081:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e505800/0xe984082ccd7253ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a139b expref: 31 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.538097:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e505800, rc 0) 00000100:00100000:1.0:1746143690.538172:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963592191360:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8654us (9622us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143690.538180:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9449 00000100:00100000:0.0:1746143690.546122:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.546189:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.546756:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592191744 00000100:00100000:2.0:1746143690.546764:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592191744 00000100:00100000:2.0:1746143690.546807:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592191616 00000100:00100000:2.0:1746143690.546809:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592191616 00000100:00100000:2.0:1746143690.546823:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9451 00000100:00100000:2.0:1746143690.546830:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592191744:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143690.546846:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.546861:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a3c00/0xe984082ccd7253bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13b0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143690.546912:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593712000:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143690.546979:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143690.547039:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9452 00000100:00100000:1.0:1746143690.547046:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592191616:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143690.547056:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143690.547066:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e505200/0xe984082ccd7253c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13a9 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143690.547088:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593712128:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143690.547107:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.550912:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593712000:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143690.550944:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368a3c00/0xe984082ccd7253bb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13b0 expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.550956:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a3c00/0xe984082ccd7253bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13b0 expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.550971:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a3c00, rc 0) 00000100:00100000:2.0:1746143690.551010:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592191744:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4179us (4894us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143690.551018:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9451 00000100:00100000:1.0:1746143690.551395:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593712128:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143690.551410:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e505200/0xe984082ccd7253c2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13a9 expref: 31 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.551418:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e505200/0xe984082ccd7253c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13a9 expref: 31 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.551429:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e505200, rc 0) 00000100:00100000:1.0:1746143690.551460:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592191616:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4414us (5271us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143690.551465:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9452 00010000:00010000:3.0:1746143690.582122:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143690.622394:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.622488:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592191872 00000100:00100000:1.0:1746143690.622497:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592191872 00000100:00100000:1.0:1746143690.622552:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9453 00000100:00100000:1.0:1746143690.622559:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592191872:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143690.622578:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143690.622594:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e504200/0xe984082ccd7253c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13b7 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143690.622641:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593712256:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143690.622729:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.623587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.623645:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592192000 00000100:00100000:2.0:1746143690.623650:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592192000 00000100:00100000:2.0:1746143690.623685:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9454 00000100:00100000:2.0:1746143690.623690:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963592192000:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143690.623699:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.623709:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd7253d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13be expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.623723:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.623724:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.623731:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd7253d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13be expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.623743:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd7253d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13be expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.623752:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a3600, rc 0) 00000100:00100000:2.0:1746143690.623794:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592192000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 103us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.623799:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9454 00002000:00010000:1.0:1746143690.624229:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime: 1746143689 -> 1746143690 00002000:00010000:1.0:1746143690.624233:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime: 1746143689 -> 1746143690 00002000:00010000:1.0:1746143690.624235:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime: 1746143689 -> 1746143690 00000100:00100000:1.0:1746143690.624251:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593712256:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143690.624267:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e504200/0xe984082ccd7253c9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13b7 expref: 18 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.624276:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e504200/0xe984082ccd7253c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13b7 expref: 18 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.624297:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e504200, rc 0) 00000100:00100000:1.0:1746143690.624323:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592191872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1764us (1936us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143690.624328:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9453 00000100:00100000:0.0:1746143690.641202:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.641280:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592192256 00000100:00100000:1.0:1746143690.641288:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592192256 00002000:00100000:1.0:1746143690.641328:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1712127) req@ffff88012f186300 x1830963592192256/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.641338:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f186300 with x1830963592192256 ext(1048576->1712127) 00002000:00010000:1.0:1746143690.641342:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f186300 00000100:00100000:1.0:1746143690.641371:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3454 00000100:00100000:1.0:1746143690.641378:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592192256:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143690.645706:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.645896:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592192512 00000100:00100000:3.0:1746143690.645905:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592192512 00002000:00100000:3.0:1746143690.645939:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1507328->2097151) req@ffff88012f185c00 x1830963592192512/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.645948:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185c00 with x1830963592192512 ext(1507328->2097151) 00002000:00010000:3.0:1746143690.645952:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185c00 00000100:00100000:3.0:1746143690.646033:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3455 00000100:00100000:3.0:1746143690.646041:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592192512:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143690.649683:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592192256:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8297us (8483us total) trans 0 rc 663552/663552 00000100:00100000:1.0:1746143690.649697:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3454 00002000:00100000:1.0:1746143690.649707:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1712127) req@ffff88012f186300 x1830963592192256/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 663552/663552 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.649715:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f186300 with x1830963592192256 ext(1048576->1712127) 00002000:00010000:1.0:1746143690.649721:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f186300 00000100:00100000:3.0:1746143690.655224:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592192512:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9173us (9516us total) trans 0 rc 589824/589824 00000100:00100000:3.0:1746143690.655233:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3455 00002000:00100000:3.0:1746143690.655243:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1507328->2097151) req@ffff88012f185c00 x1830963592192512/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 589824/589824 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.655251:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185c00 with x1830963592192512 ext(1507328->2097151) 00002000:00010000:3.0:1746143690.655256:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185c00 00000100:00100000:0.0:1746143690.662527:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.662629:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592192640 00000100:00100000:1.0:1746143690.662637:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592192640 00000100:00100000:1.0:1746143690.662672:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9455 00000100:00100000:1.0:1746143690.662679:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28336:x1830963592192640:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143690.662697:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143690.662712:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7253d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13c5 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.662736:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.662744:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143690.662746:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143690.662749:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7253d7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13c5 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.662775:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.662785:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 24 pid: 25369 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.662801:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593712384:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143690.663391:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143690.664799:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593712384:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143690.664816:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7253d7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13c5 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.664829:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e504800, rc 0) 00000100:00100000:1.0:1746143690.664855:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28336:x1830963592192640:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2176us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.664861:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9455 00000100:00100000:0.0:1746143690.666369:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.666449:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592192768 00000100:00100000:3.0:1746143690.666455:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592192768 00002000:00100000:3.0:1746143690.666486:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4227071) req@ffff88012f186d80 x1830963592192768/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.666495:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f186d80 with x1830963592192768 ext(4194304->4227071) 00010000:00010000:3.0:1746143690.666502:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 25 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.666513:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 25 pid: 25369 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746143690.666519:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f186d80 00000100:00100000:3.0:1746143690.666581:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 829 00000100:00100000:3.0:1746143690.666587:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592192768:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143690.671281:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592192768:12345-192.168.202.48@tcp:4:cat.0 Request processed in 4685us (4910us total) trans 17179872433 rc 0/0 00000100:00100000:3.0:1746143690.671293:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 829 00002000:00100000:3.0:1746143690.671301:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4227071) req@ffff88012f186d80 x1830963592192768/t17179872433(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/448 e 0 to 0 dl 1746143701 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.671309:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f186d80 with x1830963592192768 ext(4194304->4227071) 00010000:00010000:3.0:1746143690.671316:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 27 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.671328:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 27 pid: 25369 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746143690.671334:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f186d80 00000100:00100000:0.0:1746143690.692475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.693378:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592192896 00000100:00100000:3.0:1746143690.693387:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592192896 00010000:00010000:3.0:1746143690.693419:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 27 pid: 25369 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.693456:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4845 00000100:00100000:3.0:1746143690.693463:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592192896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143690.693474:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143690.693493:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 27 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.693505:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 27 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.693527:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd725391 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a137f expref: 27 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.693557:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.693559:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.693565:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7253d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13c5 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.693572:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7253d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13c5 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.693600:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7253d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13c5 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.693610:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593712512:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143690.693688:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.699727:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593712512:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143690.699748:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143690.699799:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963592192896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6335us (7329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.699808:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4845 00000100:00100000:0.0:1746143690.702063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.702182:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592193024 00000100:00100000:2.0:1746143690.702190:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592193024 00000100:00100000:2.0:1746143690.702229:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8253 00000100:00100000:2.0:1746143690.702235:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28343:x1830963592193024:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143690.702255:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.702271:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd7253de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13cc expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.702322:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7253e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.702331:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7253e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.702340:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7253e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.702351:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd7253ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.702356:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd7253ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.702360:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd7253ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.702456:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.702464:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1340 expref: 21 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.702470:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d800/0xe984082ccd725359 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a134e expref: 254 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.702475:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.702498:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d800/0xe984082ccd725359 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a134e expref: 254 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.702508:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d800/0xe984082ccd725359 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a134e expref: 254 pid: 14764 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.702517:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593712640:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.702592:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1340 expref: 21 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.702598:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1340 expref: 21 pid: 14764 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.702605:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593712768:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143690.702621:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.706769:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.707266:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593712640:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143690.707277:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593712768:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.707299:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:3.0:1746143690.708469:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592193152 00000100:00100000:3.0:1746143690.708476:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592193152 00010000:00010000:3.0:1746143690.708506:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d800/0xe984082ccd725359 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a134e expref: 255 pid: 14764 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.708540:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4846 00000100:00100000:3.0:1746143690.708545:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1963:x1830963592193152:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143690.708555:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143690.708559:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d800/0xe984082ccd725359 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a134e expref: 255 pid: 14764 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.708568:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d800/0xe984082ccd725359 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a134e expref: 255 pid: 14764 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.708584:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d800/0xe984082ccd725359 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a134e expref: 255 pid: 14764 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.708597:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143690.708601:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.708608:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.708612:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.708616:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143690.708650:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:1963:x1830963592193152:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 106us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.708655:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4846 00000100:00100000:1.0:1746143690.710950:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.710979:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.711043:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592193536 00000100:00100000:3.0:1746143690.711049:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592193536 00002000:00100000:3.0:1746143690.711082:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009bfe1880 x1830963592193536/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.711091:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1880 with x1830963592193536 ext(2097152->3145727) 00002000:00010000:3.0:1746143690.711095:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1880 00000100:00100000:3.0:1746143690.711114:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3456 00000100:00100000:3.0:1746143690.711120:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592193536:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143690.716003:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.716022:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.717940:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592193280 00000100:00100000:2.0:1746143690.717949:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592193280 00010000:00010000:2.0:1746143690.717991:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1340 expref: 22 pid: 14764 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.718022:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4847 00000100:00100000:2.0:1746143690.718030:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963592193280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143690.718041:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143690.718046:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1340 expref: 22 pid: 14764 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.718059:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1340 expref: 22 pid: 14764 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.718081:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800900cb000/0xe984082ccd72533d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1340 expref: 22 pid: 14764 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.718109:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143690.718114:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718122:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718127:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718163:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143690.718206:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592193280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 176us (7225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.718211:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4847 00010000:00010000:2.0:1746143690.718233:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718238:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143690.718275:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:2.0:1746143690.718280:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143690.718299:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718310:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718320:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7253e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718325:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7253e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718329:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7253e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718333:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801368a2c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143690.718336:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7253e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718344:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7253e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718351:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143690.718353:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143690.718355:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7253e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718359:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7253e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718375:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd7253ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718379:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd7253ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718383:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd7253ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718386:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801368a3200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143690.718388:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd7253ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718395:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd7253ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718400:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5ab00) 00010000:00010000:2.0:1746143690.718402:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143690.718403:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd7253ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718407:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3200/0xe984082ccd7253ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.718432:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd7253de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13cc expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.718440:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13cc expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.718445:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143690.718446:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143690.718448:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a3000, rc 0) 00000100:00100000:2.0:1746143690.718468:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28343:x1830963592193024:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 16233us (16411us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.718473:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8253 00000100:00100000:1.0:1746143690.719011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.719036:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592193792 00000100:00100000:2.0:1746143690.719040:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592193792 00002000:00100000:2.0:1746143690.719064:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009bfe0000 x1830963592193792/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.719076:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0000 with x1830963592193792 ext(3145728->4194303) 00002000:00010000:2.0:1746143690.719079:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0000 00000100:00100000:2.0:1746143690.719096:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592194176 00000100:00100000:2.0:1746143690.719099:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592194176 00002000:00100000:2.0:1746143690.719111:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880093807800 x1830963592194176/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.719116:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807800 with x1830963592194176 ext(3145728->4194303) 00002000:00010000:2.0:1746143690.719119:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093807800 00000100:00100000:2.0:1746143690.719136:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3457 00000100:00100000:2.0:1746143690.719157:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592193792:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143690.720029:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3458 00000100:00100000:3.0:1746143690.720037:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592194176:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143690.720400:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592194048 00000100:00100000:1.0:1746143690.720403:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592194048 00002000:00100000:1.0:1746143690.720422:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880093806680 x1830963592194048/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.720428:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806680 with x1830963592194048 ext(2097152->3145727) 00002000:00010000:1.0:1746143690.720431:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093806680 00000100:00100000:1.0:1746143690.720443:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3459 00000100:00100000:1.0:1746143690.720448:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1963:x1830963592194048:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143690.721480:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.722136:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.722186:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.722204:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592194432 00000100:00100000:1.0:1746143690.722208:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592194432 00000100:00100000:1.0:1746143690.722233:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592194560 00000100:00100000:1.0:1746143690.722235:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592194560 00000100:00100000:1.0:1746143690.722257:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592194688 00000100:00100000:1.0:1746143690.722259:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592194688 00000100:00100000:1.0:1746143690.722271:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9456 00000100:00100000:1.0:1746143690.722277:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592194432:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143690.722289:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143690.722302:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801369ea600/0xe984082ccd7253fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13d3 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143690.722340:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593712896:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143690.722390:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143690.722404:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9457 00000100:00100000:1.0:1746143690.722409:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592194560:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143690.722416:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143690.722423:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cabce00/0xe984082ccd725401 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13da expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143690.722442:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593713024:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143690.722456:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143690.722508:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9458 00000100:00100000:1.0:1746143690.722512:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592194688:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143690.722517:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143690.722522:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725408 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13e1 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.722531:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.722533:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.722538:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725408 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e1 expref: 29 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.722550:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725408 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e1 expref: 29 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.722558:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cabda00, rc 0) 00000100:00100000:1.0:1746143690.722575:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592194688:12345-192.168.202.48@tcp:101:cat.0 Request processed in 63us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.722580:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9458 00000100:00100000:0.0:1746143690.732701:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.732735:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.732747:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.732757:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.732767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.732784:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592194944 00000100:00100000:0.0:1746143690.732791:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592194944 00000100:00100000:0.0:1746143690.732819:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592195200 00000100:00100000:0.0:1746143690.732821:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592195200 00000100:00100000:0.0:1746143690.732846:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592194816 00000100:00100000:0.0:1746143690.732848:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592194816 00000100:00100000:3.0:1746143690.733327:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592193536:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22204us (22382us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143690.733335:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3456 00002000:00100000:3.0:1746143690.733345:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009bfe1880 x1830963592193536/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.733354:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1880 with x1830963592193536 ext(2097152->3145727) 00002000:00010000:3.0:1746143690.733358:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1880 00000100:00100000:3.0:1746143690.733431:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593712896:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143690.733455:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801369ea600/0xe984082ccd7253fa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13d3 expref: 31 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.733467:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801369ea600/0xe984082ccd7253fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13d3 expref: 31 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.733481:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369ea600, rc 0) 00000100:00100000:3.0:1746143690.733496:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592194432:12345-192.168.202.48@tcp:101:cat.0 Request processed in 11219us (12017us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143690.733501:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9456 00000100:00100000:3.0:1746143690.733519:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592195072 00000100:00100000:3.0:1746143690.733521:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592195072 00000100:00100000:2.0:1746143690.734724:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592195328 00000100:00100000:2.0:1746143690.734731:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592195328 00000100:00100000:2.0:1746143690.734761:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9459 00000100:00100000:2.0:1746143690.734767:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592194944:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143690.734779:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.734793:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801368a3a00/0xe984082ccd72540f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13ef expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143690.734830:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593713152:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143690.734890:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.734908:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9460 00000100:00100000:2.0:1746143690.734913:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592195200:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143690.734921:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.734930:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725416 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13fd expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.734942:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.734944:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.734951:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725416 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13fd expref: 12 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.734962:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725416 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13fd expref: 12 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.734970:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a2000, rc 0) 00000100:00100000:2.0:1746143690.734988:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963592195200:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 74us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.734993:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9460 00000100:00100000:2.0:1746143690.735006:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9461 00000100:00100000:2.0:1746143690.735011:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963592194816:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143690.735016:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.735022:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72541d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13e8 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.735031:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.735032:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.735036:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72541d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e8 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.735045:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72541d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e8 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.735056:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369eb600, rc 0) 00000100:00100000:2.0:1746143690.735071:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963592194816:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 60us (2322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.735075:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9461 00000100:00100000:2.0:1746143690.735085:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9462 00000100:00100000:2.0:1746143690.735089:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592195072:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143690.735094:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.735101:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5200/0xe984082ccd725424 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a13f6 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143690.735121:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593713280:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143690.735157:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.735192:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9463 00000100:00100000:2.0:1746143690.735197:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963592195328:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143690.735203:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.735209:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129dc0000/0xe984082ccd72542b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1404 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.735218:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.735219:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.735224:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129dc0000/0xe984082ccd72542b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1404 expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.735231:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129dc0000/0xe984082ccd72542b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1404 expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.735237:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dc0000, rc 0) 00000100:00100000:2.0:1746143690.735252:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963592195328:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 55us (2482us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.735255:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9463 00000100:00100000:2.0:1746143690.735437:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593713024:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143690.735453:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cabce00/0xe984082ccd725401 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13da expref: 28 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.735462:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cabce00/0xe984082ccd725401 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13da expref: 28 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.735473:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cabce00, rc 0) 00000100:00100000:2.0:1746143690.735493:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592194560:12345-192.168.202.48@tcp:101:cat.0 Request processed in 13083us (13358us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143690.735498:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9457 00000100:00100000:1.0:1746143690.737248:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1963:x1830963592194048:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16794us (18232us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143690.737255:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3459 00002000:00100000:1.0:1746143690.737263:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880093806680 x1830963592194048/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.737271:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806680 with x1830963592194048 ext(2097152->3145727) 00002000:00010000:1.0:1746143690.737276:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093806680 00000100:00100000:0.0:1746143690.767432:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.768086:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592195456 00000100:00100000:1.0:1746143690.768093:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592195456 00000100:00100000:1.0:1746143690.768128:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9464 00000100:00100000:1.0:1746143690.768135:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28344:x1830963592195456:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143690.768176:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143690.768191:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd725432 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a140b expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.768214:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.768221:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143690.768223:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143690.768225:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd725432 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a140b expref: 31 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.768247:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.768256:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 26 pid: 25369 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.768267:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593713408:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143690.768325:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143690.768393:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593713280:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143690.768414:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5200/0xe984082ccd725424 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13f6 expref: 12 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.768424:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5200/0xe984082ccd725424 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13f6 expref: 12 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.768437:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f5200, rc 0) 00000100:00100000:1.0:1746143690.768454:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592195072:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 33364us (35695us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143690.768459:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9462 00000100:00100000:3.0:1746143690.768728:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592194176:12345-192.168.202.48@tcp:3:cat.0 Request processed in 48692us (52704us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143690.768735:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3458 00002000:00100000:3.0:1746143690.768742:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880093807800 x1830963592194176/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.768750:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807800 with x1830963592194176 ext(3145728->4194303) 00002000:00010000:3.0:1746143690.768754:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093807800 00000100:00100000:2.0:1746143690.768835:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593713152:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143690.768850:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801368a3a00/0xe984082ccd72540f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13ef expref: 12 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.768858:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368a3a00/0xe984082ccd72540f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13ef expref: 12 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.768869:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a3a00, rc 0) 00000100:00100000:2.0:1746143690.768893:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592194944:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 34126us (36200us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143690.768899:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9459 00000100:00100000:0.0:1746143690.774227:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.774319:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592195584 00000100:00100000:3.0:1746143690.774327:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592195584 00000100:00100000:3.0:1746143690.774371:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9465 00000100:00100000:3.0:1746143690.774378:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:28341:x1830963592195584:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143690.774393:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.774408:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1412 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.774430:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0700c00/0xe984082ccd72538a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1378 expref: 33 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.774438:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129dc0000/0xe984082ccd72542b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1404 expref: 10 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.774445:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd7253d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13be expref: 24 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.774451:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.774452:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.774455:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3817472->4194303] (req 3817472->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 33 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.774477:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd7253d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13be expref: 24 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.774487:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd7253d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13be expref: 24 pid: 12618 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746143690.774497:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593713536:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.774564:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129dc0000/0xe984082ccd72542b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1404 expref: 10 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.774572:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129dc0000/0xe984082ccd72542b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1404 expref: 10 pid: 9527 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746143690.774579:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593713664:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.774599:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0700c00/0xe984082ccd72538a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1378 expref: 33 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.774606:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0700c00/0xe984082ccd72538a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1378 expref: 33 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.774617:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593713792:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.774630:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.775194:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592193792:12345-192.168.202.48@tcp:3:cat.0 Request processed in 56036us (59197us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143690.775202:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3457 00002000:00100000:2.0:1746143690.775210:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009bfe0000 x1830963592193792/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.775219:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0000 with x1830963592193792 ext(3145728->4194303) 00002000:00010000:2.0:1746143690.775223:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0000 00000100:00100000:1.0:1746143690.776563:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593713408:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143690.776585:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd725432 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a140b expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.776600:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7c7a00, rc 0) 00000100:00100000:1.0:1746143690.776626:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:28344:x1830963592195456:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8490us (9200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.776633:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9464 00000100:00100000:0.0:1746143690.778313:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.801437:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592195968 00000100:00100000:2.0:1746143690.801448:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592195968 00000100:00100000:2.0:1746143690.801509:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8254 00000100:00100000:2.0:1746143690.801516:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28343:x1830963592195968:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143690.801534:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.801549:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc1c00/0xe984082ccd725440 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1419 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.801635:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.801648:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13cc expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.801654:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.801681:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13cc expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.801695:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13cc expref: 10 pid: 21713 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.801706:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593713920:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143690.801800:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.802412:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.802486:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.802501:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.802515:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592196352 00000100:00100000:2.0:1746143690.802518:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592196352 00010000:00010000:2.0:1746143690.802535:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd7253d0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13be expref: 25 pid: 12618 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746143690.802552:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4848 00000100:00100000:2.0:1746143690.802557:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592196352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143690.802564:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143690.802580:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd7253d0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13be expref: 25 pid: 12618 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746143690.802589:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd7253d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13be expref: 25 pid: 12618 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746143690.802605:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143690.802625:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592196352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 68us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.802634:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4848 00000100:00100000:2.0:1746143690.802659:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.802667:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592196224 00000100:00100000:2.0:1746143690.802669:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592196224 00010000:00010000:2.0:1746143690.802678:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129dc0000/0xe984082ccd72542b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1404 expref: 11 pid: 9527 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746143690.802689:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4849 00000100:00100000:2.0:1746143690.802693:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592196224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143690.802698:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143690.802705:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129dc0000/0xe984082ccd72542b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1404 expref: 11 pid: 9527 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746143690.802712:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129dc0000/0xe984082ccd72542b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1404 expref: 11 pid: 9527 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746143690.802721:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143690.802732:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592196224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 38us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.802737:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4849 00000100:00100000:2.0:1746143690.802784:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.802794:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592196480 00000100:00100000:2.0:1746143690.802796:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592196480 00010000:00010000:2.0:1746143690.802806:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0700c00/0xe984082ccd72538a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1378 expref: 33 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.802818:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4850 00000100:00100000:2.0:1746143690.802822:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963592196480:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143690.802828:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143690.802834:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0700c00/0xe984082ccd72538a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1378 expref: 33 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.802841:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0700c00/0xe984082ccd72538a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1378 expref: 33 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.802851:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.802853:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.802858:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 33 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.802865:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 33 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.802895:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 33 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143690.802903:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593714048:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143690.802937:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5480 going to sleep for 11 seconds 00010000:00010000:3.0:1746143690.805358:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd7253d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13be expref: 24 pid: 12618 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746143690.805396:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593713536:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.805410:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129dc0000/0xe984082ccd72542b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1404 expref: 10 pid: 9527 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746143690.805419:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593713664:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.805430:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0700c00/0xe984082ccd72538a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1378 expref: 33 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.805437:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593713792:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.805471:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 32 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.805481:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093212e00, rc 0) 00000100:00100000:3.0:1746143690.805524:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:28341:x1830963592195584:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 31146us (31304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.805531:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9465 00000100:00100000:3.0:1746143690.805552:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592196096 00000100:00100000:3.0:1746143690.805556:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592196096 00000100:00100000:3.0:1746143690.805579:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9466 00000100:00100000:3.0:1746143690.805584:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28336:x1830963592196096:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.805597:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.805606:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72544e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1420 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.805623:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 31 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.805629:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143690.805631:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143690.805634:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72544e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1420 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.805651:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 31 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.805660:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 31 pid: 6929 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.805669:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593714176:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.805711:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.805725:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592195712 00000100:00100000:3.0:1746143690.805728:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592195712 00002000:00100000:3.0:1746143690.805749:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1712128->2097151) req@ffff8800930c0a80 x1830963592195712/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.805757:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0a80 with x1830963592195712 ext(1712128->2097151) 00010000:00010000:3.0:1746143690.805764:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 26 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.805773:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 26 pid: 25369 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746143690.805779:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930c0a80 00000100:00100000:3.0:1746143690.805791:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 830 00000100:00100000:3.0:1746143690.805795:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592195712:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143690.806711:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593714048:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143690.806724:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143690.806743:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592196480:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3920us (3958us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.806750:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4850 00000100:00100000:2.0:1746143690.806838:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.806852:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592196608 00000100:00100000:2.0:1746143690.806855:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592196608 00010000:00010000:2.0:1746143690.806879:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13cc expref: 11 pid: 21713 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.806896:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4851 00000100:00100000:2.0:1746143690.806901:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592196608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143690.806909:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143690.806914:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13cc expref: 11 pid: 21713 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.806922:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13cc expref: 11 pid: 21713 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.806938:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143690.806942:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.806950:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.806955:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143690.806966:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143690.806980:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592196608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 79us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.806985:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4851 00010000:00010000:3.0:1746143690.809794:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd7253f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13cc expref: 10 pid: 21713 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.809812:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593713920:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.809831:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.809838:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.809843:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143690.809863:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143690.810008:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc1c00/0xe984082ccd725440 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1419 expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.810020:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1419 expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.810031:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143690.810033:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143690.810036:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f5200, rc 0) 00000100:00100000:3.0:1746143690.810080:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28343:x1830963592195968:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 8563us (31771us total) trans 8589942352 rc 0/0 00000100:00100000:3.0:1746143690.810087:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8254 00000100:00100000:0.0:1746143690.811084:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.811097:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593714176:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.811119:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72544e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1420 expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.811131:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7bd000, rc 0) 00000100:00100000:3.0:1746143690.811184:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+27:28336:x1830963592196096:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5599us (8697us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.811191:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9466 00000100:00100000:2.0:1746143690.811247:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592196864 00000100:00100000:2.0:1746143690.811253:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592196864 00002000:00100000:2.0:1746143690.811280:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3817472->3821567) req@ffff88009cdc0e00 x1830963592196864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.811288:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0e00 with x1830963592196864 ext(3817472->3821567) 00010000:00010000:2.0:1746143690.811293:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 31 pid: 6929 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.811302:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 31 pid: 6929 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746143690.811308:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc0e00 00000100:00100000:2.0:1746143690.811334:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 831 00000100:00100000:2.0:1746143690.811340:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592196864:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143690.811445:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592196864:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 104us (362us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143690.811450:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 831 00002000:00100000:2.0:1746143690.811455:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3817472->3821567) req@ffff88009cdc0e00 x1830963592196864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/4536 e 0 to 0 dl 1746143701 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.811462:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0e00 with x1830963592196864 ext(3817472->3821567) 00010000:00010000:2.0:1746143690.811466:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 31 pid: 6929 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.811473:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 31 pid: 6929 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746143690.811478:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc0e00 00000100:00100000:0.0:1746143690.814706:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.814791:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592196992 00000100:00100000:3.0:1746143690.814797:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592196992 00000100:00100000:3.0:1746143690.814830:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8255 00000100:00100000:3.0:1746143690.814835:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28343:x1830963592196992:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143690.814854:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.814867:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093213a00/0xe984082ccd72545c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1427 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.814946:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.814958:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1419 expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.814964:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.814986:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1419 expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.814995:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1419 expref: 11 pid: 21713 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.815004:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593714304:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.815081:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.816816:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593714304:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.816833:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:2.0:1746143690.819196:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.819242:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.819299:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592197376 00000100:00100000:1.0:1746143690.819305:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592197376 00002000:00100000:1.0:1746143690.819341:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3817472->4194303) req@ffff88009bef5880 x1830963592197376/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.819350:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef5880 with x1830963592197376 ext(3817472->4194303) 00010000:00010000:1.0:1746143690.819358:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 31 pid: 6929 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.819369:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 31 pid: 6929 timeout: 869 lvb_type: 0 00002000:00010000:1.0:1746143690.819375:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bef5880 00000100:00100000:1.0:1746143690.819392:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 832 00000100:00100000:1.0:1746143690.819398:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592197376:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143690.819774:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592197120 00000100:00100000:1.0:1746143690.819777:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592197120 00010000:00010000:1.0:1746143690.819793:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1419 expref: 12 pid: 21713 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.819810:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4852 00000100:00100000:1.0:1746143690.819815:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592197120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143690.819825:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143690.819832:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1419 expref: 12 pid: 21713 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.819841:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1419 expref: 12 pid: 21713 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.819862:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5200/0xe984082ccd725447 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1419 expref: 12 pid: 21713 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.819889:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143690.819893:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143690.819903:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143690.819910:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143690.819933:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143690.819952:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.819962:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:1.0:1746143690.819964:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592197120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 148us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.819970:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4852 00000004:00200000:3.0:1746143690.820004:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:3.0:1746143690.820010:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143690.820027:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.820073:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093213a00/0xe984082ccd72545c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1427 expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.820100:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1427 expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.820107:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143690.820110:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143690.820123:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093212400, rc 0) 00000100:00100000:3.0:1746143690.820174:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28343:x1830963592196992:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5336us (5471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.820182:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8255 00000100:00100000:3.0:1746143690.821561:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963592195712:12345-192.168.202.48@tcp:4:cat.0 Request processed in 15762us (19147us total) trans 21474839702 rc 0/0 00000100:00100000:3.0:1746143690.821568:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 830 00002000:00100000:3.0:1746143690.821575:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1712128->2097151) req@ffff8800930c0a80 x1830963592195712/t21474839702(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/448 e 0 to 0 dl 1746143701 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.821583:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0a80 with x1830963592195712 ext(1712128->2097151) 00010000:00010000:3.0:1746143690.821590:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 27 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.821599:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 27 pid: 25369 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746143690.821605:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930c0a80 00000100:00100000:0.0:1746143690.825071:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.825180:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592197504 00000100:00100000:3.0:1746143690.825190:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592197504 00000100:00100000:3.0:1746143690.825239:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9467 00000100:00100000:3.0:1746143690.825246:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:28341:x1830963592197504:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143690.825261:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.825275:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a142e expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.825299:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7253d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13c5 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.825307:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725416 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13fd expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.825314:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725408 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e1 expref: 28 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.825320:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.825322:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.825325:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4194304->4513791] (req 4194304->4513791) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.825349:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725408 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e1 expref: 28 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.825359:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725408 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e1 expref: 28 pid: 4581 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746143690.825370:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593714432:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.825456:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725416 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13fd expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.825464:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725416 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13fd expref: 10 pid: 15784 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746143690.825471:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593714560:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.825492:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7253d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13c5 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.825499:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7253d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13c5 expref: 17 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.825506:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593714688:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.825519:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.832676:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.833114:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.833165:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592197760 00000100:00100000:0.0:1746143690.833172:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592197760 00000100:00100000:0.0:1746143690.833204:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592197632 00000100:00100000:0.0:1746143690.833206:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592197632 00000100:00100000:0.0:1746143690.833233:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9468 00000100:00100000:0.0:1746143690.833240:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592197760:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143690.833255:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143690.833269:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e505800/0xe984082ccd725471 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a143c expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143690.833312:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593714816:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143690.833377:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.833400:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.833532:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592197888 00000100:00100000:3.0:1746143690.833536:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592197888 00000100:00100000:3.0:1746143690.833552:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9469 00000100:00100000:3.0:1746143690.833557:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592197632:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143690.833565:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.833573:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd725478 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1435 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.833596:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593714944:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143690.833624:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.833639:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9470 00000100:00100000:3.0:1746143690.833643:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592197888:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143690.833649:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.833655:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd72547f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1443 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.833675:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593715072:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143690.833691:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.833711:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593714432:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143690.833719:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593714560:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143690.837714:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.837731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.837749:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.837836:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593714688:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.837865:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4194304->4513791] (req 4194304->4513791) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.837889:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0701a00, rc 0) 00000100:00100000:3.0:1746143690.837921:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28341:x1830963592197504:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 12675us (12857us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.837928:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9467 00000100:00100000:3.0:1746143690.837965:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592198144 00000100:00100000:3.0:1746143690.837970:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592198144 00010000:00010000:3.0:1746143690.837988:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725416 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13fd expref: 13 pid: 15784 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746143690.838001:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592198016 00000100:00100000:3.0:1746143690.838003:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592198016 00010000:00010000:3.0:1746143690.838010:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725408 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e1 expref: 28 pid: 4581 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746143690.838022:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592198272 00000100:00100000:3.0:1746143690.838024:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592198272 00010000:00010000:3.0:1746143690.838031:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 27 pid: 25369 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.838041:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4853 00000100:00100000:3.0:1746143690.838046:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1963:x1830963592198144:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143690.838055:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143690.838071:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725416 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13fd expref: 13 pid: 15784 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746143690.838079:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725416 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13fd expref: 13 pid: 15784 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746143690.838095:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725416 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13fd expref: 13 pid: 15784 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746143690.838106:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143690.838118:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592198144:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 72us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.838123:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4853 00000100:00100000:3.0:1746143690.838132:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4854 00000100:00100000:3.0:1746143690.838136:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592198016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143690.838164:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143690.838171:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725408 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e1 expref: 28 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746143690.838178:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725408 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e1 expref: 28 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746143690.838186:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725408 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e1 expref: 28 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746143690.838192:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143690.838203:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592198016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 67us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.838208:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4854 00000100:00100000:3.0:1746143690.838216:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4855 00000100:00100000:3.0:1746143690.838219:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592198272:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143690.838224:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143690.838234:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 27 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.838240:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 27 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.838250:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.838252:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.838257:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd725432 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a140b expref: 32 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.838268:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd725432 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a140b expref: 32 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.838287:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd725432 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a140b expref: 32 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.838297:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593715200:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143690.838337:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143690.839551:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963592197376:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 20149us (20305us total) trans 21474839703 rc 0/0 00000100:00100000:1.0:1746143690.839558:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 832 00002000:00100000:1.0:1746143690.839565:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3817472->4194303) req@ffff88009bef5880 x1830963592197376/t21474839703(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/448 e 0 to 0 dl 1746143701 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.839573:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef5880 with x1830963592197376 ext(3817472->4194303) 00010000:00010000:1.0:1746143690.839579:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 33 pid: 6929 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.839588:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 33 pid: 6929 timeout: 869 lvb_type: 0 00002000:00010000:1.0:1746143690.839593:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bef5880 00000100:00100000:0.0:1746143690.840882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143690.840959:0:4581:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff880094c12d80 x1830963593714944) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 27 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.840982:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d53b400/0xe984082ccd725398 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1386 expref: 27 pid: 25369 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.840994:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593714944:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143690.841018:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd725478 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1435 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.841028:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd725478 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1435 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.841034:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cabc600, rc 0) 00000100:00100000:3.0:1746143690.841072:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592197632:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 7512us (7956us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143690.841084:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9469 00000100:00100000:3.0:1746143690.841115:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592198400 00000100:00100000:3.0:1746143690.841121:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592198400 00010000:00010000:3.0:1746143690.841171:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7253d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13c5 expref: 18 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.841195:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4856 00000100:00100000:3.0:1746143690.841203:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592198400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143690.841216:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143690.841232:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7253d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13c5 expref: 18 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.841241:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7253d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13c5 expref: 18 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.841256:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7253d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13c5 expref: 18 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.841267:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.841269:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.841275:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.841283:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.841314:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.841327:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593715328:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143690.841405:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.841479:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593715072:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143690.841496:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd72547f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1443 expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.841506:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091024c00/0xe984082ccd72547f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1443 expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.841514:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091024c00, rc 0) 00000100:00100000:3.0:1746143690.841538:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592197888:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 7892us (8136us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143690.841544:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9470 00000100:00100000:2.0:1746143690.841739:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593714816:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143690.841760:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e505800/0xe984082ccd725471 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a143c expref: 11 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.841769:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e505800/0xe984082ccd725471 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a143c expref: 11 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.843770:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e505800, rc 0) 00000100:00100000:2.0:1746143690.844583:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592197760:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 11337us (11908us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143690.844591:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9468 00000100:00100000:3.0:1746143690.851972:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593715200:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143690.851999:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143690.856910:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963592198272:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 18673us (19143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.856924:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4855 00000100:00100000:0.0:1746143690.858307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.858502:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593715328:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143690.858526:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143690.858572:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592198400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 17368us (17700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.858580:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4856 00000100:00100000:3.0:1746143690.858603:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592198784 00000100:00100000:3.0:1746143690.858610:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592198784 00010000:00010000:3.0:1746143690.858636:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 33 pid: 6929 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.858663:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4857 00000100:00100000:3.0:1746143690.858671:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963592198784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143690.858684:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143690.858706:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 33 pid: 6929 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.858717:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 33 pid: 6929 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.858737:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd725439 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1412 expref: 33 pid: 6929 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.858755:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.858757:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.858764:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72544e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1420 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.858772:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72544e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1420 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.858805:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72544e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1420 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.858823:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593715456:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143690.859084:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.864823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.864864:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.864989:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592198656 00000100:00100000:1.0:1746143690.864997:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592198656 00002000:00100000:1.0:1746143690.865054:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8801305c8a80 x1830963592198656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.865070:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8a80 with x1830963592198656 ext(1048576->2097151) 00002000:00010000:1.0:1746143690.865075:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8a80 00000100:00100000:1.0:1746143690.865098:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3460 00000100:00100000:1.0:1746143690.865105:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963592198656:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143690.865169:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.866707:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592199424 00000100:00100000:3.0:1746143690.866712:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592199424 00000100:00100000:3.0:1746143690.866742:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8256 00000100:00100000:3.0:1746143690.866748:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28343:x1830963592199424:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143690.866760:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.866774:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd725486 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a144a expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.866886:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744600/0xe984082ccd72548d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.866899:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090744600/0xe984082ccd72548d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.866910:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090744600/0xe984082ccd72548d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.866922:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744600/0xe984082ccd72548d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.866927:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090744600/0xe984082ccd72548d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.866933:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090744600/0xe984082ccd72548d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.866937:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090744600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143690.866941:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744600/0xe984082ccd72548d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.866947:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744600/0xe984082ccd72548d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.866956:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143690.866959:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143690.866962:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090744600/0xe984082ccd72548d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.866967:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090744600/0xe984082ccd72548d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143690.866998:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd725486 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a144a expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.867005:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd725486 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a144a expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.867014:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090745400, rc 0) 00000100:00100000:3.0:1746143690.867043:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28343:x1830963592199424:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 294us (2179us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143690.867049:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8256 00000100:00100000:2.0:1746143690.867342:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592199168 00000100:00100000:2.0:1746143690.867347:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592199168 00002000:00100000:2.0:1746143690.867371:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (4509696->4513791) req@ffff8801305c9f80 x1830963592199168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.867381:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9f80 with x1830963592199168 ext(4509696->4513791) 00002000:00010000:2.0:1746143690.867384:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c9f80 00000100:00100000:2.0:1746143690.867408:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3461 00000100:00100000:2.0:1746143690.867413:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592199168:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143690.867512:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592199168:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 98us (2343us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143690.867517:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3461 00002000:00100000:2.0:1746143690.867522:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (4509696->4513791) req@ffff8801305c9f80 x1830963592199168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/4536 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.867528:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9f80 with x1830963592199168 ext(4509696->4513791) 00002000:00010000:2.0:1746143690.867531:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c9f80 00000100:00100000:0.0:1746143690.877489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.877586:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592199680 00000100:00100000:2.0:1746143690.877593:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592199680 00002000:00100000:2.0:1746143690.877630:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8801305ca300 x1830963592199680/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.877639:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305ca300 with x1830963592199680 ext(3145728->4194303) 00002000:00010000:2.0:1746143690.877644:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305ca300 00000100:00100000:2.0:1746143690.877670:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3462 00000100:00100000:2.0:1746143690.877677:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592199680:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143690.880465:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593715456:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143690.880485:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143690.880537:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963592198784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 21866us (22235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.880546:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4857 00000100:00100000:2.0:1746143690.881986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.882324:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592198656:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 17219us (17508us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143690.882334:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3460 00002000:00100000:1.0:1746143690.882343:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8801305c8a80 x1830963592198656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.882352:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8a80 with x1830963592198656 ext(1048576->2097151) 00002000:00010000:1.0:1746143690.882356:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8a80 00000100:00100000:3.0:1746143690.883107:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592199936 00000100:00100000:3.0:1746143690.883113:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592199936 00000100:00100000:3.0:1746143690.883158:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3352 00000100:00100000:3.0:1746143690.883164:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:28341:x1830963592199936:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143690.883348:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:28341:x1830963592199936:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 184us (1364us total) trans 8589942353 rc 0/0 00000100:00100000:3.0:1746143690.883354:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3352 00000100:00100000:2.0:1746143690.903468:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.903852:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592199680:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26173us (26369us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143690.903861:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3462 00002000:00100000:3.0:1746143690.903879:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8801305ca300 x1830963592199680/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.903888:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305ca300 with x1830963592199680 ext(3145728->4194303) 00002000:00010000:3.0:1746143690.903892:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305ca300 00000100:00100000:0.0:1746143690.907984:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592200192 00000100:00100000:0.0:1746143690.907996:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592200192 00000100:00100000:0.0:1746143690.908056:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3353 00000100:00100000:0.0:1746143690.908062:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28343:x1830963592200192:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1746143690.908259:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28343:x1830963592200192:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 196us (4799us total) trans 8589942354 rc 0/0 00000100:00100000:0.0:1746143690.908265:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3353 00000100:00100000:0.0:1746143690.910359:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.910425:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592200320 00000100:00100000:2.0:1746143690.910430:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592200320 00000100:00100000:2.0:1746143690.910464:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9471 00000100:00100000:2.0:1746143690.910469:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28338:x1830963592200320:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143690.910480:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.910493:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1451 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.910513:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd724f85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1133 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.910521:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd725073 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1187 expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.910528:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd72506c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1180 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.910533:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.910534:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.910537:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [749568->1048575] (req 749568->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.910556:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd72506c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1180 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.910564:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd72506c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1180 expref: 18 pid: 9527 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.910572:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593715584:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.910640:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd725073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1187 expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.910647:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd725073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1187 expref: 26 pid: 15784 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.910653:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593715712:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.910669:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd724f85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1133 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.910680:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd724f85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1133 expref: 9 pid: 4581 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746143690.910686:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593715840:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143690.910696:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.911809:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593715584:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143690.911817:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593715712:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143690.911823:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593715840:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.911839:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [749568->1048575] (req 749568->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.911847:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e504c00, rc 0) 00000100:00100000:2.0:1746143690.911867:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28338:x1830963592200320:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1398us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.911883:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9471 00000100:00100000:0.0:1746143690.914801:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.914834:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.914863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.914904:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.914989:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592200704 00000100:00100000:1.0:1746143690.914996:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592200704 00010000:00010000:1.0:1746143690.915026:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd724f85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1133 expref: 10 pid: 4581 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746143690.915056:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592200576 00000100:00100000:1.0:1746143690.915058:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592200576 00010000:00010000:1.0:1746143690.915068:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd72506c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1180 expref: 18 pid: 9527 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.915079:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592200832 00000100:00100000:1.0:1746143690.915081:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592200832 00010000:00010000:1.0:1746143690.915089:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd725073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1187 expref: 27 pid: 15784 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.915101:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4858 00000100:00100000:1.0:1746143690.915106:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592200704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143690.915117:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143690.915135:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd724f85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1133 expref: 10 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746143690.915171:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd724f85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1133 expref: 10 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746143690.915189:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd724f85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1133 expref: 10 pid: 4581 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746143690.915206:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143690.915237:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592200704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 129us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.915242:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4858 00000100:00100000:1.0:1746143690.915266:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4859 00000100:00100000:1.0:1746143690.915270:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592200576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143690.915276:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143690.915282:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd72506c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1180 expref: 18 pid: 9527 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.915290:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd72506c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1180 expref: 18 pid: 9527 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.915300:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd72506c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1180 expref: 18 pid: 9527 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.915307:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143690.915319:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592200576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.915326:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4859 00000100:00100000:1.0:1746143690.915335:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4860 00000100:00100000:1.0:1746143690.915338:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592200832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143690.915343:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143690.915349:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd725073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1187 expref: 27 pid: 15784 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.915356:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd725073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1187 expref: 27 pid: 15784 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.915365:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd725073 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1187 expref: 27 pid: 15784 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.915372:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.915374:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.915379:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.915385:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.915412:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143690.915422:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593715968:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143690.915467:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.915716:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592200448 00000100:00100000:2.0:1746143690.915720:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592200448 00000100:00100000:2.0:1746143690.915749:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9472 00000100:00100000:2.0:1746143690.915755:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:28344:x1830963592200448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143690.915766:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.915777:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e505400/0xe984082ccd72549b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1458 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.915795:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.915801:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143690.915802:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143690.915804:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e505400/0xe984082ccd72549b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1458 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.915818:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.915826:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 16 pid: 25369 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.915834:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593716096:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143690.915857:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.923315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.923353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.923381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.923399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.923521:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592200960 00000100:00100000:3.0:1746143690.923529:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592200960 00000100:00100000:3.0:1746143690.923559:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592201216 00000100:00100000:3.0:1746143690.923560:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592201216 00000100:00100000:3.0:1746143690.923568:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592201088 00000100:00100000:3.0:1746143690.923569:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592201088 00000100:00100000:3.0:1746143690.923585:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9473 00000100:00100000:3.0:1746143690.923591:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592200960:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.923606:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.923618:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd7254a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a145f expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.923658:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593716224:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143690.923717:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21576c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.923732:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9474 00000100:00100000:3.0:1746143690.923736:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592201216:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.923741:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.923746:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5600/0xe984082ccd7254a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a146d expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.923763:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593716352:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143690.923778:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.923787:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9475 00000100:00100000:3.0:1746143690.923793:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963592201088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.923799:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.923808:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd7254b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1466 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.923817:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.923819:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.923825:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd7254b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1466 expref: 27 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.923837:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd7254b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1466 expref: 27 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.923845:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cabc600, rc 0) 00000100:00100000:3.0:1746143690.923862:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592201088:12345-192.168.202.48@tcp:101:cat.0 Request processed in 69us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.923882:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9475 00000100:00100000:3.0:1746143690.923901:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592201472 00000100:00100000:3.0:1746143690.923904:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592201472 00002000:00100000:3.0:1746143690.923922:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34c:0x0] (749568->753663) req@ffff88008f1ec000 x1830963592201472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.923929:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ec000 with x1830963592201472 ext(749568->753663) 00002000:00010000:3.0:1746143690.923932:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ec000 00000100:00100000:3.0:1746143690.923947:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3463 00000100:00100000:3.0:1746143690.923952:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592201472:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143690.924071:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592201472:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 118us (671us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143690.924076:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3463 00002000:00100000:3.0:1746143690.924081:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34c:0x0] (749568->753663) req@ffff88008f1ec000 x1830963592201472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/4536 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.924087:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ec000 with x1830963592201472 ext(749568->753663) 00002000:00010000:3.0:1746143690.924090:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ec000 00000100:00100000:3.0:1746143690.924160:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593716096:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.924176:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e505400/0xe984082ccd72549b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1458 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.924184:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e505400, rc 0) 00000100:00100000:3.0:1746143690.924199:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28344:x1830963592200448:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8445us (9336us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.924207:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9472 00000100:00100000:1.0:1746143690.924415:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593715968:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143690.924425:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143690.924454:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592200832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9114us (9548us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.924462:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4860 00000100:00100000:0.0:1746143690.926014:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143690.926089:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592201600 00000100:00100000:3.0:1746143690.926094:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592201600 00002000:00100000:3.0:1746143690.926115:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1507327) req@ffff88008f1ef800 x1830963592201600/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.926122:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef800 with x1830963592201600 ext(1048576->1507327) 00010000:00010000:3.0:1746143690.926128:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 21 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.926160:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 21 pid: 25369 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746143690.926165:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f1ef800 00000100:00100000:3.0:1746143690.926179:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 833 00000100:00100000:3.0:1746143690.926184:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592201600:12345-192.168.202.48@tcp:4:multiop.0 00002000:00010000:3.0:1746143690.931026:0:8496:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime: 1746143688 -> 1746143690 00002000:00010000:3.0:1746143690.931032:0:8496:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime: 1746143688 -> 1746143690 00002000:00010000:3.0:1746143690.931034:0:8496:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime: 1746143688 -> 1746143690 00000100:00100000:3.0:1746143690.931054:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593716224:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143690.931083:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd7254a2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a145f expref: 22 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.931097:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090744c00/0xe984082ccd7254a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a145f expref: 22 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.931115:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744c00, rc 0) 00000100:00100000:3.0:1746143690.931187:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592200960:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7594us (7880us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143690.931194:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9473 00000100:00100000:3.0:1746143690.931236:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593716352:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143690.931248:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5600/0xe984082ccd7254a9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a146d expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.931257:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5600/0xe984082ccd7254a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a146d expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.931264:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e5600, rc 0) 00000100:00100000:3.0:1746143690.931280:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592201216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7543us (7926us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143690.931285:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9474 00000100:00100000:0.0:1746143690.940509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.940548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.940605:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592201728 00000100:00100000:2.0:1746143690.940614:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592201728 00000100:00100000:2.0:1746143690.940651:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592201856 00000100:00100000:2.0:1746143690.940653:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592201856 00000100:00100000:2.0:1746143690.940666:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9476 00000100:00100000:2.0:1746143690.940671:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+27:28338:x1830963592201728:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143690.940686:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.940699:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a147b expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.940726:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd72530c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a131d expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.940733:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72541d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e8 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.940739:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6000/0xe984082ccd725321 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a132b expref: 31 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.940744:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.940745:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.940748:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [1048576->1798143] (req 1048576->1798143) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.940771:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6000/0xe984082ccd725321 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a132b expref: 31 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.940779:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6000/0xe984082ccd725321 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a132b expref: 31 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.940788:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593716480:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.940861:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72541d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e8 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.940876:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72541d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e8 expref: 9 pid: 15784 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746143690.940884:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593716608:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.940905:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd72530c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a131d expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.940912:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd72530c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a131d expref: 28 pid: 4581 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.940917:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593716736:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143690.940927:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143690.940942:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9477 00000100:00100000:2.0:1746143690.940946:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28336:x1830963592201856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143690.940952:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.940959:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7254be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1474 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.940970:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.940975:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143690.940976:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143690.940978:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7254be lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1474 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.940990:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.940996:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 26 pid: 6929 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.941002:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593716864:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143690.941015:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.943656:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592201600:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 17464us (17637us total) trans 17179872434 rc 0/0 00000100:00100000:3.0:1746143690.943666:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 833 00002000:00100000:3.0:1746143690.943676:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1507327) req@ffff88008f1ef800 x1830963592201600/t17179872434(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/448 e 0 to 0 dl 1746143701 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.943685:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef800 with x1830963592201600 ext(1048576->1507327) 00010000:00010000:3.0:1746143690.943694:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 21 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.943708:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 21 pid: 25369 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746143690.943714:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f1ef800 00000100:00100000:0.0:1746143690.944319:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.944342:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.944356:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.944370:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592202368 00000100:00100000:0.0:1746143690.944375:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592202368 00010000:00010000:0.0:1746143690.944397:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd72530c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a131d expref: 29 pid: 4581 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746143690.944411:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592202112 00000100:00100000:0.0:1746143690.944413:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592202112 00010000:00010000:0.0:1746143690.944419:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72541d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e8 expref: 10 pid: 15784 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746143690.944427:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592201984 00000100:00100000:0.0:1746143690.944429:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592201984 00010000:00010000:0.0:1746143690.944436:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 21 pid: 25369 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746143690.944445:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4861 00000100:00100000:0.0:1746143690.944450:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1962:x1830963592202368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143690.944459:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143690.944475:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd72530c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a131d expref: 29 pid: 4581 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746143690.944483:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd72530c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a131d expref: 29 pid: 4581 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746143690.944501:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143690.944528:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1962:x1830963592202368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143690.944532:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4861 00000100:00100000:0.0:1746143690.944542:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4862 00000100:00100000:0.0:1746143690.944545:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592202112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143690.944550:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143690.944555:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72541d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e8 expref: 10 pid: 15784 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746143690.944565:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72541d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e8 expref: 10 pid: 15784 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746143690.944573:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143690.944582:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592202112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 36us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143690.944585:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4862 00000100:00100000:0.0:1746143690.944591:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4863 00000100:00100000:0.0:1746143690.944595:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592201984:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143690.944599:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143690.944608:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 21 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746143690.944614:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 21 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746143690.944623:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd7253a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1507327) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1394 expref: 21 pid: 25369 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746143690.944633:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143690.944635:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143690.944641:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e505400/0xe984082ccd72549b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1458 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143690.944648:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e505400/0xe984082ccd72549b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1458 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143690.944673:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e505400/0xe984082ccd72549b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1458 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143690.944682:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ad880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593716992:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143690.944728:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.944764:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.944933:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593716480:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.944944:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72541d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a13e8 expref: 9 pid: 15784 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746143690.944957:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593716608:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.944967:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd72530c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a131d expref: 28 pid: 4581 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.944976:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593716736:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143690.944997:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->1798143] (req 1048576->1798143) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.945005:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e505a00, rc 0) 00000100:00100000:2.0:1746143690.945029:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+27:28338:x1830963592201728:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4356us (4526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.945034:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9476 00000100:00100000:3.0:1746143690.945194:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593716864:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143690.945205:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7254be lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1474 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.945214:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e504800, rc 0) 00000100:00100000:3.0:1746143690.945276:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28336:x1830963592201856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4329us (4727us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.945281:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9477 00000100:00100000:3.0:1746143690.945298:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592202240 00000100:00100000:3.0:1746143690.945300:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592202240 00002000:00100000:3.0:1746143690.945318:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4513791) req@ffff8800a5d81500 x1830963592202240/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143690.945325:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81500 with x1830963592202240 ext(4194304->4513791) 00010000:00010000:3.0:1746143690.945329:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 27 pid: 6929 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746143690.945337:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 27 pid: 6929 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746143690.945342:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d81500 00000100:00100000:3.0:1746143690.945352:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 834 00000100:00100000:3.0:1746143690.945357:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592202240:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143690.949105:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.949389:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ad880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593716992:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143690.949406:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143690.949440:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592201984:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4844us (5082us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.949449:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4863 00000100:00100000:1.0:1746143690.949472:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592202496 00000100:00100000:1.0:1746143690.949477:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592202496 00010000:00010000:1.0:1746143690.949499:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6000/0xe984082ccd725321 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a132b expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746143690.949513:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4864 00000100:00100000:1.0:1746143690.949518:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592202496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143690.949527:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143690.949546:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6000/0xe984082ccd725321 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a132b expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.949554:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6000/0xe984082ccd725321 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a132b expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.949573:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c6000/0xe984082ccd725321 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a132b expref: 32 pid: 8495 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746143690.949591:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.949593:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.949599:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.949606:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.949630:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143690.949638:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593717120:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143690.949679:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143690.953992:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593717120:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143690.954013:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143690.954052:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592202496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4531us (4951us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.954061:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4864 00000100:00100000:2.0:1746143690.958800:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592202240:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 13433us (14025us total) trans 17179872435 rc 0/0 00000100:00100000:2.0:1746143690.958815:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 834 00002000:00100000:2.0:1746143690.958826:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4513791) req@ffff8800a5d81500 x1830963592202240/t17179872435(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/448 e 0 to 0 dl 1746143701 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.958834:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81500 with x1830963592202240 ext(4194304->4513791) 00010000:00010000:2.0:1746143690.958843:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 29 pid: 6929 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.958857:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 29 pid: 6929 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746143690.958862:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d81500 00000100:00100000:0.0:1746143690.959512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.959605:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592202752 00000100:00100000:2.0:1746143690.959611:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592202752 00002000:00100000:2.0:1746143690.959641:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff8800a5d80380 x1830963592202752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.959648:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80380 with x1830963592202752 ext(1048576->2097151) 00002000:00010000:2.0:1746143690.959651:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80380 00000100:00100000:2.0:1746143690.959665:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3464 00000100:00100000:2.0:1746143690.959672:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592202752:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143690.960834:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.960902:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592203008 00000100:00100000:1.0:1746143690.960906:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592203008 00002000:00100000:1.0:1746143690.960926:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1794048->1798143) req@ffff8800908f2a00 x1830963592203008/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.960933:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f2a00 with x1830963592203008 ext(1794048->1798143) 00002000:00010000:1.0:1746143690.960937:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f2a00 00000100:00100000:1.0:1746143690.960948:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3465 00000100:00100000:1.0:1746143690.960954:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592203008:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143690.961066:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592203008:12345-192.168.202.48@tcp:3:cat.0 Request processed in 111us (234us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143690.961071:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3465 00002000:00100000:1.0:1746143690.961075:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1794048->1798143) req@ffff8800908f2a00 x1830963592203008/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/4536 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143690.961081:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f2a00 with x1830963592203008 ext(1794048->1798143) 00002000:00010000:1.0:1746143690.961084:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f2a00 00000100:00100000:1.0:1746143690.964391:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.964500:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.964566:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592203136 00000100:00100000:2.0:1746143690.964574:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592203136 00010000:00010000:2.0:1746143690.964608:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 31 pid: 6929 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746143690.964746:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4865 00000100:00100000:2.0:1746143690.964753:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592203136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143690.964761:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592203392 00010000:00010000:2.0:1746143690.964764:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143690.964765:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592203392 00010000:00010000:2.0:1746143690.964784:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 31 pid: 6929 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.964795:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 31 pid: 6929 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746143690.964796:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3354 00000100:00100000:3.0:1746143690.964801:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28338:x1830963592203392:12345-192.168.202.48@tcp:35:multiop.0 00010000:00010000:2.0:1746143690.964813:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0701a00/0xe984082ccd72546a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a142e expref: 31 pid: 6929 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746143690.964945:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.964947:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143690.964953:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7254be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1474 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.964961:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7254be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1474 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143690.964989:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7254be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1474 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143690.964999:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593717248:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143690.965233:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.965394:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28338:x1830963592203392:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 591us (893us total) trans 8589942355 rc 0/0 00000100:00100000:3.0:1746143690.965400:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3354 00000100:00100000:2.0:1746143690.968483:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593717248:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143690.968501:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143690.968535:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592203136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3782us (4150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143690.968544:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4865 00000100:00100000:2.0:1746143690.969822:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592202752:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 10146us (10306us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143690.969831:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3464 00002000:00100000:2.0:1746143690.969841:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff8800a5d80380 x1830963592202752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.969850:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80380 with x1830963592202752 ext(1048576->2097151) 00002000:00010000:2.0:1746143690.969855:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80380 00000100:00100000:0.0:1746143690.972287:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.972480:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592203648 00000100:00100000:2.0:1746143690.972488:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592203648 00002000:00100000:2.0:1746143690.972525:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800908f3100 x1830963592203648/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/0 e 0 to 0 dl 1746143701 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143690.972534:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f3100 with x1830963592203648 ext(4194304->4898815) 00002000:00010000:2.0:1746143690.972539:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800908f3100 00000100:00100000:2.0:1746143690.972561:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3466 00000100:00100000:2.0:1746143690.972569:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592203648:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143690.979124:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.979200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143690.979568:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592203776 00000100:00100000:2.0:1746143690.979577:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592203776 00000100:00100000:2.0:1746143690.979610:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592203904 00000100:00100000:2.0:1746143690.979612:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592203904 00000100:00100000:2.0:1746143690.979635:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9478 00000100:00100000:2.0:1746143690.979642:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592203776:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143690.979658:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143690.979674:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b36600/0xe984082ccd7254c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1482 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143690.979718:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593717376:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143690.979782:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143690.979852:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9479 00000100:00100000:3.0:1746143690.979859:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592203904:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.979868:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.979887:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090650a00/0xe984082ccd7254cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1489 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143690.979910:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593717504:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143690.979933:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143690.981770:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592203648:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9197us (9484us total) trans 0 rc 704512/704512 00000100:00100000:0.0:1746143690.981778:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3466 00002000:00100000:0.0:1746143690.981786:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800908f3100 x1830963592203648/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:86/0 lens 488/440 e 0 to 0 dl 1746143701 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143690.981794:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f3100 with x1830963592203648 ext(4194304->4898815) 00002000:00010000:0.0:1746143690.981798:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800908f3100 00000100:00100000:0.0:1746143690.982454:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143690.982481:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143690.982844:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592204032 00000100:00100000:1.0:1746143690.982850:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592204032 00000100:00100000:1.0:1746143690.982900:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592204160 00000100:00100000:1.0:1746143690.982902:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592204160 00000100:00100000:1.0:1746143690.982915:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9480 00000100:00100000:1.0:1746143690.982921:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592204032:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143690.982932:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143690.982944:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942ce200/0xe984082ccd7254d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1490 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143690.982959:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.982961:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143690.982967:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942ce200/0xe984082ccd7254d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1490 expref: 31 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.982979:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942ce200/0xe984082ccd7254d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1490 expref: 31 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143690.982992:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942ce200, rc 0) 00000100:00100000:3.0:1746143690.983062:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9481 00000100:00100000:3.0:1746143690.983068:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963592204160:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143690.983074:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143690.983083:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090651200/0xe984082ccd7254da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1497 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143690.983095:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.983509:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143690.983516:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090651200/0xe984082ccd7254da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1497 expref: 34 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143690.983559:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592204032:12345-192.168.202.48@tcp:101:cat.0 Request processed in 638us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143690.983564:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9480 00010000:00010000:3.0:1746143690.983984:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090651200/0xe984082ccd7254da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1497 expref: 34 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.983992:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090651200, rc 0) 00000100:00100000:3.0:1746143690.984014:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592204160:12345-192.168.202.48@tcp:101:cat.0 Request processed in 947us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143690.984018:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9481 00000100:00100000:2.0:1746143690.985449:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593717376:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143690.985473:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b36600/0xe984082ccd7254c5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1482 expref: 30 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.985483:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b36600/0xe984082ccd7254c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1482 expref: 30 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143690.985495:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b36600, rc 0) 00000100:00100000:2.0:1746143690.985531:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592203776:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5888us (6414us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143690.985537:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9478 00002000:00010000:3.0:1746143690.987471:0:4581:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime: 1746143689 -> 1746143690 00002000:00010000:3.0:1746143690.987476:0:4581:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143689 -> 1746143690 00002000:00010000:3.0:1746143690.987478:0:4581:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime: 1746143689 -> 1746143690 00000100:00100000:3.0:1746143690.987493:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593717504:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143690.987515:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090650a00/0xe984082ccd7254cc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1489 expref: 33 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.987524:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090650a00/0xe984082ccd7254cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1489 expref: 33 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143690.987587:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090650a00, rc 0) 00000100:00100000:3.0:1746143690.987751:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592203904:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7891us (8549us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143690.987759:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9479 00000100:00100000:0.0:1746143690.997883:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.000318:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592204288 00000100:00100000:3.0:1746143691.000331:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592204288 00000100:00100000:3.0:1746143691.000403:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9482 00000100:00100000:3.0:1746143691.000413:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592204288:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.000429:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.000445:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090650e00/0xe984082ccd7254e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a149e expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.000465:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143691.000467:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143691.000474:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090650e00/0xe984082ccd7254e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a149e expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.000490:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090650e00/0xe984082ccd7254e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a149e expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.000500:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090650e00, rc 0) 00000100:00100000:3.0:1746143691.000560:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592204288:12345-192.168.202.48@tcp:101:cat.0 Request processed in 149us (2697us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.000566:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9482 00000100:00080000:0.0:1746143691.000886:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143691.003663:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.003758:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592204544 00000100:00100000:2.0:1746143691.003765:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592204544 00002000:00100000:2.0:1746143691.003808:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880131e9df80 x1830963592204544/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.003817:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9df80 with x1830963592204544 ext(2097152->3145727) 00002000:00010000:2.0:1746143691.003822:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9df80 00000100:00100000:2.0:1746143691.003850:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3467 00000100:00100000:2.0:1746143691.003857:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592204544:12345-192.168.202.48@tcp:3:cat.0 00000100:00080000:0.0:1746143691.005121:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143691.008017:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.008063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.009022:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592204800 00000100:00100000:1.0:1746143691.009031:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592204800 00002000:00100000:1.0:1746143691.009070:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880131e9f800 x1830963592204800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.009080:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9f800 with x1830963592204800 ext(3145728->4194303) 00002000:00010000:1.0:1746143691.009084:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9f800 00000100:00100000:1.0:1746143691.009116:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592205056 00000100:00100000:1.0:1746143691.009118:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592205056 00002000:00100000:1.0:1746143691.009137:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880131e9ca80 x1830963592205056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.009166:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9ca80 with x1830963592205056 ext(2097152->3145727) 00002000:00010000:1.0:1746143691.009169:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9ca80 00000100:00100000:1.0:1746143691.009180:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3468 00000100:00100000:1.0:1746143691.009187:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963592204800:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143691.010725:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3469 00000100:00100000:0.0:1746143691.010735:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592205056:12345-192.168.202.48@tcp:3:cat.0 00000100:00080000:3.0:1746143691.011157:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143691.012307:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.012776:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592205312 00000100:00100000:2.0:1746143691.012784:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592205312 00002000:00100000:2.0:1746143691.012820:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880131e9dc00 x1830963592205312/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.012828:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9dc00 with x1830963592205312 ext(3145728->4194303) 00002000:00010000:2.0:1746143691.012834:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9dc00 00000100:00100000:2.0:1746143691.012876:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3470 00000100:00100000:2.0:1746143691.012883:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963592205312:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143691.023050:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592204544:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19185us (19386us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143691.023061:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3467 00002000:00100000:2.0:1746143691.023071:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880131e9df80 x1830963592204544/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.023081:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9df80 with x1830963592204544 ext(2097152->3145727) 00002000:00010000:2.0:1746143691.023086:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9df80 00000100:00100000:1.0:1746143691.031242:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592204800:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22047us (23227us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143691.031252:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3468 00002000:00100000:1.0:1746143691.031262:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880131e9f800 x1830963592204800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.031277:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9f800 with x1830963592204800 ext(3145728->4194303) 00002000:00010000:1.0:1746143691.031282:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e9f800 00000100:00100000:2.0:1746143691.037070:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963592205312:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24179us (24758us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143691.037079:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3470 00002000:00100000:2.0:1746143691.037088:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880131e9dc00 x1830963592205312/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.037097:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9dc00 with x1830963592205312 ext(3145728->4194303) 00002000:00010000:2.0:1746143691.037102:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9dc00 00000100:00100000:3.0:1746143691.044512:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592205056:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33770us (36440us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143691.044522:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3469 00002000:00100000:3.0:1746143691.044532:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880131e9ca80 x1830963592205056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.044540:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e9ca80 with x1830963592205056 ext(2097152->3145727) 00002000:00010000:3.0:1746143691.044546:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e9ca80 00000100:00100000:2.0:1746143691.055405:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.055590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.055800:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.055896:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592205696 00000100:00100000:1.0:1746143691.055904:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592205696 00000100:00100000:1.0:1746143691.055946:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8257 00000100:00100000:1.0:1746143691.055954:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:28351:x1830963592205696:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143691.055975:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143691.055990:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510c00/0xe984082ccd7254e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a14ac expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.056077:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143691.056091:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1427 expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.056098:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143691.056127:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1427 expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.056158:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1427 expref: 10 pid: 21713 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746143691.056170:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593717632:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143691.056238:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143691.056636:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592205440 00000100:00100000:3.0:1746143691.056641:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592205440 00000100:00100000:3.0:1746143691.056728:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592205824 00000100:00100000:3.0:1746143691.056730:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592205824 00000100:00100000:3.0:1746143691.056753:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9483 00000100:00100000:3.0:1746143691.056758:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592205440:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.056766:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.056776:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090651800/0xe984082ccd7254f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a14a5 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143691.056803:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593717760:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143691.056950:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9484 00000100:00100000:0.0:1746143691.056957:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592205824:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143691.056965:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143691.056974:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e91c00/0xe984082ccd7254fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a14b3 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143691.056998:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593717888:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143691.057040:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.057075:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.059974:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593717888:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143691.060004:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e91c00/0xe984082ccd7254fd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14b3 expref: 33 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143691.060019:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e91c00/0xe984082ccd7254fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14b3 expref: 33 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143691.060127:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593717760:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143691.060164:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090651800/0xe984082ccd7254f6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14a5 expref: 30 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.060171:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090651800/0xe984082ccd7254f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14a5 expref: 30 pid: 25369 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143691.060429:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593717632:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143691.060449:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143691.060493:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090651800, rc 0) 00000100:00100000:3.0:1746143691.060539:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592205440:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3780us (5141us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143691.060546:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9483 00000100:00100000:1.0:1746143691.060660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143691.060812:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91c00, rc 0) 00000100:00100000:0.0:1746143691.060838:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592205824:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3881us (5247us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143691.060847:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9484 00000100:00100000:3.0:1746143691.061172:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592205952 00000100:00100000:3.0:1746143691.061178:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592205952 00010000:00010000:3.0:1746143691.061199:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1427 expref: 11 pid: 21713 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746143691.061223:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4866 00000100:00100000:3.0:1746143691.061230:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592205952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143691.061242:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143691.061246:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1427 expref: 11 pid: 21713 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746143691.061255:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1427 expref: 11 pid: 21713 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746143691.061273:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093212400/0xe984082ccd725463 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1427 expref: 11 pid: 21713 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746143691.061291:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143691.061295:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143691.061303:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143691.061308:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143691.061322:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143691.061340:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592205952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 110us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.061346:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4866 00010000:00010000:1.0:1746143691.061659:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143691.061666:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143691.061685:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143691.061839:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510c00/0xe984082ccd7254e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14ac expref: 258 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.061887:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14ac expref: 257 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.061893:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143691.061896:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143691.061898:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d510e00, rc 0) 00000100:00100000:1.0:1746143691.061936:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:28351:x1830963592205696:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5982us (6136us total) trans 8589942356 rc 0/0 00000100:00100000:1.0:1746143691.061942:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8257 00000100:00100000:0.0:1746143691.073986:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.074081:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592206208 00000100:00100000:3.0:1746143691.074089:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592206208 00002000:00100000:3.0:1746143691.074125:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009b852d80 x1830963592206208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.074169:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b852d80 with x1830963592206208 ext(4194304->4898815) 00002000:00010000:3.0:1746143691.074174:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b852d80 00000100:00100000:3.0:1746143691.074250:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3471 00000100:00100000:3.0:1746143691.074257:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592206208:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143691.084584:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592206208:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10319us (10597us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143691.084595:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3471 00002000:00100000:3.0:1746143691.084606:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009b852d80 x1830963592206208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.084615:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b852d80 with x1830963592206208 ext(4194304->4898815) 00002000:00010000:3.0:1746143691.084621:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b852d80 00000100:00100000:0.0:1746143691.091966:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.092106:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592206464 00000100:00100000:2.0:1746143691.092116:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592206464 00000100:00100000:2.0:1746143691.092214:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9485 00000100:00100000:2.0:1746143691.092224:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592206464:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143691.092243:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143691.092260:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093b36a00/0xe984082ccd72550b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a14c1 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143691.092313:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593718016:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143691.093105:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.093448:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592206336 00000100:00100000:2.0:1746143691.093513:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592206336 00000100:00100000:2.0:1746143691.094195:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9486 00000100:00100000:2.0:1746143691.094201:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592206336:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143691.094213:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143691.094223:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b37800/0xe984082ccd725512 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a14ba expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143691.094257:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593718144:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143691.094401:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143691.094776:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143691.096076:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593718016:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143691.096103:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093b36a00/0xe984082ccd72550b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14c1 expref: 33 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.096121:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b36a00/0xe984082ccd72550b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14c1 expref: 33 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143691.096200:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593718144:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143691.096216:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b37800/0xe984082ccd725512 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14ba expref: 30 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.096224:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b37800/0xe984082ccd725512 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14ba expref: 30 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.096347:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b37800, rc 0) 00000100:00100000:3.0:1746143691.096377:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592206336:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2176us (3275us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143691.096384:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9486 00010000:00010000:2.0:1746143691.096681:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b36a00, rc 0) 00000100:00100000:2.0:1746143691.096707:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592206464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4485us (4750us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143691.096712:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9485 00000100:00100000:0.0:1746143691.098675:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.098715:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.098852:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592206720 00000100:00100000:2.0:1746143691.098852:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592206592 00000100:00100000:3.0:1746143691.098859:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592206720 00000100:00100000:2.0:1746143691.098859:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592206592 00000100:00100000:3.0:1746143691.098957:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9487 00000100:00100000:2.0:1746143691.098962:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9488 00000100:00100000:3.0:1746143691.098964:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592206720:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143691.098967:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592206592:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.098978:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143691.098978:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.098990:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090650c00/0xe984082ccd725520 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a14cf expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.098990:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b37200/0xe984082ccd725519 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a14c8 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143691.099028:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593718272:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143691.099028:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593718400:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143691.099092:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143691.099510:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143691.100972:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593718272:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143691.100997:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090650c00/0xe984082ccd725520 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14cf expref: 33 pid: 25369 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143691.101009:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593718400:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143691.101010:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090650c00/0xe984082ccd725520 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14cf expref: 33 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.101020:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090650c00, rc 0) 00010000:00010000:2.0:1746143691.101031:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b37200/0xe984082ccd725519 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14c8 expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.101041:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b37200/0xe984082ccd725519 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14c8 expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.101050:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b37200, rc 0) 00000100:00100000:3.0:1746143691.101064:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592206720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2099us (2346us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143691.101070:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9487 00000100:00100000:2.0:1746143691.101079:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592206592:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2110us (2407us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143691.101086:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9488 00000100:00100000:0.0:1746143691.157944:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.157985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.158307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.158467:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592207104 00000100:00100000:3.0:1746143691.158475:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592207104 00002000:00100000:3.0:1746143691.158512:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->749567) req@ffff880094760e00 x1830963592207104/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.158521:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760e00 with x1830963592207104 ext(0->749567) 00002000:00010000:3.0:1746143691.158525:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094760e00 00000100:00100000:3.0:1746143691.158581:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592207232 00000100:00100000:3.0:1746143691.158584:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592207232 00000100:00100000:1.0:1746143691.158594:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592207616 00000100:00100000:1.0:1746143691.158597:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592207616 00000100:00080000:3.0:1746143691.158602:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1746143691.158612:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1798144->2097151) req@ffff880094762300 x1830963592207232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.158612:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094760700 x1830963592207616/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.158619:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094762300 with x1830963592207232 ext(1798144->2097151) 00002000:00100000:1.0:1746143691.158619:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760700 with x1830963592207616 ext(1048576->2097151) 00002000:00010000:3.0:1746143691.158622:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094762300 00002000:00010000:1.0:1746143691.158622:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094760700 00000100:00100000:3.0:1746143691.158641:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3472 00000100:00100000:3.0:1746143691.158648:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592207104:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143691.158648:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3473 00000100:00100000:1.0:1746143691.158652:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963592207232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143691.159077:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3474 00000100:00100000:1.0:1746143691.159082:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592207616:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143691.159622:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.160225:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592207744 00000100:00100000:1.0:1746143691.160229:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592207744 00002000:00100000:1.0:1746143691.160250:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880094c12a00 x1830963592207744/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.160258:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12a00 with x1830963592207744 ext(1048576->2097151) 00002000:00010000:1.0:1746143691.160261:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c12a00 00000100:00100000:1.0:1746143691.160279:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3475 00000100:00100000:1.0:1746143691.160284:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1964:x1830963592207744:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143691.170614:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1965:x1830963592207232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11953us (12621us total) trans 0 rc 299008/299008 00000100:00100000:1.0:1746143691.170623:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3473 00002000:00100000:1.0:1746143691.170632:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1798144->2097151) req@ffff880094762300 x1830963592207232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 299008/299008 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.170641:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094762300 with x1830963592207232 ext(1798144->2097151) 00002000:00010000:1.0:1746143691.170646:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094762300 00000100:00100000:3.0:1746143691.176834:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592207104:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18178us (18891us total) trans 0 rc 749568/749568 00000100:00100000:3.0:1746143691.176845:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3472 00002000:00100000:3.0:1746143691.176855:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->749567) req@ffff880094760e00 x1830963592207104/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 749568/749568 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.176864:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760e00 with x1830963592207104 ext(0->749567) 00002000:00010000:3.0:1746143691.176877:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094760e00 00000100:00100000:1.0:1746143691.199541:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592207616:12345-192.168.202.48@tcp:3:cat.0 Request processed in 40450us (41226us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143691.199552:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3474 00002000:00100000:1.0:1746143691.199563:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094760700 x1830963592207616/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.199572:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760700 with x1830963592207616 ext(1048576->2097151) 00002000:00010000:1.0:1746143691.199577:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094760700 00000100:00100000:1.0:1746143691.206406:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592207744:12345-192.168.202.48@tcp:3:cat.0 Request processed in 46113us (46776us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143691.206416:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3475 00002000:00100000:1.0:1746143691.206426:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880094c12a00 x1830963592207744/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.206436:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12a00 with x1830963592207744 ext(1048576->2097151) 00002000:00010000:1.0:1746143691.206442:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c12a00 00000100:00100000:0.0:1746143691.230646:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.231696:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592208000 00000100:00100000:1.0:1746143691.231705:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592208000 00000100:00100000:1.0:1746143691.231763:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8258 00000100:00100000:1.0:1746143691.231771:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28357:x1830963592208000:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143691.231792:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143691.231807:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510000/0xe984082ccd725527 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a14d6 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.231895:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510400/0xe984082ccd72552e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143691.231907:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510400/0xe984082ccd72552e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143691.231917:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510400/0xe984082ccd72552e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143691.231930:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143691.232025:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510000/0xe984082ccd725527 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14d6 expref: 25 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.232072:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510400/0xe984082ccd72552e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14d6 expref: 24 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.232079:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143691.232082:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143691.232085:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d510400, rc 0) 00000100:00100000:1.0:1746143691.232126:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28357:x1830963592208000:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 356us (1486us total) trans 8589942357 rc 0/0 00000100:00100000:1.0:1746143691.232131:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8258 00000100:00100000:1.0:1746143691.233807:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.233906:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592208128 00000100:00100000:3.0:1746143691.233913:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592208128 00000100:00100000:3.0:1746143691.233951:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9489 00000100:00100000:3.0:1746143691.233958:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:28351:x1830963592208128:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143691.233969:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.233980:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a14dd expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.234006:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd725432 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a140b expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.234014:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd7254b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1466 expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.234020:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143691.234021:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143691.234025:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1236992->2056191] (req 1236992->2056191) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.234053:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd7254b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1466 expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.234063:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd7254b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1466 expref: 26 pid: 12618 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746143691.234073:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593718528:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.234165:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd725432 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a140b expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.234173:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd725432 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a140b expref: 33 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746143691.234180:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593718656:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.234212:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143691.235460:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593718528:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.235471:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593718656:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.235492:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1236992->2056191] (req 1236992->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.235503:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bdc00, rc 0) 00000100:00100000:3.0:1746143691.237153:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:28351:x1830963592208128:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3180us (3334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.237163:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9489 00000100:00100000:0.0:1746143691.237683:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.237711:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.238086:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592208256 00000100:00100000:1.0:1746143691.238092:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592208256 00010000:00010000:1.0:1746143691.238116:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd7254b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1466 expref: 27 pid: 12618 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746143691.238153:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592208384 00000100:00100000:1.0:1746143691.238155:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592208384 00010000:00010000:1.0:1746143691.238163:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd725432 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a140b expref: 33 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746143691.238175:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4867 00000100:00100000:1.0:1746143691.238180:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1963:x1830963592208256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143691.238190:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143691.238208:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd7254b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1466 expref: 27 pid: 12618 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746143691.238216:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd7254b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1466 expref: 27 pid: 12618 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746143691.238232:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cabc600/0xe984082ccd7254b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1466 expref: 27 pid: 12618 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746143691.238244:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143691.238271:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1963:x1830963592208256:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 90us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143691.238275:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4867 00000100:00100000:1.0:1746143691.238293:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4868 00000100:00100000:1.0:1746143691.238297:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963592208384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143691.238301:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143691.238306:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd725432 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a140b expref: 33 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.238313:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd725432 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a140b expref: 33 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.238321:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7c7a00/0xe984082ccd725432 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a140b expref: 33 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.238327:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143691.238329:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143691.238335:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 32 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.238341:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 32 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.238363:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 32 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143691.238371:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593718784:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143691.238414:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143691.242604:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593718784:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143691.242623:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143691.242672:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963592208384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4373us (4959us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143691.242683:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4868 00000100:00100000:0.0:1746143691.243270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.243588:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592208512 00000100:00100000:1.0:1746143691.243592:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.243594:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592208512 00000100:00100000:3.0:1746143691.243848:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592208640 00000100:00100000:3.0:1746143691.243851:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592208640 00000100:00100000:3.0:1746143691.243880:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9490 00000100:00100000:3.0:1746143691.243886:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592208512:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.243901:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.243916:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd725543 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a14e4 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143691.243957:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593718912:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143691.244013:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143691.244123:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9491 00000100:00100000:2.0:1746143691.244130:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963592208640:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143691.244158:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143691.244168:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093b36800/0xe984082ccd72554a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a14eb expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143691.244190:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593719040:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143691.244233:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.246557:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.246608:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592208896 00000100:00100000:1.0:1746143691.246614:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592208896 00002000:00100000:1.0:1746143691.246647:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1236992->1241087) req@ffff88009ba45180 x1830963592208896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.246654:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba45180 with x1830963592208896 ext(1236992->1241087) 00002000:00010000:1.0:1746143691.246658:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba45180 00000100:00100000:2.0:1746143691.246667:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593719040:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143691.246687:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3476 00010000:00010000:2.0:1746143691.246690:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093b36800/0xe984082ccd72554a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14eb expref: 34 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143691.246692:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963592208896:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:2.0:1746143691.246702:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b36800/0xe984082ccd72554a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14eb expref: 34 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.246715:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b36800, rc 0) 00000100:00100000:2.0:1746143691.246745:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963592208640:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2616us (3154us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143691.246751:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9491 00000100:00100000:1.0:1746143691.246809:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963592208896:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 116us (258us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143691.246815:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3476 00002000:00100000:1.0:1746143691.246820:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1236992->1241087) req@ffff88009ba45180 x1830963592208896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/4536 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.246827:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba45180 with x1830963592208896 ext(1236992->1241087) 00002000:00010000:1.0:1746143691.246829:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba45180 00000100:00100000:3.0:1746143691.247428:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593718912:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143691.247445:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd725543 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14e4 expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.247454:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351bca00/0xe984082ccd725543 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14e4 expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.247481:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351bca00, rc 0) 00000100:00100000:3.0:1746143691.247508:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592208512:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3622us (4952us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143691.247514:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9490 00000100:00100000:0.0:1746143691.250979:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.251338:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592209024 00000100:00100000:3.0:1746143691.251347:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592209024 00000100:00100000:3.0:1746143691.251425:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9492 00000100:00100000:3.0:1746143691.251434:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28360:x1830963592209024:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.251451:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.251465:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a2a00/0xe984082ccd725551 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a14f2 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.251492:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 19 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.251499:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143691.251500:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143691.251503:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a2a00/0xe984082ccd725551 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f2 expref: 30 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.252106:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 19 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.252118:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 19 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746143691.252133:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593719168:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.252469:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.257413:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.257902:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592209152 00000100:00100000:2.0:1746143691.257910:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592209152 00000100:00100000:2.0:1746143691.257957:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8259 00000100:00100000:2.0:1746143691.257963:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28361:x1830963592209152:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143691.257983:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143691.257997:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b37c00/0xe984082ccd725558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a14f9 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.258050:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36200/0xe984082ccd72555f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143691.258060:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36200/0xe984082ccd72555f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143691.258071:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36200/0xe984082ccd72555f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143691.258082:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36600/0xe984082ccd725566 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143691.258086:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36600/0xe984082ccd725566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143691.258090:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36600/0xe984082ccd725566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143691.258217:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143691.258227:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14ac expref: 256 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.258233:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510400/0xe984082ccd72552e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14d6 expref: 23 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.258237:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143691.258261:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510400/0xe984082ccd72552e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14d6 expref: 23 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.258271:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510400/0xe984082ccd72552e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14d6 expref: 23 pid: 14764 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746143691.258286:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593719296:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143691.258372:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14ac expref: 256 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.258379:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14ac expref: 256 pid: 14764 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746143691.258386:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593719424:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143691.258403:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143691.259498:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593719168:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.259519:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368a2a00/0xe984082ccd725551 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f2 expref: 30 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.259531:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a2a00, rc 0) 00000100:00100000:3.0:1746143691.259561:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28360:x1830963592209024:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8128us (8589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.259568:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9492 00000100:00100000:0.0:1746143691.260272:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.260335:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592209536 00000100:00100000:1.0:1746143691.260340:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592209536 00002000:00100000:1.0:1746143691.260367:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8801305cad80 x1830963592209536/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.260375:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cad80 with x1830963592209536 ext(2097152->3145727) 00002000:00010000:1.0:1746143691.260379:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305cad80 00000100:00100000:1.0:1746143691.260403:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3477 00000100:00100000:1.0:1746143691.260409:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592209536:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143691.263480:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.263516:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.263553:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.264303:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592209408 00000100:00100000:2.0:1746143691.264313:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592209408 00002000:00100000:2.0:1746143691.264355:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (749568->1048575) req@ffff8800a0361f80 x1830963592209408/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.264364:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0361f80 with x1830963592209408 ext(749568->1048575) 00010000:00010000:2.0:1746143691.264373:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 22 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.264386:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 22 pid: 4582 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746143691.264392:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0361f80 00000100:00100000:2.0:1746143691.264408:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592209792 00000100:00100000:2.0:1746143691.264411:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592209792 00002000:00100000:2.0:1746143691.264421:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a0362680 x1830963592209792/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.264432:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0362680 with x1830963592209792 ext(3145728->4194303) 00002000:00010000:2.0:1746143691.264435:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0362680 00000100:00100000:2.0:1746143691.264556:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592210048 00000100:00100000:2.0:1746143691.264559:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592210048 00002000:00100000:2.0:1746143691.264573:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f1ec380 x1830963592210048/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.264579:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ec380 with x1830963592210048 ext(2097152->3145727) 00002000:00010000:2.0:1746143691.264582:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ec380 00000100:00100000:3.0:1746143691.264635:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 835 00000100:00100000:3.0:1746143691.264644:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1962:x1830963592209408:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143691.265002:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3478 00000100:00100000:3.0:1746143691.265007:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963592209792:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143691.265442:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3479 00000100:00100000:2.0:1746143691.265448:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592210048:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143691.271508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.271537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.271759:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592210304 00000100:00100000:0.0:1746143691.271766:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592210304 00010000:00010000:0.0:1746143691.271795:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14ac expref: 257 pid: 14764 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746143691.271817:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592210176 00000100:00100000:0.0:1746143691.271819:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592210176 00010000:00010000:0.0:1746143691.271827:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510400/0xe984082ccd72552e lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14d6 expref: 24 pid: 14764 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746143691.271846:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4869 00000100:00100000:0.0:1746143691.271852:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:1962:x1830963592210304:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143691.271863:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143691.271877:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14ac expref: 257 pid: 14764 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746143691.271887:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14ac expref: 257 pid: 14764 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746143691.271905:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:0.0:1746143691.271909:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143691.271916:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143691.271921:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143691.271925:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143691.271971:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:1962:x1830963592210304:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 118us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143691.271976:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4869 00000100:00100000:0.0:1746143691.271990:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4870 00000100:00100000:0.0:1746143691.271994:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1962:x1830963592210176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143691.272002:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143691.272006:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510400/0xe984082ccd72552e lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14d6 expref: 24 pid: 14764 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746143691.272013:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510400/0xe984082ccd72552e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14d6 expref: 24 pid: 14764 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746143691.272023:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:0.0:1746143691.272026:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143691.272031:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143691.272037:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143691.272051:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143691.272063:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1962:x1830963592210176:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 69us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143691.272068:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4870 00010000:00010000:3.0:1746143691.273512:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510400/0xe984082ccd72552e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14d6 expref: 23 pid: 14764 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746143691.273540:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593719296:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.273552:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd7254ef lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14ac expref: 256 pid: 14764 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746143691.273560:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593719424:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.273578:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273584:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273588:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143691.273627:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:3.0:1746143691.273631:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143691.273646:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273656:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273663:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36200/0xe984082ccd72555f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273669:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36200/0xe984082ccd72555f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273674:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36200/0xe984082ccd72555f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273678:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093b36200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143691.273681:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36200/0xe984082ccd72555f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273686:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36200/0xe984082ccd72555f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273695:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143691.273697:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143691.273701:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36200/0xe984082ccd72555f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273704:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36200/0xe984082ccd72555f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273712:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36600/0xe984082ccd725566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273716:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36600/0xe984082ccd725566 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273719:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36600/0xe984082ccd725566 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273723:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093b36600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143691.273724:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36600/0xe984082ccd725566 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273729:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36600/0xe984082ccd725566 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273734:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a900) 00010000:00010000:3.0:1746143691.273735:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143691.273737:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36600/0xe984082ccd725566 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273741:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36600/0xe984082ccd725566 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.273767:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b37c00/0xe984082ccd725558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f9 expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.273781:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f9 expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.273786:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143691.273788:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143691.273790:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b36400, rc 0) 00000100:00100000:3.0:1746143691.273838:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28361:x1830963592209152:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 15875us (16433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.273845:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8259 00000100:00100000:0.0:1746143691.285524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.286454:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963592209536:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26042us (26180us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143691.286464:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3477 00002000:00100000:1.0:1746143691.286473:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8801305cad80 x1830963592209536/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.286481:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cad80 with x1830963592209536 ext(2097152->3145727) 00002000:00010000:1.0:1746143691.286486:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305cad80 00000100:00100000:2.0:1746143691.286535:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592210560 00000100:00100000:2.0:1746143691.286543:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592210560 00002000:00100000:2.0:1746143691.286569:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (2052096->2056191) req@ffff8800908f3480 x1830963592210560/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.286575:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f3480 with x1830963592210560 ext(2052096->2056191) 00002000:00010000:2.0:1746143691.286578:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f3480 00000100:00100000:2.0:1746143691.286591:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3480 00000100:00100000:2.0:1746143691.286596:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592210560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143691.286701:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592210560:12345-192.168.202.48@tcp:3:cat.0 Request processed in 104us (1185us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143691.286706:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3480 00002000:00100000:2.0:1746143691.286711:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (2052096->2056191) req@ffff8800908f3480 x1830963592210560/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/4536 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.286716:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800908f3480 with x1830963592210560 ext(2052096->2056191) 00002000:00010000:2.0:1746143691.286718:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800908f3480 00000100:00100000:2.0:1746143691.292560:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592210048:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27104us (28998us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143691.292571:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3479 00002000:00100000:2.0:1746143691.292582:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f1ec380 x1830963592210048/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.292591:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ec380 with x1830963592210048 ext(2097152->3145727) 00002000:00010000:2.0:1746143691.292596:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ec380 00000100:00100000:3.0:1746143691.294644:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1962:x1830963592209408:12345-192.168.202.48@tcp:4:cat.0 Request processed in 29994us (31163us total) trans 17179872436 rc 0/0 00000100:00100000:3.0:1746143691.294655:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 835 00002000:00100000:3.0:1746143691.294665:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (749568->1048575) req@ffff8800a0361f80 x1830963592209408/t17179872436(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/448 e 0 to 0 dl 1746143702 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.294673:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0361f80 with x1830963592209408 ext(749568->1048575) 00010000:00010000:3.0:1746143691.294681:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 24 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746143691.294694:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 24 pid: 4582 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746143691.294700:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0361f80 00000100:00100000:0.0:1746143691.302607:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.302744:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592211584 00000100:00100000:2.0:1746143691.302752:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592211584 00000100:00100000:2.0:1746143691.302797:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3355 00000100:00100000:2.0:1746143691.302803:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800908f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:28351:x1830963592211584:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143691.303030:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800908f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:28351:x1830963592211584:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 227us (430us total) trans 8589942358 rc 0/0 00000100:00100000:2.0:1746143691.303036:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3355 00000100:00100000:0.0:1746143691.303370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.303430:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.303442:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.303463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.303476:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592210816 00000100:00100000:0.0:1746143691.303479:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592210816 00000100:00100000:0.0:1746143691.303496:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592211072 00000100:00100000:0.0:1746143691.303498:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592211072 00000100:00100000:0.0:1746143691.303506:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592211328 00000100:00100000:0.0:1746143691.303507:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592211328 00000100:00100000:0.0:1746143691.303515:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592210688 00000100:00100000:0.0:1746143691.303516:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592210688 00000100:00100000:0.0:1746143691.303527:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9493 00000100:00100000:0.0:1746143691.303532:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592210816:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143691.303541:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143691.303554:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725574 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1507 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143691.303590:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593719552:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143691.303647:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.303663:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9494 00000100:00100000:0.0:1746143691.303668:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592211072:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143691.303675:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143691.303682:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e90400/0xe984082ccd72557b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1515 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.303693:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143691.303695:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143691.303702:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e90400/0xe984082ccd72557b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1515 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143691.303713:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e90400/0xe984082ccd72557b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1515 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143691.303721:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e90400, rc 0) 00000100:00100000:0.0:1746143691.303736:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592211072:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 69us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143691.303740:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9494 00000100:00100000:0.0:1746143691.303751:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9495 00000100:00100000:0.0:1746143691.303755:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592211328:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143691.303760:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143691.303766:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e91200/0xe984082ccd725582 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1523 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.303774:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143691.303775:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143691.303779:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e91200/0xe984082ccd725582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1523 expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143691.303787:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e91200/0xe984082ccd725582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1523 expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143691.303793:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91200, rc 0) 00000100:00100000:0.0:1746143691.303806:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592211328:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 50us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143691.303811:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9495 00000100:00100000:0.0:1746143691.303819:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9496 00000100:00100000:0.0:1746143691.303823:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592210688:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143691.303827:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143691.303832:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e91000/0xe984082ccd725589 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1500 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143691.303854:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593719680:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143691.303883:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.303903:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.303936:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.303949:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592210944 00000100:00100000:0.0:1746143691.303952:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592210944 00000100:00100000:0.0:1746143691.303964:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592211200 00000100:00100000:0.0:1746143691.303966:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592211200 00000100:00100000:0.0:1746143691.303973:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9497 00000100:00100000:0.0:1746143691.303978:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592210944:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143691.303983:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143691.303990:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e91c00/0xe984082ccd725590 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a150e expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143691.304010:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593719808:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143691.304028:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.304040:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9498 00000100:00100000:0.0:1746143691.304045:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592211200:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143691.304050:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143691.304056:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725597 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a151c expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.304064:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143691.304065:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143691.304069:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725597 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a151c expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143691.304078:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725597 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a151c expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143691.304085:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cabda00, rc 0) 00000100:00100000:0.0:1746143691.304098:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963592211200:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 54us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143691.304103:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9498 00000100:00100000:0.0:1746143691.304543:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.304723:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592209792:12345-192.168.202.48@tcp:3:cat.0 Request processed in 39715us (41205us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143691.304733:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3478 00002000:00100000:3.0:1746143691.304741:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a0362680 x1830963592209792/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.304748:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0362680 with x1830963592209792 ext(3145728->4194303) 00002000:00010000:3.0:1746143691.304752:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0362680 00000100:00100000:2.0:1746143691.304808:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592211712 00000100:00100000:2.0:1746143691.304812:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592211712 00010000:00010000:2.0:1746143691.304831:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 22 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746143691.304847:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4871 00000100:00100000:2.0:1746143691.304851:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963592211712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143691.304859:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143691.304883:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 22 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.304893:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 22 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.304906:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.304908:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.304912:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368a2a00/0xe984082ccd725551 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f2 expref: 29 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.304918:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a2a00/0xe984082ccd725551 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f2 expref: 29 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.304936:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801368a2a00/0xe984082ccd725551 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f2 expref: 29 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143691.304944:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593719936:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143691.304982:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00002000:00010000:1.0:1746143691.309662:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143690 -> 1746143691 00000100:00100000:1.0:1746143691.309688:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593719552:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143691.309694:0:8497:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff8800a0878700 x1830963593719680) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 22 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.309714:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725574 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1507 expref: 13 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143691.309719:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e504c00/0xe984082ccd725494 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1451 expref: 22 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.309725:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725574 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1507 expref: 13 pid: 25369 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143691.309728:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593719680:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143691.309741:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e91000/0xe984082ccd725589 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1500 expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143691.309749:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e90c00, rc 0) 00010000:00010000:0.0:1746143691.309749:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e91000/0xe984082ccd725589 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1500 expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143691.309754:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91000, rc 0) 00000100:00100000:1.0:1746143691.309849:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592210816:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 6315us (6477us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143691.309857:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9493 00002000:00010000:3.0:1746143691.309961:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime: 1746143690 -> 1746143691 00002000:00010000:3.0:1746143691.309964:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime: 1746143690 -> 1746143691 00002000:00010000:3.0:1746143691.309966:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime: 1746143690 -> 1746143691 00000100:00100000:3.0:1746143691.309973:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593719808:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143691.309990:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e91c00/0xe984082ccd725590 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a150e expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.309999:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e91c00/0xe984082ccd725590 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a150e expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.310008:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91c00, rc 0) 00000100:00100000:3.0:1746143691.310023:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592210944:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 6045us (6120us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143691.310028:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9497 00000100:00100000:0.0:1746143691.311683:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592210688:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 7853us (8213us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143691.311694:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9496 00000100:00100000:3.0:1746143691.320444:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.320466:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.320509:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592211840 00000100:00100000:2.0:1746143691.320517:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592211840 00000100:00100000:2.0:1746143691.320549:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592211968 00000100:00100000:2.0:1746143691.320551:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592211968 00000100:00100000:2.0:1746143691.320571:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9499 00000100:00100000:3.0:1746143691.320573:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.320579:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592211840:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143691.320589:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9500 00000100:00100000:3.0:1746143691.320594:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963592211968:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143691.320596:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.320601:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.320610:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a513a00/0xe984082ccd7255a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1531 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.320610:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b37200/0xe984082ccd72559e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a152a expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.320628:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.320629:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.320636:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b37200/0xe984082ccd72559e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a152a expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.320648:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b37200/0xe984082ccd72559e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a152a expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143691.320649:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593720064:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143691.320656:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b37200, rc 0) 00000100:00100000:2.0:1746143691.320687:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592211840:12345-192.168.202.48@tcp:101:cat.0 Request processed in 110us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.320692:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9499 00000100:00100000:3.0:1746143691.320697:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143691.320710:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592212224 00000100:00100000:3.0:1746143691.320713:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592212224 00000100:00100000:2.0:1746143691.320734:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593719936:192.168.202.48@tcp:105: 00002000:00100000:3.0:1746143691.320737:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880094c11c00 x1830963592212224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.320745:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11c00 with x1830963592212224 ext(0->1048575) 00010000:00010000:2.0:1746143691.320746:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1746143691.320748:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11c00 00000100:00100000:3.0:1746143691.320758:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3481 00000100:00100000:2.0:1746143691.320760:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963592211712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 15909us (16218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.320763:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592212224:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143691.320766:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4871 00000100:00100000:2.0:1746143691.321883:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593720064:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143691.321903:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a513a00/0xe984082ccd7255a5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1531 expref: 27 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.321912:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a513a00/0xe984082ccd7255a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1531 expref: 27 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.321928:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a513a00, rc 0) 00000100:00100000:2.0:1746143691.321951:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963592211968:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1357us (1484us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143691.321957:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9500 00000100:00100000:0.0:1746143691.333461:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.334526:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592212352 00000100:00100000:3.0:1746143691.334534:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592212352 00000100:00100000:2.0:1746143691.334688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.334912:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9501 00000100:00100000:3.0:1746143691.334920:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592212352:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.334936:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.334951:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c70a200/0xe984082ccd7255ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1538 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143691.334994:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593720192:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143691.335047:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143691.335062:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592212608 00000100:00100000:3.0:1746143691.335066:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592212608 00000100:00100000:3.0:1746143691.335089:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8260 00000100:00100000:3.0:1746143691.335093:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28361:x1830963592212608:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143691.335101:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.335110:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70aa00/0xe984082ccd7255b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a153f expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.336604:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70ac00/0xe984082ccd7255ba lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.336622:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f9 expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.336632:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70ac00/0xe984082ccd7255ba lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.336654:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f9 expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.336664:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f9 expref: 12 pid: 21713 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746143691.336677:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593720320:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.336737:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.340968:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592212224:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20192us (20381us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143691.340980:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3481 00002000:00100000:0.0:1746143691.340993:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880094c11c00 x1830963592212224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143691.341002:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11c00 with x1830963592212224 ext(0->1048575) 00002000:00010000:0.0:1746143691.341007:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11c00 00000100:00100000:3.0:1746143691.342433:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593720192:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143691.342461:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c70a200/0xe984082ccd7255ac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1538 expref: 27 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.342475:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c70a200/0xe984082ccd7255ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1538 expref: 27 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.342499:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c70a200, rc 0) 00000100:00100000:3.0:1746143691.343226:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592212352:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8305us (9771us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143691.343233:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9501 00000100:00100000:0.0:1746143691.344582:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.344799:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593720320:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.344818:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70ac00/0xe984082ccd7255ba lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:2.0:1746143691.344889:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592212736 00000100:00100000:2.0:1746143691.344895:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592212736 00010000:00010000:2.0:1746143691.344923:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f9 expref: 13 pid: 21713 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746143691.344998:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4872 00000100:00100000:2.0:1746143691.345005:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963592212736:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143691.345018:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143691.345023:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f9 expref: 13 pid: 21713 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.345033:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f9 expref: 13 pid: 21713 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.345050:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36400/0xe984082ccd72556d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f9 expref: 13 pid: 21713 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.345066:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143691.345071:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70ac00/0xe984082ccd7255ba lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143691.345079:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70ac00/0xe984082ccd7255ba lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143691.345085:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70ac00/0xe984082ccd7255ba lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143691.345098:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143691.345129:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592212736:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 123us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.345135:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4872 00010000:00010000:3.0:1746143691.345335:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70ac00/0xe984082ccd7255ba lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.345341:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70ac00/0xe984082ccd7255ba lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143691.345358:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143691.345468:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70aa00/0xe984082ccd7255b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a153f expref: 13 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.345480:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70ac00/0xe984082ccd7255ba lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a153f expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.345485:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143691.345487:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143691.345489:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c70ac00, rc 0) 00000100:00100000:3.0:1746143691.345511:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28361:x1830963592212608:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 10417us (10824us total) trans 8589942359 rc 0/0 00000100:00100000:3.0:1746143691.345517:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8260 00000100:00100000:0.0:1746143691.351675:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.351741:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592212992 00000100:00100000:3.0:1746143691.351748:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592212992 00000100:00100000:3.0:1746143691.351796:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8261 00000100:00100000:3.0:1746143691.351803:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28361:x1830963592212992:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143691.351821:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.351824:0:21713:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143691.351845:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70ac00/0xe984082ccd7255ba lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a153f expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.351860:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143691.351864:0:21713:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143691.351883:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70ae00/0xe984082ccd7255c8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1546 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.351961:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70b000/0xe984082ccd7255cf lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.351972:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70b000/0xe984082ccd7255cf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.351979:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70b000/0xe984082ccd7255cf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.351989:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70b000/0xe984082ccd7255cf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.351994:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70b000/0xe984082ccd7255cf lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.352000:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70b000/0xe984082ccd7255cf lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.352013:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c70b000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143691.352016:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70b000/0xe984082ccd7255cf lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.352021:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70b000/0xe984082ccd7255cf lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.352027:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143691.352029:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143691.352031:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70b000/0xe984082ccd7255cf lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.352036:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70b000/0xe984082ccd7255cf lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.352055:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70ae00/0xe984082ccd7255c8 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1546 expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.352061:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c70ae00/0xe984082ccd7255c8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1546 expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.352066:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c70ae00, rc 0) 00000100:00100000:3.0:1746143691.352280:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28361:x1830963592212992:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 476us (612us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143691.352287:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8261 00000100:00100000:0.0:1746143691.366901:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.366946:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.367017:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592213120 00000100:00100000:1.0:1746143691.367026:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592213120 00000100:00100000:3.0:1746143691.367029:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592213248 00000100:00100000:3.0:1746143691.367033:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592213248 00000100:00100000:3.0:1746143691.367067:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9502 00000100:00100000:3.0:1746143691.367074:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963592213248:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.367095:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.367109:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c70a000/0xe984082ccd7255d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1554 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143691.367178:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593720448:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143691.367253:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143691.367421:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9503 00000100:00100000:1.0:1746143691.367427:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:28360:x1830963592213120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143691.367434:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143691.367441:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f1e0e00/0xe984082ccd7255dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a154d expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.367465:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.367471:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143691.367473:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143691.367476:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f1e0e00/0xe984082ccd7255dd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a154d expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.367496:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.367510:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 27 pid: 25369 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746143691.367518:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593720576:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143691.367544:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.370328:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.374825:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592213504 00000100:00100000:1.0:1746143691.374836:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592213504 00000100:00100000:1.0:1746143691.374918:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3356 00000100:00100000:1.0:1746143691.374927:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28361:x1830963592213504:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143691.375132:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28361:x1830963592213504:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 206us (4810us total) trans 8589942360 rc 0/0 00000100:00100000:1.0:1746143691.375154:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3356 00000100:00100000:3.0:1746143691.377123:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593720448:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143691.377165:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c70a000/0xe984082ccd7255d6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1554 expref: 27 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.377177:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c70a000/0xe984082ccd7255d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1554 expref: 27 pid: 15784 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143691.377274:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593720576:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143691.377291:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f1e0e00/0xe984082ccd7255dd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a154d expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.377302:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1e0e00, rc 0) 00000100:00100000:1.0:1746143691.377929:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:28360:x1830963592213120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 10500us (11031us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143691.377936:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9503 00010000:00010000:3.0:1746143691.378781:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c70a000, rc 0) 00000100:00100000:3.0:1746143691.379266:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963592213248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 12189us (12316us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143691.379273:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9502 00000100:00100000:2.0:1746143691.380719:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.381551:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592213632 00000100:00100000:1.0:1746143691.381559:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592213632 00002000:00100000:1.0:1746143691.381597:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1798143) req@ffff88009bef5f80 x1830963592213632/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.381611:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef5f80 with x1830963592213632 ext(1048576->1798143) 00010000:00010000:1.0:1746143691.381620:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 26 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.381632:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 26 pid: 25369 timeout: 870 lvb_type: 0 00002000:00010000:1.0:1746143691.381638:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bef5f80 00000100:00100000:1.0:1746143691.381664:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 836 00000100:00100000:1.0:1746143691.381671:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1963:x1830963592213632:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143691.419918:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1963:x1830963592213632:12345-192.168.202.48@tcp:4:cat.0 Request processed in 38239us (39194us total) trans 21474839704 rc 0/0 00000100:00100000:3.0:1746143691.419929:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 836 00002000:00100000:3.0:1746143691.419938:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1798143) req@ffff88009bef5f80 x1830963592213632/t21474839704(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/448 e 0 to 0 dl 1746143702 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.419946:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef5f80 with x1830963592213632 ext(1048576->1798143) 00010000:00010000:3.0:1746143691.419954:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 28 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746143691.419973:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 28 pid: 25369 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746143691.419979:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bef5f80 00000100:00100000:0.0:1746143691.422937:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.423946:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592213760 00000100:00100000:1.0:1746143691.423954:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592213760 00010000:00010000:1.0:1746143691.423987:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 28 pid: 25369 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746143691.424026:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4873 00000100:00100000:1.0:1746143691.424032:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1964:x1830963592213760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143691.424045:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143691.424063:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143690 -> 1746143691 00010000:00010000:1.0:1746143691.424068:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 28 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.424079:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 28 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.424101:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e505a00/0xe984082ccd7254b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1798143) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a147b expref: 28 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.424127:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143691.424129:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143691.424135:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f1e0e00/0xe984082ccd7255dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a154d expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.424157:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f1e0e00/0xe984082ccd7255dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a154d expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.424183:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f1e0e00/0xe984082ccd7255dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a154d expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143691.424192:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593720704:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143691.424268:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143691.430177:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593720704:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143691.430198:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143691.430246:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592213760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6213us (7316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143691.430256:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4873 00000100:00100000:0.0:1746143691.433104:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.433178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.436151:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592214144 00000100:00100000:3.0:1746143691.436162:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592214144 00002000:00100000:3.0:1746143691.436207:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a087a680 x1830963592214144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 504/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.436216:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087a680 with x1830963592214144 ext(1048576->2097151) 00002000:00010000:3.0:1746143691.436221:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087a680 00000100:00100000:3.0:1746143691.436245:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592214016 00000100:00100000:3.0:1746143691.436248:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592214016 00002000:00100000:3.0:1746143691.436258:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a087aa00 x1830963592214016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.436264:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087aa00 with x1830963592214016 ext(1048576->2097151) 00002000:00010000:3.0:1746143691.436267:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087aa00 00000100:00100000:3.0:1746143691.436289:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3482 00000100:00100000:3.0:1746143691.436295:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963592214144:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143691.436928:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3483 00000100:00100000:0.0:1746143691.436935:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963592214016:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143691.457642:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963592214144:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21338us (24535us total) trans 0 rc 229376/229376 00000100:00100000:3.0:1746143691.457654:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3482 00002000:00100000:3.0:1746143691.457666:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a087a680 x1830963592214144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 504/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 229376/229376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.457680:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087a680 with x1830963592214144 ext(1048576->2097151) 00002000:00010000:3.0:1746143691.457685:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087a680 00000100:00100000:0.0:1746143691.460614:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.460769:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592214528 00000100:00100000:3.0:1746143691.460778:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592214528 00000100:00100000:3.0:1746143691.460815:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8262 00000100:00100000:3.0:1746143691.460821:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:28366:x1830963592214528:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143691.460841:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.460857:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a004be00/0xe984082ccd7255e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a155b expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.460950:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a004bc00/0xe984082ccd7255eb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.460961:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a004bc00/0xe984082ccd7255eb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143691.460971:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a004bc00/0xe984082ccd7255eb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143691.460981:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143691.461076:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a004be00/0xe984082ccd7255e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a155b expref: 260 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.461110:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a004bc00/0xe984082ccd7255eb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a155b expref: 259 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.461118:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143691.461120:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143691.461122:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a004bc00, rc 0) 00000100:00100000:3.0:1746143691.461208:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:28366:x1830963592214528:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 386us (599us total) trans 8589942361 rc 0/0 00000100:00100000:3.0:1746143691.461214:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8262 00000100:00100000:2.0:1746143691.464797:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963592214016:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27851us (31606us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143691.464808:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3483 00002000:00100000:2.0:1746143691.464820:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a087aa00 x1830963592214016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.464828:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087aa00 with x1830963592214016 ext(1048576->2097151) 00002000:00010000:2.0:1746143691.464834:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087aa00 00000100:00100000:0.0:1746143691.489806:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.490087:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592214656 00000100:00100000:3.0:1746143691.490095:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592214656 00000100:00100000:3.0:1746143691.490226:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9504 00000100:00100000:3.0:1746143691.490234:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+27:28357:x1830963592214656:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143691.490250:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.490266:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1562 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.490293:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f1e0e00/0xe984082ccd7255dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a154d expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.490300:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143691.490301:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143691.490305:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1896448->2097151] (req 1896448->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.490330:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f1e0e00/0xe984082ccd7255dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a154d expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.490341:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f1e0e00/0xe984082ccd7255dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a154d expref: 32 pid: 25369 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746143691.490352:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593720832:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.490435:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143691.494412:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593720832:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.494439:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1896448->2097151] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.494454:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a004ba00, rc 0) 00000100:00100000:3.0:1746143691.494505:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+28:28357:x1830963592214656:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4271us (4709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.494513:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9504 00000100:00100000:0.0:1746143691.497572:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.497668:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592214784 00000100:00100000:1.0:1746143691.497675:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592214784 00010000:00010000:1.0:1746143691.497703:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f1e0e00/0xe984082ccd7255dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a154d expref: 33 pid: 25369 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746143691.497741:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4874 00000100:00100000:1.0:1746143691.497747:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963592214784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143691.497757:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143691.497777:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f1e0e00/0xe984082ccd7255dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a154d expref: 33 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.497788:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f1e0e00/0xe984082ccd7255dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a154d expref: 33 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.497806:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f1e0e00/0xe984082ccd7255dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a154d expref: 33 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.497836:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143691.497837:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143691.497843:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.497850:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.497885:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143691.497895:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593720960:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143691.497960:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143691.505331:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593720960:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143691.505355:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143691.505408:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963592214784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7658us (7839us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143691.505418:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4874 00000100:00100000:0.0:1746143691.509832:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.509979:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592215040 00000100:00100000:2.0:1746143691.509988:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592215040 00002000:00100000:2.0:1746143691.510037:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1896448->1900543) req@ffff8800a087b800 x1830963592215040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.510047:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b800 with x1830963592215040 ext(1896448->1900543) 00002000:00010000:2.0:1746143691.510053:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087b800 00000100:00100000:2.0:1746143691.510099:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3484 00000100:00100000:2.0:1746143691.510108:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1964:x1830963592215040:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143691.510333:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1964:x1830963592215040:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 223us (508us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143691.510344:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3484 00002000:00100000:2.0:1746143691.510351:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1896448->1900543) req@ffff8800a087b800 x1830963592215040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/4536 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.510358:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b800 with x1830963592215040 ext(1896448->1900543) 00002000:00010000:2.0:1746143691.510361:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087b800 00000100:00100000:0.0:1746143691.514658:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.516637:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592215168 00000100:00100000:3.0:1746143691.516649:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592215168 00000100:00100000:1.0:1746143691.518307:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9505 00000100:00100000:1.0:1746143691.518323:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+28:28357:x1830963592215168:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143691.518346:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143691.518367:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1569 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.518401:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 31 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.518409:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143691.518410:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143691.518414:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->1732607] (req 1048576->1732607) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.518445:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 31 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.518458:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 31 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746143691.518470:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593721088:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143691.518582:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.523434:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.523654:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593721088:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143691.523687:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->1732607] (req 1048576->1732607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.523704:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f1e1400, rc 0) 00000100:00100000:1.0:1746143691.523759:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+29:28357:x1830963592215168:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5440us (9108us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143691.523768:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9505 00000100:00100000:3.0:1746143691.523890:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592215296 00000100:00100000:3.0:1746143691.523898:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592215296 00002000:00100000:3.0:1746143691.523939:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1236992->2056191) req@ffff8800a0879180 x1830963592215296/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.523948:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879180 with x1830963592215296 ext(1236992->2056191) 00010000:00010000:3.0:1746143691.523955:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 32 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746143691.523967:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 32 pid: 4582 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746143691.523973:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0879180 00000100:00100000:3.0:1746143691.524018:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 837 00000100:00100000:3.0:1746143691.524027:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592215296:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143691.546077:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592215296:12345-192.168.202.48@tcp:4:cat.0 Request processed in 22039us (22641us total) trans 21474839705 rc 0/0 00000100:00100000:2.0:1746143691.546091:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 837 00002000:00100000:2.0:1746143691.546105:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1236992->2056191) req@ffff8800a0879180 x1830963592215296/t21474839705(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/448 e 0 to 0 dl 1746143702 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.546113:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879180 with x1830963592215296 ext(1236992->2056191) 00010000:00010000:2.0:1746143691.546123:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 34 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.546159:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 34 pid: 4582 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746143691.546166:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0879180 00000100:00100000:2.0:1746143691.554545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.554710:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592215424 00000100:00100000:1.0:1746143691.554718:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592215424 00010000:00010000:1.0:1746143691.554748:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 34 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746143691.554781:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4875 00000100:00100000:1.0:1746143691.554788:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963592215424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143691.554800:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143691.554819:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 34 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.554830:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 34 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.554849:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351bdc00/0xe984082ccd72553c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->2056191) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14dd expref: 34 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.554878:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143691.554881:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143691.554887:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.554894:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.554924:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143691.554936:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593721216:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143691.555014:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.559718:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.559807:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592215552 00000100:00100000:2.0:1746143691.559815:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592215552 00000100:00100000:2.0:1746143691.559879:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9506 00000100:00100000:2.0:1746143691.559887:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28366:x1830963592215552:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143691.559906:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143691.559924:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1570 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.559950:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e505400/0xe984082ccd72549b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1458 expref: 31 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.559958:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e90400/0xe984082ccd72557b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1515 expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.559965:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090650e00/0xe984082ccd7254e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a149e expref: 21 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.559971:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.559973:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.559977:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1675264->2097151] (req 1675264->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.560006:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090650e00/0xe984082ccd7254e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a149e expref: 21 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.560018:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090650e00/0xe984082ccd7254e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a149e expref: 21 pid: 4581 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746143691.560029:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593721344:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143691.560120:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e90400/0xe984082ccd72557b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1515 expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.560128:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e90400/0xe984082ccd72557b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1515 expref: 10 pid: 8497 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746143691.560136:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593721472:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143691.560201:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e505400/0xe984082ccd72549b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1458 expref: 31 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.560209:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e505400/0xe984082ccd72549b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1458 expref: 31 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746143691.560216:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593721600:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143691.560231:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143691.560654:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593721216:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143691.560668:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143691.560693:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963592215424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5905us (6157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143691.560701:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4875 00000100:00100000:2.0:1746143691.562485:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593721344:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143691.563260:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.563415:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593721472:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.563424:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593721600:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.563447:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1675264->2097151] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.563461:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b83c600, rc 0) 00000100:00100000:3.0:1746143691.563494:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:28366:x1830963592215552:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3608us (3784us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.563501:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9506 00000100:00100000:2.0:1746143691.563731:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592215808 00000100:00100000:2.0:1746143691.563737:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592215808 00002000:00100000:2.0:1746143691.563766:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1728512->1732607) req@ffff88008f3c8000 x1830963592215808/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.563775:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8000 with x1830963592215808 ext(1728512->1732607) 00002000:00010000:2.0:1746143691.563779:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c8000 00000100:00100000:2.0:1746143691.564682:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3485 00000100:00100000:2.0:1746143691.564691:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1965:x1830963592215808:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143691.565464:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+29:1965:x1830963592215808:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 772us (2203us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143691.565470:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3485 00002000:00100000:2.0:1746143691.565478:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1728512->1732607) req@ffff88008f3c8000 x1830963592215808/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/4536 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.565487:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8000 with x1830963592215808 ext(1728512->1732607) 00002000:00010000:2.0:1746143691.565491:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c8000 00000100:00100000:0.0:1746143691.566688:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.567906:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592216064 00000100:00100000:1.0:1746143691.567914:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592216064 00010000:00010000:1.0:1746143691.567945:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090650e00/0xe984082ccd7254e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a149e expref: 22 pid: 4581 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746143691.567980:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4876 00000100:00100000:1.0:1746143691.567987:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963592216064:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143691.567999:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143691.568024:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090650e00/0xe984082ccd7254e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a149e expref: 22 pid: 4581 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746143691.568039:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090650e00/0xe984082ccd7254e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a149e expref: 22 pid: 4581 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746143691.568059:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090650e00/0xe984082ccd7254e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a149e expref: 22 pid: 4581 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746143691.568086:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143691.568130:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592216064:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 143us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143691.568135:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4876 00000100:00100000:0.0:1746143691.568726:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.568751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.568957:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592215936 00000100:00100000:2.0:1746143691.568961:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592215936 00010000:00010000:2.0:1746143691.568978:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e90400/0xe984082ccd72557b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1515 expref: 11 pid: 8497 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746143691.569987:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592216192 00000100:00100000:0.0:1746143691.569992:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592216192 00010000:00010000:0.0:1746143691.570007:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e505400/0xe984082ccd72549b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1458 expref: 31 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746143691.570054:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4877 00000100:00100000:2.0:1746143691.570060:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592215936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143691.570071:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143691.570086:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e90400/0xe984082ccd72557b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1515 expref: 11 pid: 8497 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746143691.570093:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e90400/0xe984082ccd72557b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1515 expref: 11 pid: 8497 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746143691.570108:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e90400/0xe984082ccd72557b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1515 expref: 11 pid: 8497 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746143691.570123:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143691.570161:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592215936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 101us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.570166:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4877 00000100:00100000:2.0:1746143691.570188:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4878 00000100:00100000:2.0:1746143691.570192:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592216192:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143691.570197:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143691.570203:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e505400/0xe984082ccd72549b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1458 expref: 31 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.570210:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e505400/0xe984082ccd72549b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1458 expref: 31 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.570218:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e505400/0xe984082ccd72549b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1458 expref: 31 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.570225:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.570227:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.570232:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.570240:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.570262:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143691.570271:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593721728:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143691.570861:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.571352:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592216448 00000100:00100000:1.0:1746143691.571358:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592216448 00000100:00100000:1.0:1746143691.571386:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3357 00000100:00100000:1.0:1746143691.571391:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28357:x1830963592216448:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143691.571562:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28357:x1830963592216448:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 170us (702us total) trans 8589942362 rc 0/0 00000100:00100000:1.0:1746143691.571567:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3357 00000100:00100000:2.0:1746143691.572177:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.573918:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.574004:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593721728:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143691.574019:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143691.574047:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592216192:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3855us (5296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.574056:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4878 00000100:00100000:3.0:1746143691.574212:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592216704 00000100:00100000:3.0:1746143691.574217:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592216704 00002000:00100000:3.0:1746143691.574251:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1675264->1679359) req@ffff88008f3c8e00 x1830963592216704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.574261:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8e00 with x1830963592216704 ext(1675264->1679359) 00002000:00010000:3.0:1746143691.574266:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c8e00 00000100:00100000:3.0:1746143691.574293:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3486 00000100:00100000:3.0:1746143691.574299:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592216704:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143691.574420:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592216704:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 122us (508us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143691.574425:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3486 00002000:00100000:3.0:1746143691.574430:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1675264->1679359) req@ffff88008f3c8e00 x1830963592216704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/4536 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.574436:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8e00 with x1830963592216704 ext(1675264->1679359) 00002000:00010000:3.0:1746143691.574438:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c8e00 00000100:00100000:0.0:1746143691.580346:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.580432:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592216832 00000100:00100000:3.0:1746143691.580440:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592216832 00000100:00100000:3.0:1746143691.580486:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9507 00000100:00100000:3.0:1746143691.580492:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28366:x1830963592216832:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143691.580509:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.580522:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1577 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.580547:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7254be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1474 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.580555:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725597 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a151c expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.580562:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942ce200/0xe984082ccd7254d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1490 expref: 31 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.580567:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143691.580569:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143691.580572:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->2445311] (req 2097152->2445311) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.580595:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942ce200/0xe984082ccd7254d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1490 expref: 31 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.580605:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942ce200/0xe984082ccd7254d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1490 expref: 31 pid: 15784 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746143691.580616:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593721856:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.580707:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725597 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a151c expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.580715:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725597 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a151c expref: 9 pid: 9527 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746143691.580722:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593721984:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.580760:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7254be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1474 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.580768:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7254be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1474 expref: 20 pid: 4581 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746143691.580776:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593722112:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.580794:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157480 going to sleep for 11 seconds 00010000:00010000:1.0:1746143691.583310:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746143691.586720:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593721856:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.586734:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593721984:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.586742:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593722112:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.586771:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->2445311] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.586787:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a004b200, rc 0) 00000100:00100000:3.0:1746143691.586826:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:28366:x1830963592216832:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6333us (6486us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.586838:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9507 00000100:00100000:0.0:1746143691.592009:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.592057:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.592177:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592216960 00000100:00100000:2.0:1746143691.592185:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592216960 00010000:00010000:2.0:1746143691.592219:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725597 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a151c expref: 10 pid: 9527 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746143691.592246:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592217088 00000100:00100000:2.0:1746143691.592248:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592217088 00010000:00010000:2.0:1746143691.592257:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7254be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1474 expref: 21 pid: 4581 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746143691.592272:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4879 00000100:00100000:2.0:1746143691.592278:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592216960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143691.592290:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143691.592311:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725597 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a151c expref: 10 pid: 9527 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746143691.592321:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725597 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a151c expref: 10 pid: 9527 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746143691.592340:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cabda00/0xe984082ccd725597 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a151c expref: 10 pid: 9527 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746143691.592372:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143691.592413:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592216960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 134us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.592423:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4879 00000100:00100000:2.0:1746143691.592461:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4880 00000100:00100000:2.0:1746143691.592466:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592217088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143691.592475:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143691.592483:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7254be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1474 expref: 21 pid: 4581 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.592490:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7254be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1474 expref: 21 pid: 4581 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746143691.593007:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.593188:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592217216 00000100:00100000:1.0:1746143691.593193:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592217216 00010000:00010000:1.0:1746143691.593209:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942ce200/0xe984082ccd7254d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1490 expref: 31 pid: 15784 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746143691.593225:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4881 00000100:00100000:1.0:1746143691.593231:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592217216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143691.593239:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143691.594383:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942ce200/0xe984082ccd7254d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1490 expref: 31 pid: 15784 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746143691.594394:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942ce200/0xe984082ccd7254d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1490 expref: 31 pid: 15784 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746143691.594408:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942ce200/0xe984082ccd7254d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1490 expref: 31 pid: 15784 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746143691.594555:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e504800/0xe984082ccd7254be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1474 expref: 21 pid: 4581 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.594565:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.594566:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.594572:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.594579:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.594608:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143691.594619:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593722240:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143691.595391:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143691.595652:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143691.595679:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592217216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2447us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143691.595687:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4881 00000100:00100000:2.0:1746143691.602806:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593722240:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143691.602825:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143691.602879:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592217088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10412us (10821us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.602889:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4880 00000100:00100000:0.0:1746143691.605328:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.605421:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592217472 00000100:00100000:2.0:1746143691.605427:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592217472 00002000:00100000:2.0:1746143691.605464:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2441216->2445311) req@ffff88008f3c9f80 x1830963592217472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.605473:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c9f80 with x1830963592217472 ext(2441216->2445311) 00002000:00010000:2.0:1746143691.605478:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c9f80 00000100:00100000:2.0:1746143691.605508:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3487 00000100:00100000:2.0:1746143691.605515:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592217472:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143691.605812:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592217472:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 297us (489us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143691.605818:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3487 00002000:00100000:2.0:1746143691.605823:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2441216->2445311) req@ffff88008f3c9f80 x1830963592217472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/4536 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.605830:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c9f80 with x1830963592217472 ext(2441216->2445311) 00002000:00010000:2.0:1746143691.605832:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c9f80 00000100:00100000:0.0:1746143691.622542:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.622640:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592217600 00000100:00100000:3.0:1746143691.622647:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592217600 00000100:00100000:3.0:1746143691.623630:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9508 00000100:00100000:3.0:1746143691.623639:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963592217600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.623654:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.623667:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090008200/0xe984082ccd725615 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a157e expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143691.623710:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593722368:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143691.623792:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.626067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.626178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.626393:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592217728 00000100:00100000:2.0:1746143691.626400:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592217728 00000100:00100000:2.0:1746143691.626442:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592217856 00000100:00100000:3.0:1746143691.626475:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9509 00000100:00100000:3.0:1746143691.626483:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963592217728:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.626497:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.626510:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090008800/0xe984082ccd72561c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1585 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143691.626546:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593722496:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143691.626580:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592217856 00000100:00100000:2.0:1746143691.626601:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9510 00000100:00100000:2.0:1746143691.626606:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963592217856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143691.626614:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143691.626622:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b83da00/0xe984082ccd725623 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a158c expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143691.626645:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593722624:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143691.626653:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143691.626668:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.629637:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.629839:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592217984 00000100:00100000:2.0:1746143691.629846:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592217984 00000100:00100000:2.0:1746143691.629901:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9511 00000100:00100000:2.0:1746143691.629908:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963592217984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143691.629924:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143691.629936:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b83d000/0xe984082ccd72562a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1593 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143691.629979:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593722752:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143691.631740:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00002000:00010000:2.0:1746143691.632053:0:15784:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime: 1746143690 -> 1746143691 00002000:00010000:2.0:1746143691.632056:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime: 1746143690 -> 1746143691 00002000:00010000:2.0:1746143691.632058:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime: 1746143690 -> 1746143691 00000100:00100000:2.0:1746143691.632078:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593722624:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143691.632101:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b83da00/0xe984082ccd725623 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a158c expref: 23 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.632113:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b83da00/0xe984082ccd725623 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a158c expref: 23 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.632131:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b83da00, rc 0) 00000100:00100000:2.0:1746143691.632194:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963592217856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5585us (6014us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143691.632200:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9510 00002000:00010000:3.0:1746143691.632424:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143690 -> 1746143691 00002000:00010000:3.0:1746143691.632428:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143690 -> 1746143691 00002000:00010000:3.0:1746143691.632430:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143690 -> 1746143691 00000100:00100000:3.0:1746143691.632440:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593722496:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143691.632454:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090008800/0xe984082ccd72561c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1585 expref: 21 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.632468:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090008800/0xe984082ccd72561c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1585 expref: 21 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.632478:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090008800, rc 0) 00000100:00100000:3.0:1746143691.632502:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963592217728:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6015us (6436us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143691.632507:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9509 00002000:00010000:3.0:1746143691.632538:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime: 1746143690 -> 1746143691 00000100:00100000:3.0:1746143691.632550:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593722368:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143691.632563:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090008200/0xe984082ccd725615 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a157e expref: 36 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.632572:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090008200/0xe984082ccd725615 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a157e expref: 36 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.632580:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090008200, rc 0) 00000100:00100000:3.0:1746143691.632594:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963592217600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8957us (10061us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143691.632599:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9508 00000100:00100000:2.0:1746143691.634824:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593722752:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143691.634848:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b83d000/0xe984082ccd72562a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1593 expref: 34 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.634858:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b83d000/0xe984082ccd72562a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1593 expref: 34 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.634882:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b83d000, rc 0) 00000100:00100000:2.0:1746143691.634914:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963592217984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5006us (5283us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143691.634920:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9511 00000100:00100000:0.0:1746143691.642858:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.642958:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592218112 00000100:00100000:2.0:1746143691.642966:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592218112 00000100:00100000:2.0:1746143691.643017:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9512 00000100:00100000:2.0:1746143691.643024:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:28375:x1830963592218112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143691.643040:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143691.643055:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b83d200/0xe984082ccd725631 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a159a expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.643078:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.643085:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143691.643086:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143691.643089:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b83d200/0xe984082ccd725631 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a159a expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.643112:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.643123:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 28 pid: 15784 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746143691.643133:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593722880:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143691.645639:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.646605:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.646636:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.646670:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.646723:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592218624 00000100:00100000:2.0:1746143691.646729:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592218624 00002000:00100000:2.0:1746143691.646764:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1732608->2097151) req@ffff88008f3cb480 x1830963592218624/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.646773:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb480 with x1830963592218624 ext(1732608->2097151) 00002000:00010000:2.0:1746143691.646777:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cb480 00000100:00100000:2.0:1746143691.646801:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592218496 00000100:00100000:2.0:1746143691.646804:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592218496 00002000:00100000:2.0:1746143691.646815:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1896447) req@ffff88008f3cb800 x1830963592218496/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.646821:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb800 with x1830963592218496 ext(1048576->1896447) 00010000:00010000:2.0:1746143691.646828:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 30 pid: 15784 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.646840:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 30 pid: 15784 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746143691.646846:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3cb800 00000100:00100000:2.0:1746143691.646856:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592218880 00000100:00100000:2.0:1746143691.646858:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592218880 00002000:00100000:2.0:1746143691.646882:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008f3cbb80 x1830963592218880/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.646888:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cbb80 with x1830963592218880 ext(0->1048575) 00002000:00010000:2.0:1746143691.646891:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3cbb80 00000100:00100000:2.0:1746143691.646903:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 838 00000100:00100000:2.0:1746143691.646909:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1964:x1830963592218496:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143691.647795:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3488 00000100:00100000:2.0:1746143691.647801:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1964:x1830963592218624:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143691.648209:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3489 00000100:00100000:2.0:1746143691.648215:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592218880:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143691.651898:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593722880:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.651926:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b83d200/0xe984082ccd725631 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a159a expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.651941:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b83d200, rc 0) 00000100:00100000:3.0:1746143691.651994:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:28375:x1830963592218112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8970us (9143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.652001:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9512 00000100:00100000:0.0:1746143691.653587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.655021:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592219008 00000100:00100000:1.0:1746143691.655030:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592219008 00002000:00100000:1.0:1746143691.655063:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1896448->2097151) req@ffff88008f3c8380 x1830963592219008/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.655073:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8380 with x1830963592219008 ext(1896448->2097151) 00010000:00010000:1.0:1746143691.655080:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 33 pid: 15784 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.655093:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 33 pid: 15784 timeout: 870 lvb_type: 0 00002000:00010000:1.0:1746143691.655099:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3c8380 00000100:00100000:1.0:1746143691.655131:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 839 00000100:00100000:1.0:1746143691.655151:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+33:1964:x1830963592219008:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143691.665089:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+33:1964:x1830963592218496:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18170us (18442us total) trans 0 rc 847872/847872 00000100:00100000:3.0:1746143691.665100:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 838 00002000:00100000:3.0:1746143691.665110:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1896447) req@ffff88008f3cb800 x1830963592218496/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:H/200/0 rc 847872/847872 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.665119:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb800 with x1830963592218496 ext(1048576->1896447) 00010000:00010000:3.0:1746143691.665128:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 33 pid: 15784 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746143691.665151:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 33 pid: 15784 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746143691.665157:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3cb800 00000100:00100000:3.0:1746143691.665658:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1964:x1830963592218624:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17856us (19056us total) trans 0 rc 364544/364544 00000100:00100000:3.0:1746143691.665664:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3488 00002000:00100000:3.0:1746143691.665669:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1732608->2097151) req@ffff88008f3cb480 x1830963592218624/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 364544/364544 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.665675:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb480 with x1830963592218624 ext(1732608->2097151) 00002000:00010000:3.0:1746143691.665677:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cb480 00000100:00100000:0.0:1746143691.666473:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1964:x1830963592219008:12345-192.168.202.48@tcp:4:cat.0 Request processed in 11334us (12888us total) trans 21474839706 rc 0/0 00000100:00100000:0.0:1746143691.666483:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 839 00002000:00100000:0.0:1746143691.666488:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34a:0x0] (1896448->2097151) req@ffff88008f3c8380 x1830963592219008/t21474839706(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/448 e 0 to 0 dl 1746143702 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143691.666496:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8380 with x1830963592219008 ext(1896448->2097151) 00010000:00010000:0.0:1746143691.666501:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 31 pid: 15784 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746143691.666512:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 31 pid: 15784 timeout: 870 lvb_type: 0 00002000:00010000:0.0:1746143691.666517:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3c8380 00000100:00100000:2.0:1746143691.674282:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592218880:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26058us (27603us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143691.674292:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3489 00002000:00100000:2.0:1746143691.674302:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008f3cbb80 x1830963592218880/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.674311:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cbb80 with x1830963592218880 ext(0->1048575) 00002000:00010000:2.0:1746143691.674316:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3cbb80 00000100:00100000:0.0:1746143691.674432:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.675020:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592219136 00000100:00100000:2.0:1746143691.675027:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592219136 00010000:00010000:2.0:1746143691.675054:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 31 pid: 15784 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746143691.675073:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4882 00000100:00100000:2.0:1746143691.675078:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1962:x1830963592219136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143691.675088:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143691.675104:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 31 pid: 15784 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.675113:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 31 pid: 15784 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.675130:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a004ba00/0xe984082ccd7255f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1562 expref: 31 pid: 15784 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.675176:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.675177:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.675183:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b83d200/0xe984082ccd725631 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a159a expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.675190:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b83d200/0xe984082ccd725631 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a159a expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.675214:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b83d200/0xe984082ccd725631 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a159a expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143691.675228:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593723008:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143691.675621:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143691.677672:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593723008:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143691.677687:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143691.677965:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1962:x1830963592219136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2884us (3531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.677973:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4882 00000100:00100000:0.0:1746143691.680120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.680492:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592219392 00000100:00100000:2.0:1746143691.680499:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592219392 00002000:00100000:2.0:1746143691.680534:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88012b79c000 x1830963592219392/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.680543:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c000 with x1830963592219392 ext(1048576->2097151) 00002000:00010000:2.0:1746143691.680548:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79c000 00000100:00100000:2.0:1746143691.680752:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3490 00000100:00100000:2.0:1746143691.680759:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963592219392:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143691.683767:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.683941:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592219520 00000100:00100000:3.0:1746143691.683949:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592219520 00000100:00100000:3.0:1746143691.683986:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9513 00000100:00100000:3.0:1746143691.683992:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+30:28376:x1830963592219520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.684007:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.684022:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090008400/0xe984082ccd725638 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15a1 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.684043:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143691.684045:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143691.684053:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090008400/0xe984082ccd725638 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a1 expref: 31 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.684067:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090008400/0xe984082ccd725638 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a1 expref: 31 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.684076:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090008400, rc 0) 00000100:00100000:3.0:1746143691.684419:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+31:28376:x1830963592219520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 425us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.684426:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9513 00000100:00100000:2.0:1746143691.687680:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963592219392:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6915us (7560us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143691.687690:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3490 00002000:00100000:2.0:1746143691.687699:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88012b79c000 x1830963592219392/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.687708:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c000 with x1830963592219392 ext(1048576->2097151) 00002000:00010000:2.0:1746143691.687712:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79c000 00000100:00100000:0.0:1746143691.689046:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.689209:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592219776 00000100:00100000:2.0:1746143691.689217:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592219776 00002000:00100000:2.0:1746143691.689247:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88012b79c700 x1830963592219776/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.689255:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c700 with x1830963592219776 ext(1048576->2097151) 00002000:00010000:2.0:1746143691.689259:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79c700 00000100:00100000:2.0:1746143691.689274:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3491 00000100:00100000:2.0:1746143691.689280:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1965:x1830963592219776:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143691.692742:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.695328:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592219904 00000100:00100000:3.0:1746143691.695338:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592219904 00000100:00100000:3.0:1746143691.695380:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9514 00000100:00100000:3.0:1746143691.695386:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:28375:x1830963592219904:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.695401:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.695416:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a004b800/0xe984082ccd72563f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15a8 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.695439:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.695446:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143691.695448:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143691.695450:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a004b800/0xe984082ccd72563f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a8 expref: 35 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.695473:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.695482:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 32 pid: 25369 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746143691.695492:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593723136:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.695573:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143691.697489:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1965:x1830963592219776:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8203us (8443us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143691.697498:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3491 00002000:00100000:2.0:1746143691.697507:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88012b79c700 x1830963592219776/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.697515:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c700 with x1830963592219776 ext(1048576->2097151) 00002000:00010000:2.0:1746143691.697519:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79c700 00000100:00100000:0.0:1746143691.701454:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.702360:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593723136:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.702393:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a004b800/0xe984082ccd72563f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a8 expref: 35 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.702409:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a004b800, rc 0) 00000100:00100000:3.0:1746143691.702456:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28375:x1830963592219904:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7070us (9723us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.702464:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9514 00000100:00100000:2.0:1746143691.705018:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592220032 00000100:00100000:2.0:1746143691.705030:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592220032 00002000:00100000:2.0:1746143691.705077:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1732607) req@ffff88012b79ce00 x1830963592220032/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.705085:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ce00 with x1830963592220032 ext(1048576->1732607) 00010000:00010000:2.0:1746143691.705092:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 31 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.705105:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 31 pid: 25369 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746143691.705115:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b79ce00 00000100:00100000:2.0:1746143691.705182:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 840 00000100:00100000:2.0:1746143691.705189:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1965:x1830963592220032:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143691.706212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.706347:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592220160 00000100:00100000:3.0:1746143691.706356:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592220160 00000100:00100000:3.0:1746143691.706381:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9515 00000100:00100000:3.0:1746143691.706387:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+33:28376:x1830963592220160:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.706397:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.706411:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a004be00/0xe984082ccd725646 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15af expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.706431:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143691.706435:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a004be00/0xe984082ccd725646 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15af expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.706445:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a004be00/0xe984082ccd725646 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15af expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.706454:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a004be00, rc 0) 00000100:00100000:3.0:1746143691.706497:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+34:28376:x1830963592220160:12345-192.168.202.48@tcp:101:cat.0 Request processed in 109us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.706503:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9515 00000100:00100000:2.0:1746143691.720534:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+34:1965:x1830963592220032:12345-192.168.202.48@tcp:4:cat.0 Request processed in 15338us (19078us total) trans 21474839707 rc 0/0 00000100:00100000:2.0:1746143691.720545:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 840 00002000:00100000:2.0:1746143691.720554:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1732607) req@ffff88012b79ce00 x1830963592220032/t21474839707(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/448 e 0 to 0 dl 1746143702 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.720562:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ce00 with x1830963592220032 ext(1048576->1732607) 00010000:00010000:2.0:1746143691.720571:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 34 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.720586:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 34 pid: 25369 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746143691.720592:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b79ce00 00000100:00100000:2.0:1746143691.734435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.734536:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592220288 00000100:00100000:0.0:1746143691.734545:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592220288 00010000:00010000:0.0:1746143691.734578:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 34 pid: 25369 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746143691.734689:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4883 00000100:00100000:0.0:1746143691.734696:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+34:1965:x1830963592220288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143691.734713:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143691.734737:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 34 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746143691.734748:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 34 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746143691.734886:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f1e1400/0xe984082ccd725600 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1569 expref: 34 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746143691.734905:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143691.734906:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143691.734915:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a004b800/0xe984082ccd72563f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a8 expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.734921:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a004b800/0xe984082ccd72563f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a8 expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.734928:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143691.734929:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143691.734932:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a004be00/0xe984082ccd725646 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15af expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.734937:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a004be00/0xe984082ccd725646 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15af expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.734972:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a004be00/0xe984082ccd725646 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15af expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143691.734990:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593723264:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143691.736052:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a004b800/0xe984082ccd72563f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a8 expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143691.736062:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593723392:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143691.736086:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143691.739329:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593723264:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143691.739342:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593723392:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143691.739360:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143691.739398:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+33:1965:x1830963592220288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4701us (4972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.739407:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4883 00000100:00100000:0.0:1746143691.746421:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.746518:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592220544 00000100:00100000:2.0:1746143691.746527:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592220544 00002000:00100000:2.0:1746143691.746565:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88012b79dc00 x1830963592220544/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.746574:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79dc00 with x1830963592220544 ext(1048576->2097151) 00002000:00010000:2.0:1746143691.746578:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79dc00 00000100:00100000:2.0:1746143691.746614:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3492 00000100:00100000:2.0:1746143691.746621:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+33:1964:x1830963592220544:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143691.750215:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.750260:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.750924:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592220800 00000100:00100000:0.0:1746143691.750938:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592220800 00002000:00100000:0.0:1746143691.750978:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009bef7480 x1830963592220800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143691.750988:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef7480 with x1830963592220800 ext(1048576->2097151) 00002000:00010000:0.0:1746143691.750993:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bef7480 00000100:00100000:0.0:1746143691.751020:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592221056 00000100:00100000:0.0:1746143691.751023:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592221056 00002000:00100000:0.0:1746143691.751039:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1675263) req@ffff88009bef5c00 x1830963592221056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143691.751045:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef5c00 with x1830963592221056 ext(1048576->1675263) 00002000:00010000:0.0:1746143691.751048:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef5c00 00000100:00100000:0.0:1746143691.751304:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3493 00000100:00100000:0.0:1746143691.751312:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963592220800:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143691.751960:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3494 00000100:00100000:3.0:1746143691.751968:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592221056:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143691.764168:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+33:1964:x1830963592220544:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17503us (17710us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143691.764178:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3492 00002000:00100000:2.0:1746143691.764188:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88012b79dc00 x1830963592220544/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.764197:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79dc00 with x1830963592220544 ext(1048576->2097151) 00002000:00010000:2.0:1746143691.764202:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79dc00 00000100:00100000:2.0:1746143691.767718:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963592220800:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16398us (17504us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143691.767729:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3493 00002000:00100000:2.0:1746143691.767738:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009bef7480 x1830963592220800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.767747:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef7480 with x1830963592220800 ext(1048576->2097151) 00002000:00010000:2.0:1746143691.767753:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bef7480 00000100:00100000:3.0:1746143691.768473:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592221056:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16503us (18209us total) trans 0 rc 626688/626688 00000100:00100000:3.0:1746143691.768480:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3494 00002000:00100000:3.0:1746143691.768484:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1675263) req@ffff88009bef5c00 x1830963592221056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 626688/626688 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.768491:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef5c00 with x1830963592221056 ext(1048576->1675263) 00002000:00010000:3.0:1746143691.768494:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef5c00 00000100:00100000:0.0:1746143691.777124:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.777852:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592221184 00000100:00100000:2.0:1746143691.777859:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592221184 00000100:00100000:2.0:1746143691.778621:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9516 00000100:00100000:2.0:1746143691.778628:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28376:x1830963592221184:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143691.778643:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143691.778658:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b37e00/0xe984082ccd72564d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15b6 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.778679:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.778685:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143691.778687:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143691.778689:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b37e00/0xe984082ccd72564d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15b6 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.778713:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.778723:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 29 pid: 25369 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746143691.778732:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593723520:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143691.781915:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.787407:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.787450:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.787565:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593723520:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143691.787590:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b37e00/0xe984082ccd72564d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15b6 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.787608:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b37e00, rc 0) 00000100:00100000:2.0:1746143691.787646:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28376:x1830963592221184:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9018us (10527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.787653:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9516 00000100:00100000:2.0:1746143691.787685:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592221312 00000100:00100000:2.0:1746143691.787689:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592221312 00002000:00100000:2.0:1746143691.787717:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1675264->2097151) req@ffff88012b79e300 x1830963592221312/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.787726:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79e300 with x1830963592221312 ext(1675264->2097151) 00010000:00010000:2.0:1746143691.787731:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 30 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.787742:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 30 pid: 25369 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746143691.787748:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b79e300 00000100:00100000:2.0:1746143691.787761:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592221568 00000100:00100000:2.0:1746143691.787764:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592221568 00002000:00100000:2.0:1746143691.787775:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2445312->3493887) req@ffff88012b79e680 x1830963592221568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.787781:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79e680 with x1830963592221568 ext(2445312->3493887) 00002000:00010000:2.0:1746143691.787784:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79e680 00000100:00100000:2.0:1746143691.787794:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 841 00000100:00100000:2.0:1746143691.787799:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592221312:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143691.788187:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3495 00000100:00100000:2.0:1746143691.788194:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592221568:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143691.795457:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.796412:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592221824 00000100:00100000:3.0:1746143691.796421:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592221824 00002000:00100000:3.0:1746143691.796459:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3493888->4194303) req@ffff88012b79ea00 x1830963592221824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.796468:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ea00 with x1830963592221824 ext(3493888->4194303) 00002000:00010000:3.0:1746143691.796472:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79ea00 00000100:00100000:3.0:1746143691.796497:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3496 00000100:00100000:3.0:1746143691.796504:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592221824:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143691.818800:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.821254:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592221568:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33052us (33795us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143691.821266:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3495 00002000:00100000:2.0:1746143691.821278:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (2445312->3493887) req@ffff88012b79e680 x1830963592221568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.821286:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79e680 with x1830963592221568 ext(2445312->3493887) 00002000:00010000:2.0:1746143691.821291:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79e680 00000100:00100000:2.0:1746143691.821326:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592222080 00000100:00100000:2.0:1746143691.821331:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592222080 00000100:00100000:2.0:1746143691.821363:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8263 00000100:00100000:2.0:1746143691.821369:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28378:x1830963592222080:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143691.821386:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143691.821401:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36800/0xe984082ccd725654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15bd expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.821487:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b37a00/0xe984082ccd72565b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143691.821499:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b37a00/0xe984082ccd72565b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143691.821508:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b37a00/0xe984082ccd72565b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143691.821517:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143691.821615:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b36800/0xe984082ccd725654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15bd expref: 27 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.821632:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b37a00/0xe984082ccd72565b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15bd expref: 26 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.821639:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143691.821641:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143691.821644:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b37a00, rc 0) 00000100:00100000:1.0:1746143691.822936:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592221824:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26429us (27483us total) trans 0 rc 700416/700416 00000100:00100000:1.0:1746143691.822943:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3496 00002000:00100000:1.0:1746143691.822949:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3493888->4194303) req@ffff88012b79ea00 x1830963592221824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 700416/700416 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.822956:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ea00 with x1830963592221824 ext(3493888->4194303) 00002000:00010000:1.0:1746143691.822960:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79ea00 00000100:00100000:2.0:1746143691.824667:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+26:28378:x1830963592222080:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3292us (5869us total) trans 8589942363 rc 0/0 00000100:00100000:2.0:1746143691.824675:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8263 00000100:00100000:3.0:1746143691.833580:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592221312:12345-192.168.202.48@tcp:4:cat.0 Request processed in 45772us (46173us total) trans 17179872437 rc 0/0 00000100:00100000:3.0:1746143691.833591:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 841 00002000:00100000:3.0:1746143691.833601:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1675264->2097151) req@ffff88012b79e300 x1830963592221312/t17179872437(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/448 e 0 to 0 dl 1746143702 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.833610:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79e300 with x1830963592221312 ext(1675264->2097151) 00010000:00010000:3.0:1746143691.833619:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 32 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746143691.833633:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 32 pid: 25369 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746143691.833640:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b79e300 00000100:00100000:0.0:1746143691.837128:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.837552:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592222208 00000100:00100000:3.0:1746143691.837560:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592222208 00000100:00100000:3.0:1746143691.837606:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9517 00000100:00100000:3.0:1746143691.837612:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592222208:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.837627:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.837641:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0821e00/0xe984082ccd725669 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15c4 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143691.837695:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593723648:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143691.842296:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143691.847636:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593723648:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143691.847667:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0821e00/0xe984082ccd725669 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15c4 expref: 33 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.847679:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0821e00/0xe984082ccd725669 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15c4 expref: 33 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.850388:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0821e00, rc 0) 00000100:00100000:3.0:1746143691.850755:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592222208:12345-192.168.202.48@tcp:101:cat.0 Request processed in 13137us (13629us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143691.850764:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9517 00000100:00100000:0.0:1746143691.856194:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.856298:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592222464 00000100:00100000:2.0:1746143691.856312:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592222464 00010000:00010000:2.0:1746143691.856359:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 32 pid: 25369 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746143691.856416:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4884 00000100:00100000:2.0:1746143691.856426:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592222464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143691.856440:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143691.856465:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 32 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.856477:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 32 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.856499:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b83c600/0xe984082ccd725607 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1570 expref: 32 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.856537:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.856540:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.856547:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b37e00/0xe984082ccd72564d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15b6 expref: 20 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.856555:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b37e00/0xe984082ccd72564d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15b6 expref: 20 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.856614:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093b37e00/0xe984082ccd72564d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15b6 expref: 20 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143691.856643:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593723776:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143691.856756:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.861410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.861715:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592222592 00000100:00100000:3.0:1746143691.861724:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592222592 00002000:00100000:3.0:1746143691.861765:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88012b79f480 x1830963592222592/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.861773:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79f480 with x1830963592222592 ext(4194304->4898815) 00002000:00010000:3.0:1746143691.861778:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79f480 00000100:00100000:3.0:1746143691.861806:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3497 00000100:00100000:3.0:1746143691.861812:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592222592:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143691.871043:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593723776:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143691.871064:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143691.871132:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963592222464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 14707us (14994us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.871177:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4884 00000100:00100000:0.0:1746143691.894360:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.894420:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592222848 00000100:00100000:1.0:1746143691.894430:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592222848 00002000:00100000:1.0:1746143691.894475:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88012b79f800 x1830963592222848/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.894484:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79f800 with x1830963592222848 ext(1048576->2097151) 00002000:00010000:1.0:1746143691.894490:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79f800 00000100:00100000:1.0:1746143691.894510:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3498 00000100:00100000:1.0:1746143691.894517:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592222848:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143691.900801:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592222592:12345-192.168.202.48@tcp:3:cat.0 Request processed in 38975us (39392us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143691.900814:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3497 00002000:00100000:3.0:1746143691.900826:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88012b79f480 x1830963592222592/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.900836:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79f480 with x1830963592222592 ext(4194304->4898815) 00002000:00010000:3.0:1746143691.900842:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79f480 00000100:00100000:1.0:1746143691.910857:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592222848:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16328us (16495us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143691.910879:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3498 00002000:00100000:1.0:1746143691.910891:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88012b79f800 x1830963592222848/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.910901:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79f800 with x1830963592222848 ext(1048576->2097151) 00002000:00010000:1.0:1746143691.910908:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79f800 00000100:00100000:0.0:1746143691.911345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.911419:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592222976 00000100:00100000:3.0:1746143691.911427:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592222976 00000100:00100000:3.0:1746143691.911460:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9518 00000100:00100000:3.0:1746143691.911466:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28380:x1830963592222976:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143691.911481:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.911498:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15cb expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.911526:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72544e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1420 expref: 32 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.911534:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e91200/0xe984082ccd725582 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1523 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.911540:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090651200/0xe984082ccd7254da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1497 expref: 36 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.911545:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143691.911547:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143691.911549:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.911581:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090651200/0xe984082ccd7254da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1497 expref: 36 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.911592:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090651200/0xe984082ccd7254da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1497 expref: 36 pid: 4582 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746143691.911602:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593723904:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.911676:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e91200/0xe984082ccd725582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1523 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.911683:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e91200/0xe984082ccd725582 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1523 expref: 9 pid: 8497 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746143691.911690:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593724032:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.911709:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72544e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1420 expref: 32 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.911716:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72544e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1420 expref: 32 pid: 6929 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746143691.911723:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593724160:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.911734:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.914182:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.914258:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592223104 00000100:00100000:2.0:1746143691.914267:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592223104 00000100:00100000:2.0:1746143691.914308:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9519 00000100:00100000:2.0:1746143691.914315:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592223104:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143691.914332:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143691.914345:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b36400/0xe984082ccd725677 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15d2 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.914368:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.914370:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.914377:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b36400/0xe984082ccd725677 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d2 expref: 32 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.914389:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b36400/0xe984082ccd725677 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d2 expref: 32 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143691.914399:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b36400, rc 0) 00000100:00100000:2.0:1746143691.914436:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592223104:12345-192.168.202.48@tcp:101:cat.0 Request processed in 120us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.914441:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9519 00000100:00100000:3.0:1746143691.915976:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593723904:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.915987:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593724032:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.915993:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593724160:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.916015:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 36 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.916027:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0864200, rc 0) 00000100:00100000:3.0:1746143691.917117:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:28380:x1830963592222976:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5647us (5768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.917125:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9518 00000100:00100000:0.0:1746143691.918714:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.918821:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592223360 00000100:00100000:3.0:1746143691.918828:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592223360 00000100:00100000:0.0:1746143691.920209:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9520 00000100:00100000:0.0:1746143691.920219:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28376:x1830963592223360:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143691.920235:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143691.920249:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72567e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15d9 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.920274:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.920281:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143691.920282:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143691.920285:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72567e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d9 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.920323:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.920333:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 31 pid: 25369 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746143691.920348:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0850000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593724288:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143691.920433:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.923389:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.923424:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.923449:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592223232 00000100:00100000:0.0:1746143691.923450:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.923456:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592223232 00000100:00100000:0.0:1746143691.923464:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592223616 00000100:00100000:0.0:1746143691.923466:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592223616 00010000:00010000:2.0:1746143691.923485:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e91200/0xe984082ccd725582 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1523 expref: 10 pid: 8497 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746143691.923485:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090651200/0xe984082ccd7254da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1497 expref: 36 pid: 4582 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746143691.923502:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592223488 00000100:00100000:0.0:1746143691.923504:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592223488 00010000:00010000:0.0:1746143691.923513:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72544e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1420 expref: 33 pid: 6929 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746143691.923522:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4885 00000100:00100000:0.0:1746143691.923525:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4886 00000100:00100000:2.0:1746143691.923528:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963592223616:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143691.923529:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592223232:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143691.923538:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143691.923538:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143691.923555:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090651200/0xe984082ccd7254da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1497 expref: 36 pid: 4582 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746143691.923555:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e91200/0xe984082ccd725582 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1523 expref: 10 pid: 8497 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746143691.923563:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090651200/0xe984082ccd7254da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1497 expref: 36 pid: 4582 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746143691.923581:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e91200/0xe984082ccd725582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1523 expref: 10 pid: 8497 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746143691.923624:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4887 00000100:00100000:1.0:1746143691.923634:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+33:1964:x1830963592223488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143691.923640:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143691.923735:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090651200/0xe984082ccd7254da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1497 expref: 36 pid: 4582 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746143691.923746:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e91200/0xe984082ccd725582 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1523 expref: 10 pid: 8497 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746143691.923760:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143691.923771:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72544e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1420 expref: 33 pid: 6929 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.923778:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72544e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1420 expref: 33 pid: 6929 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.923788:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72544e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1420 expref: 33 pid: 6929 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746143691.923791:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592223232:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 261us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143691.923796:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4886 00010000:00010000:1.0:1746143691.923800:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143691.923802:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143691.923807:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.923813:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.923839:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 35 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143691.923847:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.923849:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593724416:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143691.923900:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.923957:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0850000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593724288:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143691.923975:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72567e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d9 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.923985:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91600, rc 0) 00000100:00100000:0.0:1746143691.924002:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28376:x1830963592223360:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3785us (5292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143691.924007:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9520 00000100:00100000:0.0:1746143691.924020:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592223744 00000100:00100000:0.0:1746143691.924022:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592223744 00000100:00100000:0.0:1746143691.924036:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9521 00000100:00100000:0.0:1746143691.924040:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+33:28378:x1830963592223744:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143691.924050:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143691.924059:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15e0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.924072:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b83d200/0xe984082ccd725631 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a159a expref: 35 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.924078:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090008400/0xe984082ccd725638 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a1 expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.924084:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143691.924086:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143691.924088:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [1331200->1921023] (req 1331200->1921023) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.924102:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090008400/0xe984082ccd725638 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a1 expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.924111:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090008400/0xe984082ccd725638 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a1 expref: 34 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.924113:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143691.924118:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0850000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593724544:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143691.924130:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963592223616:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 603us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.924136:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4885 00000100:00100000:3.0:1746143691.924484:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.924500:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592223872 00000100:00100000:3.0:1746143691.924503:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592223872 00002000:00100000:3.0:1746143691.924524:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094c13100 x1830963592223872/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 504/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.924532:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13100 with x1830963592223872 ext(2097152->3145727) 00010000:00010000:3.0:1746143691.924537:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 32 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746143691.924545:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 32 pid: 25369 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746143691.924549:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c13100 00000100:00100000:3.0:1746143691.924561:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 842 00000100:00100000:3.0:1746143691.924566:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963592223872:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:0.0:1746143691.924727:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b83d200/0xe984082ccd725631 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a159a expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143691.924735:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b83d200/0xe984082ccd725631 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a159a expref: 34 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746143691.924744:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0850e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593724672:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143691.924762:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.925901:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.925966:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592224000 00000100:00100000:3.0:1746143691.925970:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592224000 00000100:00100000:3.0:1746143691.926386:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9522 00000100:00100000:3.0:1746143691.926393:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963592224000:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.926402:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.926411:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0864a00/0xe984082ccd72568c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15e7 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143691.926441:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593724800:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143691.926554:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.935713:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.935791:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.935813:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592224128 00000100:00100000:0.0:1746143691.935819:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592224128 00010000:00010000:0.0:1746143691.935846:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090008400/0xe984082ccd725638 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a1 expref: 35 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746143691.935879:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592224256 00000100:00100000:0.0:1746143691.935881:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592224256 00010000:00010000:0.0:1746143691.935889:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b83d200/0xe984082ccd725631 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a159a expref: 37 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746143691.935901:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4888 00000100:00100000:0.0:1746143691.935907:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1964:x1830963592224128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143691.935917:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143691.935935:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090008400/0xe984082ccd725638 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a1 expref: 35 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746143691.935944:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090008400/0xe984082ccd725638 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a1 expref: 35 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746143691.935963:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143691.935975:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4889 00000100:00100000:2.0:1746143691.935980:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0851880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963592224256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143691.935986:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143691.935994:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1964:x1830963592224128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 87us (290us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143691.935995:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b83d200/0xe984082ccd725631 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a159a expref: 37 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746143691.936000:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4888 00010000:00010000:2.0:1746143691.936002:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b83d200/0xe984082ccd725631 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a159a expref: 37 pid: 4582 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.936012:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.936014:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.936020:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.936026:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.936052:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143691.936062:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593724928:192.168.202.48@tcp:105: 00002000:00010000:3.0:1746143691.936125:0:25369:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime: 1746143690 -> 1746143691 00002000:00010000:3.0:1746143691.936128:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143690 -> 1746143691 00002000:00010000:3.0:1746143691.936130:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime: 1746143690 -> 1746143691 00000100:00100000:3.0:1746143691.936170:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593724800:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143691.936189:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0864a00/0xe984082ccd72568c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e7 expref: 37 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.936198:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0864a00/0xe984082ccd72568c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e7 expref: 37 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143691.936212:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0864a00, rc 0) 00000100:00100000:1.0:1746143691.936392:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593724416:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143691.936404:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143691.936422:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+34:1964:x1830963592223488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12792us (12971us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143691.936427:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4887 00010000:00010000:1.0:1746143691.936449:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090008400/0xe984082ccd725638 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a1 expref: 33 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746143691.936466:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0850000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593724544:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143691.936473:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b83d200/0xe984082ccd725631 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a159a expref: 36 pid: 4582 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746143691.936479:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0850e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593724672:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143691.936490:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 32 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143691.936496:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e90c00, rc 0) 00000100:00100000:1.0:1746143691.936509:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+32:28378:x1830963592223744:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 12469us (12661us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143691.936514:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9521 00000100:00100000:3.0:1746143691.936696:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963592224000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 10303us (10797us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143691.936702:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9522 00000100:00100000:2.0:1746143691.936708:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.942726:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143691.942749:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.942868:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593724928:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143691.942886:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143691.942929:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0851880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963592224256:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6947us (7136us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.942939:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4889 00000100:00100000:2.0:1746143691.942971:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592224512 00000100:00100000:2.0:1746143691.942975:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592224512 00000100:00100000:1.0:1746143691.942984:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592224768 00000100:00100000:1.0:1746143691.942987:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592224768 00002000:00100000:2.0:1746143691.943003:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2449408->2453503) req@ffff8800a0851c00 x1830963592224512/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.943003:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1331200->1335295) req@ffff8800a0851f80 x1830963592224768/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143691.943012:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0851c00 with x1830963592224512 ext(2449408->2453503) 00002000:00100000:1.0:1746143691.943012:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0851f80 with x1830963592224768 ext(1331200->1335295) 00002000:00010000:2.0:1746143691.943016:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0851c00 00002000:00010000:1.0:1746143691.943016:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0851f80 00000100:00100000:1.0:1746143691.943029:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3499 00000100:00100000:1.0:1746143691.943035:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1964:x1830963592224768:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143691.943170:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1964:x1830963592224768:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 134us (418us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143691.943175:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3499 00002000:00100000:1.0:1746143691.943180:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1331200->1335295) req@ffff8800a0851f80 x1830963592224768/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/4536 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.943186:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0851f80 with x1830963592224768 ext(1331200->1335295) 00002000:00010000:1.0:1746143691.943189:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0851f80 00000100:00100000:1.0:1746143691.943200:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3500 00000100:00100000:1.0:1746143691.943205:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963592224512:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143691.943263:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963592224512:12345-192.168.202.48@tcp:3:cat.0 Request processed in 57us (543us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143691.943268:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3500 00002000:00100000:1.0:1746143691.943272:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2449408->2453503) req@ffff8800a0851c00 x1830963592224512/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/4536 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.943278:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0851c00 with x1830963592224512 ext(2449408->2453503) 00002000:00010000:1.0:1746143691.943280:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0851c00 00000100:00100000:3.0:1746143691.944285:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592223872:12345-192.168.202.48@tcp:4:cat.0 Request processed in 19716us (19798us total) trans 17179872438 rc 0/0 00000100:00100000:3.0:1746143691.944292:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 842 00002000:00100000:3.0:1746143691.944297:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094c13100 x1830963592223872/t17179872438(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 504/448 e 0 to 0 dl 1746143702 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.944303:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13100 with x1830963592223872 ext(2097152->3145727) 00010000:00010000:3.0:1746143691.944310:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 34 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746143691.944321:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 34 pid: 25369 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746143691.944327:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c13100 00000100:00100000:0.0:1746143691.957755:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143691.957987:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592224896 00000100:00100000:2.0:1746143691.957996:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592224896 00010000:00010000:2.0:1746143691.958028:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 34 pid: 25369 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746143691.958053:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4890 00000100:00100000:2.0:1746143691.958059:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963592224896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143691.958071:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143691.958090:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 34 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.958106:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 34 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.958124:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a004b200/0xe984082ccd72560e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1577 expref: 34 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746143691.958168:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.958170:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143691.958177:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72567e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d9 expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.958183:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72567e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d9 expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143691.958211:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72567e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d9 expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143691.958221:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593725056:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143691.958302:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143691.961781:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.962785:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592225152 00000100:00100000:3.0:1746143691.962795:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592225152 00002000:00100000:3.0:1746143691.962836:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1916928->1921023) req@ffff88009bef7800 x1830963592225152/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.962845:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef7800 with x1830963592225152 ext(1916928->1921023) 00002000:00010000:3.0:1746143691.962850:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bef7800 00000100:00100000:3.0:1746143691.963261:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3501 00000100:00100000:3.0:1746143691.963269:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1964:x1830963592225152:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143691.963436:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1964:x1830963592225152:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 167us (1662us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143691.963442:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3501 00002000:00100000:3.0:1746143691.963448:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1916928->1921023) req@ffff88009bef7800 x1830963592225152/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/4536 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143691.963460:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef7800 with x1830963592225152 ext(1916928->1921023) 00002000:00010000:3.0:1746143691.963462:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bef7800 00000100:00100000:2.0:1746143691.964881:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593725056:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143691.964898:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143691.964925:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963592224896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6866us (7182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143691.964933:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4890 00000100:00100000:0.0:1746143691.965493:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.965540:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592225408 00000100:00100000:1.0:1746143691.965544:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592225408 00002000:00100000:1.0:1746143691.965570:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a0852680 x1830963592225408/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.965577:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0852680 with x1830963592225408 ext(2097152->3145727) 00002000:00010000:1.0:1746143691.965581:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0852680 00000100:00100000:1.0:1746143691.965607:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3502 00000100:00100000:1.0:1746143691.965613:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592225408:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143691.982322:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592225408:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 16700us (16821us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143691.982334:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3502 00002000:00100000:1.0:1746143691.982344:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a0852680 x1830963592225408/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:87/0 lens 488/440 e 0 to 0 dl 1746143702 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.982353:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0852680 with x1830963592225408 ext(2097152->3145727) 00002000:00010000:1.0:1746143691.982358:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0852680 00000100:00100000:0.0:1746143691.989468:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143691.989802:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592225536 00000100:00100000:3.0:1746143691.989815:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592225536 00000100:00100000:3.0:1746143691.989888:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9523 00000100:00100000:3.0:1746143691.989896:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+32:28376:x1830963592225536:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143691.989912:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143691.989929:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0864c00/0xe984082ccd725693 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15ee expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.989953:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.989964:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143691.989966:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143691.989969:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0864c00/0xe984082ccd725693 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15ee expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.990008:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.990020:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 33 pid: 25369 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746143691.990030:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593725184:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143691.991155:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143691.994364:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143691.994465:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592225664 00000100:00100000:1.0:1746143691.994475:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592225664 00002000:00100000:1.0:1746143691.994524:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2453503) req@ffff8800a0852d80 x1830963592225664/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/0 e 0 to 0 dl 1746143702 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143691.994534:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0852d80 with x1830963592225664 ext(2097152->2453503) 00010000:00010000:1.0:1746143691.994543:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 34 pid: 25369 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746143691.994557:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 34 pid: 25369 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746143691.994563:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0852d80 00000100:00100000:1.0:1746143691.994598:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 843 00000100:00100000:1.0:1746143691.994606:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592225664:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143691.996874:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593725184:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143691.996911:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0864c00/0xe984082ccd725693 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15ee expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143691.996928:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0864c00, rc 0) 00000100:00100000:3.0:1746143691.996983:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+33:28376:x1830963592225536:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7087us (7526us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143691.997006:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9523 00000100:00100000:1.0:1746143692.001223:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963592225664:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6605us (6857us total) trans 21474839708 rc 0/0 00000100:00100000:1.0:1746143692.001236:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 843 00002000:00100000:1.0:1746143692.001248:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2453503) req@ffff8800a0852d80 x1830963592225664/t21474839708(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:87/0 lens 488/448 e 0 to 0 dl 1746143702 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.001258:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0852d80 with x1830963592225664 ext(2097152->2453503) 00010000:00010000:1.0:1746143692.001270:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 36 pid: 25369 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.001285:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 36 pid: 25369 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746143692.001293:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0852d80 00000100:00100000:0.0:1746143692.005380:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.005446:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592225792 00000100:00100000:2.0:1746143692.005460:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592225792 00010000:00010000:2.0:1746143692.005530:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 36 pid: 25369 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.005578:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4891 00000100:00100000:2.0:1746143692.005586:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963592225792:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.005603:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143692.005626:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 36 pid: 25369 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.005639:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 36 pid: 25369 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.005665:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0864200/0xe984082ccd725670 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15cb expref: 36 pid: 25369 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.005697:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.005699:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.005706:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0864c00/0xe984082ccd725693 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15ee expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.005715:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0864c00/0xe984082ccd725693 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15ee expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.005749:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0864c00/0xe984082ccd725693 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15ee expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143692.005766:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593725312:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143692.005852:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.009594:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593725312:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143692.009622:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143692.009677:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963592225792:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4089us (4305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.009688:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4891 00000100:00100000:0.0:1746143692.027275:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.027387:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592226176 00000100:00100000:1.0:1746143692.027397:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592226176 00002000:00100000:1.0:1746143692.027448:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a0853480 x1830963592226176/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.027459:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0853480 with x1830963592226176 ext(2097152->3145727) 00002000:00010000:1.0:1746143692.027464:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0853480 00000100:00100000:1.0:1746143692.027743:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3503 00000100:00100000:1.0:1746143692.027752:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+33:1965:x1830963592226176:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143692.030111:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.030163:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592226304 00000100:00100000:3.0:1746143692.030173:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592226304 00002000:00100000:3.0:1746143692.030214:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800a0853800 x1830963592226304/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.030222:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0853800 with x1830963592226304 ext(3145728->4194303) 00002000:00010000:3.0:1746143692.030227:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0853800 00000100:00100000:3.0:1746143692.030247:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3504 00000100:00100000:3.0:1746143692.030254:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1964:x1830963592226304:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143692.031067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.031101:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592226560 00000100:00100000:1.0:1746143692.031104:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592226560 00002000:00100000:1.0:1746143692.031125:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880093804700 x1830963592226560/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.031159:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804700 with x1830963592226560 ext(3145728->4194303) 00002000:00010000:1.0:1746143692.031163:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093804700 00000100:00100000:1.0:1746143692.031175:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3505 00000100:00100000:1.0:1746143692.031181:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592226560:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143692.043445:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1965:x1830963592226176:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 15681us (16167us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143692.043456:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3503 00002000:00100000:1.0:1746143692.043470:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a0853480 x1830963592226176/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.043480:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0853480 with x1830963592226176 ext(2097152->3145727) 00002000:00010000:1.0:1746143692.043486:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0853480 00000100:00100000:3.0:1746143692.048323:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+33:1964:x1830963592226304:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 18057us (18211us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143692.048334:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3504 00002000:00100000:3.0:1746143692.048346:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800a0853800 x1830963592226304/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.048355:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0853800 with x1830963592226304 ext(3145728->4194303) 00002000:00010000:3.0:1746143692.048361:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0853800 00000100:00100000:1.0:1746143692.059293:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592226560:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 28100us (28215us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143692.059305:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3505 00002000:00100000:1.0:1746143692.059317:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880093804700 x1830963592226560/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.059326:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804700 with x1830963592226560 ext(3145728->4194303) 00002000:00010000:1.0:1746143692.059331:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093804700 00000100:00100000:0.0:1746143692.066459:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.068103:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592226816 00000100:00100000:1.0:1746143692.068115:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592226816 00002000:00100000:1.0:1746143692.068182:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a0853b80 x1830963592226816/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.068198:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0853b80 with x1830963592226816 ext(4194304->4898815) 00002000:00010000:1.0:1746143692.068204:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0853b80 00000100:00100000:1.0:1746143692.068240:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3506 00000100:00100000:1.0:1746143692.068248:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963592226816:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143692.074806:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963592226816:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6551us (8352us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143692.074815:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3506 00002000:00100000:1.0:1746143692.074826:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a0853b80 x1830963592226816/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.074834:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0853b80 with x1830963592226816 ext(4194304->4898815) 00002000:00010000:1.0:1746143692.074839:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0853b80 00000100:00100000:0.0:1746143692.088278:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.088321:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.088358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.088379:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592226944 00000100:00100000:0.0:1746143692.088385:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592226944 00000100:00100000:0.0:1746143692.088423:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592227072 00000100:00100000:0.0:1746143692.088424:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592227072 00000100:00100000:0.0:1746143692.088433:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592227200 00000100:00100000:0.0:1746143692.088434:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592227200 00000100:00100000:0.0:1746143692.088444:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9524 00000100:00100000:0.0:1746143692.088450:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963592226944:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143692.088465:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143692.088478:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090009800/0xe984082ccd72569a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15f5 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143692.088493:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9525 00000100:00100000:2.0:1746143692.088507:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963592227072:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143692.088516:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593725440:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143692.088525:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.088539:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a008a800/0xe984082ccd7256a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a15fc expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.088560:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.088562:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.088571:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a008a800/0xe984082ccd7256a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15fc expref: 34 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.088587:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a008a800/0xe984082ccd7256a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15fc expref: 34 pid: 15784 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143692.088587:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b300 going to sleep for 11 seconds 00010000:00010000:2.0:1746143692.088597:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a008a800, rc 0) 00000100:00100000:2.0:1746143692.088640:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963592227072:12345-192.168.202.48@tcp:101:cat.0 Request processed in 138us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.088650:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9525 00000100:00100000:2.0:1746143692.088672:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9526 00000100:00100000:2.0:1746143692.088677:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592227200:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.088684:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.088691:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a008aa00/0xe984082ccd7256a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1603 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.088703:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.088704:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.088708:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a008aa00/0xe984082ccd7256a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1603 expref: 38 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.088722:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a008aa00/0xe984082ccd7256a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1603 expref: 38 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.088728:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a008aa00, rc 0) 00000100:00100000:2.0:1746143692.088751:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963592227200:12345-192.168.202.48@tcp:101:cat.0 Request processed in 74us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.088755:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9526 00000100:00100000:2.0:1746143692.091771:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593725440:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143692.091807:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090009800/0xe984082ccd72569a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15f5 expref: 37 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.091820:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090009800/0xe984082ccd72569a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15f5 expref: 37 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.091868:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090009800, rc 0) 00000100:00100000:2.0:1746143692.091943:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963592226944:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3490us (3671us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143692.091951:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9524 00000100:00100000:0.0:1746143692.105313:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.107234:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592227328 00000100:00100000:2.0:1746143692.107245:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592227328 00000100:00100000:2.0:1746143692.107299:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9527 00000100:00100000:2.0:1746143692.107307:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:28390:x1830963592227328:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.107328:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.107348:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a008ae00/0xe984082ccd7256af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a160a expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.107379:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 32 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.107388:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143692.107389:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143692.107392:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a008ae00/0xe984082ccd7256af lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a160a expref: 37 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.107423:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 32 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.108853:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 32 pid: 8495 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.108899:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593725568:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.109086:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143692.113044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.115245:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593725568:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.115279:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a008ae00/0xe984082ccd7256af lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a160a expref: 37 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.115300:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a008ae00, rc 0) 00000100:00100000:2.0:1746143692.115361:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:28390:x1830963592227328:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8054us (10060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.115370:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9527 00000100:00100000:1.0:1746143692.115475:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592227456 00000100:00100000:1.0:1746143692.115483:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592227456 00002000:00100000:1.0:1746143692.115535:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1331200->1921023) req@ffff88008f3c8700 x1830963592227456/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.115544:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8700 with x1830963592227456 ext(1331200->1921023) 00010000:00010000:1.0:1746143692.115551:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 33 pid: 8495 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.115564:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 33 pid: 8495 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746143692.115571:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3c8700 00000100:00100000:1.0:1746143692.115600:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 844 00000100:00100000:1.0:1746143692.115608:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+33:1964:x1830963592227456:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143692.132415:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1964:x1830963592227456:12345-192.168.202.48@tcp:4:cat.0 Request processed in 16798us (19374us total) trans 21474839709 rc 0/0 00000100:00100000:1.0:1746143692.132426:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 844 00002000:00100000:1.0:1746143692.132437:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1331200->1921023) req@ffff88008f3c8700 x1830963592227456/t21474839709(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/448 e 0 to 0 dl 1746143703 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.132446:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8700 with x1830963592227456 ext(1331200->1921023) 00010000:00010000:1.0:1746143692.132455:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 35 pid: 8495 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.132471:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 35 pid: 8495 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746143692.132477:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3c8700 00000100:00100000:0.0:1746143692.138643:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.139967:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592227584 00000100:00100000:2.0:1746143692.139975:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592227584 00010000:00010000:2.0:1746143692.140008:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 35 pid: 8495 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.140384:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4892 00000100:00100000:2.0:1746143692.140392:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1964:x1830963592227584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.140405:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143692.140428:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 35 pid: 8495 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.140439:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 35 pid: 8495 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.140463:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd725685 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1331200->1921023) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15e0 expref: 35 pid: 8495 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.140492:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.140494:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.140501:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a008ae00/0xe984082ccd7256af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a160a expref: 36 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.140508:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a008ae00/0xe984082ccd7256af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a160a expref: 36 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.140539:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a008ae00/0xe984082ccd7256af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a160a expref: 36 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143692.140549:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593725696:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143692.141108:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.144968:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593725696:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143692.144989:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143692.145043:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+34:1964:x1830963592227584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4650us (6406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.145053:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4892 00000100:00100000:0.0:1746143692.146351:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.146433:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592227840 00000100:00100000:1.0:1746143692.146440:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592227840 00002000:00100000:1.0:1746143692.146480:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008f3c9c00 x1830963592227840/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.146489:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c9c00 with x1830963592227840 ext(1048576->2097151) 00002000:00010000:1.0:1746143692.146494:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c9c00 00000100:00100000:1.0:1746143692.146527:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3507 00000100:00100000:1.0:1746143692.146535:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592227840:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143692.148644:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.148703:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592227968 00000100:00100000:2.0:1746143692.148709:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592227968 00000100:00100000:2.0:1746143692.148785:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9528 00000100:00100000:2.0:1746143692.148793:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:28389:x1830963592227968:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143692.148810:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.148826:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1611 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.148851:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368a2a00/0xe984082ccd725551 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f2 expref: 35 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.148871:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b37200/0xe984082ccd72559e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a152a expref: 21 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.148877:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.148879:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.148882:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [794624->1048575] (req 794624->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 35 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.148906:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093b37200/0xe984082ccd72559e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a152a expref: 21 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.148917:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093b37200/0xe984082ccd72559e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a152a expref: 21 pid: 8495 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746143692.148927:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593725824:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.148996:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801368a2a00/0xe984082ccd725551 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f2 expref: 35 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.149004:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801368a2a00/0xe984082ccd725551 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f2 expref: 35 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.149016:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593725952:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.149035:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.149095:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.149159:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592228224 00000100:00100000:2.0:1746143692.149163:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592228224 00002000:00100000:2.0:1746143692.149186:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff8800a0850380 x1830963592228224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143692.149194:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0850380 with x1830963592228224 ext(1048576->2097151) 00002000:00010000:2.0:1746143692.149198:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0850380 00000100:00100000:2.0:1746143692.149989:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3508 00000100:00100000:2.0:1746143692.149996:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963592228224:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143692.154728:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593725824:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143692.156366:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.156441:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592228352 00000100:00100000:3.0:1746143692.156448:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592228352 00010000:00010000:3.0:1746143692.156474:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b37200/0xe984082ccd72559e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a152a expref: 22 pid: 8495 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746143692.156494:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4893 00000100:00100000:3.0:1746143692.156499:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592228352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.156509:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.156526:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b37200/0xe984082ccd72559e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a152a expref: 22 pid: 8495 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.156536:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b37200/0xe984082ccd72559e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a152a expref: 22 pid: 8495 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.156553:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b37200/0xe984082ccd72559e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a152a expref: 22 pid: 8495 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.156570:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143692.157229:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593725952:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.157255:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [794624->1048575] (req 794624->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 37 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.157265:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a008b000, rc 0) 00000100:00100000:3.0:1746143692.157823:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592228352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1320us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.157832:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4893 00000100:00100000:2.0:1746143692.157907:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:28389:x1830963592227968:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 9114us (9273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.157914:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9528 00000100:00100000:1.0:1746143692.159317:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.160400:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592228480 00000100:00100000:0.0:1746143692.160407:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592228480 00010000:00010000:0.0:1746143692.160448:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a2a00/0xe984082ccd725551 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f2 expref: 37 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746143692.160477:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4894 00000100:00100000:0.0:1746143692.160484:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592228480:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143692.160494:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143692.160512:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801368a2a00/0xe984082ccd725551 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f2 expref: 37 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.160526:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801368a2a00/0xe984082ccd725551 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f2 expref: 37 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.160544:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a2a00/0xe984082ccd725551 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a14f2 expref: 37 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.160565:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143692.160566:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143692.160572:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 36 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.160578:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 36 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.160605:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 36 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143692.160615:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593726080:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143692.160677:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143692.160791:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592227840:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14256us (14442us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143692.160801:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3507 00002000:00100000:1.0:1746143692.160809:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008f3c9c00 x1830963592227840/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.160818:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c9c00 with x1830963592227840 ext(1048576->2097151) 00002000:00010000:1.0:1746143692.160821:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c9c00 00000100:00100000:2.0:1746143692.162740:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963592228224:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12737us (13638us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143692.162753:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3508 00002000:00100000:2.0:1746143692.162763:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff8800a0850380 x1830963592228224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143692.162771:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0850380 with x1830963592228224 ext(1048576->2097151) 00002000:00010000:2.0:1746143692.162776:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0850380 00000100:00100000:2.0:1746143692.164356:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593726080:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143692.164373:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143692.164418:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592228480:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3933us (5104us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.164427:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4894 00000100:00100000:0.0:1746143692.170037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.170987:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592228736 00000100:00100000:2.0:1746143692.170999:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592228736 00002000:00100000:2.0:1746143692.171055:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (794624->798719) req@ffff8800a087b480 x1830963592228736/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143692.171064:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b480 with x1830963592228736 ext(794624->798719) 00002000:00010000:2.0:1746143692.171068:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a087b480 00000100:00100000:2.0:1746143692.171099:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3509 00000100:00100000:2.0:1746143692.171106:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963592228736:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143692.171855:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963592228736:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 747us (1823us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143692.171872:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3509 00002000:00100000:2.0:1746143692.171878:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (794624->798719) req@ffff8800a087b480 x1830963592228736/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/4536 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143692.171891:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b480 with x1830963592228736 ext(794624->798719) 00002000:00010000:2.0:1746143692.171894:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a087b480 00000100:00100000:0.0:1746143692.178685:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.178717:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.178739:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.178750:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.178774:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.178936:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592229632 00000100:00100000:1.0:1746143692.178944:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592229632 00002000:00100000:1.0:1746143692.178984:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800a087a300 x1830963592229632/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.178993:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087a300 with x1830963592229632 ext(3145728->4194303) 00002000:00010000:1.0:1746143692.178998:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087a300 00000100:00100000:1.0:1746143692.179013:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592228992 00000100:00100000:1.0:1746143692.179015:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592228992 00002000:00100000:1.0:1746143692.179025:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009cdc3100 x1830963592228992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.179030:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3100 with x1830963592228992 ext(2097152->3145727) 00002000:00010000:1.0:1746143692.179032:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3100 00000100:00100000:1.0:1746143692.179040:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592229248 00000100:00100000:1.0:1746143692.179041:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592229248 00002000:00100000:1.0:1746143692.179048:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009cdc0000 x1830963592229248/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.179052:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0000 with x1830963592229248 ext(3145728->4194303) 00002000:00010000:1.0:1746143692.179054:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc0000 00000100:00100000:1.0:1746143692.179060:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592229504 00000100:00100000:1.0:1746143692.179062:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592229504 00002000:00100000:1.0:1746143692.179069:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009cdc1880 x1830963592229504/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.179074:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1880 with x1830963592229504 ext(2097152->3145727) 00002000:00010000:1.0:1746143692.179075:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc1880 00000100:00100000:1.0:1746143692.179083:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3510 00000100:00100000:1.0:1746143692.179088:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963592229632:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143692.179602:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3511 00000100:00100000:0.0:1746143692.179610:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963592228992:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143692.179912:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3512 00000100:00100000:3.0:1746143692.179919:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963592229248:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143692.180033:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3513 00000100:00100000:0.0:1746143692.180045:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963592229504:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143692.181211:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592229888 00000100:00100000:3.0:1746143692.181216:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592229888 00000100:00100000:3.0:1746143692.181241:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9529 00000100:00100000:3.0:1746143692.181245:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:28389:x1830963592229888:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143692.181256:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.181269:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1618 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.181291:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a008ae00/0xe984082ccd7256af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a160a expref: 42 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.181298:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.181299:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.181302:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->1351679] (req 1048576->1351679) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 42 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.181325:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a008ae00/0xe984082ccd7256af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a160a expref: 42 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.181334:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a008ae00/0xe984082ccd7256af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a160a expref: 42 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.181344:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593726208:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.181394:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143692.198557:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963592229632:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19458us (19870us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143692.198567:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3510 00002000:00100000:1.0:1746143692.198577:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800a087a300 x1830963592229632/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.198586:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087a300 with x1830963592229632 ext(3145728->4194303) 00002000:00010000:1.0:1746143692.198591:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087a300 00000100:00100000:2.0:1746143692.206624:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963592229248:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26696us (27873us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143692.206636:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3512 00002000:00100000:2.0:1746143692.206646:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009cdc0000 x1830963592229248/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143692.206654:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0000 with x1830963592229248 ext(3145728->4194303) 00002000:00010000:2.0:1746143692.206659:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc0000 00000100:00100000:3.0:1746143692.206782:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593726208:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.206803:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->1351679] (req 1048576->1351679) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 40 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.206816:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f588600, rc 0) 00000100:00100000:3.0:1746143692.206833:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:28389:x1830963592229888:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 25588us (28059us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.206840:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9529 00000100:00100000:0.0:1746143692.207341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.208024:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.208090:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592230144 00000100:00100000:3.0:1746143692.208096:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592230144 00000100:00100000:3.0:1746143692.208128:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9530 00000100:00100000:3.0:1746143692.208134:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28393:x1830963592230144:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143692.208168:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.208180:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a161f expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.208201:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72567e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d9 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.208209:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a008a800/0xe984082ccd7256a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15fc expref: 35 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.208213:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.208215:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.208218:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2453504->2703359] (req 2453504->2703359) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 22 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.208241:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a008a800/0xe984082ccd7256a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15fc expref: 35 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.208249:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a008a800/0xe984082ccd7256a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15fc expref: 35 pid: 15784 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746143692.208260:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593726336:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.209684:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72567e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d9 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.209696:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72567e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d9 expref: 22 pid: 8495 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.209706:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593726464:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.209740:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.209930:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592230016 00000100:00100000:2.0:1746143692.209936:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592230016 00010000:00010000:2.0:1746143692.209963:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a008ae00/0xe984082ccd7256af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a160a expref: 40 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.209996:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4895 00000100:00100000:2.0:1746143692.210003:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963592230016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.210013:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143692.210033:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a008ae00/0xe984082ccd7256af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a160a expref: 40 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.210042:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a008ae00/0xe984082ccd7256af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a160a expref: 40 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.210060:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a008ae00/0xe984082ccd7256af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a160a expref: 40 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.210501:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.210504:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.210511:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 39 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.210520:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 39 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.210544:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 39 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143692.210553:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0851500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593726592:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143692.211654:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143692.214647:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963592228992:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35031us (35922us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143692.214657:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3511 00002000:00100000:1.0:1746143692.214666:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009cdc3100 x1830963592228992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.214675:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3100 with x1830963592228992 ext(2097152->3145727) 00010000:00010000:1.0:1746143692.214683:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a008a800/0xe984082ccd7256a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15fc expref: 34 pid: 15784 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746143692.214694:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a008a800/0xe984082ccd7256a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15fc expref: 34 pid: 15784 timeout: 871 lvb_type: 1 00002000:00010000:1.0:1746143692.214701:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cdc3100 00000100:00100000:3.0:1746143692.221013:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593726336:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.221025:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593726464:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.221051:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2453504->2703359] (req 2453504->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 22 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.221067:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d511400, rc 0) 00000100:00100000:3.0:1746143692.221106:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28393:x1830963592230144:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 12970us (13764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.221113:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9530 00000100:00100000:0.0:1746143692.221658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.221786:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592230272 00000100:00100000:3.0:1746143692.221793:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592230272 00010000:00010000:3.0:1746143692.221813:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72567e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d9 expref: 22 pid: 8495 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.222433:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4896 00000100:00100000:3.0:1746143692.222442:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963592230272:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.222454:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.222473:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72567e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d9 expref: 22 pid: 8495 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.222484:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72567e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d9 expref: 22 pid: 8495 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.222502:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72567e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d9 expref: 22 pid: 8495 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.222578:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143692.222734:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592230272:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 293us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.222740:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4896 00000100:00100000:2.0:1746143692.226280:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0851500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593726592:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143692.226299:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143692.226348:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963592230016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 16345us (18324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.226356:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4895 00000100:00100000:1.0:1746143692.226407:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963592229504:12345-192.168.202.48@tcp:3:cat.0 Request processed in 46362us (47653us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143692.226419:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3513 00002000:00100000:1.0:1746143692.226427:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009cdc1880 x1830963592229504/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.226436:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1880 with x1830963592229504 ext(2097152->3145727) 00002000:00010000:1.0:1746143692.226441:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc1880 00000100:00100000:0.0:1746143692.235010:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.235398:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.235562:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592230656 00000100:00100000:1.0:1746143692.235570:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592230656 00002000:00100000:1.0:1746143692.235610:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1347584->1351679) req@ffff88009ba46a00 x1830963592230656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.235619:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba46a00 with x1830963592230656 ext(1347584->1351679) 00002000:00010000:1.0:1746143692.235623:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba46a00 00000100:00100000:3.0:1746143692.235716:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592230400 00000100:00100000:3.0:1746143692.235720:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592230400 00000100:00100000:1.0:1746143692.236232:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3514 00000100:00100000:1.0:1746143692.236240:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963592230656:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143692.237436:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9531 00000100:00100000:3.0:1746143692.237445:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:28390:x1830963592230400:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143692.237457:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.237472:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d511c00/0xe984082ccd7256cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1626 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.237491:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.237493:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.237499:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d511c00/0xe984082ccd7256cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1626 expref: 35 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.237510:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d511c00/0xe984082ccd7256cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1626 expref: 35 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143692.237522:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963592230656:12345-192.168.202.48@tcp:3:cat.0 Request processed in 1281us (2123us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1746143692.237524:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d511c00, rc 0) 00000100:00100000:1.0:1746143692.237529:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3514 00002000:00100000:1.0:1746143692.237535:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1347584->1351679) req@ffff88009ba46a00 x1830963592230656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/4536 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.237543:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba46a00 with x1830963592230656 ext(1347584->1351679) 00002000:00010000:1.0:1746143692.237547:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba46a00 00000100:00100000:3.0:1746143692.237642:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:28390:x1830963592230400:12345-192.168.202.48@tcp:101:cat.0 Request processed in 197us (2638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.237647:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9531 00000100:00100000:0.0:1746143692.241053:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.241473:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592230784 00000100:00100000:2.0:1746143692.241481:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592230784 00010000:00010000:2.0:1746143692.241513:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a008a800/0xe984082ccd7256a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15fc expref: 35 pid: 15784 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746143692.241581:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4897 00000100:00100000:2.0:1746143692.241588:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963592230784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.241600:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143692.241620:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a008a800/0xe984082ccd7256a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15fc expref: 35 pid: 15784 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746143692.241631:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a008a800/0xe984082ccd7256a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15fc expref: 35 pid: 15784 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746143692.241651:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a008a800/0xe984082ccd7256a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15fc expref: 35 pid: 15784 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746143692.241685:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.241687:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.241693:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.241700:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.241726:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143692.241735:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0851500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593726720:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143692.241805:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143692.242302:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.242674:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592231040 00000100:00100000:1.0:1746143692.242678:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592231040 00002000:00100000:1.0:1746143692.242704:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009ba46d80 x1830963592231040/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.242713:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba46d80 with x1830963592231040 ext(3145728->4194303) 00002000:00010000:1.0:1746143692.242717:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba46d80 00000100:00100000:1.0:1746143692.242729:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3515 00000100:00100000:1.0:1746143692.242734:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963592231040:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143692.247273:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.247387:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0851500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593726720:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143692.247410:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143692.247448:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963592230784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5859us (6401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.247457:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4897 00000100:00100000:0.0:1746143692.247529:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592231296 00000100:00100000:0.0:1746143692.247535:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592231296 00002000:00100000:0.0:1746143692.247565:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2453504->2457599) req@ffff8800a0850700 x1830963592231296/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143692.247574:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0850700 with x1830963592231296 ext(2453504->2457599) 00002000:00010000:0.0:1746143692.247578:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0850700 00000100:00100000:0.0:1746143692.247603:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3516 00000100:00100000:0.0:1746143692.247610:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592231296:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143692.247720:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592231296:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 110us (453us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143692.247725:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3516 00002000:00100000:0.0:1746143692.247729:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2453504->2457599) req@ffff8800a0850700 x1830963592231296/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/4536 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143692.247736:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0850700 with x1830963592231296 ext(2453504->2457599) 00002000:00010000:0.0:1746143692.247739:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0850700 00000100:00100000:1.0:1746143692.255166:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963592231040:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12395us (12829us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143692.255176:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3515 00002000:00100000:1.0:1746143692.255186:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009ba46d80 x1830963592231040/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.256682:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba46d80 with x1830963592231040 ext(3145728->4194303) 00002000:00010000:1.0:1746143692.256692:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba46d80 00000100:00100000:0.0:1746143692.257288:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.257354:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592231552 00000100:00100000:1.0:1746143692.257361:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592231552 00002000:00100000:1.0:1746143692.257391:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2699264->2703359) req@ffff8800949f3b80 x1830963592231552/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.257399:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3b80 with x1830963592231552 ext(2699264->2703359) 00002000:00010000:1.0:1746143692.257402:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f3b80 00000100:00100000:1.0:1746143692.257429:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3517 00000100:00100000:1.0:1746143692.257436:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592231552:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143692.257571:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592231552:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 136us (286us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143692.257577:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3517 00002000:00100000:1.0:1746143692.257582:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2699264->2703359) req@ffff8800949f3b80 x1830963592231552/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/4536 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.257589:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3b80 with x1830963592231552 ext(2699264->2703359) 00002000:00010000:1.0:1746143692.257592:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f3b80 00000100:00100000:0.0:1746143692.264709:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.264923:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592231680 00000100:00100000:3.0:1746143692.264931:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592231680 00000100:00100000:3.0:1746143692.264986:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9532 00000100:00100000:3.0:1746143692.264993:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592231680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143692.265009:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.265023:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d511600/0xe984082ccd7256d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a162d expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.265050:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d511600/0xe984082ccd7256d2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a162d expref: 35 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.265059:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d511600/0xe984082ccd7256d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a162d expref: 35 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.265087:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d511600, rc 0) 00000100:00100000:3.0:1746143692.265135:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592231680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 142us (437us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143692.265167:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9532 00000100:00100000:0.0:1746143692.274626:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.274733:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592231936 00000100:00100000:3.0:1746143692.274741:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592231936 00002000:00100000:3.0:1746143692.274779:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800949f1880 x1830963592231936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.274788:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1880 with x1830963592231936 ext(4194304->4898815) 00002000:00010000:3.0:1746143692.274793:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f1880 00000100:00100000:3.0:1746143692.274823:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3518 00000100:00100000:3.0:1746143692.274830:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963592231936:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143692.286052:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963592231936:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11214us (11427us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143692.286062:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3518 00002000:00100000:3.0:1746143692.286071:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800949f1880 x1830963592231936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.286079:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1880 with x1830963592231936 ext(4194304->4898815) 00002000:00010000:3.0:1746143692.286084:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f1880 00000100:00100000:0.0:1746143692.301303:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.301985:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592232064 00000100:00100000:1.0:1746143692.301993:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592232064 00000100:00100000:1.0:1746143692.302040:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9533 00000100:00100000:1.0:1746143692.302046:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963592232064:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143692.302061:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143692.302075:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e91e00/0xe984082ccd7256d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1634 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.302099:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e91e00/0xe984082ccd7256d9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1634 expref: 35 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.302107:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e91e00/0xe984082ccd7256d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1634 expref: 35 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.302130:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91e00, rc 0) 00000100:00100000:1.0:1746143692.302199:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963592232064:12345-192.168.202.48@tcp:101:cat.0 Request processed in 153us (904us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143692.302204:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9533 00000100:00100000:0.0:1746143692.319444:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.320752:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592232192 00000100:00100000:3.0:1746143692.320763:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592232192 00000100:00100000:3.0:1746143692.321077:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9534 00000100:00100000:3.0:1746143692.321084:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963592232192:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143692.321098:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.321111:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d511800/0xe984082ccd7256e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a163b expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.321153:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d511800/0xe984082ccd7256e0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a163b expref: 35 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.321162:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d511800/0xe984082ccd7256e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a163b expref: 35 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.322111:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d511800, rc 0) 00000100:00100000:3.0:1746143692.322203:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963592232192:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1117us (2766us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143692.322210:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9534 00000100:00100000:0.0:1746143692.335567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.335604:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.335642:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.335730:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592232320 00000100:00100000:2.0:1746143692.335738:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592232320 00000100:00100000:2.0:1746143692.335771:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592232576 00000100:00100000:2.0:1746143692.335773:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592232576 00000100:00100000:2.0:1746143692.335783:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592232448 00000100:00100000:2.0:1746143692.335784:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592232448 00000100:00100000:2.0:1746143692.335798:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9535 00000100:00100000:2.0:1746143692.335806:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592232320:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.335823:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.335836:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a008ac00/0xe984082ccd7256e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1642 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143692.335887:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0851880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593726848:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143692.335962:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.335985:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9536 00000100:00100000:2.0:1746143692.335992:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592232576:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.336000:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.336010:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a008b400/0xe984082ccd7256ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1650 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.336029:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a008b400/0xe984082ccd7256ee lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1650 expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.336039:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a008b400/0xe984082ccd7256ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1650 expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.336056:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a008b400, rc 0) 00000100:00100000:2.0:1746143692.336084:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592232576:12345-192.168.202.48@tcp:101:cat.0 Request processed in 92us (478us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143692.336091:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9536 00000100:00100000:2.0:1746143692.336111:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9537 00000100:00100000:2.0:1746143692.336117:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+34:1964:x1830963592232448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.336126:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.336136:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a008a600/0xe984082ccd7256f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1649 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143692.336182:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0852300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593726976:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143692.336212:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00002000:00010000:3.0:1746143692.342367:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143691 -> 1746143692 00000100:00100000:3.0:1746143692.342393:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0852300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593726976:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143692.342421:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a008a600/0xe984082ccd7256f5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1649 expref: 35 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.342433:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a008a600/0xe984082ccd7256f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1649 expref: 35 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.342447:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a008a600, rc 0) 00000100:00100000:3.0:1746143692.342481:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+34:1964:x1830963592232448:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6364us (6839us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143692.342488:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9537 00002000:00010000:2.0:1746143692.342613:0:8497:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime: 1746143690 -> 1746143691 00002000:00010000:2.0:1746143692.342616:0:8497:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime: 1746143690 -> 1746143692 00002000:00010000:2.0:1746143692.342618:0:8497:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime: 1746143690 -> 1746143691 00000100:00100000:2.0:1746143692.342631:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0851880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593726848:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143692.342646:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a008ac00/0xe984082ccd7256e7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1642 expref: 22 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.342655:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a008ac00/0xe984082ccd7256e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1642 expref: 22 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.342662:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a008ac00, rc 0) 00000100:00100000:2.0:1746143692.342679:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592232320:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6875us (7120us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143692.342684:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9535 00000100:00100000:0.0:1746143692.348104:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.348336:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592232704 00000100:00100000:2.0:1746143692.348343:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592232704 00000100:00100000:2.0:1746143692.348714:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9538 00000100:00100000:2.0:1746143692.348721:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28398:x1830963592232704:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.348738:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.348754:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a008a200/0xe984082ccd7256fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1657 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.348777:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.348784:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143692.348785:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143692.348788:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a008a200/0xe984082ccd7256fc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1657 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.348809:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.348819:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 33 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.348828:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0851880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593727104:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.348926:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.350934:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0851880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593727104:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.350963:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a008a200/0xe984082ccd7256fc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1657 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.350979:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a008a200, rc 0) 00000100:00100000:2.0:1746143692.351018:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28398:x1830963592232704:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2296us (2921us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.351029:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9538 00000100:00100000:0.0:1746143692.354010:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.354241:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592232832 00000100:00100000:3.0:1746143692.354248:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592232832 00002000:00100000:3.0:1746143692.354288:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (794624->1048575) req@ffff88012f187800 x1830963592232832/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.354299:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187800 with x1830963592232832 ext(794624->1048575) 00010000:00010000:3.0:1746143692.354307:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 34 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.354321:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 34 pid: 4582 timeout: 871 lvb_type: 0 00002000:00010000:3.0:1746143692.354328:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f187800 00000100:00100000:3.0:1746143692.354351:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 845 00000100:00100000:3.0:1746143692.354358:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963592232832:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143692.363689:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963592232832:12345-192.168.202.48@tcp:4:cat.0 Request processed in 9322us (9677us total) trans 17179872439 rc 0/0 00000100:00100000:1.0:1746143692.363701:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 845 00002000:00100000:1.0:1746143692.363714:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (794624->1048575) req@ffff88012f187800 x1830963592232832/t17179872439(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/448 e 0 to 0 dl 1746143703 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.363723:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187800 with x1830963592232832 ext(794624->1048575) 00010000:00010000:1.0:1746143692.363733:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 36 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.363749:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 36 pid: 4582 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746143692.363755:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f187800 00000100:00100000:0.0:1746143692.370705:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.370804:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592232960 00000100:00100000:3.0:1746143692.370813:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592232960 00010000:00010000:3.0:1746143692.370991:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 36 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.373431:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4898 00000100:00100000:3.0:1746143692.373449:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963592232960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.373469:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.373496:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 36 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.373511:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 36 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.373534:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a008b000/0xe984082ccd7256b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 794624->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1611 expref: 36 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.373556:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.373558:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.373565:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a008a200/0xe984082ccd7256fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1657 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.373573:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a008a200/0xe984082ccd7256fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1657 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.373606:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a008a200/0xe984082ccd7256fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1657 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143692.373617:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593727232:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143692.373705:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143692.375744:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593727232:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143692.375762:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143692.375793:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963592232960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2352us (5096us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.375801:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4898 00000100:00100000:0.0:1746143692.379037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.380761:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592233216 00000100:00100000:1.0:1746143692.380770:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592233216 00002000:00100000:1.0:1746143692.380812:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009bfe1180 x1830963592233216/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.380820:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1180 with x1830963592233216 ext(0->1048575) 00002000:00010000:1.0:1746143692.380825:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1180 00000100:00100000:1.0:1746143692.382356:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3519 00000100:00100000:1.0:1746143692.382368:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592233216:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143692.398238:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592233216:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15863us (19199us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143692.398249:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3519 00002000:00100000:1.0:1746143692.398260:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009bfe1180 x1830963592233216/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.398270:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1180 with x1830963592233216 ext(0->1048575) 00002000:00010000:1.0:1746143692.398276:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1180 00000100:00100000:0.0:1746143692.411541:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.412501:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592233344 00000100:00100000:2.0:1746143692.412513:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592233344 00000100:00100000:2.0:1746143692.413325:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9539 00000100:00100000:2.0:1746143692.413335:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+34:28398:x1830963592233344:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.413351:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.413367:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd725703 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a165e expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.413395:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 36 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.413402:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143692.413404:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143692.413407:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd725703 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a165e expref: 35 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.413436:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 36 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.413448:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 36 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.413459:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0851880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593727360:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.413556:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.416721:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0851880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593727360:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.416754:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd725703 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a165e expref: 35 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.416771:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d520200, rc 0) 00000100:00100000:2.0:1746143692.416819:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+35:28398:x1830963592233344:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3486us (5286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.416827:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9539 00000100:00100000:0.0:1746143692.417455:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.417714:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592233472 00000100:00100000:1.0:1746143692.417720:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592233472 00002000:00100000:1.0:1746143692.417751:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1351679) req@ffff8800a5c23b80 x1830963592233472/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.417760:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23b80 with x1830963592233472 ext(1048576->1351679) 00010000:00010000:1.0:1746143692.417767:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 37 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.417777:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 37 pid: 4582 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746143692.417783:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5c23b80 00000100:00100000:1.0:1746143692.417807:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 846 00000100:00100000:1.0:1746143692.417813:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592233472:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143692.426795:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963592233472:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8973us (9332us total) trans 21474839710 rc 0/0 00000100:00100000:1.0:1746143692.426808:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 846 00002000:00100000:1.0:1746143692.426819:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->1351679) req@ffff8800a5c23b80 x1830963592233472/t21474839710(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/448 e 0 to 0 dl 1746143703 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.426828:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23b80 with x1830963592233472 ext(1048576->1351679) 00010000:00010000:1.0:1746143692.426838:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 39 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.426867:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 39 pid: 4582 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746143692.426874:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5c23b80 00000100:00100000:0.0:1746143692.429441:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.429493:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592233600 00000100:00100000:2.0:1746143692.429501:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592233600 00010000:00010000:2.0:1746143692.429534:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 39 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.429571:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4899 00000100:00100000:2.0:1746143692.429579:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963592233600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.429590:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143692.429610:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 39 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.429621:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 39 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.429641:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f588600/0xe984082ccd7256bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1618 expref: 39 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.429658:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.429659:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.429666:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd725703 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a165e expref: 34 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.429673:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd725703 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a165e expref: 34 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.429701:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd725703 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a165e expref: 34 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143692.429712:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0851880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593727488:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143692.429776:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143692.439600:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0851880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593727488:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143692.439622:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143692.439664:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963592233600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10085us (10228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.439673:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4899 00000100:00100000:1.0:1746143692.441099:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.441176:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592233856 00000100:00100000:1.0:1746143692.441181:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592233856 00002000:00100000:1.0:1746143692.441211:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093805880 x1830963592233856/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.441220:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805880 with x1830963592233856 ext(1048576->2097151) 00002000:00010000:1.0:1746143692.441224:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093805880 00000100:00100000:1.0:1746143692.441802:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3520 00000100:00100000:1.0:1746143692.441809:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1964:x1830963592233856:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143692.472901:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+35:1964:x1830963592233856:12345-192.168.202.48@tcp:3:cat.0 Request processed in 31085us (31796us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143692.472912:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3520 00002000:00100000:0.0:1746143692.472923:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093805880 x1830963592233856/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143692.472932:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805880 with x1830963592233856 ext(1048576->2097151) 00002000:00010000:0.0:1746143692.472937:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093805880 00000100:00100000:0.0:1746143692.489219:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.489958:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592233984 00000100:00100000:2.0:1746143692.489966:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592233984 00000100:00100000:2.0:1746143692.490001:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9540 00000100:00100000:2.0:1746143692.490008:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28398:x1830963592233984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.490023:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.490037:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd72570a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1665 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.490061:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.490068:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143692.490070:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143692.490073:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd72570a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1665 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.490095:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.490109:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 23 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.490119:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0853100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593727616:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.490213:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143692.491187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.491260:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.491745:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592234112 00000100:00100000:2.0:1746143692.491750:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592234112 00000100:00100000:2.0:1746143692.491778:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592234368 00000100:00100000:2.0:1746143692.491780:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592234368 00000100:00100000:2.0:1746143692.491794:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9541 00000100:00100000:2.0:1746143692.491799:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963592234112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.491810:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.491822:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd725711 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a166c expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.491838:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.491840:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.491846:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd725711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a166c expref: 37 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.491870:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd725711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a166c expref: 37 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.491879:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6dfc00, rc 0) 00000100:00100000:2.0:1746143692.491909:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592234112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 108us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.491917:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9541 00000100:00100000:2.0:1746143692.491929:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9542 00000100:00100000:2.0:1746143692.491934:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963592234368:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.491939:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.491944:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6de000/0xe984082ccd725718 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a167a expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.491959:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6de000/0xe984082ccd725718 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a167a expref: 37 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.491966:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6de000/0xe984082ccd725718 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a167a expref: 37 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.491974:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6de000, rc 0) 00000100:00100000:2.0:1746143692.491988:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963592234368:12345-192.168.202.48@tcp:101:cat.0 Request processed in 54us (727us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143692.491992:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9542 00000100:00100000:0.0:1746143692.492094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.492346:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592234240 00000100:00100000:3.0:1746143692.492350:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592234240 00000100:00100000:3.0:1746143692.492368:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9543 00000100:00100000:3.0:1746143692.492373:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963592234240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143692.492379:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.492388:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d511600/0xe984082ccd72571f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1673 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.492402:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.492403:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.492407:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d511600/0xe984082ccd72571f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1673 expref: 39 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.492416:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d511600/0xe984082ccd72571f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1673 expref: 39 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.492422:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d511600, rc 0) 00000100:00100000:3.0:1746143692.492441:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963592234240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 68us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.492445:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9543 00000100:00100000:2.0:1746143692.502770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.502794:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592234496 00000100:00100000:2.0:1746143692.502801:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592234496 00002000:00100000:2.0:1746143692.502839:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2453504->2703359) req@ffff8800a0851880 x1830963592234496/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143692.502847:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0851880 with x1830963592234496 ext(2453504->2703359) 00010000:00010000:2.0:1746143692.502863:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 24 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.502880:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 24 pid: 4582 timeout: 871 lvb_type: 0 00002000:00010000:2.0:1746143692.502886:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0851880 00000100:00100000:2.0:1746143692.502904:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 847 00000100:00100000:2.0:1746143692.502912:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1962:x1830963592234496:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143692.503238:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0853100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593727616:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.503262:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd72570a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1665 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.503275:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a652bc00, rc 0) 00000100:00100000:2.0:1746143692.503301:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28398:x1830963592233984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 13293us (14087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.503308:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9540 00000100:00100000:3.0:1746143692.510252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.510278:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.512010:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1962:x1830963592234496:12345-192.168.202.48@tcp:4:cat.0 Request processed in 9093us (9239us total) trans 17179872440 rc 0/0 00000100:00100000:3.0:1746143692.512019:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 847 00002000:00100000:3.0:1746143692.512029:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2453504->2703359) req@ffff8800a0851880 x1830963592234496/t17179872440(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/448 e 0 to 0 dl 1746143703 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.512038:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0851880 with x1830963592234496 ext(2453504->2703359) 00010000:00010000:3.0:1746143692.512046:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 25 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.512060:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 25 pid: 4582 timeout: 871 lvb_type: 0 00002000:00010000:3.0:1746143692.512071:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0851880 00000100:00100000:3.0:1746143692.512089:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592234880 00000100:00100000:3.0:1746143692.512094:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592234880 00002000:00100000:3.0:1746143692.512113:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880094c13b80 x1830963592234880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.512119:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13b80 with x1830963592234880 ext(0->1048575) 00002000:00010000:3.0:1746143692.512122:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c13b80 00000100:00100000:3.0:1746143692.512131:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592235008 00000100:00100000:3.0:1746143692.512133:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592235008 00002000:00100000:3.0:1746143692.512155:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880094c12d80 x1830963592235008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.512161:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12d80 with x1830963592235008 ext(1048576->2097151) 00002000:00010000:3.0:1746143692.512164:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c12d80 00000100:00100000:3.0:1746143692.512174:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3521 00000100:00100000:3.0:1746143692.512831:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963592234880:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143692.516163:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3522 00000100:00100000:3.0:1746143692.516176:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963592235008:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143692.523952:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.523983:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592235136 00000100:00100000:2.0:1746143692.523990:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592235136 00010000:00010000:2.0:1746143692.524021:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 25 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.524046:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4900 00000100:00100000:2.0:1746143692.524053:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592235136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.524063:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143692.524083:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 25 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.524094:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 25 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.524113:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d511400/0xe984082ccd7256c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2453504->3145727] (req 2453504->2703359) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a161f expref: 25 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.524126:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.524127:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.524132:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd72570a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1665 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.524157:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd72570a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1665 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.524183:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd72570a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1665 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143692.524193:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0852300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593727744:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143692.524250:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.535735:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963592234880:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22898us (25482us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143692.535747:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3521 00002000:00100000:2.0:1746143692.535757:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880094c13b80 x1830963592234880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143692.535767:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13b80 with x1830963592234880 ext(0->1048575) 00002000:00010000:2.0:1746143692.535773:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c13b80 00000100:00100000:0.0:1746143692.546587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.546614:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.546628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.546967:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592235264 00000100:00100000:2.0:1746143692.546974:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592235264 00000100:00100000:3.0:1746143692.547246:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0852300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593727744:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143692.547261:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143692.547299:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1963:x1830963592235136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 23245us (23352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.547308:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4900 00000100:00100000:2.0:1746143692.547327:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9544 00000100:00100000:3.0:1746143692.547335:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592235520 00000100:00100000:2.0:1746143692.547335:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:28402:x1830963592235264:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:3.0:1746143692.547338:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592235520 00010000:00010000:2.0:1746143692.547349:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746143692.547360:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a5c22680 x1830963592235520/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143692.547363:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1681 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143692.547368:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22680 with x1830963592235520 ext(2097152->3145727) 00002000:00010000:3.0:1746143692.547372:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c22680 00000100:00100000:3.0:1746143692.547382:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592235648 00000100:00100000:3.0:1746143692.547385:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592235648 00010000:00010000:2.0:1746143692.547385:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b37e00/0xe984082ccd72564d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15b6 expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.547391:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b36400/0xe984082ccd725677 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d2 expref: 37 pid: 4582 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746143692.547394:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880093bf1880 x1830963592235648/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143692.547397:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.547399:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:3.0:1746143692.547401:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf1880 with x1830963592235648 ext(3145728->4194303) 00010000:00010000:2.0:1746143692.547401:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1277952->1814527] (req 1277952->1814527) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 37 pid: 8497 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143692.547403:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf1880 00000100:00100000:3.0:1746143692.547413:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3523 00000100:00100000:3.0:1746143692.547418:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592235520:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:2.0:1746143692.547423:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093b36400/0xe984082ccd725677 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d2 expref: 37 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.547433:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093b36400/0xe984082ccd725677 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d2 expref: 37 pid: 4582 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746143692.547443:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593727872:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.548530:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3524 00000100:00100000:3.0:1746143692.548536:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592235648:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:2.0:1746143692.549436:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093b37e00/0xe984082ccd72564d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15b6 expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.549447:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093b37e00/0xe984082ccd72564d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15b6 expref: 27 pid: 25369 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.549457:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593728000:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.549493:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143692.550162:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963592235008:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33989us (39881us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143692.550169:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3522 00002000:00100000:3.0:1746143692.550178:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880094c12d80 x1830963592235008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.550187:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12d80 with x1830963592235008 ext(1048576->2097151) 00002000:00010000:3.0:1746143692.550191:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c12d80 00000100:00100000:2.0:1746143692.561799:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593727872:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.561817:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593728000:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.561842:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1277952->1814527] (req 1277952->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 37 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.561866:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61fe200, rc 0) 00000100:00100000:2.0:1746143692.561906:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:28402:x1830963592235264:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 14571us (15325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.561914:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9544 00000100:00100000:3.0:1746143692.562056:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592235520:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14636us (15439us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143692.562068:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3523 00002000:00100000:3.0:1746143692.562077:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a5c22680 x1830963592235520/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.562085:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22680 with x1830963592235520 ext(2097152->3145727) 00002000:00010000:3.0:1746143692.562090:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c22680 00000100:00100000:1.0:1746143692.564067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.564213:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.564257:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592235904 00000100:00100000:2.0:1746143692.564265:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592235904 00000100:00100000:3.0:1746143692.564280:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592236032 00000100:00100000:3.0:1746143692.564284:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592236032 00010000:00010000:2.0:1746143692.564292:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b36400/0xe984082ccd725677 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d2 expref: 37 pid: 4582 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.564298:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b37e00/0xe984082ccd72564d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15b6 expref: 26 pid: 25369 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.564315:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4901 00000100:00100000:2.0:1746143692.564321:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963592235904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.564332:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143692.564344:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4902 00000100:00100000:3.0:1746143692.564350:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592236032:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.564351:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b36400/0xe984082ccd725677 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d2 expref: 37 pid: 4582 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.564357:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143692.564360:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b36400/0xe984082ccd725677 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d2 expref: 37 pid: 4582 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.564373:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b37e00/0xe984082ccd72564d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15b6 expref: 26 pid: 25369 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.564387:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b36400/0xe984082ccd725677 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15d2 expref: 37 pid: 4582 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.564423:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b37e00/0xe984082ccd72564d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15b6 expref: 26 pid: 25369 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.564433:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143692.564444:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b37e00/0xe984082ccd72564d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15b6 expref: 26 pid: 25369 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.564453:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.564455:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.564461:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 36 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.564472:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 36 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.564503:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 36 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143692.564514:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593728128:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143692.565966:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963592235904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1638us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.565975:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4901 00000100:00100000:3.0:1746143692.566380:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143692.573310:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.573735:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963592235648:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25196us (27102us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143692.573746:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3524 00002000:00100000:3.0:1746143692.573756:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880093bf1880 x1830963592235648/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.573765:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf1880 with x1830963592235648 ext(3145728->4194303) 00002000:00010000:3.0:1746143692.573771:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bf1880 00000100:00100000:2.0:1746143692.575322:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592236160 00000100:00100000:2.0:1746143692.575331:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592236160 00000100:00100000:2.0:1746143692.575375:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9545 00000100:00100000:2.0:1746143692.575382:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:28404:x1830963592236160:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.575395:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.575412:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72572d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1688 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.575437:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 37 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.575445:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143692.575446:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143692.575450:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72572d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1688 expref: 37 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.575486:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 37 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.575497:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 37 pid: 8497 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.575508:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593728256:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.575569:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143692.575686:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593728128:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143692.575699:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143692.575719:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592236032:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 11369us (11506us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143692.575727:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4902 00010000:00010000:3.0:1746143692.585543:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143692.587670:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.587801:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593728256:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.587825:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72572d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1688 expref: 37 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.587841:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef3e800, rc 0) 00000100:00100000:3.0:1746143692.588616:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592236416 00000100:00100000:3.0:1746143692.588622:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592236416 00002000:00100000:3.0:1746143692.588656:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1277952->1282047) req@ffff8800a0851500 x1830963592236416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.588665:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0851500 with x1830963592236416 ext(1277952->1282047) 00010000:00010000:3.0:1746143692.588671:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 38 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.588688:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 38 pid: 8497 timeout: 871 lvb_type: 0 00002000:00010000:3.0:1746143692.588694:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0851500 00000100:00100000:3.0:1746143692.588709:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 848 00000100:00100000:3.0:1746143692.588714:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963592236416:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143692.588846:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963592236416:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 131us (1183us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143692.588852:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 848 00002000:00100000:3.0:1746143692.588866:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1277952->1282047) req@ffff8800a0851500 x1830963592236416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/4536 e 0 to 0 dl 1746143703 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.588872:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0851500 with x1830963592236416 ext(1277952->1282047) 00010000:00010000:3.0:1746143692.588875:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 38 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.588883:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 38 pid: 8497 timeout: 871 lvb_type: 0 00002000:00010000:3.0:1746143692.588888:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0851500 00000100:00100000:2.0:1746143692.589833:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:28404:x1830963592236160:12345-192.168.202.48@tcp:101:cat.0 Request processed in 14448us (16527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.589840:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9545 00000100:00100000:2.0:1746143692.595891:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.596518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.596565:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592236544 00000100:00100000:3.0:1746143692.596572:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592236544 00000100:00100000:3.0:1746143692.596601:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592236672 00000100:00100000:3.0:1746143692.596602:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592236672 00000100:00100000:3.0:1746143692.596613:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9546 00000100:00100000:3.0:1746143692.596619:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28406:x1830963592236544:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143692.596633:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.596647:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a168f expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.596671:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd72570a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1665 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.596680:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.596681:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.596684:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2363392->2863103] (req 2363392->2863103) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.596710:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd72570a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1665 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.596719:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd72570a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1665 expref: 25 pid: 8497 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.596729:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593728384:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.596794:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21576c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143692.596808:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9547 00000100:00100000:3.0:1746143692.596813:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592236672:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143692.596818:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.596823:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a25400/0xe984082ccd72573b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1696 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143692.596863:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593728512:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143692.596885:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143692.597240:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.598191:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592236928 00000100:00100000:3.0:1746143692.598197:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592236928 00002000:00100000:3.0:1746143692.598226:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1810432->1814527) req@ffff880093bf0700 x1830963592236928/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.598234:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf0700 with x1830963592236928 ext(1810432->1814527) 00010000:00010000:3.0:1746143692.598240:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 37 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.598249:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 37 pid: 8497 timeout: 871 lvb_type: 0 00002000:00010000:3.0:1746143692.598255:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bf0700 00000100:00100000:3.0:1746143692.598273:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 849 00000100:00100000:3.0:1746143692.598277:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963592236928:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143692.598407:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963592236928:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 129us (1167us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143692.598413:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 849 00002000:00100000:3.0:1746143692.598417:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1810432->1814527) req@ffff880093bf0700 x1830963592236928/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/4536 e 0 to 0 dl 1746143703 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.598423:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf0700 with x1830963592236928 ext(1810432->1814527) 00010000:00010000:3.0:1746143692.598427:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 37 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.598434:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 37 pid: 8497 timeout: 871 lvb_type: 0 00002000:00010000:3.0:1746143692.598439:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bf0700 00000001:00080000:3.0:1746143692.599816:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839706 is committed 00000001:00080000:3.0:1746143692.599829:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839675 is committed 00000001:00080000:3.0:1746143692.599835:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839673 is committed 00000001:00080000:3.0:1746143692.599847:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839710 is committed 00000001:00080000:3.0:1746143692.599864:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839709 is committed 00000001:00080000:3.0:1746143692.599884:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839691 is committed 00000001:00080000:3.0:1746143692.599893:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839676 is committed 00000001:00080000:3.0:1746143692.599960:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839693 is committed 00000001:00080000:3.0:1746143692.599976:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839677 is committed 00002000:00010000:2.0:1746143692.600399:0:4582:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143691 -> 1746143692 00002000:00010000:2.0:1746143692.600403:0:4582:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143691 -> 1746143692 00002000:00010000:2.0:1746143692.600405:0:4582:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143691 -> 1746143692 00000100:00100000:2.0:1746143692.600421:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593728512:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143692.600445:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a25400/0xe984082ccd72573b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1696 expref: 26 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.600457:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a25400/0xe984082ccd72573b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1696 expref: 26 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.600465:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a25400, rc 0) 00000100:00100000:2.0:1746143692.600496:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592236672:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3683us (3979us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143692.600505:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9547 00000100:00100000:0.0:1746143692.600732:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593728384:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143692.600747:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2363392->2863103] (req 2363392->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.600758:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a24800, rc 0) 00000100:00100000:0.0:1746143692.600775:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28406:x1830963592236544:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4157us (4890us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143692.600780:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9546 00000100:00100000:0.0:1746143692.601171:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.601252:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592237184 00000100:00100000:2.0:1746143692.601257:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592237184 00002000:00100000:2.0:1746143692.601281:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1277952->1814527) req@ffff880093bf3800 x1830963592237184/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143692.601290:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf3800 with x1830963592237184 ext(1277952->1814527) 00010000:00010000:2.0:1746143692.601296:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 37 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.601305:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 37 pid: 8497 timeout: 871 lvb_type: 0 00002000:00010000:2.0:1746143692.601311:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bf3800 00000100:00100000:2.0:1746143692.602475:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 850 00000100:00100000:2.0:1746143692.602484:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963592237184:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143692.602799:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.602888:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592237312 00000100:00100000:0.0:1746143692.602892:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592237312 00000100:00100000:0.0:1746143692.602917:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9548 00000100:00100000:0.0:1746143692.602922:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28398:x1830963592237312:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143692.602930:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143692.602942:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b102e00/0xe984082ccd725742 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a169d expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.602958:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143692.602960:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143692.602967:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b102e00/0xe984082ccd725742 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2867200->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a169d expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.602979:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b102e00/0xe984082ccd725742 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2867200->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a169d expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.602988:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b102e00, rc 0) 00000100:00100000:0.0:1746143692.603014:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28398:x1830963592237312:12345-192.168.202.48@tcp:101:cat.0 Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143692.603019:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9548 00000100:00100000:3.0:1746143692.608705:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.608787:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.608851:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592237440 00000100:00100000:1.0:1746143692.608867:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592237440 00000100:00100000:2.0:1746143692.608915:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592237696 00000100:00100000:2.0:1746143692.608919:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592237696 00002000:00100000:2.0:1746143692.608953:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094c11880 x1830963592237696/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143692.608962:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11880 with x1830963592237696 ext(4194304->4898815) 00002000:00010000:2.0:1746143692.608968:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11880 00000100:00100000:2.0:1746143692.608995:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3525 00000100:00100000:2.0:1746143692.609002:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963592237696:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143692.609222:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd72570a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1665 expref: 26 pid: 8497 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746143692.609241:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4903 00000100:00100000:1.0:1746143692.609247:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963592237440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143692.609256:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143692.609272:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd72570a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1665 expref: 26 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.609283:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd72570a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1665 expref: 26 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.609300:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd72570a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1665 expref: 26 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.609316:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.609318:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.609323:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.609330:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.609356:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143692.609366:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593728640:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143692.610216:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.614747:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963592237184:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 12254us (13567us total) trans 17179872441 rc 0/0 00000100:00100000:2.0:1746143692.614763:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 850 00002000:00100000:2.0:1746143692.614775:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1277952->1814527) req@ffff880093bf3800 x1830963592237184/t17179872441(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/448 e 0 to 0 dl 1746143703 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143692.614899:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf3800 with x1830963592237184 ext(1277952->1814527) 00010000:00010000:2.0:1746143692.614907:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 39 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.614920:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 39 pid: 8497 timeout: 871 lvb_type: 0 00002000:00010000:2.0:1746143692.614927:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bf3800 00000100:00100000:3.0:1746143692.615865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.615879:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593728640:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143692.615894:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143692.615933:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1964:x1830963592237440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6685us (7235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.615941:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4903 00000100:00100000:2.0:1746143692.616462:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963592237696:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7459us (7673us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143692.616469:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3525 00002000:00100000:2.0:1746143692.616475:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094c11880 x1830963592237696/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143692.616483:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11880 with x1830963592237696 ext(4194304->4898815) 00002000:00010000:2.0:1746143692.616488:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11880 00000100:00100000:2.0:1746143692.616498:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592237952 00000100:00100000:2.0:1746143692.616502:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592237952 00002000:00100000:2.0:1746143692.616523:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2363392->2367487) req@ffff880094c13480 x1830963592237952/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143692.616528:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13480 with x1830963592237952 ext(2363392->2367487) 00002000:00010000:2.0:1746143692.616531:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c13480 00000100:00100000:2.0:1746143692.616648:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3526 00000100:00100000:2.0:1746143692.616655:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963592237952:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143692.616777:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963592237952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 121us (923us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143692.616782:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3526 00002000:00100000:2.0:1746143692.616787:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2363392->2367487) req@ffff880094c13480 x1830963592237952/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/4536 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143692.616793:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13480 with x1830963592237952 ext(2363392->2367487) 00002000:00010000:2.0:1746143692.616796:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c13480 00000100:00100000:0.0:1746143692.620923:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.621060:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592238080 00000100:00100000:1.0:1746143692.621067:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592238080 00010000:00010000:1.0:1746143692.621095:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 39 pid: 8497 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.621507:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4904 00000100:00100000:3.0:1746143692.621516:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963592238080:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.621527:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.621547:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 39 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.621558:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 39 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.621577:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd725726 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1277952->1814527) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1681 expref: 39 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.621595:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.621597:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.621602:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72572d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1688 expref: 38 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.621610:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72572d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1688 expref: 38 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.621638:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72572d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1688 expref: 38 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143692.621649:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593728768:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143692.621723:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143692.626277:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.626510:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592238336 00000100:00100000:3.0:1746143692.626518:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592238336 00002000:00100000:3.0:1746143692.626555:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2859008->2863103) req@ffff88009c3f8000 x1830963592238336/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.626564:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8000 with x1830963592238336 ext(2859008->2863103) 00002000:00010000:3.0:1746143692.626568:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f8000 00000100:00100000:3.0:1746143692.626587:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3527 00000100:00100000:3.0:1746143692.626593:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1963:x1830963592238336:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143692.626603:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593728768:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143692.626618:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143692.626666:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963592238080:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5151us (5749us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.626674:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4904 00000100:00100000:3.0:1746143692.626818:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1963:x1830963592238336:12345-192.168.202.48@tcp:3:cat.0 Request processed in 225us (547us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143692.626824:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3527 00002000:00100000:3.0:1746143692.626828:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2859008->2863103) req@ffff88009c3f8000 x1830963592238336/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/4536 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.626833:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8000 with x1830963592238336 ext(2859008->2863103) 00002000:00010000:3.0:1746143692.626836:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f8000 00000100:00100000:0.0:1746143692.628865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.628916:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.628940:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592238464 00000100:00100000:2.0:1746143692.628946:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592238464 00000100:00100000:2.0:1746143692.628979:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592238592 00000100:00100000:2.0:1746143692.628981:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592238592 00000100:00100000:2.0:1746143692.628995:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9549 00000100:00100000:2.0:1746143692.629001:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592238464:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143692.629002:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9550 00000100:00100000:3.0:1746143692.629010:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592238592:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.629014:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.629017:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.629026:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a24e00/0xe984082ccd725750 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16ab expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.629026:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fc00/0xe984082ccd725749 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16a4 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.629042:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.629043:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.629047:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a24e00/0xe984082ccd725750 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ab expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.629050:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fc00/0xe984082ccd725749 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16a4 expref: 27 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.629056:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a24e00/0xe984082ccd725750 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ab expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.629061:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fc00/0xe984082ccd725749 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16a4 expref: 27 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.629068:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef3fc00, rc 0) 00010000:00010000:3.0:1746143692.629077:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a24e00, rc 0) 00000100:00100000:3.0:1746143692.629110:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592238592:12345-192.168.202.48@tcp:101:cat.0 Request processed in 101us (194us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143692.629110:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592238464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 109us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.629115:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9549 00000100:00100000:3.0:1746143692.629119:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9550 00000100:00100000:1.0:1746143692.631213:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.631407:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592238848 00000100:00100000:0.0:1746143692.631413:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592238848 00002000:00100000:0.0:1746143692.631447:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880093805180 x1830963592238848/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143692.631457:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805180 with x1830963592238848 ext(1048576->2097151) 00002000:00010000:0.0:1746143692.631461:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093805180 00000100:00100000:0.0:1746143692.631490:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3528 00000100:00100000:0.0:1746143692.631496:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963592238848:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143692.635405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.636265:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592238976 00000100:00100000:2.0:1746143692.636273:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592238976 00000100:00100000:2.0:1746143692.636327:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9551 00000100:00100000:2.0:1746143692.636334:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592238976:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.636351:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.636365:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd725757 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16b2 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.636893:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd725757 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b2 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.636908:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd725757 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b2 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.636932:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef3fa00, rc 0) 00000100:00100000:2.0:1746143692.637051:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592238976:12345-192.168.202.48@tcp:101:cat.0 Request processed in 717us (1653us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143692.637057:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9551 00000100:00100000:1.0:1746143692.642660:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963592238848:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 11156us (11445us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143692.642671:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3528 00002000:00100000:1.0:1746143692.642681:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880093805180 x1830963592238848/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.642690:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805180 with x1830963592238848 ext(1048576->2097151) 00002000:00010000:1.0:1746143692.642694:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093805180 00000100:00100000:0.0:1746143692.648847:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.648972:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592239104 00000100:00100000:2.0:1746143692.648979:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592239104 00000100:00100000:2.0:1746143692.649029:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9552 00000100:00100000:2.0:1746143692.649036:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:28404:x1830963592239104:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143692.649055:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.649070:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd72575e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16b9 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.650355:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.650364:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143692.650365:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143692.650369:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd72575e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b9 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.650398:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.650413:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 24 pid: 8497 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.650424:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593728896:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.650974:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.653887:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593728896:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.653914:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd72575e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b9 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.653928:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef3fa00, rc 0) 00000100:00100000:2.0:1746143692.653978:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:28404:x1830963592239104:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4941us (5138us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.653986:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9552 00000100:00100000:0.0:1746143692.654267:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.654382:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592239232 00000100:00100000:1.0:1746143692.654388:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592239232 00002000:00100000:1.0:1746143692.654420:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2363392->2863103) req@ffff88008f4ec700 x1830963592239232/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143692.654427:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ec700 with x1830963592239232 ext(2363392->2863103) 00010000:00010000:1.0:1746143692.654433:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 25 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.654444:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 25 pid: 8497 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746143692.654449:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f4ec700 00000100:00100000:1.0:1746143692.654477:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 851 00000100:00100000:1.0:1746143692.654483:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592239232:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143692.669751:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963592239232:12345-192.168.202.48@tcp:4:cat.0 Request processed in 15260us (15477us total) trans 17179872442 rc 0/0 00000100:00100000:0.0:1746143692.669762:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 851 00002000:00100000:0.0:1746143692.669772:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2363392->2863103) req@ffff88008f4ec700 x1830963592239232/t17179872442(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:88/0 lens 488/448 e 0 to 0 dl 1746143703 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143692.669780:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f4ec700 with x1830963592239232 ext(2363392->2863103) 00010000:00010000:0.0:1746143692.669789:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 27 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.669802:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 27 pid: 8497 timeout: 871 lvb_type: 0 00002000:00010000:0.0:1746143692.669808:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f4ec700 00000100:00100000:3.0:1746143692.677453:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.677475:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592239360 00000100:00100000:3.0:1746143692.677481:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592239360 00010000:00010000:3.0:1746143692.677508:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 27 pid: 8497 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.677531:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4905 00000100:00100000:3.0:1746143692.677538:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963592239360:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.677548:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143692.677563:0:11106:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143691 -> 1746143692 00002000:00010000:3.0:1746143692.677566:0:11106:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143691 -> 1746143692 00010000:00010000:3.0:1746143692.677571:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 27 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.677581:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 27 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.677599:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a24800/0xe984082ccd725734 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2363392->2867199] (req 2363392->2863103) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a168f expref: 27 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.677613:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.677615:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.677621:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd72575e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b9 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.677629:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd72575e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b9 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.677654:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd72575e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b9 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143692.677665:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593729024:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143692.677718:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143692.680877:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593729024:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143692.680894:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143692.680930:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592239360:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3391us (3483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.680939:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4905 00000100:00100000:3.0:1746143692.683073:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.683095:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592239616 00000100:00100000:3.0:1746143692.683101:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592239616 00002000:00100000:3.0:1746143692.683438:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009b850e00 x1830963592239616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/0 e 0 to 0 dl 1746143703 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.683448:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850e00 with x1830963592239616 ext(2097152->3145727) 00002000:00010000:3.0:1746143692.683453:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b850e00 00000100:00100000:3.0:1746143692.683475:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3529 00000100:00100000:3.0:1746143692.683483:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963592239616:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143692.695364:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963592239616:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11876us (12290us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143692.695374:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3529 00002000:00100000:3.0:1746143692.695384:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009b850e00 x1830963592239616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:88/0 lens 488/440 e 0 to 0 dl 1746143703 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143692.695393:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850e00 with x1830963592239616 ext(2097152->3145727) 00002000:00010000:3.0:1746143692.695398:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b850e00 00000100:00100000:0.0:1746143692.729758:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.729780:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592239744 00000100:00100000:1.0:1746143692.729787:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592239744 00000100:00080000:0.0:1746143692.729823:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143692.729832:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8264 00000100:00100000:1.0:1746143692.729840:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28411:x1830963592239744:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143692.729867:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143692.729882:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095610800/0xe984082ccd725765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16c0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.729930:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095610e00/0xe984082ccd72576c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.729939:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095610e00/0xe984082ccd72576c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.729948:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095610e00/0xe984082ccd72576c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.729957:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095611000/0xe984082ccd725773 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.729962:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095611000/0xe984082ccd725773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.729970:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095611000/0xe984082ccd725773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.732984:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.733003:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a004bc00/0xe984082ccd7255eb lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a155b expref: 258 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.733010:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b37a00/0xe984082ccd72565b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15bd expref: 25 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.733017:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.733048:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093b37a00/0xe984082ccd72565b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15bd expref: 25 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.733061:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b37a00/0xe984082ccd72565b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15bd expref: 25 pid: 14764 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746143692.733072:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593729152:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143692.733165:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a004bc00/0xe984082ccd7255eb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a155b expref: 258 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.733173:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a004bc00/0xe984082ccd7255eb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a155b expref: 258 pid: 21713 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746143692.733180:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593729280:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143692.733201:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143692.739812:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593729152:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143692.739822:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593729280:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143692.739842:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:0.0:1746143692.742591:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.742672:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.742806:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592240000 00000100:00100000:1.0:1746143692.742813:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592240000 00000100:00100000:1.0:1746143692.742864:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592240256 00000100:00100000:1.0:1746143692.742866:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592240256 00000100:00100000:1.0:1746143692.742886:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3358 00000100:00100000:1.0:1746143692.742892:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+26:26913:x1830963592240000:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143692.743101:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+27:26913:x1830963592240000:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 208us (517us total) trans 8589942364 rc 0/0 00000100:00100000:1.0:1746143692.743107:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3358 00000100:00100000:1.0:1746143692.743128:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3359 00000100:00100000:1.0:1746143692.743133:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:7696:x1830963592240256:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143692.743223:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:7696:x1830963592240256:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 90us (551us total) trans 8589942365 rc 0/0 00000100:00100000:1.0:1746143692.743228:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3359 00000100:00080000:0.0:1746143692.743633:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143692.750752:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.750783:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.750804:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592240384 00000100:00100000:3.0:1746143692.750811:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592240384 00010000:00010000:3.0:1746143692.750839:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a004bc00/0xe984082ccd7255eb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a155b expref: 260 pid: 21713 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.750871:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592240512 00000100:00100000:3.0:1746143692.750874:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592240512 00010000:00010000:3.0:1746143692.750884:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b37a00/0xe984082ccd72565b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15bd expref: 27 pid: 14764 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.750896:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4906 00000100:00100000:3.0:1746143692.750902:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:1964:x1830963592240384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.750913:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.750917:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a004bc00/0xe984082ccd7255eb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a155b expref: 260 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.750926:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a004bc00/0xe984082ccd7255eb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a155b expref: 260 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.750942:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a004bc00/0xe984082ccd7255eb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a155b expref: 260 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.750952:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143692.750956:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.750963:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.750967:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.750971:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143692.751000:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1964:x1830963592240384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 98us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.751005:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4906 00000100:00100000:3.0:1746143692.751039:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4907 00000100:00100000:3.0:1746143692.751043:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1965:x1830963592240512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.751048:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.751051:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093b37a00/0xe984082ccd72565b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15bd expref: 27 pid: 14764 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.751058:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093b37a00/0xe984082ccd72565b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15bd expref: 27 pid: 14764 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.751067:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b37a00/0xe984082ccd72565b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15bd expref: 27 pid: 14764 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.751074:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143692.751076:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.751082:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.751087:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.751112:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143692.751126:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1965:x1830963592240512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 83us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.751131:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4907 00010000:00010000:1.0:1746143692.751136:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751155:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143692.751192:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:1.0:1746143692.751196:0:14764:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143692.751210:0:14764:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751219:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751227:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095610e00/0xe984082ccd72576c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751233:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095610e00/0xe984082ccd72576c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751238:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095610e00/0xe984082ccd72576c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751242:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095610e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143692.751246:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095610e00/0xe984082ccd72576c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751252:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095610e00/0xe984082ccd72576c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751261:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143692.751263:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143692.751266:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095610e00/0xe984082ccd72576c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751271:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095610e00/0xe984082ccd72576c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751291:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095611000/0xe984082ccd725773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751295:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095611000/0xe984082ccd725773 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751300:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095611000/0xe984082ccd725773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751304:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095611000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143692.751306:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095611000/0xe984082ccd725773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751310:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095611000/0xe984082ccd725773 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751316:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090e74200) 00010000:00010000:1.0:1746143692.751318:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143692.751320:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095611000/0xe984082ccd725773 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751324:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095611000/0xe984082ccd725773 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.751354:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095610800/0xe984082ccd725765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c0 expref: 14 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.751366:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c0 expref: 13 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.751371:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143692.751373:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143692.751375:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d0000, rc 0) 00000100:00100000:1.0:1746143692.752454:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28411:x1830963592239744:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 22612us (22698us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.752461:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8264 00000100:00100000:3.0:1746143692.765984:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.766009:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.766021:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.766033:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.766062:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.766086:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.766133:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592240640 00000100:00100000:3.0:1746143692.766161:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592240640 00000100:00100000:3.0:1746143692.766198:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592240768 00000100:00100000:3.0:1746143692.766201:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592240768 00000100:00100000:3.0:1746143692.766214:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592241024 00000100:00100000:3.0:1746143692.766215:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592241024 00000100:00100000:3.0:1746143692.766223:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592241280 00000100:00100000:3.0:1746143692.766225:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592241280 00000100:00100000:3.0:1746143692.766233:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592240896 00000100:00100000:3.0:1746143692.766235:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592240896 00000100:00100000:3.0:1746143692.766244:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592241152 00000100:00100000:3.0:1746143692.766246:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592241152 00000100:00100000:3.0:1746143692.766256:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9553 00000100:00100000:3.0:1746143692.766263:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592240640:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143692.766278:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.766294:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee1600/0xe984082ccd725781 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16c7 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.766314:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.766316:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.766324:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee1600/0xe984082ccd725781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c7 expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.766339:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee1600/0xe984082ccd725781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c7 expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.766348:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ee1600, rc 0) 00000100:00100000:3.0:1746143692.766388:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592240640:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 125us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.766394:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9553 00000100:00100000:3.0:1746143692.766410:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9554 00000100:00100000:3.0:1746143692.766415:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592240768:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143692.766421:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.766430:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093368800/0xe984082ccd725788 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16ce expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.766440:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.766441:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.766445:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093368800/0xe984082ccd725788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ce expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.766454:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093368800/0xe984082ccd725788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ce expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.766461:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093368800, rc 0) 00000100:00100000:3.0:1746143692.766477:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592240768:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 62us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.766482:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9554 00000100:00100000:3.0:1746143692.766492:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9555 00000100:00100000:3.0:1746143692.766496:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592241024:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143692.766502:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.766507:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0xe984082ccd72578f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16dc expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.766517:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.766519:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.766523:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0xe984082ccd72578f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16dc expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.766531:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0xe984082ccd72578f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16dc expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.766538:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093368600, rc 0) 00000100:00100000:3.0:1746143692.766552:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592241024:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 55us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.766557:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9555 00000100:00100000:3.0:1746143692.766567:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9556 00000100:00100000:3.0:1746143692.766571:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592241280:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143692.766576:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.766581:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093369400/0xe984082ccd725796 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16ea expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.766590:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.766591:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.766595:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093369400/0xe984082ccd725796 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ea expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.766603:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093369400/0xe984082ccd725796 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ea expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.766609:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093369400, rc 0) 00000100:00100000:3.0:1746143692.766623:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592241280:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 51us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.766632:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9556 00000100:00100000:3.0:1746143692.766642:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9557 00000100:00100000:3.0:1746143692.766646:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592240896:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143692.766651:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.766656:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093369200/0xe984082ccd72579d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16d5 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.766665:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.766666:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.766670:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093369200/0xe984082ccd72579d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16d5 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.766677:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093369200/0xe984082ccd72579d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16d5 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.766683:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093369200, rc 0) 00000100:00100000:3.0:1746143692.766695:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592240896:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 49us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.766700:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9557 00000100:00100000:3.0:1746143692.766708:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9558 00000100:00100000:3.0:1746143692.766712:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592241152:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143692.766717:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.766724:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093369800/0xe984082ccd7257a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16e3 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.766732:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.766734:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.766738:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093369800/0xe984082ccd7257a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16e3 expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.766744:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093369800/0xe984082ccd7257a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16e3 expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.766750:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093369800, rc 0) 00000100:00100000:3.0:1746143692.766763:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592241152:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 51us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.766767:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9558 00000100:00080000:0.0:1746143692.767248:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143692.767251:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143692.777360:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.777592:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592241536 00000100:00100000:1.0:1746143692.777600:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592241536 00000100:00100000:1.0:1746143692.777634:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8265 00000100:00100000:1.0:1746143692.777641:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28411:x1830963592241536:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143692.777656:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143692.777670:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0600/0xe984082ccd7257ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16f1 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.777749:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0e00/0xe984082ccd7257b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.777762:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c0 expref: 14 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.777769:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0e00/0xe984082ccd7257b2 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.777794:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c0 expref: 14 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.777804:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c0 expref: 14 pid: 14764 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746143692.777814:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593729408:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143692.777904:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143692.780374:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593729408:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143692.780392:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0e00/0xe984082ccd7257b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143692.780399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.780441:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592241664 00000100:00100000:3.0:1746143692.780446:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592241664 00010000:00010000:3.0:1746143692.780469:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c0 expref: 15 pid: 14764 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.780491:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4908 00000100:00100000:3.0:1746143692.780497:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1965:x1830963592241664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.780506:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.780511:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c0 expref: 15 pid: 14764 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.780519:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c0 expref: 15 pid: 14764 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.780537:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd72577a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c0 expref: 15 pid: 14764 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.780560:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143692.780686:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0e00/0xe984082ccd7257b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.780694:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0e00/0xe984082ccd7257b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.780698:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0e00/0xe984082ccd7257b2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.780723:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143692.780765:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1965:x1830963592241664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 267us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.780771:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4908 00010000:00010000:0.0:1746143692.780848:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0e00/0xe984082ccd7257b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143692.780865:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0e00/0xe984082ccd7257b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:0.0:1746143692.780881:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143692.780993:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0600/0xe984082ccd7257ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16f1 expref: 15 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.781005:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0e00/0xe984082ccd7257b2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16f1 expref: 14 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.781011:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:0.0:1746143692.781013:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143692.781014:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d0e00, rc 0) 00000100:00100000:0.0:1746143692.781036:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:28411:x1830963592241536:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 3396us (3684us total) trans 8589942366 rc 0/0 00000100:00100000:0.0:1746143692.781041:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8265 00000001:00080000:3.0:1746143692.782087:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872439 is committed 00000001:00080000:3.0:1746143692.782097:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872425 is committed 00000001:00080000:3.0:1746143692.782108:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872409 is committed 00000001:00080000:3.0:1746143692.782113:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872398 is committed 00000001:00080000:3.0:1746143692.782158:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872441 is committed 00000001:00080000:3.0:1746143692.782173:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872427 is committed 00000001:00080000:3.0:1746143692.782179:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872410 is committed 00000001:00080000:3.0:1746143692.782184:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872440 is committed 00000001:00080000:3.0:1746143692.782234:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872428 is committed 00000100:00100000:0.0:1746143692.783014:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.783059:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592241920 00000100:00100000:2.0:1746143692.783065:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592241920 00000100:00100000:2.0:1746143692.783091:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8266 00000100:00100000:2.0:1746143692.783096:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:28411:x1830963592241920:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143692.783113:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143692.783115:0:14764:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143692.783130:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0e00/0xe984082ccd7257b2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16f1 expref: 14 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.783173:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143692.783177:0:14764:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143692.783186:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffc00/0xe984082ccd7257c0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16f8 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.783295:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7400/0xe984082ccd7257c7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.783305:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7400/0xe984082ccd7257c7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.783312:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7400/0xe984082ccd7257c7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143692.783320:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143692.783390:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffc00/0xe984082ccd7257c0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16f8 expref: 16 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.783405:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7400/0xe984082ccd7257c7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16f8 expref: 15 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.783410:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143692.783412:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143692.783414:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d7400, rc 0) 00000100:00100000:3.0:1746143692.783458:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:28411:x1830963592241920:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 360us (445us total) trans 8589942367 rc 0/0 00000100:00100000:3.0:1746143692.783464:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8266 00000100:00100000:0.0:1746143692.785189:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.785270:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592242048 00000100:00100000:3.0:1746143692.785276:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592242048 00000100:00100000:3.0:1746143692.785349:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8267 00000100:00100000:3.0:1746143692.785356:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:28411:x1830963592242048:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143692.785371:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.785384:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7e00/0xe984082ccd7257d5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a16ff expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.785428:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7e00/0xe984082ccd7257d5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ff expref: 16 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.785438:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7e00/0xe984082ccd7257d5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ff expref: 16 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.785455:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143692.785457:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143692.785459:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d7e00, rc 0) 00000100:00100000:3.0:1746143692.785489:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:28411:x1830963592242048:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 134us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.785494:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8267 00000100:00100000:0.0:1746143692.787303:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.787337:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.787397:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592242176 00000100:00100000:1.0:1746143692.787403:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592242176 00000100:00100000:1.0:1746143692.787430:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592242432 00000100:00100000:1.0:1746143692.787431:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592242432 00000100:00100000:0.0:1746143692.787452:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.787481:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.787494:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.787511:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.787527:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592242688 00000100:00100000:0.0:1746143692.787529:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592242688 00000100:00100000:1.0:1746143692.787557:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9559 00000100:00100000:1.0:1746143692.787564:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592242176:12345-192.168.202.48@tcp:1:mirror_io.0 00000100:00100000:2.0:1746143692.787583:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592242304 00000100:00100000:2.0:1746143692.787586:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592242304 00010000:00010000:1.0:1746143692.787595:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.787609:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a008a200/0xe984082ccd7256fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1657 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.787616:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee1600/0xe984082ccd725781 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c7 expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.787622:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd725711 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a166c expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143692.787628:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592242560 00010000:00010000:1.0:1746143692.787628:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.787630:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143692.787631:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592242560 00010000:00010000:1.0:1746143692.787632:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.787655:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd725711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a166c expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.787666:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd725711 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a166c expref: 20 pid: 15784 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746143692.787677:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093807480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593729536:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143692.787729:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee1600/0xe984082ccd725781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c7 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.787737:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee1600/0xe984082ccd725781 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c7 expref: 11 pid: 8497 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746143692.787743:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593729664:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143692.787759:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a008a200/0xe984082ccd7256fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1657 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.787765:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a008a200/0xe984082ccd7256fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1657 expref: 9 pid: 8497 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746143692.787772:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593729792:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143692.787785:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143692.787797:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592242816 00000100:00100000:1.0:1746143692.787799:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592242816 00000100:00100000:0.0:1746143692.787884:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9560 00000100:00100000:0.0:1746143692.787890:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592242432:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143692.787909:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.787919:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a004b800/0xe984082ccd72563f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a8 expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.787925:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093369200/0xe984082ccd72579d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16d5 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143692.787932:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a004be00/0xe984082ccd725646 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15af expref: 8 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.787937:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143692.787938:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143692.787940:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.787955:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a004be00/0xe984082ccd725646 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15af expref: 8 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.787966:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a004be00/0xe984082ccd725646 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15af expref: 8 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746143692.787973:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593729920:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143692.787999:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093369200/0xe984082ccd72579d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16d5 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143692.788006:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093369200/0xe984082ccd72579d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16d5 expref: 11 pid: 8497 timeout: 871 lvb_type: 1 00000100:00100000:0.0:1746143692.788013:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593730048:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143692.788028:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a004b800/0xe984082ccd72563f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a8 expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.788034:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a004b800/0xe984082ccd72563f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a8 expref: 16 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746143692.788040:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593730176:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143692.788049:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.788112:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9561 00000100:00100000:2.0:1746143692.788117:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592242688:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143692.788131:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.788161:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd72575e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b9 expref: 20 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.788167:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093369800/0xe984082ccd7257a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16e3 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.788173:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b102e00/0xe984082ccd725742 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2867200->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a169d expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.788178:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d511c00/0xe984082ccd7256cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1626 expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.788182:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143692.788184:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143692.788185:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 7/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.788200:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d511c00/0xe984082ccd7256cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1626 expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.788208:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d511c00/0xe984082ccd7256cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1626 expref: 20 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.788214:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593730304:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.788238:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b102e00/0xe984082ccd725742 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2867200->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a169d expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.788244:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b102e00/0xe984082ccd725742 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2867200->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a169d expref: 9 pid: 8497 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.788250:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0850000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593730432:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.788267:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093369800/0xe984082ccd7257a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16e3 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.788273:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093369800/0xe984082ccd7257a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16e3 expref: 11 pid: 8497 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746143692.788279:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0850e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593730560:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.788295:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd72575e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b9 expref: 20 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.788301:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd72575e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b9 expref: 20 pid: 25369 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.788311:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0853100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593730688:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.788322:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c3076c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.788337:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9562 00000100:00100000:2.0:1746143692.788342:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592242304:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143692.788356:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.788365:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd725703 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a165e expref: 8 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.788370:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093368800/0xe984082ccd725788 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ce expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.788376:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d511600/0xe984082ccd72571f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1673 expref: 16 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.788381:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.788382:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.788384:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.788396:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d511600/0xe984082ccd72571f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1673 expref: 16 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.788403:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d511600/0xe984082ccd72571f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1673 expref: 16 pid: 4582 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746143692.788410:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0852300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593730816:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.788429:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093368800/0xe984082ccd725788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ce expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143692.788435:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093368800/0xe984082ccd725788 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ce expref: 11 pid: 8497 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746143692.788472:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9563 00000100:00100000:1.0:1746143692.788476:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9564 00000100:00100000:3.0:1746143692.788478:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592242560:12345-192.168.202.48@tcp:1:mirror_io.0 00000100:00100000:1.0:1746143692.788481:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592242816:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143692.788492:0:8495:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.788493:0:8496:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.788501:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72572d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1688 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.788501:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0864c00/0xe984082ccd725693 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15ee expref: 8 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.788508:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0xe984082ccd72578f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16dc expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.788508:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093369400/0xe984082ccd725796 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ea expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.788513:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fc00/0xe984082ccd725749 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16a4 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.788518:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.788519:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.788519:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a008aa00/0xe984082ccd7256a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1603 expref: 16 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.788520:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.788524:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.788525:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.788527:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.788537:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fc00/0xe984082ccd725749 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16a4 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.788537:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a008aa00/0xe984082ccd7256a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1603 expref: 16 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143692.788544:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fc00/0xe984082ccd725749 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16a4 expref: 9 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746143692.788544:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a008aa00/0xe984082ccd7256a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1603 expref: 16 pid: 15784 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746143692.788551:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593731200:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143692.788551:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593731072:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143692.788570:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093369400/0xe984082ccd725796 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ea expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.788578:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093369400/0xe984082ccd725796 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ea expref: 11 pid: 8497 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746143692.788584:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593731328:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.788640:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0xe984082ccd72578f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16dc expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.788640:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0864c00/0xe984082ccd725693 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15ee expref: 8 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.788648:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0xe984082ccd72578f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16dc expref: 11 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746143692.788652:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0864c00/0xe984082ccd725693 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15ee expref: 8 pid: 25369 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.788655:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593731584:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143692.788658:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593731456:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143692.788668:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8d3b300 going to sleep for 11 seconds 00010000:00010000:3.0:1746143692.788671:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72572d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1688 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.788677:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72572d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1688 expref: 20 pid: 8497 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.788684:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593731712:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.788695:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.788750:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593730944:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.788772:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd725703 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a165e expref: 8 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.788778:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd725703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a165e expref: 8 pid: 8497 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.788784:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593731840:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.788795:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c307a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143692.793122:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593729920:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143692.793230:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093807480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593729536:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143692.793240:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593729664:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143692.793248:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593729792:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143692.793270:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143692.794051:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.794430:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592242944 00000100:00100000:3.0:1746143692.794436:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592242944 00010000:00010000:3.0:1746143692.794464:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee1600/0xe984082ccd725781 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c7 expref: 12 pid: 8497 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746143692.794485:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4909 00000100:00100000:3.0:1746143692.794492:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592242944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.794503:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.794522:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee1600/0xe984082ccd725781 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c7 expref: 12 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.794531:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee1600/0xe984082ccd725781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c7 expref: 12 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.794547:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ee1600/0xe984082ccd725781 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16c7 expref: 12 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.794560:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143692.794591:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592242944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 98us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.794596:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4909 00000100:00100000:2.0:1746143692.794946:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593730048:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.795374:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593731200:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.795383:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593731584:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.795390:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593731712:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.795408:0:8496:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143692.795491:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593731328:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143692.795498:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593731456:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.795595:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593730944:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.795602:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593731840:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.795686:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593730176:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.795702:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143692.795820:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593731072:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143692.795837:0:8495:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143692.795893:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593730304:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.795902:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0850000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593730432:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.795910:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0850e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593730560:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143692.795916:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0853100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593730688:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143692.795932:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143692.795995:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0852300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593730816:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.796008:0:4582:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143692.804594:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.804629:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.804654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.804671:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.804683:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.804712:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.805618:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592243072 00000100:00100000:1.0:1746143692.805625:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592243840 00000100:00100000:2.0:1746143692.805626:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592243072 00000100:00100000:1.0:1746143692.805630:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592243840 00000100:00100000:0.0:1746143692.805646:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143692.805654:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093369200/0xe984082ccd72579d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16d5 expref: 13 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746143692.805654:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093368800/0xe984082ccd725788 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ce expref: 13 pid: 8497 timeout: 871 lvb_type: 1 00000100:00100000:0.0:1746143692.805658:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.805666:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.805672:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592243328 00000100:00100000:2.0:1746143692.805673:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592243584 00000100:00100000:1.0:1746143692.805674:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592243328 00000100:00100000:2.0:1746143692.805675:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592243584 00000100:00100000:0.0:1746143692.805675:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143692.805682:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093369400/0xe984082ccd725796 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ea expref: 14 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746143692.805685:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0xe984082ccd72578f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16dc expref: 11 pid: 8497 timeout: 871 lvb_type: 1 00000100:00100000:0.0:1746143692.805686:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.805690:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592243712 00000100:00100000:1.0:1746143692.805691:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592243712 00000100:00100000:2.0:1746143692.805694:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592243200 00000100:00100000:0.0:1746143692.805695:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.805696:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592243200 00010000:00010000:1.0:1746143692.805699:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd725711 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a166c expref: 21 pid: 15784 timeout: 871 lvb_type: 1 00000100:00100000:0.0:1746143692.805703:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143692.805706:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fc00/0xe984082ccd725749 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16a4 expref: 10 pid: 8497 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746143692.805707:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592243456 00000100:00100000:1.0:1746143692.805709:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592243456 00000100:00100000:0.0:1746143692.805710:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.805713:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592243968 00000100:00100000:2.0:1746143692.805715:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592243968 00010000:00010000:1.0:1746143692.805716:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a008a200/0xe984082ccd7256fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1657 expref: 11 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.805722:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72572d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1688 expref: 22 pid: 8497 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746143692.805723:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592244096 00000100:00100000:1.0:1746143692.805725:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592244096 00000100:00100000:2.0:1746143692.805729:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592244480 00000100:00100000:2.0:1746143692.805730:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592244480 00000100:00100000:0.0:1746143692.805730:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143692.805733:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a004be00/0xe984082ccd725646 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15af expref: 9 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.805738:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b102e00/0xe984082ccd725742 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2867200->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a169d expref: 12 pid: 8497 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746143692.805740:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592244864 00000100:00100000:1.0:1746143692.805742:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592244864 00000100:00100000:0.0:1746143692.805743:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592244736 00000100:00100000:2.0:1746143692.805745:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592244352 00000100:00100000:0.0:1746143692.805746:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592244736 00000100:00100000:2.0:1746143692.805747:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592244352 00010000:00010000:1.0:1746143692.805749:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d511600/0xe984082ccd72571f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1673 expref: 17 pid: 4582 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746143692.805757:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592244224 00010000:00010000:0.0:1746143692.805758:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd725703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a165e expref: 10 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.805759:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093369800/0xe984082ccd7257a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16e3 expref: 12 pid: 8497 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746143692.805759:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592244224 00010000:00010000:1.0:1746143692.805766:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d511c00/0xe984082ccd7256cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1626 expref: 23 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.805767:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592244608 00000100:00100000:2.0:1746143692.805768:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592244608 00010000:00010000:2.0:1746143692.805775:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0864c00/0xe984082ccd725693 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15ee expref: 11 pid: 25369 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746143692.805776:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4910 00000100:00100000:0.0:1746143692.805780:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4911 00000100:00100000:1.0:1746143692.805782:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1962:x1830963592243072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143692.805785:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1965:x1830963592243840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143692.805787:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4912 00000100:00100000:2.0:1746143692.805792:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1962:x1830963592243328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143692.805792:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143692.805792:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143692.805798:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143692.805809:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093369200/0xe984082ccd72579d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16d5 expref: 14 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746143692.805809:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093368800/0xe984082ccd725788 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ce expref: 14 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746143692.805818:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093369200/0xe984082ccd72579d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16d5 expref: 14 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746143692.805818:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093368800/0xe984082ccd725788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ce expref: 14 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746143692.805835:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093369200/0xe984082ccd72579d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16d5 expref: 14 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746143692.805835:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093368800/0xe984082ccd725788 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ce expref: 14 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746143692.805863:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143692.805866:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143692.805896:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963592243072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 114us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.805902:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4910 00010000:00010000:2.0:1746143692.805908:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093369400/0xe984082ccd725796 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ea expref: 12 pid: 8497 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746143692.805915:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4913 00010000:00010000:2.0:1746143692.805916:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093369400/0xe984082ccd725796 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ea expref: 11 pid: 8497 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746143692.805919:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963592243584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.805926:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093369400/0xe984082ccd725796 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ea expref: 11 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746143692.805926:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143692.805938:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0xe984082ccd72578f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16dc expref: 12 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746143692.805940:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143692.805945:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0xe984082ccd72578f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16dc expref: 12 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746143692.805959:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093368600/0xe984082ccd72578f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16dc expref: 12 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746143692.805967:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143692.806109:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4914 00000100:00100000:3.0:1746143692.806117:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592243712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.806125:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.806135:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd725711 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a166c expref: 23 pid: 15784 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.806161:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd725711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a166c expref: 23 pid: 15784 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.806171:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd725711 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a166c expref: 23 pid: 15784 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.806184:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143692.807246:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592243840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1456us (2612us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143692.807252:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4911 00000100:00100000:2.0:1746143692.807253:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963592243328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1458us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.807260:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4912 00000100:00100000:3.0:1746143692.807277:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592243712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1161us (2592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143692.807277:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4915 00000100:00100000:2.0:1746143692.807281:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4916 00000100:00100000:0.0:1746143692.807283:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592243200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143692.807285:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4914 00000100:00100000:2.0:1746143692.807287:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592243456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143692.807289:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143692.807293:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143692.807296:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4917 00010000:00010000:0.0:1746143692.807299:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fc00/0xe984082ccd725749 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16a4 expref: 12 pid: 8497 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746143692.807301:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963592243968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.807303:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a008a200/0xe984082ccd7256fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1657 expref: 12 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.807307:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fc00/0xe984082ccd725749 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16a4 expref: 12 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.807309:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143692.807311:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a008a200/0xe984082ccd7256fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1657 expref: 12 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.807319:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fc00/0xe984082ccd725749 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16a4 expref: 12 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746143692.807321:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a008a200/0xe984082ccd7256fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1657 expref: 12 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.807324:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72572d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1688 expref: 21 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.807327:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143692.807331:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72572d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1688 expref: 21 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.807331:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.807332:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.807336:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.807340:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd72572d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1688 expref: 21 pid: 8497 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746143692.807341:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1962:x1830963592243200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 59us (2629us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143692.807343:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143692.807346:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4915 00010000:00010000:3.0:1746143692.807347:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.807349:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143692.807351:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143692.807355:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4918 00010000:00010000:3.0:1746143692.807357:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143692.807359:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592244096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.807363:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143692.807364:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.807371:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143692.807372:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a004be00/0xe984082ccd725646 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15af expref: 11 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.807379:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1962:x1830963592243456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 93us (1734us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143692.807380:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a004be00/0xe984082ccd725646 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15af expref: 11 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.807384:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963592243968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 84us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.807384:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4916 00000100:00100000:3.0:1746143692.807389:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4917 00010000:00010000:0.0:1746143692.807389:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a004be00/0xe984082ccd725646 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15af expref: 11 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746143692.807395:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4919 00010000:00010000:0.0:1746143692.807397:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143692.807399:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4920 00000100:00100000:2.0:1746143692.807401:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1965:x1830963592244480:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143692.807404:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963592244864:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143692.807405:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592244096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 46us (1738us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143692.807407:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143692.807409:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4918 00010000:00010000:3.0:1746143692.807410:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143692.807415:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b102e00/0xe984082ccd725742 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2867200->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a169d expref: 8 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.807418:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d511600/0xe984082ccd72571f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1673 expref: 17 pid: 4582 timeout: 871 lvb_type: 1 00000100:00100000:0.0:1746143692.807418:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4921 00000100:00100000:0.0:1746143692.807422:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592244352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.807423:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b102e00/0xe984082ccd725742 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2867200->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a169d expref: 8 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.807427:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.807430:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d511600/0xe984082ccd72571f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1673 expref: 17 pid: 4582 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746143692.807433:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b102e00/0xe984082ccd725742 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [2867200->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a169d expref: 8 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.807434:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093369800/0xe984082ccd7257a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16e3 expref: 11 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746143692.807440:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d511600/0xe984082ccd72571f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1673 expref: 17 pid: 4582 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746143692.807440:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093369800/0xe984082ccd7257a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16e3 expref: 11 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746143692.807446:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143692.807447:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143692.807450:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093369800/0xe984082ccd7257a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16e3 expref: 11 pid: 8497 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746143692.807456:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143692.807457:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+7:1965:x1830963592244480:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 56us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.807459:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963592244864:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 55us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.807462:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4919 00000100:00100000:0.0:1746143692.807463:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592244352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 42us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.807465:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4920 00000100:00100000:0.0:1746143692.807471:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4921 00000100:00100000:2.0:1746143692.807474:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4922 00000100:00100000:2.0:1746143692.807479:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963592244736:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143692.807480:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4923 00000100:00100000:3.0:1746143692.807484:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963592244224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.807485:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143692.807485:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4924 00000100:00100000:0.0:1746143692.807488:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963592244608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.807490:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143692.807493:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd725703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a165e expref: 9 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.807493:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.807497:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d511c00/0xe984082ccd7256cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1626 expref: 19 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.807500:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd725703 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a165e expref: 9 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.807500:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0864c00/0xe984082ccd725693 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15ee expref: 9 pid: 25369 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.807504:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d511c00/0xe984082ccd7256cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1626 expref: 19 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.807507:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0864c00/0xe984082ccd725693 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15ee expref: 9 pid: 25369 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746143692.807510:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d520200/0xe984082ccd725703 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a165e expref: 9 pid: 8497 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.807512:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d511c00/0xe984082ccd7256cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1626 expref: 19 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.807515:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0864c00/0xe984082ccd725693 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15ee expref: 9 pid: 25369 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.807519:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143692.807521:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143692.807524:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.807526:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143692.807527:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963592244224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 44us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143692.807528:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+7:1963:x1830963592244608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 40us (1798us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143692.807529:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143692.807533:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4924 00010000:00010000:2.0:1746143692.807534:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143692.807535:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4923 00010000:00010000:2.0:1746143692.807547:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143692.807560:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+6:1964:x1830963592244736:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 81us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.807565:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4922 00010000:00010000:3.0:1746143692.807568:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.807574:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.807591:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.807594:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.807597:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.807600:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.807604:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.807610:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d7200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143692.807613:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.807613:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.807618:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.807620:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.807624:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.807629:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.807634:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a21fe800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143692.807635:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7200/0xe984082ccd7257f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.807637:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.807643:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.807653:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.807658:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe800/0xe984082ccd7257f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143692.807671:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592242560:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 19194us (20176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.807677:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9563 00000100:00100000:2.0:1746143692.807690:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592242304:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 19347us (20207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143692.807696:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9562 00000100:00100000:1.0:1746143692.808537:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592243584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2614us (3862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.808543:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4913 00010000:00010000:1.0:1746143692.808585:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.808592:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.808608:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.808614:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.808620:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.808625:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d1800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143692.808628:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.808638:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.808646:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.808650:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d1800/0xe984082ccd7257dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143692.808681:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592242176:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 21117us (21383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.808688:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9559 00000100:00100000:0.0:1746143692.811192:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.811363:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592244992 00000100:00100000:1.0:1746143692.811372:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592244992 00010000:00010000:1.0:1746143692.811403:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd72575e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b9 expref: 18 pid: 25369 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746143692.811428:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4925 00000100:00100000:1.0:1746143692.811434:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592244992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143692.811444:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143692.811461:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd72575e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b9 expref: 18 pid: 25369 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.811470:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd72575e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b9 expref: 18 pid: 25369 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.811491:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3fa00/0xe984082ccd72575e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16b9 expref: 18 pid: 25369 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.811502:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.811504:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.811509:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.811517:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.811536:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143692.811566:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963592244992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 132us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.811572:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4925 00010000:00010000:1.0:1746143692.811598:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.811604:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.811619:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.811626:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.811641:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.811646:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a21fee00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143692.811649:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.811655:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.811663:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.811669:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fee00/0xe984082ccd7257ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143692.811705:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1964:x1830963592242688:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 23588us (24253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.811712:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9561 00000100:00100000:0.0:1746143692.812658:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.813193:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592245120 00000100:00100000:2.0:1746143692.813199:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592245120 00010000:00010000:2.0:1746143692.813223:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a008aa00/0xe984082ccd7256a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1603 expref: 16 pid: 15784 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746143692.813259:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4926 00000100:00100000:2.0:1746143692.813266:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963592245120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143692.813277:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143692.813292:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a008aa00/0xe984082ccd7256a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1603 expref: 16 pid: 15784 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746143692.813302:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a008aa00/0xe984082ccd7256a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1603 expref: 16 pid: 15784 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746143692.813317:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a008aa00/0xe984082ccd7256a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1603 expref: 16 pid: 15784 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746143692.813327:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.813329:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143692.813332:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.813344:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143692.813367:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143692.813373:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.813380:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.813396:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143692.813400:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1963:x1830963592245120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 134us (744us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143692.813402:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143692.813405:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4926 00010000:00010000:0.0:1746143692.813407:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.813412:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d0800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143692.813414:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.813420:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.813429:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.813433:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d0800/0xe984082ccd7257ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143692.813473:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592242816:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 24991us (25961us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143692.813480:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9564 00000100:00100000:0.0:1746143692.816227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.816741:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592245248 00000100:00100000:1.0:1746143692.816748:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592245248 00010000:00010000:1.0:1746143692.816776:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a004b800/0xe984082ccd72563f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a8 expref: 15 pid: 4582 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746143692.816798:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4927 00000100:00100000:1.0:1746143692.816805:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1963:x1830963592245248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143692.816817:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143692.816836:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a004b800/0xe984082ccd72563f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a8 expref: 15 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.816846:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a004b800/0xe984082ccd72563f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a8 expref: 15 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.816874:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a004b800/0xe984082ccd72563f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a15a8 expref: 15 pid: 4582 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.816888:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.816890:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.816893:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.816900:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143692.817274:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143692.817317:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+14:1963:x1830963592245248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 511us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.817324:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4927 00010000:00010000:3.0:1746143692.817587:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.817596:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.817616:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.817624:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.817631:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.817637:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4dae200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143692.817640:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.817646:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.817655:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.817662:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4dae200/0xe984082ccd7257e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143692.817710:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1964:x1830963592242432:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 29820us (30372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.817716:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9560 00000100:00100000:0.0:1746143692.821674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.821731:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592245504 00000100:00100000:3.0:1746143692.821738:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592245504 00000100:00100000:3.0:1746143692.821786:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8268 00000100:00100000:3.0:1746143692.821794:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:28411:x1830963592245504:12345-192.168.202.48@tcp:36:mirror_io.0 00010000:00010000:3.0:1746143692.821834:0:14764:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.821865:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7e00/0xe984082ccd7257d5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16ff expref: 16 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.821882:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143692.821885:0:14764:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143692.821912:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.821923:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a118e expref: 258 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.821930:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 25 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.821936:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11aa expref: 258 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.821942:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725161 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a122f expref: 25 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.821948:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792200/0xe984082ccd725176 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1236 expref: 258 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.821954:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2400/0xe984082ccd7251d8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a126e expref: 258 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.821960:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd725233 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12a6 expref: 25 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.821966:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 10/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.821991:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd725233 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12a6 expref: 25 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.822002:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd725233 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12a6 expref: 25 pid: 21713 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.822013:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593731968:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.822709:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2400/0xe984082ccd7251d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a126e expref: 258 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.822717:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2400/0xe984082ccd7251d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a126e expref: 258 pid: 14764 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.822730:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593732096:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.822782:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792200/0xe984082ccd725176 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1236 expref: 258 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.822789:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792200/0xe984082ccd725176 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1236 expref: 258 pid: 21713 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.822796:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593732224:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.822819:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725161 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a122f expref: 25 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.822825:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725161 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a122f expref: 25 pid: 21713 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.822832:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593732352:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.822871:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11aa expref: 258 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.822878:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11aa expref: 258 pid: 14762 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.822885:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593732480:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.822908:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 25 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.822918:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 25 pid: 14762 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.822924:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593732608:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.822945:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a118e expref: 258 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.822950:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a118e expref: 258 pid: 21713 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.822956:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593732736:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.822970:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143692.824711:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593731968:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.824722:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593732096:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.824729:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593732224:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.824735:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593732352:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.824742:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593732480:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.824748:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593732608:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143692.824754:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593732736:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143692.824786:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:0.0:1746143692.825016:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.825086:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.825264:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592245632 00000100:00100000:1.0:1746143692.825270:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592245632 00010000:00010000:1.0:1746143692.825297:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd725233 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12a6 expref: 26 pid: 21713 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746143692.825329:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592245760 00000100:00100000:1.0:1746143692.825332:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592245760 00010000:00010000:1.0:1746143692.825342:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2400/0xe984082ccd7251d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a126e expref: 259 pid: 14764 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746143692.825357:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4928 00000100:00100000:1.0:1746143692.825363:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1962:x1830963592245632:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143692.825373:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143692.825377:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd725233 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12a6 expref: 26 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.825386:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd725233 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12a6 expref: 26 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.825403:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd725233 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a12a6 expref: 26 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.825415:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143692.825418:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.825425:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143692.825458:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1962:x1830963592245632:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 94us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.825464:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4928 00000100:00100000:1.0:1746143692.825485:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4929 00000100:00100000:1.0:1746143692.825490:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1962:x1830963592245760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143692.825498:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143692.825501:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2400/0xe984082ccd7251d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a126e expref: 259 pid: 14764 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.825508:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2400/0xe984082ccd7251d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a126e expref: 259 pid: 14764 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.825519:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2400/0xe984082ccd7251d8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a126e expref: 259 pid: 14764 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.825529:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143692.825532:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.825537:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143692.825550:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:1962:x1830963592245760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 60us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.825555:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4929 00000100:00100000:2.0:1746143692.828695:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.829366:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.829392:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143692.829416:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.829419:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592246016 00000100:00100000:1.0:1746143692.829427:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592246016 00000100:00100000:1.0:1746143692.829455:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592246272 00000100:00100000:1.0:1746143692.829456:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592246272 00000100:00100000:1.0:1746143692.829468:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3360 00000100:00100000:1.0:1746143692.829474:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:23698:x1830963592246016:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143692.829641:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:23698:x1830963592246016:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 165us (952us total) trans 8589942368 rc 0/0 00000100:00100000:1.0:1746143692.829647:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3360 00000100:00100000:1.0:1746143692.829661:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3361 00000100:00100000:2.0:1746143692.829663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.829666:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+25:7695:x1830963592246272:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143692.829726:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:7695:x1830963592246272:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 59us (360us total) trans 8589942369 rc 0/0 00000100:00100000:1.0:1746143692.829732:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3361 00000100:00100000:3.0:1746143692.829795:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592246656 00000100:00100000:3.0:1746143692.829798:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592246656 00010000:00010000:3.0:1746143692.829813:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a118e expref: 259 pid: 21713 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.829828:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592246400 00000100:00100000:3.0:1746143692.829830:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592246400 00010000:00010000:3.0:1746143692.829836:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11aa expref: 260 pid: 14762 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.829844:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592246528 00000100:00100000:3.0:1746143692.829845:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592246528 00010000:00010000:3.0:1746143692.829860:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 26 pid: 14762 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.829871:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4930 00000100:00100000:3.0:1746143692.829875:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:1964:x1830963592246656:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.829882:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.829887:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a118e expref: 260 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.829894:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a118e expref: 260 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.829909:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725081 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a118e expref: 260 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.829919:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143692.829923:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.829932:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143692.829946:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1964:x1830963592246656:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 70us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.829950:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4930 00000100:00100000:3.0:1746143692.829959:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4931 00000100:00100000:3.0:1746143692.829962:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:1963:x1830963592246400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.829966:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.829969:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11aa expref: 258 pid: 14762 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746143692.829975:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11aa expref: 258 pid: 14762 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746143692.829977:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4932 00010000:00010000:3.0:1746143692.829982:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72509d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a11aa expref: 258 pid: 14762 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746143692.829985:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+26:1963:x1830963592246528:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143692.829987:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143692.829990:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143692.829992:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143692.829993:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143692.829997:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 26 pid: 14762 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746143692.830001:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:1963:x1830963592246400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 39us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.830005:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4931 00010000:00010000:0.0:1746143692.830005:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 26 pid: 14762 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.830016:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa200/0xe984082ccd72508f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a119c expref: 26 pid: 14762 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.830026:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:0.0:1746143692.830030:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143692.830249:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143692.830267:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592246528:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 284us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143692.830273:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4932 00000100:00100000:0.0:1746143692.832740:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.833178:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592246784 00000100:00100000:1.0:1746143692.833185:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592246784 00010000:00010000:1.0:1746143692.833212:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725161 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a122f expref: 25 pid: 21713 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746143692.833234:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4933 00000100:00100000:1.0:1746143692.833241:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592246784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143692.833253:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143692.833258:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725161 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a122f expref: 25 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.833265:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725161 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a122f expref: 25 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.833282:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725161 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a122f expref: 25 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746143692.833302:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143692.833307:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.833313:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143692.833542:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963592246784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 300us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.833548:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4933 00000100:00100000:3.0:1746143692.835667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.835882:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592246912 00000100:00100000:0.0:1746143692.835887:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592246912 00010000:00010000:0.0:1746143692.835911:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792200/0xe984082ccd725176 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1236 expref: 257 pid: 21713 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746143692.835938:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4934 00000100:00100000:0.0:1746143692.835944:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:1964:x1830963592246912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143692.835957:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143692.835961:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792200/0xe984082ccd725176 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1236 expref: 257 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.835970:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792200/0xe984082ccd725176 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1236 expref: 257 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.835986:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792200/0xe984082ccd725176 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1236 expref: 257 pid: 21713 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746143692.836006:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:0.0:1746143692.836010:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143692.836017:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143692.836023:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143692.836040:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143692.836071:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:1964:x1830963592246912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 127us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143692.836077:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4934 00010000:00010000:3.0:1746143692.836506:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143692.836516:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000040:00080000:3.0:1746143692.837126:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2267, 88 off190440 00000004:00080000:3.0:1746143692.837132:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771846992011ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143692.837187:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2217, 88 off185856 00000004:00080000:3.0:1746143692.837191:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771847051483ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143692.837201:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2218, 88 off185944 00000004:00080000:3.0:1746143692.837203:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771847063523ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143692.837209:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2268, 88 off190528 00000004:00080000:3.0:1746143692.837211:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771847071210ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143692.837216:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2269, 88 off190616 00000004:00080000:3.0:1746143692.837218:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771847078556ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143692.837223:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2219, 88 off186032 00000004:00080000:3.0:1746143692.837225:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771847085365ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143692.837230:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2220, 88 off186120 00000004:00080000:3.0:1746143692.837232:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771847092586ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143692.837237:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2221, 88 off186208 00000004:00080000:3.0:1746143692.837239:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771847099136ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143692.837244:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2270, 88 off190704 00000004:00080000:3.0:1746143692.837245:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771847105615ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143692.837250:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2222, 88 off186296 00000004:00080000:3.0:1746143692.837252:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771847111998ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143692.837256:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2271, 88 off190792 00000004:00080000:3.0:1746143692.837258:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771847118553ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143692.837263:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2223, 88 off186384 00000004:00080000:3.0:1746143692.837265:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771847125563ns, next at 718087967394ns, rc = 0 00000040:00080000:3.0:1746143692.837270:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2272, 88 off190880 00000004:00080000:3.0:1746143692.837272:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771847132565ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143692.837277:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2273, 88 off190968 00000004:00080000:3.0:1746143692.837279:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771847139468ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143692.837284:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2274, 88 off191056 00000004:00080000:3.0:1746143692.837286:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771847145963ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143692.837290:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2275, 88 off191144 00000004:00080000:3.0:1746143692.837292:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771847152266ns, next at 758183694006ns, rc = 0 00000040:00080000:3.0:1746143692.837297:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2224, 88 off186472 00000004:00080000:3.0:1746143692.837298:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771847158616ns, next at 718087967394ns, rc = 0 00000001:00080000:1.0:1746143692.871885:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942366 is committed 00000001:00080000:1.0:1746143692.871902:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942369 is committed 00000001:00080000:1.0:1746143692.871907:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942368 is committed 00000001:00080000:1.0:1746143692.871951:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942370 is committed 00000004:00080000:1.0:1746143692.871954:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1570 committed 00000004:00080000:1.0:1746143692.871961:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1620 committed 00000004:00080000:1.0:1746143692.871965:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1619 committed 00000004:00080000:1.0:1746143692.871967:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1618 committed 00000004:00080000:1.0:1746143692.871968:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1617 committed 00000004:00080000:1.0:1746143692.871969:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1569 committed 00000004:00080000:1.0:1746143692.871970:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1616 committed 00000004:00080000:1.0:1746143692.871971:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1568 committed 00000004:00080000:1.0:1746143692.871973:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1615 committed 00000004:00080000:1.0:1746143692.871974:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1567 committed 00000004:00080000:1.0:1746143692.871975:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1566 committed 00000004:00080000:1.0:1746143692.871976:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1565 committed 00000004:00080000:1.0:1746143692.871977:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1614 committed 00000004:00080000:1.0:1746143692.871978:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1613 committed 00000004:00080000:1.0:1746143692.871979:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1564 committed 00000004:00080000:1.0:1746143692.871981:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1563 committed 00000004:00080000:1.0:1746143692.871982:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1612 committed 00000100:00100000:0.0:1746143692.872209:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593733120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143692.872262:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143692.872296:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593733632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143692.872311:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143692.872321:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593734144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143692.872333:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143692.872341:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593734656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143692.872351:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143692.872363:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746143692.872366:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593732992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143692.872375:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143692.872382:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593733504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143692.872391:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143692.872397:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593734016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143692.872407:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143692.872413:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593734528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143692.872423:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143692.872438:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593733120 00000100:00100000:0.0:1746143692.872443:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593733120 00000100:00100000:0.0:1746143692.872471:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593733632 00000100:00100000:0.0:1746143692.872472:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593733632 00000100:00100000:0.0:1746143692.872480:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593734144 00000100:00100000:0.0:1746143692.872482:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593734144 00000100:00100000:0.0:1746143692.872490:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593734656 00000100:00100000:0.0:1746143692.872491:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593734656 00000100:00100000:0.0:1746143692.872496:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593732992 00000100:00100000:0.0:1746143692.872497:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593732992 00000100:00100000:0.0:1746143692.872501:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593733504 00000100:00100000:0.0:1746143692.872502:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593733504 00000100:00100000:0.0:1746143692.872506:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593734016 00000100:00100000:0.0:1746143692.872507:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593734016 00000100:00100000:0.0:1746143692.872511:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593734528 00000100:00100000:0.0:1746143692.872512:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593734528 00000100:00100000:0.0:1746143692.872519:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9565 00000100:00100000:0.0:1746143692.872525:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3293:x1830963593733120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143692.872756:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3293:x1830963593733120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (493us total) trans 21474839711 rc 0/0 00000100:00100000:0.0:1746143692.872762:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9565 00000100:00100000:0.0:1746143692.872778:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9566 00000100:00100000:0.0:1746143692.872781:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3293:x1830963593733632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143692.872865:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3293:x1830963593733632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (552us total) trans 21474839712 rc 0/0 00000100:00100000:0.0:1746143692.872869:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9566 00000100:00100000:0.0:1746143692.872879:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9567 00000100:00100000:0.0:1746143692.872882:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3293:x1830963593734144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143692.872966:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3293:x1830963593734144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (631us total) trans 17179872443 rc 0/0 00000100:00100000:0.0:1746143692.872970:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9567 00000100:00100000:0.0:1746143692.872977:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9568 00000100:00100000:0.0:1746143692.872980:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3293:x1830963593734656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143692.873046:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3293:x1830963593734656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (694us total) trans 17179872444 rc 0/0 00000100:00100000:0.0:1746143692.873050:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9568 00000100:00100000:0.0:1746143692.873057:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9569 00000100:00100000:0.0:1746143692.873060:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3293:x1830963593732992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143692.873131:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3293:x1830963593732992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (755us total) trans 21474839713 rc 0/0 00000100:00100000:0.0:1746143692.873135:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9569 00000100:00100000:0.0:1746143692.873160:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9570 00000100:00100000:0.0:1746143692.873164:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3293:x1830963593733504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143692.873223:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3293:x1830963593733504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (830us total) trans 21474839714 rc 0/0 00000100:00100000:0.0:1746143692.873227:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9570 00000100:00100000:0.0:1746143692.873233:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9571 00000100:00100000:0.0:1746143692.873236:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3293:x1830963593734016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143692.873300:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091715180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3293:x1830963593734016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (892us total) trans 17179872445 rc 0/0 00000100:00100000:0.0:1746143692.873304:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9571 00000100:00100000:0.0:1746143692.873311:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9572 00000100:00100000:0.0:1746143692.873314:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3293:x1830963593734528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143692.873382:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3293:x1830963593734528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (957us total) trans 17179872446 rc 0/0 00000100:00100000:0.0:1746143692.873386:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9572 00000100:00080000:0.0:1746143692.873402:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143692.873405:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143692.873478:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839693 gen 2 00000004:00080000:0.0:1746143692.873482:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d3800, transno 21474839667 00000004:00080000:0.0:1746143692.873486:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d3b80, transno 21474839668 00000004:00080000:0.0:1746143692.873488:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d2300, transno 21474839669 00000004:00080000:0.0:1746143692.873490:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d0a80, transno 21474839670 00000004:00080000:0.0:1746143692.873492:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d3100, transno 21474839671 00000004:00080000:0.0:1746143692.873494:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d2a00, transno 21474839672 00000004:00080000:0.0:1746143692.873495:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d1c00, transno 21474839673 00000004:00080000:0.0:1746143692.873497:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d2680, transno 21474839674 00000004:00080000:0.0:1746143692.873499:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a1f80, transno 21474839678 00000004:00080000:0.0:1746143692.873501:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a2d80, transno 21474839679 00000004:00080000:0.0:1746143692.873503:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a0700, transno 21474839680 00000004:00080000:0.0:1746143692.873505:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a1500, transno 21474839681 00000004:00080000:0.0:1746143692.873507:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a3800, transno 21474839682 00000004:00080000:0.0:1746143692.873509:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a2680, transno 21474839683 00000004:00080000:0.0:1746143692.873510:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a0a80, transno 21474839684 00000004:00080000:0.0:1746143692.873512:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a3480, transno 21474839685 00000004:00080000:0.0:1746143692.873513:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f530e00, transno 21474839686 00000004:00080000:0.0:1746143692.873515:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f531500, transno 21474839687 00000004:00080000:0.0:1746143692.873517:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f533b80, transno 21474839688 00000004:00080000:0.0:1746143692.873519:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f532a00, transno 21474839689 00000004:00080000:0.0:1746143692.873521:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0361880, transno 21474839690 00000004:00080000:0.0:1746143692.873523:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f530000, transno 21474839691 00000004:00080000:0.0:1746143692.873524:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f532300, transno 21474839692 00000004:00080000:0.0:1746143692.873526:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f531c00, transno 21474839693 00000100:00100000:0.0:1746143692.873531:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008f3cad80 x1830963593732992/t21474839713(21474839713) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143708 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746143692.873539:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3cad80/2, rc 0, transno 21474839713 00000100:00100000:0.0:1746143692.873542:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593732992:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143692.873548:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c9500/2, rc 0, transno 21474839714 00000100:00100000:0.0:1746143692.873550:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593733504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143692.873555:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872428 gen 2 00000004:00080000:0.0:1746143692.873557:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cc700, transno 17179872399 00000004:00080000:0.0:1746143692.873561:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cd880, transno 17179872400 00000004:00080000:0.0:1746143692.873562:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cdc00, transno 17179872401 00000004:00080000:0.0:1746143692.873564:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7ce680, transno 17179872402 00000004:00080000:0.0:1746143692.873566:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cf100, transno 17179872403 00000004:00080000:0.0:1746143692.873568:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cc000, transno 17179872404 00000004:00080000:0.0:1746143692.873570:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cd500, transno 17179872405 00000004:00080000:0.0:1746143692.873572:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7c2680, transno 17179872406 00000004:00080000:0.0:1746143692.873574:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cc380, transno 17179872407 00000004:00080000:0.0:1746143692.873576:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009445b100, transno 17179872411 00000004:00080000:0.0:1746143692.873578:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd4e00, transno 17179872412 00000004:00080000:0.0:1746143692.873580:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094458e00, transno 17179872413 00000004:00080000:0.0:1746143692.873582:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094459180, transno 17179872414 00000004:00080000:0.0:1746143692.873583:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cdf80, transno 17179872415 00000004:00080000:0.0:1746143692.873585:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009445ad80, transno 17179872416 00000004:00080000:0.0:1746143692.873587:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd4700, transno 17179872417 00000004:00080000:0.0:1746143692.873588:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009445b800, transno 17179872418 00000004:00080000:0.0:1746143692.873590:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd7b80, transno 17179872419 00000004:00080000:0.0:1746143692.873592:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dc000, transno 17179872420 00000004:00080000:0.0:1746143692.873593:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930de680, transno 17179872421 00000004:00080000:0.0:1746143692.873595:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dce00, transno 17179872422 00000004:00080000:0.0:1746143692.873597:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dd880, transno 17179872423 00000004:00080000:0.0:1746143692.873599:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dea00, transno 17179872424 00000004:00080000:0.0:1746143692.873600:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930df100, transno 17179872425 00000004:00080000:0.0:1746143692.873602:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930de300, transno 17179872426 00000004:00080000:0.0:1746143692.873603:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dfb80, transno 17179872427 00000004:00080000:0.0:1746143692.873604:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c23480, transno 17179872428 00000100:00100000:0.0:1746143692.873607:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012b79d180 x1830963593734016/t17179872445(17179872445) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143708 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746143692.873612:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79d180/2, rc 0, transno 17179872445 00000100:00100000:0.0:1746143692.873614:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593734016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143692.873619:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79fb80/2, rc 0, transno 17179872446 00000100:00100000:0.0:1746143692.873621:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593734528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143692.873626:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3ca300/2, rc 0, transno 21474839711 00000100:00100000:0.0:1746143692.873628:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593733120:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143692.873632:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c9180/2, rc 0, transno 21474839712 00000100:00100000:0.0:1746143692.873635:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593733632:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143692.873639:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79df80/2, rc 0, transno 17179872443 00000100:00100000:0.0:1746143692.873641:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593734144:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143692.873645:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79d500/2, rc 0, transno 17179872444 00000100:00100000:0.0:1746143692.873646:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593734656:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143692.873815:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 27 done 00000004:00080000:0.0:1746143692.873965:0:14800:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 24 done 00000100:00100000:2.0:1746143692.874022:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593732864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143692.874049:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143692.874070:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593733376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143692.874086:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143692.874095:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593733888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143692.874106:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143692.874114:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593734400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143692.874125:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143692.874132:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593734912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143692.874163:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143692.874178:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746143692.874183:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593733248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143692.874196:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143692.874204:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593733760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143692.874216:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143692.874222:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593734272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143692.874233:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143692.874239:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593734784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143692.874251:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143692.874268:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593732864 00000100:00100000:2.0:1746143692.874272:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593732864 00000100:00100000:2.0:1746143692.874287:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593733376 00000100:00100000:2.0:1746143692.874288:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593733376 00000100:00100000:2.0:1746143692.874294:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593733888 00000100:00100000:2.0:1746143692.874295:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593733888 00000100:00100000:2.0:1746143692.874301:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593734400 00000100:00100000:2.0:1746143692.874303:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593734400 00000100:00100000:2.0:1746143692.874308:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593734912 00000100:00100000:2.0:1746143692.874309:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593734912 00000100:00100000:2.0:1746143692.874315:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593733248 00000100:00100000:2.0:1746143692.874317:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593733248 00000100:00100000:2.0:1746143692.874322:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593733760 00000100:00100000:2.0:1746143692.874324:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593733760 00000100:00100000:2.0:1746143692.874329:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593734272 00000100:00100000:2.0:1746143692.874330:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593734272 00000100:00100000:2.0:1746143692.874336:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593734784 00000100:00100000:2.0:1746143692.874337:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593734784 00000100:00100000:2.0:1746143692.874345:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9573 00000100:00100000:2.0:1746143692.874349:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963593732864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143692.874456:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963593732864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (406us total) trans 21474839715 rc 0/0 00000100:00100000:2.0:1746143692.874461:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9573 00000100:00100000:2.0:1746143692.874558:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9574 00000100:00100000:2.0:1746143692.874562:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963593733376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143692.874639:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:2.0:1746143692.874642:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:2.0:1746143692.874644:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143692.874646:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:2.0:1746143692.874647:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:2.0:1746143692.874662:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963593733376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (575us total) trans 21474839716 rc 0/0 00000100:00100000:2.0:1746143692.874665:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9574 00000100:00100000:2.0:1746143692.874672:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9575 00000100:00100000:2.0:1746143692.874676:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963593733888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143692.874746:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593733888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (639us total) trans 17179872447 rc 0/0 00000100:00100000:2.0:1746143692.874750:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9575 00000100:00100000:2.0:1746143692.874757:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9576 00000100:00100000:2.0:1746143692.874761:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963593734400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143692.874822:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593734400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (695us total) trans 17179872448 rc 0/0 00000100:00100000:2.0:1746143692.874826:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9576 00000100:00100000:2.0:1746143692.874834:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9577 00000100:00100000:2.0:1746143692.874837:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963593734912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143692.874923:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593734912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (759us total) trans 17179872449 rc 0/0 00000100:00100000:2.0:1746143692.874928:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9577 00000100:00100000:2.0:1746143692.874936:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9578 00000100:00100000:2.0:1746143692.874940:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963593733248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143692.874994:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143692.874996:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143692.874998:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143692.874999:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143692.875001:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143692.875017:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963593733248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (819us total) trans 21474839717 rc 0/0 00000100:00100000:2.0:1746143692.875021:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9578 00000100:00100000:2.0:1746143692.875029:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9579 00000100:00100000:2.0:1746143692.875033:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963593733760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143692.875103:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963593733760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (885us total) trans 21474839718 rc 0/0 00000100:00100000:2.0:1746143692.875108:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9579 00000100:00100000:2.0:1746143692.875117:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9580 00000100:00100000:2.0:1746143692.875120:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963593734272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143692.875202:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143692.875204:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746143692.875205:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143692.875207:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746143692.875208:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143692.875227:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593734272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (992us total) trans 17179872450 rc 0/0 00000100:00100000:2.0:1746143692.875231:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9580 00000100:00100000:2.0:1746143692.875240:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9581 00000100:00100000:2.0:1746143692.875244:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963593734784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143692.875317:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593734784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1064us total) trans 17179872451 rc 0/0 00000100:00100000:2.0:1746143692.875321:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9581 00000004:00080000:2.0:1746143692.875353:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3caa00/2, rc 0, transno 21474839717 00000100:00100000:2.0:1746143692.875357:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593733248:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143692.875364:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79c380/2, rc 0, transno 21474839718 00000100:00100000:2.0:1746143692.875367:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593733760:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143692.875374:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79ed80/2, rc 0, transno 17179872450 00000100:00100000:2.0:1746143692.875376:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593734272:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143692.875381:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79f100/2, rc 0, transno 17179872451 00000100:00100000:2.0:1746143692.875384:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593734784:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143692.875389:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3ca680/2, rc 0, transno 21474839715 00000100:00100000:2.0:1746143692.875391:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593732864:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143692.875396:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3cb100/2, rc 0, transno 21474839716 00000100:00100000:2.0:1746143692.875398:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593733376:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143692.875404:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79ca80/2, rc 0, transno 17179872447 00000100:00100000:2.0:1746143692.875407:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593733888:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143692.875413:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79d880/2, rc 0, transno 17179872448 00000100:00100000:2.0:1746143692.875415:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593734400:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143692.875420:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009509b800/2, rc 0, transno 17179872449 00000100:00100000:2.0:1746143692.875423:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009509b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593734912:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746143692.875672:0:14764:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008f3c9880 reply state ffff880092a5ac00 transno 8589942370 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:3.0:1746143692.875681:0:14764:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746143692.875742:0:14764:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143692.875767:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28411:x1830963592245504:12345-192.168.202.48@tcp:36:mirror_io.0 Request processed in 53971us (54097us total) trans 8589942370 rc 0/0 00000100:00100000:3.0:1746143692.875773:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8268 00010000:00010000:1.0:1746143692.875837:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.875845:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.875862:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.875868:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6264000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143692.875871:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.875881:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.875893:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143692.875896:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143692.875899:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143692.875904:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd725806 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00000100:00100000:0.0:1746143692.890276:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143692.893226:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592247040 00000100:00100000:3.0:1746143692.893235:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592247040 00000100:00100000:3.0:1746143692.893280:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8269 00000100:00100000:3.0:1746143692.893287:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28411:x1830963592247040:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143692.893306:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143692.893325:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7200/0xe984082ccd72580d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1706 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.893376:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7200/0xe984082ccd72580d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1706 expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.893388:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7200/0xe984082ccd72580d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1706 expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143692.893405:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143692.893408:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143692.893411:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d7200, rc 0) 00000100:00100000:3.0:1746143692.893467:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28411:x1830963592247040:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 180us (3198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143692.893473:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8269 00000100:00100000:2.0:1746143692.900347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.900421:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592247168 00000100:00100000:0.0:1746143692.900430:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592247168 00000100:00100000:0.0:1746143692.900486:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8270 00000100:00100000:0.0:1746143692.900494:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28411:x1830963592247168:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143692.900510:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143692.900526:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095070e00/0xe984082ccd725814 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a170d expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.900596:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72581b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143692.900608:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72581b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143692.900617:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72581b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143692.900643:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:0.0:1746143692.900648:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143692.900661:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72581b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143692.900683:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095070e00/0xe984082ccd725814 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a170d expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.900695:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72581b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a170d expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143692.900702:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:0.0:1746143692.900705:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143692.900707:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a962800, rc 0) 00000100:00100000:0.0:1746143692.901417:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28411:x1830963592247168:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 922us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143692.901424:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8270 00000100:00100000:0.0:1746143692.906515:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.906536:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.906565:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.906578:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.907372:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143692.907802:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143692.907839:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592247296 00000100:00100000:1.0:1746143692.907847:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592247296 00000100:00100000:1.0:1746143692.907891:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592247552 00000100:00100000:1.0:1746143692.907894:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592247552 00000100:00100000:1.0:1746143692.907905:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592247808 00000100:00100000:1.0:1746143692.907907:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592247808 00000100:00100000:1.0:1746143692.907914:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592247424 00000100:00100000:1.0:1746143692.907916:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592247424 00000100:00100000:1.0:1746143692.907925:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592247680 00000100:00100000:1.0:1746143692.907926:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592247680 00000100:00100000:1.0:1746143692.907937:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9582 00000100:00100000:1.0:1746143692.907944:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592247296:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143692.907959:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143692.907974:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725822 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1714 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143692.907995:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409cb, atime: 0x681409ca, ctime: 0x681409cb, blocks: 0x809 00010000:00010000:1.0:1746143692.908012:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.908014:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.908021:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725822 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1714 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.908034:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725822 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1714 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.908042:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06cce00, rc 0) 00000100:00100000:1.0:1746143692.908080:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592247296:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 137us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.908086:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9582 00000100:00100000:1.0:1746143692.908109:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9583 00000100:00100000:1.0:1746143692.908114:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592247552:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143692.908120:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143692.908128:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd400/0xe984082ccd725829 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1722 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143692.908158:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34b:0x0] initial LVB size: 2097152, mtime: 0x681409cb, atime: 0x681409cb, ctime: 0x681409cb, blocks: 0x821 00010000:00010000:1.0:1746143692.908166:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.908167:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.908172:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd400/0xe984082ccd725829 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1722 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.908181:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd400/0xe984082ccd725829 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1722 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.908187:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06cd400, rc 0) 00000100:00100000:1.0:1746143692.908203:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592247552:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 89us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.908208:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9583 00000100:00100000:1.0:1746143692.908219:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9584 00000100:00100000:1.0:1746143692.908224:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592247808:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143692.908229:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143692.908236:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd600/0xe984082ccd725830 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1730 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143692.908246:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 4897312, mtime: 0x681409cc, atime: 0x681409cc, ctime: 0x681409cb, blocks: 0x15a5 00010000:00010000:1.0:1746143692.908252:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.908253:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.908256:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd600/0xe984082ccd725830 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1730 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.908264:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd600/0xe984082ccd725830 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1730 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.908270:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06cd600, rc 0) 00000100:00100000:1.0:1746143692.908284:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592247808:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 61us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.908288:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9584 00000100:00100000:1.0:1746143692.908297:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9585 00000100:00100000:1.0:1746143692.908302:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592247424:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143692.908307:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143692.908313:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd800/0xe984082ccd725837 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a171b expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143692.908326:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34a:0x0] initial LVB size: 2097152, mtime: 0x681409cb, atime: 0x681409cb, ctime: 0x681409cb, blocks: 0x81f 00010000:00010000:1.0:1746143692.908331:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.908332:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.908336:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd800/0xe984082ccd725837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a171b expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.908343:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd800/0xe984082ccd725837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a171b expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.908349:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06cd800, rc 0) 00000100:00100000:1.0:1746143692.908362:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592247424:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 60us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.908366:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9585 00000100:00100000:1.0:1746143692.908377:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9586 00000100:00100000:1.0:1746143692.908381:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592247680:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143692.908386:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143692.908392:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd72583e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1729 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143692.908401:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409cc, atime: 0x681409cb, ctime: 0x681409cc, blocks: 0x821 00010000:00010000:1.0:1746143692.908407:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.908408:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143692.908411:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd72583e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1729 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.908424:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd72583e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1729 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143692.908430:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06cc200, rc 0) 00000100:00100000:1.0:1746143692.908443:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592247680:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 62us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143692.908448:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9586 00000100:00100000:0.0:1746143692.908961:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592247936 00000100:00100000:0.0:1746143692.908965:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592247936 00000100:00100000:0.0:1746143692.908983:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9587 00000100:00100000:0.0:1746143692.908988:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592247936:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143692.908993:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143692.909002:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093213200/0xe984082ccd725845 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1737 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143692.909016:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409cb, atime: 0x681409cb, ctime: 0x681409cb, blocks: 0x1029 00010000:00010000:0.0:1746143692.909023:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143692.909025:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143692.909028:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093213200/0xe984082ccd725845 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1737 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143692.909037:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093213200/0xe984082ccd725845 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1737 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143692.909043:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093213200, rc 0) 00000100:00100000:0.0:1746143692.909061:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592247936:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 73us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143692.909066:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9587 00000100:00100000:2.0:1746143693.167195:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593735040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746143693.167263:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143693.169033:0:8498:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593735040 00000100:00100000:0.0:1746143693.169042:0:8498:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593735040 00000100:00100000:0.0:1746143693.169082:0:8498:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1746143693.169088:0:8498:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a3b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963593735040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746143693.169122:0:8498:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 339410944 pending 0 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746143693.169193:0:8498:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a3b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963593735040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143693.169199:0:8498:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1746143693.169455:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593735040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746143693.182965:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1830963593735424:0@lo:400:kworker.0 00000100:00100000:2.0:1746143693.183023:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143693.183079:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746143693.183084:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1830963593735296:0@lo:400:kworker.0 00000100:00100000:2.0:1746143693.183102:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143693.183128:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593735552:0@lo:400:kworker.0 00000100:00100000:1.0:1746143693.183190:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b20e2be-dc58-49ff-81b7-9c0574412294:3293:1830963593735168:0@lo:400:kworker.0 00000100:00100000:1.0:1746143693.183215:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143693.183236:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830963593735680:0@lo:400:kworker.0 00000100:00100000:1.0:1746143693.183248:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143693.183269:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593735424 00000100:00100000:1.0:1746143693.183274:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593735424 00000100:00100000:1.0:1746143693.183303:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593735296 00000100:00100000:1.0:1746143693.183304:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593735296 00000100:00100000:1.0:1746143693.183314:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593735680 00000100:00100000:1.0:1746143693.183315:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593735680 00000100:00100000:1.0:1746143693.183326:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1746143693.183331:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830963593735424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143693.183365:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830963593735424:12345-0@lo:400:kworker.0 Request processed in 33us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143693.183370:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1746143693.183389:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1746143693.183393:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830963593735296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143693.183406:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830963593735296:12345-0@lo:400:kworker.0 Request processed in 13us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143693.183410:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1746143693.183415:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1746143693.183418:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963593735680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143693.183432:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963593735680:12345-0@lo:400:kworker.0 Request processed in 13us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143693.183436:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1746143693.183447:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143693.183463:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830963593735680:0@lo:400:kworker.0 00000100:00100000:1.0:1746143693.183480:0:14761:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593735168 00000100:00100000:1.0:1746143693.183482:0:14761:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593735168 00000100:00100000:1.0:1746143693.183495:0:14761:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1746143693.183498:0:14761:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3293:x1830963593735168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143693.183518:0:14761:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3293:x1830963593735168:12345-0@lo:400:kworker.0 Request processed in 19us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143693.183522:0:14761:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1746143693.183543:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b20e2be-dc58-49ff-81b7-9c0574412294:3293:1830963593735168:0@lo:400:kworker.0 00000100:00100000:2.0:1746143693.184547:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143693.184590:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3295:1830963593735296:0@lo:400:kworker.0 00000100:00100000:2.0:1746143693.184599:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1830963593735424:0@lo:400:kworker.0 00000100:00100000:1.0:1746143693.184934:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593735552 00000100:00100000:1.0:1746143693.184938:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593735552 00000100:00100000:1.0:1746143693.184962:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1746143693.184967:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963593735552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143693.185011:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963593735552:12345-0@lo:400:kworker.0 Request processed in 43us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143693.185015:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1746143693.185075:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593735552:0@lo:400:kworker.0 00000100:00100000:3.0:1746143693.197385:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746143693.197405:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593735808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746143693.197462:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143693.197559:0:8499:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593735808 00000100:00100000:0.0:1746143693.197569:0:8499:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593735808 00000100:00100000:0.0:1746143693.197606:0:8499:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1746143693.197612:0:8499:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593735808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746143693.197644:0:8499:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 366411776 pending 1703936 free 3849322496 avail 3847225344 00000100:00100000:0.0:1746143693.197675:0:8499:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593735808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143693.197681:0:8499:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1746143693.198181:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593735808:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1746143693.587332:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143693.925693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143693.925858:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592248192 00000100:00100000:3.0:1746143693.925867:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592248192 00000100:00100000:3.0:1746143693.925930:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3530 00000100:00100000:3.0:1746143693.925938:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592248192:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143693.925970:0:31339:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7600/0xe984082ccd72584c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143693.925980:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143693.925982:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143693.925987:0:31339:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7600/0xe984082ccd72584c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143693.925997:0:31339:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7600/0xe984082ccd72584c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143693.934402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143693.934450:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143693.935106:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592248448 00000100:00100000:2.0:1746143693.935115:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592248448 00000100:00100000:2.0:1746143693.935211:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592248704 00000100:00100000:2.0:1746143693.935214:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592248704 00000100:00100000:2.0:1746143693.935233:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3531 00000100:00100000:2.0:1746143693.935240:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592248448:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143693.935269:0:8500:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a0559a00/0xe984082ccd725853 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.935281:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143693.935283:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143693.935287:0:8500:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0559a00/0xe984082ccd725853 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.935298:0:8500:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0559a00/0xe984082ccd725853 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143693.936578:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3532 00000100:00100000:2.0:1746143693.936586:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592248704:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143693.936608:0:21518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a0559e00/0xe984082ccd72585a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.936617:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143693.936618:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143693.936620:0:21518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0559e00/0xe984082ccd72585a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.936628:0:21518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0559e00/0xe984082ccd72585a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143693.940262:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143693.940450:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143693.940633:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592248960 00000100:00100000:1.0:1746143693.940640:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592248960 00000100:00100000:1.0:1746143693.940678:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592249216 00000100:00100000:1.0:1746143693.940681:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592249216 00000100:00100000:1.0:1746143693.940705:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3533 00000100:00100000:1.0:1746143693.940711:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592248960:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143693.940740:0:25544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094677200/0xe984082ccd725861 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143693.940752:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143693.940754:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143693.940758:0:25544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094677200/0xe984082ccd725861 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143693.940769:0:25544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094677200/0xe984082ccd725861 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143693.943033:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3534 00000100:00100000:0.0:1746143693.943048:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592249216:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143693.943075:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093212e00/0xe984082ccd725868 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143693.943086:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143693.943088:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143693.943091:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093212e00/0xe984082ccd725868 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143693.943100:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093212e00/0xe984082ccd725868 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143693.948043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143693.948803:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592249472 00000100:00100000:3.0:1746143693.948810:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592249472 00000100:00100000:3.0:1746143693.948863:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3535 00000100:00100000:3.0:1746143693.948870:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963592249472:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143693.948901:0:26144:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72586f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143693.948913:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143693.948915:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143693.948919:0:26144:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72586f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143693.948931:0:26144:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72586f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143693.955305:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143693.957339:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143693.957750:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592249728 00000100:00100000:1.0:1746143693.957757:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592249728 00000100:00100000:1.0:1746143693.957800:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592249984 00000100:00100000:1.0:1746143693.957802:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592249984 00000100:00100000:1.0:1746143693.957818:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3536 00000100:00100000:1.0:1746143693.957824:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1962:x1830963592249728:12345-192.168.202.48@tcp:3:mirror_io.0 00000100:00100000:0.0:1746143693.957861:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3537 00010000:00010000:1.0:1746143693.957863:0:8501:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd725876 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143693.957869:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1962:x1830963592249984:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143693.957874:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143693.957876:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143693.957881:0:8501:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd725876 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143693.957887:0:8502:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091025200/0xe984082ccd72587d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143693.957895:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143693.957897:0:8501:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd725876 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143693.957897:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143693.957900:0:8502:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091025200/0xe984082ccd72587d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143693.957909:0:8502:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091025200/0xe984082ccd72587d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143693.961589:0:31339:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7600/0xe984082ccd72584c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143693.961605:0:31339:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7600/0xe984082ccd72584c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143693.961612:0:31339:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7600/0xe984082ccd72584c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143693.961618:0:31339:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4d7600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143693.961621:0:31339:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7600/0xe984082ccd72584c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143693.961628:0:31339:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7600/0xe984082ccd72584c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143693.961643:0:31339:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7600/0xe984082ccd72584c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143693.961649:0:31339:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d7600/0xe984082ccd72584c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143693.961703:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1963:x1830963592248192:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 35761us (36012us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143693.961712:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3530 00010000:00010000:2.0:1746143693.964097:0:8500:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a0559a00/0xe984082ccd725853 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.964117:0:8500:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0559a00/0xe984082ccd725853 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.964136:0:8500:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0559a00/0xe984082ccd725853 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.964198:0:8500:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0559a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143693.964201:0:8500:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0559a00/0xe984082ccd725853 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.964207:0:8500:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0559a00/0xe984082ccd725853 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.964221:0:8500:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0559a00/0xe984082ccd725853 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.964226:0:8500:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0559a00/0xe984082ccd725853 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143693.964283:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1963:x1830963592248448:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 29039us (29885us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143693.964291:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3531 00010000:00010000:2.0:1746143693.986438:0:31338:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093212e00/0xe984082ccd725868 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.989168:0:31338:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093212e00/0xe984082ccd725868 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.989181:0:31338:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093212e00/0xe984082ccd725868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.989186:0:31338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093212e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143693.989190:0:31338:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093212e00/0xe984082ccd725868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.989197:0:31338:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093212e00/0xe984082ccd725868 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.989212:0:31338:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093212e00/0xe984082ccd725868 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143693.989218:0:31338:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093212e00/0xe984082ccd725868 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143693.989331:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1963:x1830963592249216:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 46281us (48898us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143693.989339:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3534 00010000:00010000:1.0:1746143693.997080:0:25544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094677200/0xe984082ccd725861 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143693.997093:0:25544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094677200/0xe984082ccd725861 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143693.997100:0:25544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094677200/0xe984082ccd725861 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143693.997105:0:25544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094677200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143693.997108:0:25544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094677200/0xe984082ccd725861 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143693.997115:0:25544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094677200/0xe984082ccd725861 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143693.997129:0:25544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094677200/0xe984082ccd725861 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143693.997134:0:25544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094677200/0xe984082ccd725861 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143693.997231:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592248960:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 56516us (56977us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143693.997242:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3533 00010000:00010000:3.0:1746143694.003418:0:26144:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72586f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.003433:0:26144:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72586f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.003441:0:26144:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72586f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.003452:0:26144:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094456e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143694.003455:0:26144:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72586f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.003462:0:26144:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72586f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.003480:0:26144:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72586f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.003487:0:26144:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72586f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143694.006007:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963592249472:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 57132us (57965us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143694.006017:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3535 00010000:00010000:3.0:1746143694.007831:0:21518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a0559e00/0xe984082ccd72585a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.007853:0:21518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0559e00/0xe984082ccd72585a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.007861:0:21518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0559e00/0xe984082ccd72585a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.007867:0:21518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0559e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143694.007871:0:21518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0559e00/0xe984082ccd72585a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.007880:0:21518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0559e00/0xe984082ccd72585a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.007893:0:21518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0559e00/0xe984082ccd72585a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.007899:0:21518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0559e00/0xe984082ccd72585a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143694.007952:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592248704:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 71365us (73499us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143694.007960:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3532 00010000:00010000:0.0:1746143694.018944:0:8502:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091025200/0xe984082ccd72587d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.018959:0:8502:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091025200/0xe984082ccd72587d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.018966:0:8502:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091025200/0xe984082ccd72587d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.018972:0:8502:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091025200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143694.018976:0:8502:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091025200/0xe984082ccd72587d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.018983:0:8502:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091025200/0xe984082ccd72587d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.018997:0:8502:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091025200/0xe984082ccd72587d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.019002:0:8502:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091025200/0xe984082ccd72587d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143694.019078:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592249984:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 61206us (61740us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143694.019089:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3537 00010000:00010000:2.0:1746143694.022571:0:8501:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd725876 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.022585:0:8501:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd725876 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.022592:0:8501:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd725876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.022598:0:8501:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63fee00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143694.022602:0:8501:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd725876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.022608:0:8501:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd725876 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.022621:0:8501:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd725876 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.022626:0:8501:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd725876 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143694.023352:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592249728:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 65524us (68050us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143694.023361:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3536 00000100:00100000:0.0:1746143694.028539:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.028715:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592250112 00000100:00100000:1.0:1746143694.028723:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592250112 00000100:00100000:1.0:1746143694.028792:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 566 00000100:00100000:1.0:1746143694.028800:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28411:x1830963592250112:12345-192.168.202.48@tcp:103:mirror_io.0 00010000:00010000:1.0:1746143694.028811:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.028834:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7400/0xe984082ccd7257c7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a16f8 expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.028864:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.028868:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.028905:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28411:x1830963592250112:12345-192.168.202.48@tcp:103:mirror_io.0 Request processed in 106us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.028911:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 566 00000100:00080000:2.0:1746143694.028944:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143694.030211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.030371:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592250368 00000100:00100000:2.0:1746143694.030376:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592250368 00000100:00100000:2.0:1746143694.030406:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3362 00000100:00100000:2.0:1746143694.030412:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28411:x1830963592250368:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143694.030643:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28411:x1830963592250368:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 229us (433us total) trans 8589942371 rc 0/0 00000100:00100000:2.0:1746143694.030649:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3362 00000100:00100000:0.0:1746143694.032036:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.032102:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592250624 00000100:00100000:2.0:1746143694.032107:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592250624 00000100:00100000:1.0:1746143694.032246:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3363 00000100:00100000:1.0:1746143694.032254:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28411:x1830963592250624:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143694.032370:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28411:x1830963592250624:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 117us (336us total) trans 8589942372 rc 0/0 00000100:00100000:1.0:1746143694.032375:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3363 00000100:00100000:0.0:1746143694.053071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.053283:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592250880 00000100:00100000:3.0:1746143694.053290:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592250880 00000100:00100000:3.0:1746143694.053849:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8271 00000100:00100000:3.0:1746143694.053857:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+6:28426:x1830963592250880:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143694.053877:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1746143694.054035:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746143694.054069:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094456000/0xe984082ccd725884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a173e expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.054575:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0559e00/0xe984082ccd72588b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054586:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0559e00/0xe984082ccd72588b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054595:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0559e00/0xe984082ccd72588b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054607:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558200/0xe984082ccd725892 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054612:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558200/0xe984082ccd725892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054616:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558200/0xe984082ccd725892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054821:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558000/0xe984082ccd725899 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054829:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558000/0xe984082ccd725899 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054835:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558000/0xe984082ccd725899 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143694.054852:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143694.054916:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0559e00/0xe984082ccd72588b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054922:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0559e00/0xe984082ccd72588b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054927:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0559e00/0xe984082ccd72588b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054932:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0559e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143694.054935:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0559e00/0xe984082ccd72588b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054940:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0559e00/0xe984082ccd72588b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054949:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143694.054951:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143694.054955:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0559e00/0xe984082ccd72588b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054960:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0559e00/0xe984082ccd72588b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054988:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558200/0xe984082ccd725892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054993:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558200/0xe984082ccd725892 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.054996:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558200/0xe984082ccd725892 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.055000:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0558200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143694.055002:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558200/0xe984082ccd725892 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.055006:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558200/0xe984082ccd725892 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.055011:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009365d900) 00010000:00010000:3.0:1746143694.055012:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143694.055014:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558200/0xe984082ccd725892 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.055017:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558200/0xe984082ccd725892 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.055048:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094456000/0xe984082ccd725884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a173e expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.055058:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558000/0xe984082ccd725899 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a173e expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.055063:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143694.055065:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143694.055067:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0558000, rc 0) 00000100:00100000:3.0:1746143694.055116:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28426:x1830963592250880:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1259us (2051us total) trans 8589942373 rc 0/0 00000100:00100000:3.0:1746143694.055122:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8271 00000100:00100000:0.0:1746143694.057382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.057609:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592251136 00000100:00100000:3.0:1746143694.057616:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592251136 00000100:00100000:3.0:1746143694.058332:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8272 00000100:00100000:3.0:1746143694.058339:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:28423:x1830963592251136:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143694.058355:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.058366:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd7258a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1745 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.058443:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264400/0xe984082ccd7258ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058452:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264400/0xe984082ccd7258ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058459:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264400/0xe984082ccd7258ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058467:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6265e00/0xe984082ccd7258b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058475:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6265e00/0xe984082ccd7258b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058479:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6265e00/0xe984082ccd7258b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058549:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264200/0xe984082ccd7258bc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058555:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264200/0xe984082ccd7258bc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058560:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264200/0xe984082ccd7258bc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143694.058567:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143694.058625:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264400/0xe984082ccd7258ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058630:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264400/0xe984082ccd7258ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058635:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264400/0xe984082ccd7258ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058639:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6264400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143694.058642:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264400/0xe984082ccd7258ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058646:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264400/0xe984082ccd7258ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058653:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143694.058656:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143694.058659:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264400/0xe984082ccd7258ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058664:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264400/0xe984082ccd7258ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058677:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6265e00/0xe984082ccd7258b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058681:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6265e00/0xe984082ccd7258b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058685:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6265e00/0xe984082ccd7258b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058688:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6265e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143694.058690:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6265e00/0xe984082ccd7258b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058695:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6265e00/0xe984082ccd7258b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058700:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009365de00) 00010000:00010000:3.0:1746143694.058702:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143694.058704:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6265e00/0xe984082ccd7258b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058711:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6265e00/0xe984082ccd7258b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.058738:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264000/0xe984082ccd7258a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1745 expref: 243 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.058752:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264200/0xe984082ccd7258bc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1745 expref: 242 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.058757:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143694.058759:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143694.058760:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6264200, rc 0) 00000100:00100000:3.0:1746143694.058808:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28423:x1830963592251136:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 469us (1430us total) trans 8589942374 rc 0/0 00000100:00100000:3.0:1746143694.058814:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8272 00000100:00080000:2.0:1746143694.058955:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143694.060097:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.060613:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592251392 00000100:00100000:0.0:1746143694.060619:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592251392 00000100:00100000:2.0:1746143694.060866:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.060887:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592251648 00000100:00100000:0.0:1746143694.060889:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8273 00000100:00100000:2.0:1746143694.060890:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592251648 00000100:00100000:0.0:1746143694.060896:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28421:x1830963592251392:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143694.060911:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143694.060922:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095711a00/0xe984082ccd7258ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a174c expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746143694.060962:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746143694.060985:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143694.060996:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72581b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a170d expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.061002:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558000/0xe984082ccd725899 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a173e expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.061007:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264200/0xe984082ccd7258bc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1745 expref: 241 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.061011:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143694.061039:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264200/0xe984082ccd7258bc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1745 expref: 241 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.061048:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264200/0xe984082ccd7258bc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1745 expref: 241 pid: 14764 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746143694.061058:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593735936:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143694.061197:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9588 00000100:00100000:2.0:1746143694.061203:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+6:1965:x1830963592251648:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143694.061209:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.061218:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe600/0xe984082ccd7258d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a175a expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.061229:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.061231:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.061236:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe600/0xe984082ccd7258d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a175a expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.061246:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe600/0xe984082ccd7258d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a175a expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.061252:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21fe600, rc 0) 00010000:00010000:0.0:1746143694.061432:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558000/0xe984082ccd725899 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a173e expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.061440:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558000/0xe984082ccd725899 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a173e expref: 9 pid: 14764 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746143694.061447:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593736064:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143694.061887:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+7:1965:x1830963592251648:12345-192.168.202.48@tcp:101:cat.0 Request processed in 683us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.061893:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9588 00000100:00100000:2.0:1746143694.061920:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.061960:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.061970:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592251904 00000100:00100000:2.0:1746143694.061972:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592251904 00000100:00100000:2.0:1746143694.061991:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592252160 00000100:00100000:2.0:1746143694.061993:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592252160 00000100:00100000:2.0:1746143694.062002:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9589 00000100:00100000:2.0:1746143694.062006:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+7:1965:x1830963592251904:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143694.062013:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.062021:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a21ffe00/0xe984082ccd7258df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1768 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.062031:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.062033:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.062037:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21ffe00/0xe984082ccd7258df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1768 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.062045:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a21ffe00/0xe984082ccd7258df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1768 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.062051:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21ffe00, rc 0) 00000100:00100000:2.0:1746143694.062064:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1965:x1830963592251904:12345-192.168.202.48@tcp:101:cat.0 Request processed in 58us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.062068:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9589 00000100:00100000:2.0:1746143694.062076:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9590 00000100:00100000:2.0:1746143694.062080:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+7:1965:x1830963592252160:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143694.062084:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.062089:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff000/0xe984082ccd7258e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1776 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.062096:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.062097:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.062100:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff000/0xe984082ccd7258e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1776 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.062107:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff000/0xe984082ccd7258e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1776 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.062113:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21ff000, rc 0) 00000100:00100000:2.0:1746143694.062121:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1965:x1830963592252160:12345-192.168.202.48@tcp:101:cat.0 Request processed in 41us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.062124:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9590 00000100:00100000:2.0:1746143694.062163:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.062171:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592251520 00000100:00100000:2.0:1746143694.062173:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592251520 00000100:00100000:2.0:1746143694.062184:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9591 00000100:00100000:2.0:1746143694.062187:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1965:x1830963592251520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143694.062192:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.062199:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1753 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.062207:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.062213:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.062217:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1753 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.062225:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1753 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.062231:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21fea00, rc 0) 00000100:00100000:2.0:1746143694.062248:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963592251520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 59us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.062253:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9591 00000100:00100000:2.0:1746143694.062281:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.062290:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592251776 00000100:00100000:2.0:1746143694.062292:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592251776 00000100:00100000:2.0:1746143694.062302:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9592 00000100:00100000:2.0:1746143694.062306:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1965:x1830963592251776:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143694.062311:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.062317:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1761 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.062325:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.062326:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.062330:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1761 expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.062337:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1761 expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.062343:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21ff400, rc 0) 00000100:00100000:2.0:1746143694.062355:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963592251776:12345-192.168.202.48@tcp:101:cat.0 Request processed in 48us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.062360:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9592 00000100:00100000:2.0:1746143694.062393:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.062403:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592252032 00000100:00100000:2.0:1746143694.062405:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592252032 00000100:00100000:2.0:1746143694.062416:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9593 00000100:00100000:2.0:1746143694.062420:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963592252032:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143694.062426:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.062432:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a21ff800/0xe984082ccd7258fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a176f expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.062440:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.062441:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.062445:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21ff800/0xe984082ccd7258fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a176f expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.062454:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a21ff800/0xe984082ccd7258fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a176f expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.062460:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21ff800, rc 0) 00000100:00100000:2.0:1746143694.062471:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592252032:12345-192.168.202.48@tcp:101:cat.0 Request processed in 51us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.062477:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9593 00000100:00080000:3.0:1746143694.062585:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143694.063365:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143694.063379:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72581b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a170d expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.063388:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72581b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a170d expref: 9 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746143694.063396:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509b100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593736192:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143694.063469:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592252416 00000100:00100000:2.0:1746143694.063472:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592252416 00000100:00100000:2.0:1746143694.063503:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8274 00000100:00100000:2.0:1746143694.063507:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28425:x1830963592252416:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143694.063518:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.063525:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffc00/0xe984082ccd725902 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a177d expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143694.063861:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143694.063970:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21fe200/0xe984082ccd725909 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143694.063980:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21fe200/0xe984082ccd725909 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143694.063989:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21fe200/0xe984082ccd725909 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143694.063997:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143694.064627:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffc00/0xe984082ccd725902 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a177d expref: 245 pid: 14764 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143694.064757:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009509bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593735936:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143694.064826:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21fe200/0xe984082ccd725909 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a177d expref: 244 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.064833:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143694.064836:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143694.064838:0:14764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.064854:0:14764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.064859:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21fe200, rc 0) 00000100:00100000:2.0:1746143694.064884:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28425:x1830963592252416:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1376us (1521us total) trans 8589942375 rc 0/0 00000100:00100000:2.0:1746143694.064890:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8274 00000100:00100000:0.0:1746143694.065595:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.065657:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.065669:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592252544 00000100:00100000:1.0:1746143694.065673:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592252544 00010000:00010000:1.0:1746143694.065691:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264200/0xe984082ccd7258bc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1745 expref: 244 pid: 14764 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746143694.065694:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.065903:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592252672 00000100:00100000:1.0:1746143694.065903:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592252800 00000100:00100000:3.0:1746143694.065906:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592252672 00000100:00100000:1.0:1746143694.065906:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592252800 00010000:00010000:3.0:1746143694.065917:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558000/0xe984082ccd725899 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a173e expref: 10 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.065917:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72581b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a170d expref: 10 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746143694.065935:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4935 00000100:00100000:3.0:1746143694.065940:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:1964:x1830963592252544:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143694.065948:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143694.065952:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264200/0xe984082ccd7258bc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1745 expref: 244 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.065960:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264200/0xe984082ccd7258bc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1745 expref: 244 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.065972:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6264200/0xe984082ccd7258bc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1745 expref: 244 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.065986:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143694.065989:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.065994:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.065997:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143694.066263:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1964:x1830963592252544:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 322us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.066269:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4935 00000100:00100000:3.0:1746143694.066288:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4936 00000100:00100000:3.0:1746143694.066511:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592252672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143694.066519:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143694.066523:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558000/0xe984082ccd725899 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a173e expref: 10 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.066530:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558000/0xe984082ccd725899 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a173e expref: 10 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.066544:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00000100:00100000:2.0:1746143694.066544:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4937 00010000:00010000:3.0:1746143694.066547:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00000100:00100000:2.0:1746143694.066551:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592252800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143694.066552:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.066556:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143694.066558:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143694.066561:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72581b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a170d expref: 10 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746143694.066568:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592252672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 276us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.066573:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4936 00010000:00010000:2.0:1746143694.066573:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72581b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a170d expref: 10 pid: 21713 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.066582:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143694.066584:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.066589:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.066594:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.066605:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143694.066618:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592252800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 68us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.066623:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4937 00010000:00010000:1.0:1746143694.066683:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558000/0xe984082ccd725899 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a173e expref: 9 pid: 14764 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.066696:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009509aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593736064:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.066706:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72581b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a170d expref: 9 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.066714:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009509b100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593736192:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.066731:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.066738:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.066743:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143694.066756:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000100:00100000:0.0:1746143694.066839:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143694.066856:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095711a00/0xe984082ccd7258ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a174c expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.066867:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a174c expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.066876:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.066878:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:0.0:1746143694.066879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143694.066880:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095710000, rc 0) 00000100:00100000:1.0:1746143694.066899:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592253056 00000100:00100000:1.0:1746143694.066902:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592253056 00000100:00100000:3.0:1746143694.067081:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592253184 00000100:00100000:3.0:1746143694.067084:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592253184 00000100:00100000:3.0:1746143694.067115:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8275 00000100:00100000:3.0:1746143694.067120:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28425:x1830963592253184:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143694.067132:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.067156:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094456000/0xe984082ccd72591e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a178b expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.067410:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.067419:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a174c expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.067424:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143694.067442:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a174c expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.067449:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a174c expref: 9 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746143694.067458:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593736320:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143694.067506:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21570c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143694.068204:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8276 00000100:00100000:1.0:1746143694.068211:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28423:x1830963592253056:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143694.068219:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.068220:0:14763:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143694.068232:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21fe200/0xe984082ccd725909 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a177d expref: 245 pid: 14764 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143694.068233:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28421:x1830963592251392:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7337us (8138us total) trans 8589942376 rc 0/0 00000100:00100000:0.0:1746143694.068239:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8273 00010000:00010000:1.0:1746143694.068240:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.068243:0:14763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.068247:0:14763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.068252:0:14763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.068256:0:14763:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143694.068261:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558200/0xe984082ccd72592c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1784 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.068285:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143694.068296:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7200/0xe984082ccd72580d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1706 expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.068306:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.068310:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143694.068319:0:14763:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.068331:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7200/0xe984082ccd72580d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1706 expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.068337:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7200/0xe984082ccd72580d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1706 expref: 8 pid: 14764 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.068344:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593736448:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143694.068384:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143694.069617:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593736320:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143694.069630:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14764 initiator: MDT0 00000100:00100000:0.0:1746143694.077875:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.077934:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592253312 00000100:00100000:2.0:1746143694.077941:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592253312 00010000:00010000:2.0:1746143694.077978:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a174c expref: 9 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746143694.078013:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4938 00000100:00100000:2.0:1746143694.078020:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963592253312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143694.078033:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143694.078038:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a174c expref: 9 pid: 21713 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.078053:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a174c expref: 9 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.078376:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593736448:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.078825:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143694.078851:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095710000/0xe984082ccd7258d1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a174c expref: 9 pid: 21713 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.078866:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143694.078870:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143694.078877:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143694.078883:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143694.079154:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143694.079161:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143694.079217:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143694.079265:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1965:x1830963592253312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1245us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.079272:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4938 00010000:00010000:0.0:1746143694.079388:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143694.079393:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14764 initiator: MDT0 00000004:00200000:0.0:1746143694.079429:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:0.0:1746143694.079432:0:14764:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143694.079446:0:14764:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143694.079471:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094456000/0xe984082ccd72591e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a178b expref: 246 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.079485:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a178b expref: 245 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746143694.079491:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a178b expref: 245 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746143694.079495:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095115600, rc 0) 00000100:00100000:0.0:1746143694.079517:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28425:x1830963592253184:12345-192.168.202.48@tcp:101:cat.0 Request processed in 12397us (12638us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143694.079522:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8275 00000100:00100000:0.0:1746143694.079595:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.079798:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592253440 00000100:00100000:3.0:1746143694.079802:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592253440 00010000:00010000:3.0:1746143694.079817:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7200/0xe984082ccd72580d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1706 expref: 9 pid: 14764 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746143694.079833:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4939 00000100:00100000:3.0:1746143694.079838:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592253440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143694.079857:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143694.079860:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7200/0xe984082ccd72580d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1706 expref: 9 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.079867:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7200/0xe984082ccd72580d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1706 expref: 9 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.079877:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d7200/0xe984082ccd72580d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1706 expref: 9 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.079889:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143694.079892:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143694.079898:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143694.079903:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143694.079919:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592253440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 81us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.079924:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4939 00000100:00100000:0.0:1746143694.082780:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.084415:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592253568 00000100:00100000:2.0:1746143694.084423:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592253568 00000100:00100000:2.0:1746143694.084463:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8277 00000100:00100000:2.0:1746143694.084469:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28426:x1830963592253568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143694.084488:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.084503:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1792 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.084562:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143694.084569:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.084581:0:16090:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143694.084590:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.084599:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143694.084601:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143694.084603:0:16090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143694.084608:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21ffa00, rc 0) 00000100:00100000:2.0:1746143694.084643:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28426:x1830963592253568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 175us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.084648:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8277 00000100:00100000:2.0:1746143694.085343:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.085398:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.085434:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592253824 00000100:00100000:1.0:1746143694.085438:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592253824 00010000:00010000:1.0:1746143694.085455:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a178b expref: 245 pid: 14764 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.085609:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4940 00000100:00100000:1.0:1746143694.085616:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:1963:x1830963592253824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.085624:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.085628:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a178b expref: 245 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.085638:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a178b expref: 245 pid: 14764 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746143694.085667:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592253696 00000100:00100000:0.0:1746143694.085670:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592253696 00000100:00100000:0.0:1746143694.085689:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8278 00000100:00100000:0.0:1746143694.085693:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:28425:x1830963592253696:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143694.085705:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143694.085712:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1799 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.085824:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095115600/0xe984082ccd725925 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a178b expref: 247 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746143694.085826:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1799 expref: 247 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.085834:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1799 expref: 246 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.085838:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.085849:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143694.085855:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143694.085860:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143694.085868:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.085911:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:0.0:1746143694.085914:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143694.085917:0:14764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.085923:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f6c00, rc 0) 00000100:00100000:0.0:1746143694.085949:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:28425:x1830963592253696:12345-192.168.202.48@tcp:101:cat.0 Request processed in 255us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143694.085954:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8278 00010000:00010000:1.0:1746143694.086014:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.086032:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:1963:x1830963592253824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 417us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.086038:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4940 00010000:00010000:0.0:1746143694.086468:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143694.086475:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00000040:00080000:0.0:1746143694.087063:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2276, 88 off191232 00000004:00080000:0.0:1746143694.087071:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773096930404ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143694.087096:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2225, 88 off186560 00000004:00080000:0.0:1746143694.087100:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773096960634ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143694.087127:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2226, 88 off186648 00000004:00080000:0.0:1746143694.087130:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773096990706ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143694.087153:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2277, 88 off191320 00000004:00080000:0.0:1746143694.087156:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773097016643ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143694.087164:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2278, 88 off191408 00000004:00080000:0.0:1746143694.087168:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773097028766ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143694.087198:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2227, 88 off186736 00000004:00080000:0.0:1746143694.088540:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773098399036ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143694.088581:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2228, 88 off186824 00000004:00080000:0.0:1746143694.088586:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773098446321ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143694.088593:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2229, 88 off186912 00000004:00080000:0.0:1746143694.088595:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773098455876ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143694.088605:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2279, 88 off191496 00000004:00080000:0.0:1746143694.088607:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773098467709ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143694.089480:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2230, 88 off187000 00000004:00080000:0.0:1746143694.089485:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773099344882ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143694.089506:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2280, 88 off191584 00000004:00080000:0.0:1746143694.089509:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773099368877ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143694.089518:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2231, 88 off187088 00000004:00080000:0.0:1746143694.089520:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773099380632ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143694.089527:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2281, 88 off191672 00000004:00080000:0.0:1746143694.089530:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773099389985ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143694.089537:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2282, 88 off191760 00000004:00080000:0.0:1746143694.089539:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773099399609ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143694.089545:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2283, 88 off191848 00000004:00080000:0.0:1746143694.089547:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773099407932ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143694.089553:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2284, 88 off191936 00000004:00080000:0.0:1746143694.089556:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773099416197ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143694.089563:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2232, 88 off187176 00000004:00080000:0.0:1746143694.089567:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773099427395ns, next at 718087967394ns, rc = 0 00000001:00080000:0.0:1746143694.129229:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942377 is committed 00000004:00080000:0.0:1746143694.129237:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1578 committed 00010000:00010000:1.0:1746143694.129912:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1784 expref: 245 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.129928:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.129931:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746143694.129935:0:14763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.129944:0:14763:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.129950:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.129955:0:14763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1799 expref: 245 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.129961:0:14763:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1799 expref: 245 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.129966:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1799 expref: 245 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.129998:0:14763:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1799 expref: 245 pid: 14764 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143694.130008:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593736576:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143694.130107:0:14763:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143694.130118:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593736704:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143694.130134:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000004:00080000:0.0:1746143694.130445:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1629 committed 00000004:00080000:0.0:1746143694.130451:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1628 committed 00000004:00080000:0.0:1746143694.130453:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1627 committed 00000004:00080000:0.0:1746143694.130454:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1626 committed 00000004:00080000:0.0:1746143694.130456:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1577 committed 00000004:00080000:0.0:1746143694.130457:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1625 committed 00000004:00080000:0.0:1746143694.130458:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1576 committed 00000004:00080000:0.0:1746143694.130460:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1624 committed 00000004:00080000:0.0:1746143694.130461:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1575 committed 00000004:00080000:0.0:1746143694.130462:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1574 committed 00000004:00080000:0.0:1746143694.130463:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1573 committed 00000004:00080000:0.0:1746143694.130465:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1623 committed 00000004:00080000:0.0:1746143694.130466:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1622 committed 00000004:00080000:0.0:1746143694.130467:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1572 committed 00000004:00080000:0.0:1746143694.130468:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1571 committed 00000004:00080000:0.0:1746143694.130470:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1621 committed 00000001:00080000:0.0:1746143694.130483:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942376 is committed 00000001:00080000:0.0:1746143694.130489:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942372 is committed 00000100:00100000:3.0:1746143694.130985:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593736832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143694.131019:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143694.131058:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593736832 00000100:00100000:3.0:1746143694.131064:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593736832 00000100:00100000:2.0:1746143694.131257:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593737216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143694.131276:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143694.131290:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593737728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143694.131302:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143694.131314:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746143694.131318:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593737344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143694.131329:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143694.131348:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593737216 00000100:00100000:2.0:1746143694.131351:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593737216 00000100:00100000:2.0:1746143694.131373:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593737728 00000100:00100000:2.0:1746143694.131375:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593737728 00000100:00100000:2.0:1746143694.131384:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593737344 00000100:00100000:2.0:1746143694.131385:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593737344 00000100:00100000:2.0:1746143694.131396:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9594 00000100:00100000:2.0:1746143694.131401:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3294:x1830963593737216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143694.131537:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143694.131539:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746143694.131541:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143694.131543:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746143694.131544:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143694.131567:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3294:x1830963593737216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 166us (290us total) trans 17179872452 rc 0/0 00000100:00100000:2.0:1746143694.131573:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9594 00000100:00100000:2.0:1746143694.131586:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9595 00000100:00100000:2.0:1746143694.131590:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3294:x1830963593737728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143694.131657:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3294:x1830963593737728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (352us total) trans 17179872453 rc 0/0 00000100:00100000:2.0:1746143694.131661:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9595 00000100:00100000:2.0:1746143694.131670:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9596 00000100:00100000:2.0:1746143694.131674:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3294:x1830963593737344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143694.131742:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3294:x1830963593737344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (410us total) trans 17179872454 rc 0/0 00000100:00100000:2.0:1746143694.131747:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9596 00000004:00080000:2.0:1746143694.131786:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3fa680/2, rc 0, transno 17179872454 00000100:00100000:2.0:1746143694.131792:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593737344:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143694.131799:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f9f80/2, rc 0, transno 17179872452 00000100:00100000:2.0:1746143694.131802:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593737216:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143694.131807:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3fb100/2, rc 0, transno 17179872453 00000100:00100000:2.0:1746143694.131809:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593737728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143694.131833:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746143694.131838:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e63d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593737856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143694.131873:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143694.131888:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593737856 00000100:00100000:2.0:1746143694.131890:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593737856 00000100:00100000:2.0:1746143694.131902:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9597 00000100:00100000:2.0:1746143694.131906:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3294:x1830963593737856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143694.131980:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3294:x1830963593737856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (106us total) trans 17179872455 rc 0/0 00000100:00100000:2.0:1746143694.131985:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9597 00000004:00080000:2.0:1746143694.132003:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e63d180/2, rc 0, transno 17179872455 00000100:00100000:2.0:1746143694.132006:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e63d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593737856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143694.132057:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593737088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143694.132080:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143694.132093:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593737600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143694.132105:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143694.132114:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143694.132118:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593736960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143694.132130:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143694.132154:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593737472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143694.132167:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143694.132184:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593737088 00000100:00100000:0.0:1746143694.132186:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593737088 00000100:00100000:0.0:1746143694.132200:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593737600 00000100:00100000:0.0:1746143694.132201:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593737600 00000100:00100000:0.0:1746143694.132208:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593736960 00000100:00100000:0.0:1746143694.132210:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593736960 00000100:00100000:0.0:1746143694.132217:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593737472 00000100:00100000:0.0:1746143694.132219:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593737472 00000100:00100000:0.0:1746143694.132226:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9598 00000100:00100000:0.0:1746143694.132230:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3293:x1830963593737088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143694.132304:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:0.0:1746143694.132306:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143692 -> 1746143692 00002000:00010000:0.0:1746143694.132308:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143692 -> 1746143692 00002000:00010000:0.0:1746143694.132309:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143691 -> 1746143691 00002000:00010000:0.0:1746143694.132311:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5541 -> 5541 00000100:00100000:0.0:1746143694.132330:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3293:x1830963593737088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (249us total) trans 17179872456 rc 0/0 00000100:00100000:0.0:1746143694.132334:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9598 00000100:00100000:0.0:1746143694.132343:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9599 00000100:00100000:0.0:1746143694.132347:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3293:x1830963593737600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143694.132417:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3293:x1830963593737600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (310us total) trans 17179872457 rc 0/0 00000100:00100000:0.0:1746143694.132421:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9599 00000100:00100000:0.0:1746143694.132430:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9600 00000100:00100000:0.0:1746143694.132433:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3293:x1830963593736960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143694.132490:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143694.132492:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143692 -> 1746143692 00002000:00010000:0.0:1746143694.132494:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143691 -> 1746143691 00002000:00010000:0.0:1746143694.132496:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143692 -> 1746143692 00002000:00010000:0.0:1746143694.132498:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143694.132514:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3293:x1830963593736960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (383us total) trans 17179872458 rc 0/0 00000100:00100000:0.0:1746143694.132518:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9600 00000100:00100000:0.0:1746143694.132527:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9601 00000100:00100000:0.0:1746143694.132531:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3293:x1830963593737472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143694.132597:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3293:x1830963593737472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (428us total) trans 17179872459 rc 0/0 00000100:00100000:0.0:1746143694.132601:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9601 00000004:00080000:0.0:1746143694.132624:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f9180/2, rc 0, transno 17179872458 00000100:00100000:0.0:1746143694.132627:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593736960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143694.132633:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f8380/2, rc 0, transno 17179872459 00000100:00100000:0.0:1746143694.132635:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593737472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143694.132641:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3fad80/2, rc 0, transno 17179872456 00000100:00100000:0.0:1746143694.132644:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593737088:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143694.132649:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f8a80/2, rc 0, transno 17179872457 00000100:00100000:0.0:1746143694.132651:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593737600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143694.132926:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9602 00000100:00100000:3.0:1746143694.132931:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963593736832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143694.133002:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143694.133004:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143691 -> 1746143691 00002000:00010000:3.0:1746143694.133006:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143690 -> 1746143690 00002000:00010000:3.0:1746143694.133008:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143691 -> 1746143691 00002000:00010000:3.0:1746143694.133009:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:3.0:1746143694.133032:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963593736832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (2013us total) trans 17179872460 rc 0/0 00000100:00100000:3.0:1746143694.133037:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9602 00000100:00080000:3.0:1746143694.133051:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143694.133379:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593737984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143694.133400:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143694.133412:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593738496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143694.133424:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143694.133432:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746143694.133436:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593738112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143694.133446:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143694.133455:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593738624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143694.133466:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143694.133479:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593737984 00000100:00100000:3.0:1746143694.133482:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593737984 00000100:00100000:3.0:1746143694.133497:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593738496 00000100:00100000:3.0:1746143694.133499:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593738496 00000100:00100000:3.0:1746143694.133507:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593738112 00000100:00100000:3.0:1746143694.133508:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593738112 00000100:00100000:3.0:1746143694.133515:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593738624 00000100:00100000:3.0:1746143694.133517:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593738624 00000100:00100000:3.0:1746143694.133523:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9603 00000100:00100000:3.0:1746143694.133527:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3292:x1830963593737984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143694.133614:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143694.133616:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143691 -> 1746143691 00002000:00010000:3.0:1746143694.133618:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143691 -> 1746143691 00002000:00010000:3.0:1746143694.133619:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143691 -> 1746143691 00002000:00010000:3.0:1746143694.133620:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746143694.133640:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963593737984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (240us total) trans 21474839719 rc 0/0 00000100:00100000:3.0:1746143694.133645:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9603 00000100:00100000:3.0:1746143694.133654:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9604 00000100:00100000:3.0:1746143694.133657:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3292:x1830963593738496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143694.133720:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:3.0:1746143694.133722:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:3.0:1746143694.133724:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143694.133725:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:3.0:1746143694.133727:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:3.0:1746143694.133744:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963593738496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (319us total) trans 21474839720 rc 0/0 00000100:00100000:3.0:1746143694.133749:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9604 00000100:00100000:3.0:1746143694.133758:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9605 00000100:00100000:3.0:1746143694.133762:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3292:x1830963593738112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143694.133823:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143694.133825:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143691 -> 1746143691 00002000:00010000:3.0:1746143694.133826:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143691 -> 1746143691 00002000:00010000:3.0:1746143694.133828:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143691 -> 1746143691 00002000:00010000:3.0:1746143694.133829:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143694.133857:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963593738112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (410us total) trans 21474839721 rc 0/0 00000100:00100000:2.0:1746143694.134391:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9606 00000100:00100000:2.0:1746143694.134399:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963593738624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143694.134485:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3292:x1830963593738624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (1018us total) trans 21474839722 rc 0/0 00000100:00100000:2.0:1746143694.134490:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9606 00000100:00100000:2.0:1746143694.134509:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593738240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143694.134526:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143694.134539:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593738752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143694.134551:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143694.134561:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746143694.134565:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593738368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143694.134576:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143694.134582:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593738880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143694.134594:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143694.134605:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593738240 00000100:00100000:2.0:1746143694.134608:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593738240 00000100:00100000:2.0:1746143694.134620:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593738752 00000100:00100000:2.0:1746143694.134621:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593738752 00000100:00100000:2.0:1746143694.134627:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593738368 00000100:00100000:2.0:1746143694.134629:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593738368 00000100:00100000:2.0:1746143694.134635:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9607 00000100:00100000:2.0:1746143694.134639:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963593738240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143694.134705:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143694.134708:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143691 -> 1746143691 00002000:00010000:2.0:1746143694.134709:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143691 -> 1746143691 00002000:00010000:2.0:1746143694.134711:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143691 -> 1746143691 00002000:00010000:2.0:1746143694.134713:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746143694.134733:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593738240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (206us total) trans 21474839723 rc 0/0 00000100:00100000:2.0:1746143694.134738:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9607 00000100:00100000:2.0:1746143694.134746:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593738880 00000100:00100000:2.0:1746143694.134748:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593738880 00000100:00100000:2.0:1746143694.134757:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9608 00000100:00100000:2.0:1746143694.134760:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593738752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143694.134831:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963593738752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (279us total) trans 21474839724 rc 0/0 00000100:00100000:2.0:1746143694.134836:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9608 00000100:00100000:2.0:1746143694.134859:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9609 00000100:00100000:2.0:1746143694.134863:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593738368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143694.134919:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143694.134921:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143694.134923:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143694.134924:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:2.0:1746143694.134925:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143694.134943:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963593738368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (365us total) trans 21474839725 rc 0/0 00000100:00100000:2.0:1746143694.134947:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9609 00000100:00100000:2.0:1746143694.134956:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9610 00000100:00100000:2.0:1746143694.134959:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593738880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143694.135024:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963593738880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (429us total) trans 21474839726 rc 0/0 00000100:00100000:2.0:1746143694.135029:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9610 00000004:00080000:2.0:1746143694.135062:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093805c00/2, rc 0, transno 21474839725 00000100:00100000:2.0:1746143694.135066:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593738368:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143694.135072:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e0a80/2, rc 0, transno 21474839726 00000100:00100000:2.0:1746143694.135075:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593738880:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143694.135079:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093804380/2, rc 0, transno 21474839723 00000100:00100000:2.0:1746143694.135082:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593738240:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143694.135087:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d2680/2, rc 0, transno 21474839724 00000100:00100000:2.0:1746143694.135089:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593738752:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143694.135104:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949f1f80/2, rc 0, transno 17179872460 00000100:00100000:2.0:1746143694.135107:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593736832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143694.135445:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.135457:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.135509:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.135526:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592253952 00000100:00100000:2.0:1746143694.135529:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592253952 00000100:00100000:2.0:1746143694.135544:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592254080 00000100:00100000:2.0:1746143694.135545:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592254080 00000100:00100000:2.0:1746143694.135556:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3364 00000100:00100000:2.0:1746143694.135560:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+7:28426:x1830963592253952:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:1.0:1746143694.135563:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3365 00000100:00100000:1.0:1746143694.135570:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28425:x1830963592254080:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:2.0:1746143694.135623:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+7:28426:x1830963592253952:12345-192.168.202.48@tcp:49:cat.0 Request processed in 61us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.135623:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28425:x1830963592254080:12345-192.168.202.48@tcp:49:cat.0 Request processed in 54us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.135627:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3365 00000100:00100000:0.0:1746143694.135656:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592254208 00000100:00100000:0.0:1746143694.135659:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592254208 00000100:00100000:0.0:1746143694.135675:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8279 00000100:00100000:0.0:1746143694.135679:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28421:x1830963592254208:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143694.135687:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143694.135698:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd725948 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17a0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.135731:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd725948 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17a0 expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.135742:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd725948 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17a0 expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.135756:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:0.0:1746143694.135758:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143694.135761:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f7e00, rc 0) 00000100:00100000:0.0:1746143694.135777:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28421:x1830963592254208:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 98us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143694.135782:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8279 00000100:00100000:2.0:1746143694.135869:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3364 00000100:00100000:3.0:1746143694.135953:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9605 00000100:00100000:2.0:1746143694.135953:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593736576:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143694.135960:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963593736704:192.168.202.48@tcp:105: 00000100:00080000:3.0:1746143694.135970:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746143694.135984:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0558200/0xe984082ccd72592c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1784 expref: 243 pid: 14763 timeout: 0 lvb_type: 3 00000004:00080000:3.0:1746143694.135986:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093806a00/2, rc 0, transno 21474839721 00000100:00100000:3.0:1746143694.135990:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593738112:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143694.135996:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093805f80/2, rc 0, transno 21474839722 00000100:00100000:3.0:1746143694.135999:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593738624:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143694.136002:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1784 expref: 242 pid: 14763 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746143694.136005:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093806d80/2, rc 0, transno 21474839719 00000100:00100000:3.0:1746143694.136007:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593737984:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143694.136013:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093804e00/2, rc 0, transno 21474839720 00000100:00100000:3.0:1746143694.136015:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593738496:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143694.136017:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135778000, rc 0) 00000100:00100000:2.0:1746143694.136039:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28423:x1830963592253056:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 67830us (69201us total) trans 8589942377 rc 0/0 00000100:00100000:2.0:1746143694.136044:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8276 00000100:00100000:0.0:1746143694.147574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.148132:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.148185:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592254464 00000100:00100000:0.0:1746143694.148188:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.148193:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592254464 00000100:00100000:0.0:1746143694.148748:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.148990:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.149004:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592254336 00000100:00100000:3.0:1746143694.149008:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592254336 00000100:00100000:3.0:1746143694.149025:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592254720 00000100:00100000:3.0:1746143694.149027:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592254720 00000100:00100000:3.0:1746143694.149040:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592254592 00000100:00100000:3.0:1746143694.149041:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592254592 00000100:00100000:3.0:1746143694.149052:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9611 00000100:00100000:3.0:1746143694.149058:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:28423:x1830963592254464:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143694.149072:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.149086:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17ae expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.149109:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725822 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1714 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.149116:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1753 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.149121:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.149122:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.149125:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [81920->237567] (req 81920->237567) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.149160:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1753 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.149170:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1753 expref: 9 pid: 8497 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746143694.149179:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593739008:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143694.149242:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725822 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1714 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.149250:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725822 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1714 expref: 8 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746143694.149257:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593739136:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143694.149271:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3889c0 going to sleep for 11 seconds 00000100:00080000:3.0:1746143694.149284:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746143694.149286:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143694.149296:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9612 00000100:00100000:3.0:1746143694.149301:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963592254336:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143694.149306:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.149311:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095711e00/0xe984082ccd725956 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17a7 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.149321:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.149328:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095711e00/0xe984082ccd725956 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17a7 expref: 20 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.149335:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095711e00/0xe984082ccd725956 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17a7 expref: 20 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.149346:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095711e00, rc 0) 00000100:00100000:3.0:1746143694.149363:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963592254336:12345-192.168.202.48@tcp:101:cat.0 Request processed in 62us (1232us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143694.149367:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9612 00000100:00100000:3.0:1746143694.149380:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9613 00000100:00100000:3.0:1746143694.149384:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1962:x1830963592254720:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143694.149397:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.149404:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095115000/0xe984082ccd72595d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17bc expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.149414:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.149415:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.149421:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095115000/0xe984082ccd72595d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17bc expref: 16 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.149430:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095115000/0xe984082ccd72595d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17bc expref: 16 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.149437:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095115000, rc 0) 00000100:00100000:3.0:1746143694.149449:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963592254720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 65us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.149453:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9613 00000100:00100000:3.0:1746143694.149462:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9614 00000100:00100000:3.0:1746143694.149466:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1962:x1830963592254592:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143694.149470:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.149475:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095114600/0xe984082ccd725964 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17b5 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.149482:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.149484:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.149487:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095114600/0xe984082ccd725964 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17b5 expref: 16 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.149494:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095114600/0xe984082ccd725964 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17b5 expref: 16 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.149500:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095114600, rc 0) 00000100:00100000:3.0:1746143694.149512:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963592254592:12345-192.168.202.48@tcp:101:cat.0 Request processed in 45us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.149516:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9614 00000100:00100000:0.0:1746143694.150856:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.150875:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.150889:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.150915:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.150963:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.150975:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592254848 00000100:00100000:0.0:1746143694.150980:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592254848 00000100:00100000:0.0:1746143694.150996:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592254976 00000100:00100000:0.0:1746143694.150997:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592254976 00000100:00100000:0.0:1746143694.151006:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592255744 00000100:00100000:0.0:1746143694.151007:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592255744 00000100:00100000:0.0:1746143694.151014:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592255616 00000100:00100000:0.0:1746143694.151016:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592255616 00000100:00100000:0.0:1746143694.151024:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9615 00000100:00100000:0.0:1746143694.151029:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963592254848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143694.151037:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143694.151046:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6000/0xe984082ccd72596b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17c3 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.151058:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143694.151059:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143694.151063:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6000/0xe984082ccd72596b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17c3 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143694.151073:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6000/0xe984082ccd72596b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17c3 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143694.151080:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f6000, rc 0) 00000100:00100000:0.0:1746143694.151102:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963592254848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 72us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143694.151107:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9615 00000100:00100000:0.0:1746143694.151118:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9616 00000100:00100000:0.0:1746143694.151122:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28421:x1830963592254976:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143694.151128:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143694.151134:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17d1 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143694.151154:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592255488 00000100:00100000:1.0:1746143694.151157:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592255488 00010000:00010000:0.0:1746143694.151160:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd400/0xe984082ccd725829 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1722 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143694.151166:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095115000/0xe984082ccd72595d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17bc expref: 16 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143694.151172:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1761 expref: 10 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143694.151177:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143694.151178:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143694.151179:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 567 00010000:00010000:0.0:1746143694.151181:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [1093632->1515519] (req 1093632->1515519) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 10 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143694.151184:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1963:x1830963592255488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.151191:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143694.151196:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1761 expref: 10 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.151203:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd725948 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17a0 expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.151203:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1761 expref: 10 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.151213:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00000100:00100000:0.0:1746143694.151213:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593739264:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.151216:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.151229:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+7:1963:x1830963592255488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 45us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.151234:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 567 00010000:00010000:0.0:1746143694.151249:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095115000/0xe984082ccd72595d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17bc expref: 16 pid: 21542 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143694.151256:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9617 00010000:00010000:0.0:1746143694.151256:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095115000/0xe984082ccd72595d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17bc expref: 16 pid: 21542 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746143694.151261:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963592255744:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143694.151264:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593739392:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.151266:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.151272:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17d8 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.151281:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.151283:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143694.151285:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd400/0xe984082ccd725829 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1722 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.151287:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d8 expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143694.151292:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd400/0xe984082ccd725829 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1722 expref: 8 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.151295:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d8 expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143694.151299:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bf0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593739520:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.151302:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094677c00, rc 0) 00000100:00100000:0.0:1746143694.151312:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143694.151313:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963592255744:12345-192.168.202.48@tcp:101:cat.0 Request processed in 52us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.151317:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9617 00000100:00100000:1.0:1746143694.151326:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9618 00000100:00100000:1.0:1746143694.151330:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963592255616:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143694.151335:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.151340:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd725980 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17ca expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.151349:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.151350:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.151353:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd725980 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ca expref: 21 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.151361:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd725980 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ca expref: 21 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.151372:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094677000, rc 0) 00000100:00100000:1.0:1746143694.151388:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963592255616:12345-192.168.202.48@tcp:101:cat.0 Request processed in 57us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.151392:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9618 00000100:00100000:2.0:1746143694.151444:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592255232 00000100:00100000:2.0:1746143694.151448:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592255232 00002000:00100000:2.0:1746143694.151471:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880094c0df80 x1830963592255232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.151484:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0df80 with x1830963592255232 ext(0->1048575) 00010000:00010000:2.0:1746143694.151489:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1753 expref: 10 pid: 8497 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.151497:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1753 expref: 10 pid: 8497 timeout: 873 lvb_type: 1 00002000:00010000:2.0:1746143694.151502:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0df80 00000100:00100000:2.0:1746143694.151513:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 852 00000100:00100000:2.0:1746143694.151518:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592255232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143694.155447:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.155475:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.155495:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592255872 00000100:00100000:1.0:1746143694.155500:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592255872 00010000:00010000:1.0:1746143694.155534:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725822 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1714 expref: 9 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746143694.155552:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592256000 00000100:00100000:1.0:1746143694.155554:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592256000 00010000:00010000:1.0:1746143694.155565:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd400/0xe984082ccd725829 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1722 expref: 9 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746143694.155577:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4941 00000100:00100000:1.0:1746143694.155583:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592255872:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.155593:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.155608:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725822 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1714 expref: 9 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.155618:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725822 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1714 expref: 9 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.155636:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.155664:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592255872:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 81us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.155669:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4941 00000100:00100000:1.0:1746143694.155689:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4942 00000100:00100000:1.0:1746143694.155693:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592256000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.155699:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.155710:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd400/0xe984082ccd725829 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1722 expref: 9 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.155716:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd400/0xe984082ccd725829 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1722 expref: 9 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.155726:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.155735:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592256000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 42us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.155739:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4942 00000100:00080000:1.0:1746143694.155752:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746143694.155754:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143694.156008:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593739008:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143694.156018:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725822 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1714 expref: 8 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746143694.156027:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593739136:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143694.156046:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [81920->237567] (req 81920->237567) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.156054:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095115600, rc 0) 00000100:00100000:3.0:1746143694.156069:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28423:x1830963592254464:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7011us (8503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.156074:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9611 00000100:00100000:0.0:1746143694.158489:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593739264:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143694.158499:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593739392:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143694.158510:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd400/0xe984082ccd725829 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1722 expref: 8 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746143694.158520:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bf0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593739520:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143694.158545:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1093632->1515519] (req 1093632->1515519) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 10 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.158555:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f6200, rc 0) 00000100:00100000:0.0:1746143694.158595:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28421:x1830963592254976:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7472us (7740us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143694.158601:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9616 00000100:00100000:1.0:1746143694.163288:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.163311:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592256256 00000100:00100000:1.0:1746143694.163317:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.163318:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592256256 00000100:00100000:3.0:1746143694.163354:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592256384 00000100:00100000:3.0:1746143694.163358:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592256384 00002000:00100000:3.0:1746143694.163385:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88012e1e2d80 x1830963592256384/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.163394:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e2d80 with x1830963592256384 ext(1048576->2097151) 00010000:00010000:3.0:1746143694.163402:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1761 expref: 10 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.163412:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1761 expref: 10 pid: 9527 timeout: 873 lvb_type: 1 00002000:00010000:3.0:1746143694.163418:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e1e2d80 00000100:00100000:3.0:1746143694.163432:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 853 00000100:00100000:3.0:1746143694.163438:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592256384:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:0.0:1746143694.164247:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88012e1e2a00 x1830963592256256/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143694.164255:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e2a00 with x1830963592256256 ext(1048576->2097151) 00002000:00010000:0.0:1746143694.164258:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e2a00 00000100:00100000:0.0:1746143694.164273:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3538 00000100:00100000:0.0:1746143694.164278:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592256256:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143694.170300:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.170600:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592256512 00000100:00100000:3.0:1746143694.170608:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592256512 00002000:00100000:3.0:1746143694.170642:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093bf0e00 x1830963592256512/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.170650:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf0e00 with x1830963592256512 ext(1048576->2097151) 00002000:00010000:3.0:1746143694.170654:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bf0e00 00000100:00100000:3.0:1746143694.170673:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3539 00000100:00100000:3.0:1746143694.170678:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592256512:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143694.180702:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.180743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.181332:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592256896 00000100:00100000:1.0:1746143694.181340:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592256896 00000100:00100000:1.0:1746143694.181374:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9619 00000100:00100000:1.0:1746143694.181379:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28425:x1830963592256896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143694.181392:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.181406:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725987 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17df expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.181431:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.181436:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [81920->237567] (req 81920->237567) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.181442:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143694.181445:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725987 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17df expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.181473:0:25369:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [81920->237567] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.181484:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725987 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17df expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.181493:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a2000, rc 0) 00000100:00100000:1.0:1746143694.181531:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28425:x1830963592256896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 151us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.181536:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9619 00000100:00100000:2.0:1746143694.181664:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592256768 00000100:00100000:2.0:1746143694.181668:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592256768 00010000:00010000:2.0:1746143694.181685:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095115000/0xe984082ccd72595d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17bc expref: 17 pid: 21542 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746143694.181706:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4943 00000100:00100000:2.0:1746143694.181711:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963592256768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143694.181719:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143694.181735:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095115000/0xe984082ccd72595d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17bc expref: 17 pid: 21542 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.181743:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095115000/0xe984082ccd72595d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17bc expref: 17 pid: 21542 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.181757:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095115000/0xe984082ccd72595d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17bc expref: 17 pid: 21542 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.181769:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143694.181786:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963592256768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 75us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.181791:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4943 00000100:00100000:3.0:1746143694.187097:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592255232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33936us (34578us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143694.187110:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 852 00002000:00100000:3.0:1746143694.187123:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880094c0df80 x1830963592255232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.187133:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0df80 with x1830963592255232 ext(0->1048575) 00010000:00010000:3.0:1746143694.187154:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1753 expref: 12 pid: 8497 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.187168:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1753 expref: 12 pid: 8497 timeout: 873 lvb_type: 1 00002000:00010000:3.0:1746143694.187174:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0df80 00000100:00100000:1.0:1746143694.192358:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592256256:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28071us (29069us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143694.192369:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3538 00002000:00100000:1.0:1746143694.192379:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88012e1e2a00 x1830963592256256/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.192388:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e2a00 with x1830963592256256 ext(1048576->2097151) 00002000:00010000:1.0:1746143694.192393:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e2a00 00000100:00100000:3.0:1746143694.200295:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592256384:12345-192.168.202.48@tcp:3:cat.0 Request processed in 36848us (36967us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143694.200306:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 853 00002000:00100000:3.0:1746143694.200316:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88012e1e2d80 x1830963592256384/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.200325:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e2d80 with x1830963592256384 ext(1048576->2097151) 00010000:00010000:3.0:1746143694.200334:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1761 expref: 12 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.200346:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1761 expref: 12 pid: 9527 timeout: 873 lvb_type: 1 00002000:00010000:3.0:1746143694.200352:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e1e2d80 00000100:00100000:3.0:1746143694.206794:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592256512:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35951us (36339us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143694.206807:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3539 00002000:00100000:3.0:1746143694.206819:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093bf0e00 x1830963592256512/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.206828:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bf0e00 with x1830963592256512 ext(1048576->2097151) 00002000:00010000:3.0:1746143694.206833:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bf0e00 00000100:00100000:0.0:1746143694.210575:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.212710:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.212781:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592257024 00000100:00100000:3.0:1746143694.212789:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592257024 00000100:00100000:2.0:1746143694.212808:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592257152 00000100:00100000:2.0:1746143694.212811:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592257152 00010000:00010000:3.0:1746143694.212822:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1753 expref: 10 pid: 8497 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.212824:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1761 expref: 10 pid: 9527 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746143694.213800:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4944 00000100:00100000:3.0:1746143694.213805:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4945 00000100:00100000:2.0:1746143694.213809:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1962:x1830963592257152:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143694.213810:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963592257024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143694.213821:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143694.213821:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143694.213849:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1753 expref: 10 pid: 8497 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.213849:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1761 expref: 10 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.213859:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1753 expref: 10 pid: 8497 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.213859:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1761 expref: 10 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.213876:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fea00/0xe984082ccd7258ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1753 expref: 10 pid: 8497 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.213876:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff400/0xe984082ccd7258f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1761 expref: 10 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.213893:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.213893:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.213895:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.213895:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.213900:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.213900:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 9 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.213907:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 9 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.213908:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.213932:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.213932:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 9 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143694.213943:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593739776:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143694.213944:0:7151:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 20 pid: 8495 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746143694.213951:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593739904:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143694.214308:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143694.214311:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3889c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143694.214360:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.214711:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592257280 00000100:00100000:2.0:1746143694.214716:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592257280 00000100:00100000:2.0:1746143694.214750:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9620 00000100:00100000:2.0:1746143694.214755:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28426:x1830963592257280:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143694.214767:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.215245:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd72598e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17e6 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.215264:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 11 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.215271:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143694.215272:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143694.215275:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd72598e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17e6 expref: 11 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.215292:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 11 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.215301:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 11 pid: 25369 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746143694.215309:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593740032:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143694.217114:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143694.217803:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593739776:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143694.217818:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143694.217865:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592257152:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4057us (5160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.217874:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4944 00000100:00100000:3.0:1746143694.217938:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593739904:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143694.218256:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143694.218286:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963592257024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4475us (7719us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.218293:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4945 00000100:00100000:0.0:1746143694.219412:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.219445:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.219647:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593740032:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143694.219666:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd72598e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17e6 expref: 10 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.219684:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f6e00, rc 0) 00000100:00100000:2.0:1746143694.219710:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28426:x1830963592257280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4955us (5351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.219717:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9620 00000100:00100000:2.0:1746143694.219740:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592257536 00000100:00100000:2.0:1746143694.219744:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592257536 00002000:00100000:2.0:1746143694.219770:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (81920->86015) req@ffff880090764700 x1830963592257536/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.219780:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764700 with x1830963592257536 ext(81920->86015) 00010000:00010000:2.0:1746143694.219787:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 21 pid: 8495 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.219796:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 21 pid: 8495 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746143694.219802:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090764700 00000100:00100000:2.0:1746143694.219828:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592257792 00000100:00100000:2.0:1746143694.219831:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592257792 00002000:00100000:2.0:1746143694.219851:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34b:0x0] (1093632->1097727) req@ffff880090766d80 x1830963592257792/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.219858:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766d80 with x1830963592257792 ext(1093632->1097727) 00010000:00010000:2.0:1746143694.219862:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 10 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.219870:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 10 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746143694.219876:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090766d80 00000100:00100000:2.0:1746143694.219886:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 854 00000100:00100000:2.0:1746143694.219892:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592257536:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143694.220014:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592257536:12345-192.168.202.48@tcp:3:cat.0 Request processed in 122us (606us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143694.220020:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 854 00002000:00100000:2.0:1746143694.220025:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (81920->86015) req@ffff880090764700 x1830963592257536/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/4536 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.220032:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764700 with x1830963592257536 ext(81920->86015) 00010000:00010000:2.0:1746143694.220036:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 21 pid: 8495 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.220044:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 21 pid: 8495 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746143694.220050:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090764700 00000100:00100000:2.0:1746143694.220058:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 855 00000100:00100000:2.0:1746143694.220063:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592257792:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143694.220126:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592257792:12345-192.168.202.48@tcp:3:cat.0 Request processed in 62us (681us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143694.220131:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 855 00002000:00100000:2.0:1746143694.220136:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34b:0x0] (1093632->1097727) req@ffff880090766d80 x1830963592257792/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/4536 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.220175:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766d80 with x1830963592257792 ext(1093632->1097727) 00010000:00010000:2.0:1746143694.220179:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 10 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.220187:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 10 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746143694.220192:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090766d80 00000100:00100000:0.0:1746143694.223090:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.223459:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592258048 00000100:00100000:3.0:1746143694.223466:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592258048 00002000:00100000:3.0:1746143694.223501:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (233472->237567) req@ffff880090765880 x1830963592258048/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.223510:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765880 with x1830963592258048 ext(233472->237567) 00010000:00010000:3.0:1746143694.223517:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 21 pid: 8495 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.223528:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 21 pid: 8495 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746143694.223534:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090765880 00000100:00100000:3.0:1746143694.223558:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 856 00000100:00100000:3.0:1746143694.223565:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592258048:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143694.223716:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592258048:12345-192.168.202.48@tcp:3:cat.0 Request processed in 150us (631us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143694.223723:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 856 00002000:00100000:3.0:1746143694.223728:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (233472->237567) req@ffff880090765880 x1830963592258048/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/4536 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.223735:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765880 with x1830963592258048 ext(233472->237567) 00010000:00010000:3.0:1746143694.223739:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 21 pid: 8495 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.223746:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 21 pid: 8495 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746143694.223752:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090765880 00000100:00100000:0.0:1746143694.226450:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.226493:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.226570:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.226692:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592258304 00000100:00100000:2.0:1746143694.226698:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592258304 00002000:00100000:2.0:1746143694.226731:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1511424->1515519) req@ffff880090766300 x1830963592258304/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.226740:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766300 with x1830963592258304 ext(1511424->1515519) 00010000:00010000:2.0:1746143694.226747:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 10 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.226757:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 10 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746143694.226763:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090766300 00000100:00100000:2.0:1746143694.226789:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592258816 00000100:00100000:2.0:1746143694.226792:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592258816 00002000:00100000:2.0:1746143694.226804:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34c:0x0] (81920->237567) req@ffff88009bfe0e00 x1830963592258816/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.226810:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0e00 with x1830963592258816 ext(81920->237567) 00010000:00010000:2.0:1746143694.226815:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 21 pid: 8495 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.226818:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 857 00010000:00010000:2.0:1746143694.226822:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 21 pid: 8495 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.226826:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592258304:12345-192.168.202.48@tcp:3:cat.0 00002000:00010000:2.0:1746143694.226827:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe0e00 00000100:00100000:2.0:1746143694.226838:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 858 00000100:00100000:2.0:1746143694.226854:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963592258816:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143694.226976:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592258304:12345-192.168.202.48@tcp:3:cat.0 Request processed in 151us (532us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143694.226981:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 857 00002000:00100000:1.0:1746143694.226985:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1511424->1515519) req@ffff880090766300 x1830963592258304/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/4536 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.226992:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766300 with x1830963592258304 ext(1511424->1515519) 00010000:00010000:1.0:1746143694.226996:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 10 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.227004:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 10 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:1.0:1746143694.227010:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090766300 00000100:00100000:3.0:1746143694.227066:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592258688 00000100:00100000:3.0:1746143694.227069:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592258688 00000100:00100000:3.0:1746143694.227090:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3366 00000100:00100000:3.0:1746143694.227095:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28423:x1830963592258688:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143694.227348:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28423:x1830963592258688:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 252us (854us total) trans 8589942378 rc 0/0 00000100:00100000:3.0:1746143694.227354:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3366 00000100:00100000:0.0:1746143694.229881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.229923:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.230318:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592259328 00000100:00100000:2.0:1746143694.230324:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592259328 00000100:00100000:2.0:1746143694.230360:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3367 00000100:00100000:2.0:1746143694.230366:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+7:28421:x1830963592259328:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143694.230551:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28421:x1830963592259328:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 184us (626us total) trans 8589942379 rc 0/0 00000100:00100000:2.0:1746143694.230557:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3367 00000100:00100000:3.0:1746143694.230929:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592259072 00000100:00100000:3.0:1746143694.230933:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592259072 00002000:00100000:3.0:1746143694.230953:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1093632->1515519) req@ffff88009bfe2d80 x1830963592259072/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.230961:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2d80 with x1830963592259072 ext(1093632->1515519) 00010000:00010000:3.0:1746143694.230968:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 10 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.230978:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 10 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746143694.230983:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe2d80 00000100:00100000:3.0:1746143694.230995:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 859 00000100:00100000:3.0:1746143694.231000:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592259072:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143694.236890:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592258816:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10027us (10311us total) trans 17179872461 rc 0/0 00000100:00100000:2.0:1746143694.236901:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 858 00002000:00100000:2.0:1746143694.236910:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34c:0x0] (81920->237567) req@ffff88009bfe0e00 x1830963592258816/t17179872461(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/448 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.236919:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0e00 with x1830963592258816 ext(81920->237567) 00010000:00010000:2.0:1746143694.236927:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 23 pid: 8495 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.236943:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 23 pid: 8495 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746143694.236949:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe0e00 00000100:00100000:3.0:1746143694.243237:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592259072:12345-192.168.202.48@tcp:4:cat.0 Request processed in 12228us (13353us total) trans 21474839727 rc 0/0 00000100:00100000:3.0:1746143694.243246:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 859 00002000:00100000:3.0:1746143694.243255:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1093632->1515519) req@ffff88009bfe2d80 x1830963592259072/t21474839727(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/448 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.243263:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2d80 with x1830963592259072 ext(1093632->1515519) 00010000:00010000:3.0:1746143694.243271:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 12 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.243282:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 12 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746143694.243288:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe2d80 00000100:00100000:0.0:1746143694.244104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.245469:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592259456 00000100:00100000:3.0:1746143694.245478:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592259456 00010000:00010000:3.0:1746143694.245509:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 23 pid: 8495 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746143694.245998:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4946 00000100:00100000:3.0:1746143694.246007:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592259456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143694.246019:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143694.246034:0:7151:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143691 -> 1746143693 00002000:00010000:3.0:1746143694.246037:0:7151:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143691 -> 1746143693 00010000:00010000:3.0:1746143694.246042:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 23 pid: 8495 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.246053:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 23 pid: 8495 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.246070:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095115600/0xe984082ccd72594f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->237567) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ae expref: 23 pid: 8495 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.248829:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.248833:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.248851:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725987 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17df expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.248861:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17df expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.248900:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17df expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143694.248914:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593740160:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143694.251239:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c388e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143694.252158:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.252476:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592259584 00000100:00100000:3.0:1746143694.252482:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592259584 00010000:00010000:3.0:1746143694.252508:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 12 pid: 25369 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746143694.252532:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4947 00000100:00100000:3.0:1746143694.252538:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592259584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143694.252549:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143694.252565:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143691 -> 1746143693 00002000:00010000:3.0:1746143694.252567:0:7150:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143691 -> 1746143693 00010000:00010000:3.0:1746143694.252572:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 12 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.252581:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 12 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.252599:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6200/0xe984082ccd725972 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1515519) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d1 expref: 12 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.252610:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.252612:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.252617:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd72598e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17e6 expref: 11 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.252628:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd72598e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17e6 expref: 11 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.252653:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd72598e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17e6 expref: 11 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143694.252663:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593740288:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143694.252711:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3889c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143694.255590:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593740160:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143694.255610:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143694.256283:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592259456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10275us (12179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.256293:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4946 00000100:00100000:0.0:1746143694.259659:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.259677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.259740:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.259795:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592259840 00000100:00100000:2.0:1746143694.259803:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592259840 00002000:00100000:2.0:1746143694.259848:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880093f01c00 x1830963592259840/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.259857:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01c00 with x1830963592259840 ext(1048576->2097151) 00002000:00010000:2.0:1746143694.259861:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01c00 00000100:00100000:2.0:1746143694.259878:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592260224 00000100:00100000:2.0:1746143694.259880:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592260224 00002000:00100000:2.0:1746143694.259892:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880093f03100 x1830963592260224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.259899:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03100 with x1830963592260224 ext(0->1048575) 00002000:00010000:2.0:1746143694.259901:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f03100 00000100:00100000:2.0:1746143694.259909:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592260352 00000100:00100000:2.0:1746143694.259910:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592260352 00002000:00100000:2.0:1746143694.259918:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093f00000 x1830963592260352/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.259923:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00000 with x1830963592260352 ext(1048576->2097151) 00002000:00010000:2.0:1746143694.259925:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00000 00000100:00100000:2.0:1746143694.259938:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3540 00000100:00100000:2.0:1746143694.259944:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592259840:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143694.261044:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3541 00000100:00100000:2.0:1746143694.261050:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592260224:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143694.262166:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3542 00000100:00100000:2.0:1746143694.262174:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963592260352:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143694.267600:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593740288:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143694.267621:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143694.267667:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592259584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 15129us (15527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.267677:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4947 00000100:00100000:2.0:1746143694.272343:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592259840:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12390us (12681us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143694.272353:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3540 00002000:00100000:2.0:1746143694.272362:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880093f01c00 x1830963592259840/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.272371:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01c00 with x1830963592259840 ext(1048576->2097151) 00002000:00010000:2.0:1746143694.272376:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01c00 00000100:00100000:2.0:1746143694.278328:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592260224:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17269us (18641us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143694.278338:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3541 00002000:00100000:2.0:1746143694.278348:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880093f03100 x1830963592260224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.278356:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03100 with x1830963592260224 ext(0->1048575) 00002000:00010000:2.0:1746143694.278360:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f03100 00000100:00100000:2.0:1746143694.282293:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963592260352:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20113us (22546us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143694.282303:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3542 00002000:00100000:2.0:1746143694.282313:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093f00000 x1830963592260352/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.282328:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00000 with x1830963592260352 ext(1048576->2097151) 00002000:00010000:2.0:1746143694.282332:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00000 00000100:00100000:0.0:1746143694.300130:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.300278:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592260480 00000100:00100000:2.0:1746143694.300290:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592260480 00000100:00100000:2.0:1746143694.300347:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9621 00000100:00100000:2.0:1746143694.300354:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:28425:x1830963592260480:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143694.300369:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.300382:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd725995 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17ed expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.300401:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.300402:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.300408:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd725995 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ed expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.300420:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd725995 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ed expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.300428:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f6a00, rc 0) 00000100:00100000:2.0:1746143694.301266:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:28425:x1830963592260480:12345-192.168.202.48@tcp:101:cat.0 Request processed in 910us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.301272:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9621 00000100:00100000:0.0:1746143694.305719:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.308067:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592260736 00000100:00100000:2.0:1746143694.308077:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592260736 00002000:00100000:2.0:1746143694.308115:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880093f02d80 x1830963592260736/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.308134:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02d80 with x1830963592260736 ext(1048576->2097151) 00002000:00010000:2.0:1746143694.308165:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02d80 00000100:00100000:2.0:1746143694.308188:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3543 00000100:00100000:2.0:1746143694.308195:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963592260736:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143694.312667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.313579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.313989:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592260992 00000100:00100000:3.0:1746143694.313997:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592260992 00002000:00100000:3.0:1746143694.314033:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88012e1e1880 x1830963592260992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.314042:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e1880 with x1830963592260992 ext(1048576->2097151) 00002000:00010000:3.0:1746143694.314046:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e1880 00000100:00100000:3.0:1746143694.314062:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592261248 00000100:00100000:3.0:1746143694.314064:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592261248 00002000:00100000:3.0:1746143694.314072:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88012e1e3800 x1830963592261248/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.314078:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e3800 with x1830963592261248 ext(2097152->3145727) 00002000:00010000:3.0:1746143694.314081:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e3800 00000100:00100000:3.0:1746143694.314090:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3544 00000100:00100000:3.0:1746143694.314097:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592260992:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143694.314108:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3545 00000100:00100000:1.0:1746143694.314116:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963592261248:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143694.317995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.318030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.318048:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592261504 00000100:00100000:0.0:1746143694.318054:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592261504 00002000:00100000:0.0:1746143694.318085:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880093f01880 x1830963592261504/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143694.318095:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01880 with x1830963592261504 ext(3145728->4194303) 00002000:00010000:0.0:1746143694.318100:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f01880 00000100:00100000:0.0:1746143694.318113:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592261760 00000100:00100000:0.0:1746143694.318116:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592261760 00002000:00100000:0.0:1746143694.318126:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880093f01500 x1830963592261760/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143694.318132:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01500 with x1830963592261760 ext(2097152->3145727) 00002000:00010000:0.0:1746143694.318135:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01500 00000100:00100000:0.0:1746143694.318163:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3546 00000100:00100000:0.0:1746143694.318170:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592261504:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143694.318698:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3547 00000100:00100000:2.0:1746143694.318706:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592261760:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143694.320667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.320689:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592262016 00000100:00100000:0.0:1746143694.320693:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592262016 00002000:00100000:0.0:1746143694.320714:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880093f01180 x1830963592262016/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143694.320722:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01180 with x1830963592262016 ext(3145728->4194303) 00002000:00010000:0.0:1746143694.320727:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01180 00000100:00100000:0.0:1746143694.320738:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3548 00000100:00100000:0.0:1746143694.320744:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592262016:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143694.330934:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963592260736:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22732us (25214us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143694.330944:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3543 00002000:00100000:2.0:1746143694.330954:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880093f02d80 x1830963592260736/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.330963:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02d80 with x1830963592260736 ext(1048576->2097151) 00002000:00010000:2.0:1746143694.330968:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02d80 00000100:00100000:3.0:1746143694.333935:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592260992:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19832us (21270us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143694.333944:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3544 00002000:00100000:3.0:1746143694.333952:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88012e1e1880 x1830963592260992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.333961:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e1880 with x1830963592260992 ext(1048576->2097151) 00002000:00010000:3.0:1746143694.333966:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e1880 00000100:00100000:1.0:1746143694.341091:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592261504:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22913us (23094us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143694.341102:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3546 00002000:00100000:1.0:1746143694.341111:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880093f01880 x1830963592261504/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.341126:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01880 with x1830963592261504 ext(3145728->4194303) 00002000:00010000:1.0:1746143694.341132:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f01880 00000100:00100000:1.0:1746143694.363477:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963592261248:12345-192.168.202.48@tcp:3:cat.0 Request processed in 49355us (49892us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143694.363488:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3545 00002000:00100000:1.0:1746143694.363499:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88012e1e3800 x1830963592261248/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.363508:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e3800 with x1830963592261248 ext(2097152->3145727) 00002000:00010000:1.0:1746143694.363513:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e3800 00000100:00100000:3.0:1746143694.369773:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592261760:12345-192.168.202.48@tcp:3:cat.0 Request processed in 51060us (51734us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143694.369784:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3547 00002000:00100000:3.0:1746143694.369795:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880093f01500 x1830963592261760/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.369805:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01500 with x1830963592261760 ext(2097152->3145727) 00002000:00010000:3.0:1746143694.369810:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01500 00000100:00100000:0.0:1746143694.371382:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592262016:12345-192.168.202.48@tcp:3:cat.0 Request processed in 50632us (50713us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143694.371391:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3548 00002000:00100000:0.0:1746143694.371398:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880093f01180 x1830963592262016/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143694.371406:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01180 with x1830963592262016 ext(3145728->4194303) 00002000:00010000:0.0:1746143694.371410:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01180 00000100:00100000:0.0:1746143694.379836:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.379931:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.381973:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592262272 00000100:00100000:1.0:1746143694.381983:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592262272 00000100:00100000:1.0:1746143694.382027:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592262528 00000100:00100000:1.0:1746143694.382029:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592262528 00000100:00100000:1.0:1746143694.382048:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8280 00000100:00100000:1.0:1746143694.382054:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28432:x1830963592262272:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143694.382073:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.382089:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b30000/0xe984082ccd72599c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17f4 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.382253:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b30e00/0xe984082ccd7259a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382264:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b30e00/0xe984082ccd7259a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382273:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b30e00/0xe984082ccd7259a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382287:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31400/0xe984082ccd7259aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382292:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31400/0xe984082ccd7259aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382297:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31400/0xe984082ccd7259aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382463:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31a00/0xe984082ccd7259b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382470:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31a00/0xe984082ccd7259b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382476:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31a00/0xe984082ccd7259b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143694.382483:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143694.382544:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b30e00/0xe984082ccd7259a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382550:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b30e00/0xe984082ccd7259a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382556:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b30e00/0xe984082ccd7259a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382561:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093b30e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143694.382565:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b30e00/0xe984082ccd7259a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382570:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b30e00/0xe984082ccd7259a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382580:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143694.382582:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143694.382586:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b30e00/0xe984082ccd7259a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382590:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b30e00/0xe984082ccd7259a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382623:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31400/0xe984082ccd7259aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382628:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31400/0xe984082ccd7259aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382633:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31400/0xe984082ccd7259aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382637:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093b31400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143694.382639:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31400/0xe984082ccd7259aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382644:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31400/0xe984082ccd7259aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382649:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093484200) 00010000:00010000:1.0:1746143694.382652:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143694.382654:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31400/0xe984082ccd7259aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143694.382661:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31400/0xe984082ccd7259aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00000100:00100000:0.0:1746143694.382689:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8281 00010000:00010000:1.0:1746143694.382695:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b30000/0xe984082ccd72599c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17f4 expref: 246 pid: 14764 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143694.382697:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28433:x1830963592262528:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143694.382707:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31a00/0xe984082ccd7259b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17f4 expref: 245 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.382712:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.382713:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.382715:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143694.382717:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b31a00, rc 0) 00010000:00010000:0.0:1746143694.382719:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd16e00/0xe984082ccd7259bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a17fb expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143694.382759:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28432:x1830963592262272:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 704us (2930us total) trans 8589942380 rc 0/0 00000100:00100000:1.0:1746143694.382765:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8280 00010000:00010000:0.0:1746143694.382765:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17c00/0xe984082ccd7259c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143694.382772:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17c00/0xe984082ccd7259c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143694.382779:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17c00/0xe984082ccd7259c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143694.382786:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17e00/0xe984082ccd7259cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143694.382792:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17e00/0xe984082ccd7259cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143694.382797:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17e00/0xe984082ccd7259cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143694.382858:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd16800/0xe984082ccd7259d4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143694.382865:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd16800/0xe984082ccd7259d4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143694.382870:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd16800/0xe984082ccd7259d4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:0.0:1746143694.382878:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143694.384297:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17c00/0xe984082ccd7259c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384306:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17c00/0xe984082ccd7259c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384311:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17c00/0xe984082ccd7259c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384315:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd17c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143694.384317:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17c00/0xe984082ccd7259c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384321:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17c00/0xe984082ccd7259c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384330:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143694.384332:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143694.384335:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17c00/0xe984082ccd7259c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384342:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17c00/0xe984082ccd7259c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384350:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17e00/0xe984082ccd7259cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384355:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17e00/0xe984082ccd7259cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384359:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17e00/0xe984082ccd7259cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384363:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd17e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143694.384365:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17e00/0xe984082ccd7259cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384369:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17e00/0xe984082ccd7259cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384374:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800939cd600) 00010000:00010000:1.0:1746143694.384376:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143694.384377:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17e00/0xe984082ccd7259cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384382:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd17e00/0xe984082ccd7259cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.384410:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd16e00/0xe984082ccd7259bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17fb expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.384419:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd16800/0xe984082ccd7259d4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17fb expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.384428:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.384429:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143694.384431:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd16800, rc 0) 00000100:00100000:1.0:1746143694.385371:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28433:x1830963592262528:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2672us (5437us total) trans 8589942381 rc 0/0 00000100:00100000:1.0:1746143694.385379:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8281 00000100:00100000:0.0:1746143694.399821:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.399969:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592262656 00000100:00100000:2.0:1746143694.399979:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592262656 00000100:00100000:2.0:1746143694.400035:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9622 00000100:00100000:2.0:1746143694.400043:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1965:x1830963592262656:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143694.400064:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.400082:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7c00/0xe984082ccd7259e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1802 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.400105:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.400107:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.400117:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7c00/0xe984082ccd7259e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1802 expref: 10 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.400131:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7c00/0xe984082ccd7259e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1802 expref: 10 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.400173:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f7c00, rc 0) 00000100:00100000:2.0:1746143694.400220:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592262656:12345-192.168.202.48@tcp:101:cat.0 Request processed in 177us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.400226:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9622 00000100:00100000:0.0:1746143694.401681:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.401759:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592263040 00000100:00100000:2.0:1746143694.401765:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592263040 00002000:00100000:2.0:1746143694.401803:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009bef7b80 x1830963592263040/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.401813:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef7b80 with x1830963592263040 ext(2097152->3145727) 00002000:00010000:2.0:1746143694.401818:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef7b80 00000100:00100000:2.0:1746143694.401854:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3549 00000100:00100000:2.0:1746143694.401860:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592263040:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143694.418511:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.418612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.418628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.418656:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.418742:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592263552 00000100:00100000:3.0:1746143694.418749:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592263552 00002000:00100000:3.0:1746143694.418783:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88012e1e0000 x1830963592263552/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.418791:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0000 with x1830963592263552 ext(3145728->4194303) 00002000:00010000:3.0:1746143694.418796:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e1e0000 00000100:00100000:3.0:1746143694.418825:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592263168 00000100:00100000:3.0:1746143694.418828:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592263168 00002000:00100000:3.0:1746143694.418851:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88012e1e1500 x1830963592263168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.418858:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e1500 with x1830963592263168 ext(3145728->4194303) 00002000:00010000:3.0:1746143694.418861:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e1500 00000100:00100000:3.0:1746143694.418869:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592263424 00000100:00100000:3.0:1746143694.418871:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592263424 00002000:00100000:3.0:1746143694.418880:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012e1e1f80 x1830963592263424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.418887:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e1f80 with x1830963592263424 ext(2097152->3145727) 00002000:00010000:3.0:1746143694.418889:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e1e1f80 00000100:00100000:3.0:1746143694.418899:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3550 00000100:00100000:3.0:1746143694.418905:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592263552:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143694.419170:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3551 00000100:00100000:0.0:1746143694.419183:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592263168:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143694.419265:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3552 00000100:00100000:3.0:1746143694.419272:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963592263424:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143694.422394:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592263808 00000100:00100000:0.0:1746143694.422404:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592263808 00000100:00100000:0.0:1746143694.422457:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9623 00000100:00100000:0.0:1746143694.422463:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28433:x1830963592263808:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143694.422477:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143694.422492:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1809 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.422517:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093213200/0xe984082ccd725845 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1737 expref: 7 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143694.422524:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d8 expref: 18 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143694.422530:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff000/0xe984082ccd7258e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1776 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143694.422535:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143694.422545:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143694.422549:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2646016->2752511] (req 2646016->2752511) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 12 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.422574:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff000/0xe984082ccd7258e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1776 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143694.422584:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff000/0xe984082ccd7258e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1776 expref: 12 pid: 9527 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746143694.422863:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593740416:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143694.422931:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d8 expref: 18 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143694.422939:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d8 expref: 18 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746143694.422946:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593740544:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143694.422967:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093213200/0xe984082ccd725845 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1737 expref: 7 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143694.422974:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093213200/0xe984082ccd725845 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1737 expref: 7 pid: 6929 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746143694.422977:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.422981:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593740672:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143694.422997:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143694.423026:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592264064 00000100:00100000:1.0:1746143694.423029:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592264064 00002000:00100000:1.0:1746143694.423050:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094763b80 x1830963592264064/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.423059:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763b80 with x1830963592264064 ext(4194304->4898815) 00002000:00010000:1.0:1746143694.423062:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094763b80 00000100:00100000:1.0:1746143694.423072:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3553 00000100:00100000:1.0:1746143694.423077:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592264064:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143694.425358:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592263040:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23492us (23676us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143694.425368:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3549 00002000:00100000:3.0:1746143694.425377:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009bef7b80 x1830963592263040/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.425385:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef7b80 with x1830963592263040 ext(2097152->3145727) 00002000:00010000:3.0:1746143694.425390:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef7b80 00000100:00100000:0.0:1746143694.435491:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.435570:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.435674:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593740416:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143694.435684:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593740544:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143694.435692:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bef7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593740672:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.435721:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2646016->2752511] (req 2646016->2752511) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 12 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.435737:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd2c800, rc 0) 00000100:00100000:1.0:1746143694.435772:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28433:x1830963592263808:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 13308us (17114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.435779:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9623 00000100:00100000:1.0:1746143694.435817:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592264320 00000100:00100000:1.0:1746143694.435821:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592264320 00010000:00010000:1.0:1746143694.435851:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093213200/0xe984082ccd725845 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1737 expref: 8 pid: 6929 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746143694.435868:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592264192 00000100:00100000:1.0:1746143694.435870:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592264192 00010000:00010000:1.0:1746143694.435877:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff000/0xe984082ccd7258e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1776 expref: 12 pid: 9527 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746143694.435888:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4948 00000100:00100000:1.0:1746143694.435893:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963592264320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.435902:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.435917:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093213200/0xe984082ccd725845 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1737 expref: 8 pid: 6929 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.435925:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093213200/0xe984082ccd725845 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1737 expref: 8 pid: 6929 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.435941:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093213200/0xe984082ccd725845 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1737 expref: 8 pid: 6929 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.435958:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143694.436013:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4949 00000100:00100000:2.0:1746143694.436020:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592264192:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143694.436027:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143694.436040:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff000/0xe984082ccd7258e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1776 expref: 12 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.436048:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff000/0xe984082ccd7258e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1776 expref: 12 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.436059:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff000/0xe984082ccd7258e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1776 expref: 12 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.436070:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143694.436085:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592264192:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 66us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.436090:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4949 00000100:00100000:1.0:1746143694.436951:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963592264320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1055us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.436958:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4948 00000100:00100000:0.0:1746143694.445800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.445992:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592264448 00000100:00100000:1.0:1746143694.446003:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592264448 00000100:00100000:1.0:1746143694.448197:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9624 00000100:00100000:1.0:1746143694.448209:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28425:x1830963592264448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143694.448224:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.448240:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800952eb800/0xe984082ccd7259f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1810 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.448262:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.448267:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2646016->2752511] (req 2646016->2752511) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 10 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.448272:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143694.448275:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800952eb800/0xe984082ccd7259f0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1810 expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.448302:0:25369:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2646016->2752511] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 10 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.448312:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800952eb800/0xe984082ccd7259f0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1810 expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.448324:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952eb800, rc 0) 00000100:00100000:1.0:1746143694.448859:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28425:x1830963592264448:12345-192.168.202.48@tcp:101:cat.0 Request processed in 652us (3071us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.448860:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592263424:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29587us (30229us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143694.448865:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9624 00000100:00100000:2.0:1746143694.448869:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3552 00002000:00100000:2.0:1746143694.448877:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012e1e1f80 x1830963592263424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.448885:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e1f80 with x1830963592263424 ext(2097152->3145727) 00010000:00010000:2.0:1746143694.448890:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d8 expref: 20 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.448900:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d8 expref: 20 pid: 15784 timeout: 873 lvb_type: 1 00002000:00010000:2.0:1746143694.448905:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e1e1f80 00000100:00100000:1.0:1746143694.449218:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592264064:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26141us (26241us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143694.449224:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3553 00002000:00100000:1.0:1746143694.449229:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094763b80 x1830963592264064/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.449235:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763b80 with x1830963592264064 ext(4194304->4898815) 00002000:00010000:1.0:1746143694.449239:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094763b80 00000100:00100000:3.0:1746143694.454362:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592263552:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35449us (35849us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143694.454373:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3550 00002000:00100000:3.0:1746143694.454383:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88012e1e0000 x1830963592263552/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.454392:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0000 with x1830963592263552 ext(3145728->4194303) 00010000:00010000:3.0:1746143694.454401:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d8 expref: 18 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.454414:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d8 expref: 18 pid: 15784 timeout: 873 lvb_type: 1 00002000:00010000:3.0:1746143694.454421:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e1e0000 00000100:00100000:0.0:1746143694.469660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.470623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.470799:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592264704 00000100:00100000:2.0:1746143694.471045:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592264704 00000100:00100000:2.0:1746143694.471099:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9625 00000100:00100000:2.0:1746143694.471107:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592264704:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143694.471127:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.471179:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6400/0xe984082ccd7259f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a181e expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.471202:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.471211:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6400/0xe984082ccd7259f7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a181e expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.471219:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6400/0xe984082ccd7259f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a181e expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.471233:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f6400, rc 0) 00000100:00100000:2.0:1746143694.471295:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592264704:12345-192.168.202.48@tcp:101:cat.0 Request processed in 189us (676us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143694.471414:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9625 00000100:00100000:1.0:1746143694.471521:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592264576 00000100:00100000:1.0:1746143694.471531:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592264576 00000100:00100000:1.0:1746143694.471574:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8282 00000100:00100000:1.0:1746143694.471581:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:28434:x1830963592264576:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143694.471603:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.471618:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2c000/0xe984082ccd7259fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1817 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.471674:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d400/0xe984082ccd725a05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471686:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d400/0xe984082ccd725a05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471697:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d400/0xe984082ccd725a05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471709:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd725a0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471713:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd725a0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471718:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd725a0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471824:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2da00/0xe984082ccd725a13 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471832:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2da00/0xe984082ccd725a13 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471868:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2da00/0xe984082ccd725a13 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143694.471896:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:1.0:1746143694.471900:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143694.471913:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2da00/0xe984082ccd725a13 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471920:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2da00/0xe984082ccd725a13 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471926:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d400/0xe984082ccd725a05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471931:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d400/0xe984082ccd725a05 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471937:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d400/0xe984082ccd725a05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471946:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bd2d400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143694.471949:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d400/0xe984082ccd725a05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471955:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d400/0xe984082ccd725a05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471963:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143694.471965:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143694.471969:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d400/0xe984082ccd725a05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.471973:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d400/0xe984082ccd725a05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.472016:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd725a0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.472021:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd725a0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.472025:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd725a0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.472029:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bd2d200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143694.472032:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd725a0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.472036:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd725a0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.472042:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093484a00) 00010000:00010000:1.0:1746143694.472044:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143694.472047:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd725a0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.472051:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2d200/0xe984082ccd725a0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143694.472076:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2c000/0xe984082ccd7259fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1817 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.472086:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2da00/0xe984082ccd725a13 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1817 expref: 7 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.472092:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.472094:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143694.472096:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd2da00, rc 0) 00000100:00100000:1.0:1746143694.472133:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28434:x1830963592264576:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 554us (2486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.472160:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8282 00000100:00100000:3.0:1746143694.473018:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592263168:12345-192.168.202.48@tcp:3:cat.0 Request processed in 53835us (54402us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143694.473027:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3551 00002000:00100000:3.0:1746143694.473036:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88012e1e1500 x1830963592263168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.473045:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e1500 with x1830963592263168 ext(3145728->4194303) 00002000:00010000:3.0:1746143694.473049:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e1500 00000100:00100000:0.0:1746143694.475030:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.476067:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592264832 00000100:00100000:1.0:1746143694.476077:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592264832 00010000:00010000:1.0:1746143694.476117:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d8 expref: 18 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746143694.476173:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4950 00000100:00100000:1.0:1746143694.476180:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963592264832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.476194:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.476217:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d8 expref: 18 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.476232:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d8 expref: 18 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.476253:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094677c00/0xe984082ccd725979 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17d8 expref: 18 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.476267:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.476269:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.476276:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 10 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.476285:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 10 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.476321:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 10 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.476331:0:7151:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 10 pid: 25369 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.476342:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593740928:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143694.476433:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143694.479282:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.479305:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.479869:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592264960 00000100:00100000:3.0:1746143694.479879:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592264960 00000100:00100000:3.0:1746143694.479922:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592265088 00000100:00100000:3.0:1746143694.479924:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592265088 00000100:00100000:3.0:1746143694.479944:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9626 00000100:00100000:3.0:1746143694.479951:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592264960:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143694.479966:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.479981:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009518b200/0xe984082ccd725a1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1825 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.480000:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.480002:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.480009:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009518b200/0xe984082ccd725a1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1825 expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.480023:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009518b200/0xe984082ccd725a1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1825 expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.480032:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009518b200, rc 0) 00000100:00100000:3.0:1746143694.480080:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592264960:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 129us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.480086:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9626 00000100:00100000:3.0:1746143694.480100:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9627 00000100:00100000:3.0:1746143694.480105:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1962:x1830963592265088:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143694.480112:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.480121:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009518bc00/0xe984082ccd725a21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a182c expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.480131:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.480133:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.480170:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009518bc00/0xe984082ccd725a21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a182c expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.480180:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009518bc00/0xe984082ccd725a21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a182c expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.480186:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009518bc00, rc 0) 00000100:00100000:3.0:1746143694.480201:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592265088:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 95us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.480205:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9627 00000100:00100000:1.0:1746143694.481057:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.481120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.481182:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593740928:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143694.481203:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.481232:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963592264832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5052us (6211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.481241:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4950 00000100:00100000:1.0:1746143694.481302:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592265472 00000100:00100000:1.0:1746143694.481307:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592265472 00002000:00100000:1.0:1746143694.481340:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2646016->2650111) req@ffff88008f1ed880 x1830963592265472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.481348:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ed880 with x1830963592265472 ext(2646016->2650111) 00010000:00010000:1.0:1746143694.481355:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 11 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.481366:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 11 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:1.0:1746143694.481371:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1ed880 00000100:00100000:1.0:1746143694.481385:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 860 00000100:00100000:1.0:1746143694.481390:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592265472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143694.481543:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592265472:12345-192.168.202.48@tcp:3:cat.0 Request processed in 153us (422us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143694.481549:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 860 00002000:00100000:1.0:1746143694.481553:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2646016->2650111) req@ffff88008f1ed880 x1830963592265472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/4536 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.481559:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ed880 with x1830963592265472 ext(2646016->2650111) 00010000:00010000:1.0:1746143694.481564:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 11 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.481572:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 11 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:1.0:1746143694.481578:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1ed880 00000100:00100000:3.0:1746143694.481605:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592265216 00000100:00100000:3.0:1746143694.481610:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592265216 00000100:00100000:3.0:1746143694.481636:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9628 00000100:00100000:3.0:1746143694.481642:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592265216:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143694.481650:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.481658:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009518b600/0xe984082ccd725a28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1833 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143694.481689:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593741056:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143694.481736:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3889c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143694.485898:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.485988:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592265728 00000100:00100000:3.0:1746143694.485998:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592265728 00000100:00100000:3.0:1746143694.486055:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3368 00000100:00100000:3.0:1746143694.486062:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28426:x1830963592265728:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143694.486282:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28426:x1830963592265728:12345-192.168.202.48@tcp:35:cat.0 Request processed in 219us (393us total) trans 8589942382 rc 0/0 00000100:00100000:3.0:1746143694.486291:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3368 00002000:00010000:3.0:1746143694.486387:0:21542:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime: 1746143691 -> 1746143693 00002000:00010000:3.0:1746143694.486390:0:21542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143691 -> 1746143694 00002000:00010000:3.0:1746143694.486391:0:21542:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime: 1746143691 -> 1746143693 00000100:00100000:3.0:1746143694.486406:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593741056:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143694.486428:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009518b600/0xe984082ccd725a28 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1833 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.486439:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009518b600/0xe984082ccd725a28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1833 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.486447:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009518b600, rc 0) 00000100:00100000:3.0:1746143694.486469:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592265216:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4827us (5416us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143694.486474:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9628 00000100:00100000:0.0:1746143694.487960:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.488551:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592265984 00000100:00100000:1.0:1746143694.488561:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592265984 00002000:00100000:1.0:1746143694.488609:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2748416->2752511) req@ffff8801305c9c00 x1830963592265984/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.488619:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9c00 with x1830963592265984 ext(2748416->2752511) 00010000:00010000:1.0:1746143694.488629:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 11 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.488641:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 11 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:1.0:1746143694.488648:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305c9c00 00000100:00100000:1.0:1746143694.488677:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 861 00000100:00100000:1.0:1746143694.488684:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592265984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143694.489880:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592265984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 1191us (1921us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143694.489889:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 861 00002000:00100000:1.0:1746143694.489897:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2748416->2752511) req@ffff8801305c9c00 x1830963592265984/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/4536 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.489910:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9c00 with x1830963592265984 ext(2748416->2752511) 00010000:00010000:1.0:1746143694.489917:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 11 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.489928:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 11 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:1.0:1746143694.489934:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305c9c00 00000100:00100000:2.0:1746143694.492936:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.493823:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592266240 00000100:00100000:1.0:1746143694.493834:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592266240 00000100:00100000:1.0:1746143694.493897:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8283 00000100:00100000:1.0:1746143694.493906:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28434:x1830963592266240:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143694.493930:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.493947:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dee00/0xe984082ccd725a2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a183a expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.494042:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.494056:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31a00/0xe984082ccd7259b1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17f4 expref: 244 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.494064:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd16800/0xe984082ccd7259d4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17fb expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.494071:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2da00/0xe984082ccd725a13 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1817 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.494082:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.494114:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2da00/0xe984082ccd725a13 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1817 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.494124:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2da00/0xe984082ccd725a13 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1817 expref: 8 pid: 16090 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.494135:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593741184:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143694.495025:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.495114:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.495597:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592266496 00000100:00100000:0.0:1746143694.495602:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592266496 00002000:00100000:0.0:1746143694.495635:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2646016->2752511) req@ffff8800935a0380 x1830963592266496/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143694.495643:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0380 with x1830963592266496 ext(2646016->2752511) 00010000:00010000:0.0:1746143694.495651:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 11 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746143694.495661:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 11 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746143694.495667:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935a0380 00000100:00100000:0.0:1746143694.495681:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 862 00000100:00100000:0.0:1746143694.495685:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592266496:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143694.496350:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592266752 00000100:00100000:2.0:1746143694.496355:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592266752 00000100:00100000:2.0:1746143694.496381:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3369 00000100:00100000:2.0:1746143694.496387:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28433:x1830963592266752:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143694.496626:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28433:x1830963592266752:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 238us (1509us total) trans 8589942383 rc 0/0 00000100:00100000:2.0:1746143694.496632:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3369 00010000:00010000:1.0:1746143694.496710:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd16800/0xe984082ccd7259d4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17fb expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.496720:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd16800/0xe984082ccd7259d4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17fb expref: 11 pid: 16090 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.496731:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593741312:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.497485:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31a00/0xe984082ccd7259b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17f4 expref: 244 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.497494:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31a00/0xe984082ccd7259b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17f4 expref: 244 pid: 14764 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.497503:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593741440:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143694.498893:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143694.499219:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593741184:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143694.499228:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593741312:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143694.505656:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592266496:12345-192.168.202.48@tcp:4:cat.0 Request processed in 9954us (10616us total) trans 21474839728 rc 0/0 00000100:00100000:0.0:1746143694.505671:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 862 00002000:00100000:0.0:1746143694.505688:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2646016->2752511) req@ffff8800935a0380 x1830963592266496/t21474839728(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/448 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143694.505697:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0380 with x1830963592266496 ext(2646016->2752511) 00010000:00010000:0.0:1746143694.505709:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 13 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746143694.505723:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 13 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746143694.505731:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935a0380 00000100:00100000:2.0:1746143694.505877:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.505994:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.506726:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.507868:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593741440:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.507908:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143694.510181:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592266880 00000100:00100000:0.0:1746143694.510195:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592266880 00000100:00100000:2.0:1746143694.510309:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.510327:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592267008 00000100:00100000:2.0:1746143694.510331:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592267008 00010000:00010000:2.0:1746143694.510366:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd16800/0xe984082ccd7259d4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17fb expref: 12 pid: 16090 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746143694.510390:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592267136 00000100:00100000:2.0:1746143694.510392:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592267136 00010000:00010000:2.0:1746143694.510402:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31a00/0xe984082ccd7259b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17f4 expref: 245 pid: 14764 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746143694.510411:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592267264 00000100:00100000:2.0:1746143694.510413:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592267264 00010000:00010000:2.0:1746143694.510422:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 13 pid: 25369 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746143694.510432:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4951 00000100:00100000:2.0:1746143694.510437:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592267008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143694.510451:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143694.510456:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd16800/0xe984082ccd7259d4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17fb expref: 12 pid: 16090 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.510466:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd16800/0xe984082ccd7259d4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17fb expref: 12 pid: 16090 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.510486:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd16800/0xe984082ccd7259d4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17fb expref: 12 pid: 16090 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.510499:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143694.510504:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.510512:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.510517:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143694.510560:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592267008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 122us (4565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.510566:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4951 00000100:00100000:2.0:1746143694.510581:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4952 00000100:00100000:2.0:1746143694.510586:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:1962:x1830963592267136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143694.510593:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143694.510597:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31a00/0xe984082ccd7259b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17f4 expref: 245 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.510604:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31a00/0xe984082ccd7259b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17f4 expref: 245 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.510614:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31a00/0xe984082ccd7259b1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17f4 expref: 245 pid: 14764 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.510634:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143694.510636:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.510641:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.510645:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143694.510657:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:1962:x1830963592267136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 72us (3933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.510662:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4952 00000100:00100000:2.0:1746143694.510670:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4953 00000100:00100000:2.0:1746143694.510674:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592267264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143694.510680:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143694.510699:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143693 -> 1746143694 00002000:00010000:2.0:1746143694.510702:0:7150:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143693 -> 1746143694 00010000:00010000:2.0:1746143694.510707:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 13 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.510715:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 13 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.510728:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c800/0xe984082ccd7259e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->2752511) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1809 expref: 13 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.510738:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.510740:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.510746:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800952eb800/0xe984082ccd7259f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1810 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.510753:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800952eb800/0xe984082ccd7259f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1810 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.510783:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800952eb800/0xe984082ccd7259f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1810 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143694.510800:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593741568:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143694.510856:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7833c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143694.511071:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2da00/0xe984082ccd725a13 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1817 expref: 9 pid: 16090 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.511086:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4954 00000100:00100000:1.0:1746143694.511092:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592266880:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.511098:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.511101:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2da00/0xe984082ccd725a13 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1817 expref: 9 pid: 16090 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.511109:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2da00/0xe984082ccd725a13 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1817 expref: 9 pid: 16090 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.511119:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd2da00/0xe984082ccd725a13 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1817 expref: 9 pid: 16090 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.511132:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.511135:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.511156:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.511161:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.511177:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.511205:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592266880:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 112us (5328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.511210:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4954 00010000:00010000:1.0:1746143694.511259:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.511266:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143694.511285:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143694.511415:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dee00/0xe984082ccd725a2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a183a expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.511430:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a183a expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.511435:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.511438:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143694.511439:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6dfc00, rc 0) 00000100:00100000:1.0:1746143694.511462:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28434:x1830963592266240:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 17558us (18539us total) trans 8589942384 rc 0/0 00000100:00100000:1.0:1746143694.511468:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8283 00000100:00100000:0.0:1746143694.525858:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.525934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.525962:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592267648 00000100:00100000:0.0:1746143694.525971:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592267648 00002000:00100000:0.0:1746143694.526019:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800935a1f80 x1830963592267648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143694.526030:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a1f80 with x1830963592267648 ext(2097152->3145727) 00002000:00010000:0.0:1746143694.526035:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a1f80 00000100:00100000:0.0:1746143694.526054:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3554 00000100:00100000:0.0:1746143694.526062:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963592267648:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143694.528550:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593741568:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143694.528574:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143694.528609:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592267264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 17932us (18303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.528620:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4953 00000100:00100000:1.0:1746143694.528756:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592267392 00000100:00100000:1.0:1746143694.528763:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592267392 00000100:00100000:1.0:1746143694.528794:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8284 00000100:00100000:1.0:1746143694.528800:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28434:x1830963592267392:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143694.528823:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.528853:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211200/0xe984082ccd725a44 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1841 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.528932:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.528945:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a183a expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.528952:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.528980:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a183a expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.528990:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a183a expref: 9 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.529002:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593741696:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143694.529060:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143694.531224:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.531341:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592267904 00000100:00100000:1.0:1746143694.531348:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592267904 00002000:00100000:1.0:1746143694.531392:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800935a2d80 x1830963592267904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.531402:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a2d80 with x1830963592267904 ext(3145728->4194303) 00002000:00010000:1.0:1746143694.531408:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a2d80 00000100:00100000:1.0:1746143694.531429:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3555 00000100:00100000:1.0:1746143694.531436:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592267904:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143694.537477:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592267648:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11401us (11528us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143694.537491:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3554 00002000:00100000:2.0:1746143694.537503:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800935a1f80 x1830963592267648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.537512:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a1f80 with x1830963592267648 ext(2097152->3145727) 00002000:00010000:2.0:1746143694.537518:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a1f80 00000100:00100000:1.0:1746143694.537619:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593741696:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.537646:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143694.543682:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.543767:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592268032 00000100:00100000:2.0:1746143694.543777:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592268032 00010000:00010000:2.0:1746143694.543817:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a183a expref: 10 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746143694.543859:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4955 00000100:00100000:2.0:1746143694.543866:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963592268032:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143694.543879:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143694.543885:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a183a expref: 10 pid: 21713 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.543897:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a183a expref: 10 pid: 21713 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.543917:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dfc00/0xe984082ccd725a36 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a183a expref: 10 pid: 21713 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.543946:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143694.543950:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.543958:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.543964:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.543981:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143694.544019:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592268032:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 153us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143694.544024:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4955 00010000:00010000:1.0:1746143694.544088:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.544095:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143694.544159:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:1.0:1746143694.544163:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143694.544178:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.544204:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211200/0xe984082ccd725a44 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1841 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.544221:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1841 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.544226:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.544228:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143694.544231:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2210e00, rc 0) 00000100:00100000:1.0:1746143694.544265:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28434:x1830963592267392:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 15464us (18426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.544271:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8284 00000100:00100000:1.0:1746143694.546474:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963592267904:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15027us (15248us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143694.546485:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3555 00002000:00100000:1.0:1746143694.546495:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800935a2d80 x1830963592267904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.546504:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a2d80 with x1830963592267904 ext(3145728->4194303) 00002000:00010000:1.0:1746143694.546510:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a2d80 00000100:00100000:0.0:1746143694.550365:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.552052:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592268160 00000100:00100000:3.0:1746143694.552065:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592268160 00000100:00100000:3.0:1746143694.552128:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9629 00000100:00100000:3.0:1746143694.552136:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592268160:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143694.552167:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.552185:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093b30a00/0xe984082ccd725a52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1848 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.552209:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.552211:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.552220:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093b30a00/0xe984082ccd725a52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1848 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.552236:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093b30a00/0xe984082ccd725a52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1848 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.552247:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b30a00, rc 0) 00000100:00100000:3.0:1746143694.552307:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592268160:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 172us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.552313:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9629 00000100:00100000:0.0:1746143694.555286:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.555364:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592268416 00000100:00100000:1.0:1746143694.555373:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592268416 00000100:00100000:2.0:1746143694.556905:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8285 00000100:00100000:2.0:1746143694.556918:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28434:x1830963592268416:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143694.556941:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.556961:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1800/0xe984082ccd725a59 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a184f expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.557054:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0800/0xe984082ccd725a60 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143694.557070:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0800/0xe984082ccd725a60 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143694.557080:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0800/0xe984082ccd725a60 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143694.557089:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0800/0xe984082ccd725a60 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143694.557095:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0800/0xe984082ccd725a60 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143694.557100:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0800/0xe984082ccd725a60 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143694.557105:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d0800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143694.557109:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0800/0xe984082ccd725a60 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143694.557115:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0800/0xe984082ccd725a60 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143694.557134:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143694.557137:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143694.557155:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0800/0xe984082ccd725a60 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143694.557160:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0800/0xe984082ccd725a60 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143694.557192:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1800/0xe984082ccd725a59 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a184f expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.557202:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1800/0xe984082ccd725a59 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a184f expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.557209:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d1800, rc 0) 00000100:00100000:2.0:1746143694.557260:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28434:x1830963592268416:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 346us (1984us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143694.557266:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8285 00000100:00100000:0.0:1746143694.560694:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.560747:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.560758:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592268672 00000100:00100000:3.0:1746143694.560771:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592268672 00000100:00100000:2.0:1746143694.560812:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592268800 00000100:00100000:2.0:1746143694.560818:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592268800 00000100:00100000:3.0:1746143694.560819:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3370 00000100:00100000:3.0:1746143694.560826:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28434:x1830963592268672:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1746143694.560860:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9630 00000100:00100000:2.0:1746143694.560866:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:28432:x1830963592268800:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143694.560880:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.560897:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1856 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.560923:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd800/0xe984082ccd725837 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a171b expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.560931:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095114600/0xe984082ccd725964 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17b5 expref: 18 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.560938:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe600/0xe984082ccd7258d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a175a expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.560943:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.560946:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.560949:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [1482752->2097151] (req 1482752->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.560978:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe600/0xe984082ccd7258d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a175a expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.560990:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe600/0xe984082ccd7258d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a175a expref: 11 pid: 8495 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746143694.561003:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593741824:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143694.561049:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28434:x1830963592268672:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 222us (365us total) trans 8589942385 rc 0/0 00000100:00100000:3.0:1746143694.561056:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3370 00010000:00010000:2.0:1746143694.561081:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095114600/0xe984082ccd725964 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17b5 expref: 18 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.561088:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095114600/0xe984082ccd725964 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17b5 expref: 18 pid: 21542 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746143694.561099:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593741952:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143694.561119:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd800/0xe984082ccd725837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a171b expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.561367:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd800/0xe984082ccd725837 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a171b expref: 8 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746143694.561376:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593742080:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143694.561417:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7833c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143694.566435:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593741824:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143694.567319:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593741952:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143694.567330:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593742080:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.567365:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [1482752->2097151] (req 1482752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.567385:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d0a00, rc 0) 00000100:00100000:1.0:1746143694.567430:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:28432:x1830963592268800:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6563us (6681us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.567439:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9630 00000100:00100000:0.0:1746143694.569625:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.569846:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592268928 00000100:00100000:1.0:1746143694.569855:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592268928 00010000:00010000:1.0:1746143694.569893:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe600/0xe984082ccd7258d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a175a expref: 12 pid: 8495 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746143694.570131:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4956 00000100:00100000:1.0:1746143694.570172:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592268928:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.570187:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.570211:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe600/0xe984082ccd7258d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a175a expref: 12 pid: 8495 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.570228:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe600/0xe984082ccd7258d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a175a expref: 12 pid: 8495 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.570251:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe600/0xe984082ccd7258d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a175a expref: 12 pid: 8495 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746143694.570412:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.570438:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143694.570483:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.570525:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592268928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 386us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.570532:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4956 00000100:00100000:1.0:1746143694.570558:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592269312 00000100:00100000:1.0:1746143694.570560:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592269312 00010000:00010000:1.0:1746143694.570570:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd800/0xe984082ccd725837 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a171b expref: 9 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746143694.571123:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4957 00000100:00100000:1.0:1746143694.571130:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592269312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.571423:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.571439:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd800/0xe984082ccd725837 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a171b expref: 9 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.571448:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd800/0xe984082ccd725837 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a171b expref: 9 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.571465:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06cd800/0xe984082ccd725837 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a171b expref: 9 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.571475:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.571497:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592269312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 368us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.571502:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4957 00000100:00100000:1.0:1746143694.571528:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592269184 00000100:00100000:1.0:1746143694.571532:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592269184 00002000:00100000:1.0:1746143694.571562:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88012b7ced80 x1830963592269184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.571571:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ced80 with x1830963592269184 ext(4194304->4898815) 00002000:00010000:1.0:1746143694.571575:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7ced80 00000100:00100000:1.0:1746143694.572414:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3556 00000100:00100000:1.0:1746143694.572423:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592269184:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143694.574375:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.574732:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592269440 00000100:00100000:3.0:1746143694.574741:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592269440 00010000:00010000:3.0:1746143694.574777:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095114600/0xe984082ccd725964 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17b5 expref: 18 pid: 21542 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746143694.574817:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4958 00000100:00100000:3.0:1746143694.574824:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963592269440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143694.574848:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143694.574871:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095114600/0xe984082ccd725964 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17b5 expref: 18 pid: 21542 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.574884:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095114600/0xe984082ccd725964 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17b5 expref: 18 pid: 21542 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.574907:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095114600/0xe984082ccd725964 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17b5 expref: 18 pid: 21542 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.574935:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.574937:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.574945:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.574954:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.574991:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143694.575004:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593742208:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143694.575080:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949cb840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143694.581813:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.582223:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592269696 00000100:00100000:0.0:1746143694.582232:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592269696 00002000:00100000:0.0:1746143694.582278:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1482752->1486847) req@ffff8800930c0e00 x1830963592269696/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143694.582485:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593742208:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143694.582509:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143694.582555:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963592269440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7730us (8188us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.582565:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4958 00002000:00100000:0.0:1746143694.582681:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0e00 with x1830963592269696 ext(1482752->1486847) 00002000:00010000:0.0:1746143694.582686:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930c0e00 00000100:00100000:0.0:1746143694.582712:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3557 00000100:00100000:0.0:1746143694.582719:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963592269696:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143694.582891:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963592269696:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 173us (1089us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143694.582897:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3557 00002000:00100000:0.0:1746143694.582902:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1482752->1486847) req@ffff8800930c0e00 x1830963592269696/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/4536 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143694.582909:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0e00 with x1830963592269696 ext(1482752->1486847) 00002000:00010000:0.0:1746143694.582912:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930c0e00 00000100:00100000:1.0:1746143694.583688:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592269184:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 11264us (13273us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143694.583695:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3556 00002000:00100000:1.0:1746143694.583701:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88012b7ced80 x1830963592269184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 704512/704512 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.583708:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ced80 with x1830963592269184 ext(4194304->4898815) 00002000:00010000:1.0:1746143694.583712:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7ced80 00010000:00010000:3.0:1746143694.589385:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143694.593218:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.593314:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.593410:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592269824 00000100:00100000:1.0:1746143694.593420:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592269824 00000100:00100000:2.0:1746143694.594161:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592270080 00000100:00100000:2.0:1746143694.594166:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592270080 00000100:00100000:1.0:1746143694.594540:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9631 00000100:00100000:1.0:1746143694.594550:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:28432:x1830963592269824:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143694.594573:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.594590:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a185d expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.594617:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd72598e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17e6 expref: 10 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.594625:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009518bc00/0xe984082ccd725a21 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a182c expref: 7 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.594631:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd725995 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ed expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.594636:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.594638:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.594641:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [1048576->1236991] (req 1048576->1236991) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.594667:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd725995 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ed expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.594678:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd725995 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ed expref: 18 pid: 9527 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.594688:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593742336:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.594767:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009518bc00/0xe984082ccd725a21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a182c expref: 7 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.594778:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009518bc00/0xe984082ccd725a21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a182c expref: 7 pid: 9527 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746143694.594785:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593742464:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.594803:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd72598e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17e6 expref: 10 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.594810:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd72598e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17e6 expref: 10 pid: 9527 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.594816:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593742592:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143694.594827:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143694.594936:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3371 00000100:00100000:2.0:1746143694.594943:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28425:x1830963592270080:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143694.595134:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28425:x1830963592270080:12345-192.168.202.48@tcp:35:cat.0 Request processed in 192us (1819us total) trans 8589942386 rc 0/0 00000100:00100000:2.0:1746143694.595157:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3371 00000100:00100000:0.0:1746143694.599287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.600372:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.600402:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592270208 00000100:00100000:0.0:1746143694.600408:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592270208 00010000:00010000:0.0:1746143694.600446:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009518bc00/0xe984082ccd725a21 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a182c expref: 8 pid: 9527 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746143694.600470:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592270336 00000100:00100000:0.0:1746143694.600472:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592270336 00010000:00010000:0.0:1746143694.600481:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd725995 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ed expref: 19 pid: 9527 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746143694.600516:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4959 00000100:00100000:0.0:1746143694.600523:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592270208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143694.600538:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143694.600564:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009518bc00/0xe984082ccd725a21 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a182c expref: 8 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746143694.600574:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009518bc00/0xe984082ccd725a21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a182c expref: 8 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746143694.600600:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143694.600641:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592270208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 118us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143694.600647:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4959 00000100:00100000:0.0:1746143694.600663:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4960 00000100:00100000:0.0:1746143694.600667:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963592270336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143694.600673:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143694.600680:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd725995 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ed expref: 19 pid: 9527 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746143694.600689:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd725995 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ed expref: 19 pid: 9527 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746143694.600700:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143694.600713:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963592270336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 46us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143694.600720:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4960 00000100:00100000:0.0:1746143694.600792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.600808:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592270464 00000100:00100000:0.0:1746143694.600811:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592270464 00010000:00010000:0.0:1746143694.600823:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd72598e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17e6 expref: 11 pid: 9527 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746143694.600851:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4961 00000100:00100000:0.0:1746143694.600856:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592270464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143694.600862:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143694.600870:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd72598e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17e6 expref: 11 pid: 9527 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746143694.600879:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd72598e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17e6 expref: 11 pid: 9527 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746143694.600891:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143694.600893:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143694.600901:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.600910:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.600941:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143694.600959:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593742720:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143694.601009:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0730c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143694.601179:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd725995 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ed expref: 18 pid: 9527 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.602582:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593742336:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.602614:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009518bc00/0xe984082ccd725a21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a182c expref: 7 pid: 9527 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746143694.602627:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593742464:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.602638:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6e00/0xe984082ccd72598e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17e6 expref: 11 pid: 9527 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.602650:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593742592:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.602680:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.602692:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2210a00, rc 0) 00000100:00100000:1.0:1746143694.602748:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:28432:x1830963592269824:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8198us (9539us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.602755:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9631 00000100:00100000:1.0:1746143694.604834:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593742720:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143694.604864:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.604913:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592270464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4055us (4120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.604924:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4961 00000100:00100000:0.0:1746143694.612660:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.614594:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.614738:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592270976 00000100:00100000:0.0:1746143694.614749:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592270976 00002000:00100000:0.0:1746143694.614796:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1232896->1236991) req@ffff88012b7cca80 x1830963592270976/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143694.614806:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cca80 with x1830963592270976 ext(1232896->1236991) 00002000:00010000:0.0:1746143694.614811:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cca80 00000100:00100000:1.0:1746143694.614991:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592270848 00000100:00100000:1.0:1746143694.614997:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592270848 00000100:00100000:1.0:1746143694.615296:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8286 00000100:00100000:1.0:1746143694.615307:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28441:x1830963592270848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143694.615336:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.615357:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211200/0xe984082ccd725a75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1864 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.615469:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd725a7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615482:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd725a7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615494:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd725a7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615506:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725a83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615511:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725a83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615515:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725a83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615627:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210400/0xe984082ccd725a8a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615635:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210400/0xe984082ccd725a8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615640:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210400/0xe984082ccd725a8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143694.615648:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143694.615730:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd725a7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615737:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd725a7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615743:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd725a7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615748:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a2210200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143694.615752:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd725a7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615758:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd725a7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615768:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143694.615771:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143694.615775:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd725a7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.615779:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210200/0xe984082ccd725a7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143694.615861:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3558 00000100:00100000:0.0:1746143694.615868:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963592270976:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143694.616615:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963592270976:12345-192.168.202.48@tcp:3:cat.0 Request processed in 743us (2027us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143694.616622:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3558 00002000:00100000:0.0:1746143694.616630:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1232896->1236991) req@ffff88012b7cca80 x1830963592270976/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/4536 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143694.616638:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cca80 with x1830963592270976 ext(1232896->1236991) 00002000:00010000:0.0:1746143694.616642:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cca80 00010000:00010000:1.0:1746143694.617556:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725a83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.617565:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725a83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.617571:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725a83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.617575:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a2211800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143694.617577:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725a83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.617583:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725a83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.617595:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093484500) 00010000:00010000:1.0:1746143694.617598:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143694.617600:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725a83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.617604:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725a83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.617673:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211200/0xe984082ccd725a75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1864 expref: 14 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.617686:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210400/0xe984082ccd725a8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1864 expref: 13 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.617693:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.617695:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143694.617697:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2210400, rc 0) 00000100:00100000:1.0:1746143694.618459:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28441:x1830963592270848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3151us (5808us total) trans 8589942387 rc 0/0 00000100:00100000:1.0:1746143694.618467:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8286 00000100:00100000:0.0:1746143694.620674:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.621697:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.621714:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.621754:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.621848:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592271104 00000100:00100000:2.0:1746143694.621859:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592271104 00000100:00100000:2.0:1746143694.621904:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592271616 00000100:00100000:2.0:1746143694.621906:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592271616 00000100:00100000:2.0:1746143694.621924:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592271360 00000100:00100000:2.0:1746143694.621926:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592271360 00000100:00100000:2.0:1746143694.621942:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9632 00000100:00100000:2.0:1746143694.621949:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592271104:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143694.621969:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.621989:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d0400/0xe984082ccd725a98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a186b expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143694.622046:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593742848:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143694.622123:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143694.622262:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9633 00000100:00100000:1.0:1746143694.622270:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592271616:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143694.622278:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.622286:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2210600/0xe984082ccd725a9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1879 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.622298:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.622300:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.622308:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2210600/0xe984082ccd725a9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1879 expref: 14 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.622323:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2210600/0xe984082ccd725a9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1879 expref: 14 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.622338:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2210600, rc 0) 00000100:00100000:1.0:1746143694.622363:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592271616:12345-192.168.202.48@tcp:101:cat.0 Request processed in 95us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.622369:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9633 00000100:00100000:1.0:1746143694.622383:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9634 00000100:00100000:1.0:1746143694.622387:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592271360:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143694.622392:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.622398:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725aa6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1872 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143694.622424:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593742976:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143694.622448:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143694.622541:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592271488 00000100:00100000:3.0:1746143694.622546:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592271488 00000100:00100000:3.0:1746143694.622573:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3372 00000100:00100000:3.0:1746143694.622577:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28432:x1830963592271488:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143694.622776:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:28432:x1830963592271488:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 197us (2111us total) trans 8589942388 rc 0/0 00000100:00100000:3.0:1746143694.622781:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3372 00002000:00010000:2.0:1746143694.624674:0:4582:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime: 1746143691 -> 1746143694 00002000:00010000:2.0:1746143694.624679:0:4582:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143691 -> 1746143694 00002000:00010000:2.0:1746143694.624681:0:4582:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime: 1746143691 -> 1746143694 00000100:00100000:2.0:1746143694.624704:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593742848:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143694.624734:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932d0400/0xe984082ccd725a98 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a186b expref: 14 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.624747:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d0400/0xe984082ccd725a98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a186b expref: 14 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143694.624760:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d0400, rc 0) 00000100:00100000:2.0:1746143694.624794:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592271104:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2845us (3100us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143694.624800:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9632 00002000:00010000:1.0:1746143694.624890:0:25369:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime: 1746143693 -> 1746143694 00002000:00010000:1.0:1746143694.624893:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime: 1746143691 -> 1746143694 00002000:00010000:1.0:1746143694.624895:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime: 1746143693 -> 1746143694 00000100:00100000:1.0:1746143694.624904:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593742976:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143694.624921:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725aa6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1872 expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.624928:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725aa6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1872 expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.624936:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2210800, rc 0) 00000100:00100000:1.0:1746143694.624953:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592271360:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2565us (3198us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143694.624959:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9634 00000100:00100000:0.0:1746143694.629789:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.629889:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592271872 00000100:00100000:2.0:1746143694.629899:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592271872 00002000:00100000:2.0:1746143694.629948:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88012b7cf100 x1830963592271872/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.629959:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cf100 with x1830963592271872 ext(0->1048575) 00002000:00010000:2.0:1746143694.629964:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7cf100 00000100:00100000:2.0:1746143694.630625:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3559 00000100:00100000:2.0:1746143694.630637:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963592271872:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143694.646062:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963592271872:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15416us (16272us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143694.646075:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3559 00002000:00100000:3.0:1746143694.646088:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88012b7cf100 x1830963592271872/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.646097:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cf100 with x1830963592271872 ext(0->1048575) 00002000:00010000:3.0:1746143694.646104:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7cf100 00000100:00100000:0.0:1746143694.656254:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.656347:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592272000 00000100:00100000:1.0:1746143694.656356:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592272000 00000100:00100000:1.0:1746143694.656409:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9635 00000100:00100000:1.0:1746143694.656420:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28441:x1830963592272000:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143694.656440:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.656458:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd725aad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1880 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.656492:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.656499:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143694.656501:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143694.656504:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd725aad lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1880 expref: 12 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.656536:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.656554:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 16 pid: 25369 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.656566:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593743104:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143694.656807:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143694.657992:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593743104:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.658019:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd725aad lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1880 expref: 12 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.658032:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2211e00, rc 0) 00000100:00100000:1.0:1746143694.658066:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28441:x1830963592272000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1646us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.658073:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9635 00000100:00100000:0.0:1746143694.659118:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.659339:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592272128 00000100:00100000:3.0:1746143694.659346:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592272128 00002000:00100000:3.0:1746143694.659388:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1482752->2097151) req@ffff88012b7cd500 x1830963592272128/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.659397:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cd500 with x1830963592272128 ext(1482752->2097151) 00010000:00010000:3.0:1746143694.659405:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 17 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.659417:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 17 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746143694.659423:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7cd500 00000100:00100000:3.0:1746143694.659486:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 863 00000100:00100000:3.0:1746143694.659494:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963592272128:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143694.667684:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592272128:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8176us (8554us total) trans 21474839729 rc 0/0 00000100:00100000:3.0:1746143694.667697:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 863 00002000:00100000:3.0:1746143694.667709:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1482752->2097151) req@ffff88012b7cd500 x1830963592272128/t21474839729(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/448 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.667718:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cd500 with x1830963592272128 ext(1482752->2097151) 00010000:00010000:3.0:1746143694.667729:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 19 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.667746:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 19 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746143694.667753:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7cd500 00000100:00100000:0.0:1746143694.672051:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.672396:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592272256 00000100:00100000:1.0:1746143694.672407:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592272256 00010000:00010000:1.0:1746143694.672454:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 19 pid: 25369 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.672498:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4962 00000100:00100000:1.0:1746143694.672506:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592272256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.672521:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.672547:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 19 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.672559:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 19 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.672584:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d0a00/0xe984082ccd725a67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1856 expref: 19 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.672870:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.672872:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.672882:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd725aad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1880 expref: 11 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.672890:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd725aad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1880 expref: 11 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.672929:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd725aad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1880 expref: 11 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143694.672942:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593743232:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143694.673025:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143694.676189:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593743232:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143694.676209:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.676249:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592272256:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3743us (4207us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.676260:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4962 00000100:00100000:0.0:1746143694.679937:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.679999:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592272512 00000100:00100000:3.0:1746143694.680010:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592272512 00002000:00100000:3.0:1746143694.680055:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88012b7cdf80 x1830963592272512/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.680063:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cdf80 with x1830963592272512 ext(1048576->2097151) 00002000:00010000:3.0:1746143694.680068:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cdf80 00000100:00100000:3.0:1746143694.680104:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3560 00000100:00100000:3.0:1746143694.680113:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592272512:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143694.694613:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592272512:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14489us (14676us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143694.694627:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3560 00002000:00100000:2.0:1746143694.694639:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88012b7cdf80 x1830963592272512/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.694648:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cdf80 with x1830963592272512 ext(1048576->2097151) 00002000:00010000:2.0:1746143694.694654:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cdf80 00000100:00100000:0.0:1746143694.705867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.705981:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592272640 00000100:00100000:1.0:1746143694.705990:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592272640 00000100:00100000:1.0:1746143694.707988:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9636 00000100:00100000:1.0:1746143694.708003:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28441:x1830963592272640:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143694.708026:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.708046:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725ab4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1887 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.708079:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.708092:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143694.708093:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143694.708096:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725ab4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1887 expref: 13 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.708124:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.708136:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 17 pid: 25369 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.708158:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593743360:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143694.709081:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143694.712005:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593743360:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.712041:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725ab4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1887 expref: 13 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.712060:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2210800, rc 0) 00000100:00100000:1.0:1746143694.712108:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28441:x1830963592272640:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4110us (6252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.712117:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9636 00000100:00100000:0.0:1746143694.712400:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.712480:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592272768 00000100:00100000:2.0:1746143694.712489:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592272768 00002000:00100000:2.0:1746143694.712531:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1236991) req@ffff8800935a0700 x1830963592272768/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.712540:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0700 with x1830963592272768 ext(1048576->1236991) 00010000:00010000:2.0:1746143694.712546:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 18 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.712558:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 18 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746143694.712564:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935a0700 00000100:00100000:2.0:1746143694.712589:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 864 00000100:00100000:2.0:1746143694.712596:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592272768:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143694.719702:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592272768:12345-192.168.202.48@tcp:4:cat.0 Request processed in 7096us (7293us total) trans 21474839730 rc 0/0 00000100:00100000:2.0:1746143694.719714:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 864 00002000:00100000:2.0:1746143694.719725:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1236991) req@ffff8800935a0700 x1830963592272768/t21474839730(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/448 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.719734:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0700 with x1830963592272768 ext(1048576->1236991) 00010000:00010000:2.0:1746143694.719744:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 20 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.719760:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 20 pid: 25369 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746143694.719767:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935a0700 00000100:00100000:0.0:1746143694.721817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.722057:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592272896 00000100:00100000:1.0:1746143694.722067:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592272896 00010000:00010000:1.0:1746143694.722105:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 20 pid: 25369 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.722564:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4963 00000100:00100000:1.0:1746143694.722574:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963592272896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.722588:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.722611:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 20 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.722623:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 20 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.722647:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210a00/0xe984082ccd725a6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a185d expref: 20 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.722680:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.722682:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.722689:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725ab4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1887 expref: 12 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.722697:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725ab4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1887 expref: 12 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.722731:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725ab4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1887 expref: 12 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143694.722742:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593743488:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143694.722819:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143694.729053:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593743488:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143694.729078:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.729135:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963592272896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6562us (7324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.729158:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4963 00000100:00100000:0.0:1746143694.729287:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.729789:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592273152 00000100:00100000:3.0:1746143694.729797:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592273152 00002000:00100000:3.0:1746143694.729847:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009445aa00 x1830963592273152/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.729857:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445aa00 with x1830963592273152 ext(1048576->2097151) 00002000:00010000:3.0:1746143694.729862:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445aa00 00000100:00100000:3.0:1746143694.729879:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3561 00000100:00100000:3.0:1746143694.729885:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592273152:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143694.740880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.741091:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592273408 00000100:00100000:1.0:1746143694.741100:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592273408 00000100:00100000:1.0:1746143694.741169:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8287 00000100:00100000:1.0:1746143694.741177:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28444:x1830963592273408:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143694.741204:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.741222:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211200/0xe984082ccd725abb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a188e expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.741315:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.741328:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1841 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.741335:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210400/0xe984082ccd725a8a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1864 expref: 14 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.741341:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.741369:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210400/0xe984082ccd725a8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1864 expref: 14 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.741380:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210400/0xe984082ccd725a8a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1864 expref: 14 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.741392:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593743616:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143694.741474:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1841 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.741482:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1841 expref: 8 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.741489:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593743744:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143694.741505:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143694.743578:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592273152:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13681us (14279us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143694.743591:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3561 00002000:00100000:3.0:1746143694.743603:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009445aa00 x1830963592273152/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.743613:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445aa00 with x1830963592273152 ext(1048576->2097151) 00002000:00010000:3.0:1746143694.743619:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445aa00 00000100:00100000:0.0:1746143694.747580:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.747669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.747756:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592273664 00000100:00100000:1.0:1746143694.747766:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592273664 00010000:00010000:1.0:1746143694.747807:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1841 expref: 9 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.747844:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592273536 00000100:00100000:1.0:1746143694.747846:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592273536 00010000:00010000:1.0:1746143694.747855:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210400/0xe984082ccd725a8a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1864 expref: 15 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.747872:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4964 00000100:00100000:1.0:1746143694.747879:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592273664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.747894:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.747899:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1841 expref: 9 pid: 21713 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.747909:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1841 expref: 9 pid: 21713 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.747931:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.747936:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.747944:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.747949:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.747985:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592273664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 107us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.747990:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4964 00000100:00100000:1.0:1746143694.748016:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4965 00000100:00100000:1.0:1746143694.748020:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592273536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.748025:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.748028:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210400/0xe984082ccd725a8a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1864 expref: 15 pid: 21713 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.748036:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210400/0xe984082ccd725a8a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1864 expref: 15 pid: 21713 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.748044:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143694.748047:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.748053:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.748059:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143694.748075:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.748086:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592273536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 66us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.748091:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4965 00010000:00010000:2.0:1746143694.749741:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210400/0xe984082ccd725a8a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1864 expref: 14 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746143694.749779:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593743616:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143694.749793:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2210e00/0xe984082ccd725a4b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1841 expref: 8 pid: 21713 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746143694.749802:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593743744:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143694.749824:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.749831:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.749845:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143694.749866:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143694.750015:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211200/0xe984082ccd725abb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a188e expref: 15 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.750030:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a188e expref: 14 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.750038:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143694.750042:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143694.750044:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2211800, rc 0) 00000100:00100000:2.0:1746143694.750092:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28444:x1830963592273408:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8914us (9221us total) trans 8589942389 rc 0/0 00000100:00100000:2.0:1746143694.750103:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8287 00000100:00100000:0.0:1746143694.760877:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.761734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.761829:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592273920 00000100:00100000:3.0:1746143694.761848:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592273920 00002000:00100000:3.0:1746143694.761900:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880094458000 x1830963592273920/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.761909:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094458000 with x1830963592273920 ext(2097152->3145727) 00002000:00010000:3.0:1746143694.761915:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094458000 00000100:00100000:3.0:1746143694.761939:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592274048 00000100:00100000:3.0:1746143694.761942:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592274048 00002000:00100000:3.0:1746143694.761954:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009445b100 x1830963592274048/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.761960:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445b100 with x1830963592274048 ext(3145728->4194303) 00002000:00010000:3.0:1746143694.761963:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445b100 00000100:00100000:3.0:1746143694.764186:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3562 00000100:00100000:3.0:1746143694.764202:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592273920:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143694.765483:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3563 00000100:00100000:1.0:1746143694.765498:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592274048:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143694.774485:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.777359:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592274432 00000100:00100000:2.0:1746143694.777375:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592274432 00000100:00100000:2.0:1746143694.777454:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8288 00000100:00100000:2.0:1746143694.777463:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:28446:x1830963592274432:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143694.777491:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143694.777513:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0400/0xe984082ccd725ad0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1895 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.777630:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd725ad7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777643:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd725ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777653:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd725ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777665:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1c00/0xe984082ccd725ade lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777670:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1c00/0xe984082ccd725ade lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777674:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1c00/0xe984082ccd725ade lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777781:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0a00/0xe984082ccd725ae5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777790:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0a00/0xe984082ccd725ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777798:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0a00/0xe984082ccd725ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143694.777805:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143694.777902:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd725ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777908:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd725ad7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777914:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd725ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777919:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d0000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143694.777922:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd725ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777928:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd725ad7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777938:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143694.777940:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143694.777944:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd725ad7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777948:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0xe984082ccd725ad7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777977:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1c00/0xe984082ccd725ade lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777981:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1c00/0xe984082ccd725ade lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777990:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1c00/0xe984082ccd725ade lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777994:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d1c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143694.777996:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1c00/0xe984082ccd725ade lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.777999:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1c00/0xe984082ccd725ade lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.778004:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a200) 00010000:00010000:2.0:1746143694.778006:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143694.778008:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1c00/0xe984082ccd725ade lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.778012:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1c00/0xe984082ccd725ade lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143694.778048:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0400/0xe984082ccd725ad0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1895 expref: 249 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.778059:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0a00/0xe984082ccd725ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1895 expref: 248 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.778065:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143694.778066:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143694.778068:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d0a00, rc 0) 00000100:00100000:2.0:1746143694.778124:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:28446:x1830963592274432:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 661us (3650us total) trans 8589942390 rc 0/0 00000100:00100000:2.0:1746143694.778130:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8288 00000100:00100000:2.0:1746143694.785771:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592274048:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20267us (24027us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143694.785782:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3563 00002000:00100000:2.0:1746143694.785794:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009445b100 x1830963592274048/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.785803:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445b100 with x1830963592274048 ext(3145728->4194303) 00002000:00010000:2.0:1746143694.785809:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445b100 00000100:00100000:3.0:1746143694.791769:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592273920:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27558us (30889us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143694.791782:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3562 00002000:00100000:3.0:1746143694.791794:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880094458000 x1830963592273920/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143694.791802:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094458000 with x1830963592273920 ext(2097152->3145727) 00002000:00010000:3.0:1746143694.791808:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094458000 00000100:00100000:0.0:1746143694.800682:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.800994:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592274688 00000100:00100000:2.0:1746143694.801004:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592274688 00000100:00100000:2.0:1746143694.801058:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3373 00000100:00100000:2.0:1746143694.801066:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ecf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28441:x1830963592274688:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143694.801345:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ecf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28441:x1830963592274688:12345-192.168.202.48@tcp:35:cat.0 Request processed in 278us (674us total) trans 8589942391 rc 0/0 00000100:00100000:2.0:1746143694.801352:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3373 00000100:00100000:0.0:1746143694.822668:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.825704:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592274944 00000100:00100000:3.0:1746143694.831863:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592274944 00000100:00100000:3.0:1746143694.831949:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8289 00000100:00100000:3.0:1746143694.831957:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:28450:x1830963592274944:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143694.831986:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.832006:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd725af3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a189c expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.832112:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31800/0xe984082ccd725afa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832124:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31800/0xe984082ccd725afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832134:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31800/0xe984082ccd725afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832165:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725b01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832175:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832181:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832284:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5600/0xe984082ccd725b08 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832291:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5600/0xe984082ccd725b08 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832296:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5600/0xe984082ccd725b08 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143694.832305:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143694.832382:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31800/0xe984082ccd725afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832387:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31800/0xe984082ccd725afa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832393:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31800/0xe984082ccd725afa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832399:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093b31800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143694.832403:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31800/0xe984082ccd725afa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832410:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31800/0xe984082ccd725afa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832420:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143694.832423:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143694.832428:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31800/0xe984082ccd725afa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.832433:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b31800/0xe984082ccd725afa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.836318:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.836335:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725b01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.836340:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725b01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.836346:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4e4c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143694.836350:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725b01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.836356:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725b01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.836374:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009328bc00) 00010000:00010000:3.0:1746143694.836377:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143694.836381:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725b01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.836385:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725b01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143694.836465:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd725af3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a189c expref: 251 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.836485:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5600/0xe984082ccd725b08 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a189c expref: 250 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.836490:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143694.836493:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143694.836496:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e5600, rc 0) 00000100:00100000:3.0:1746143694.836579:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:28450:x1830963592274944:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4621us (13923us total) trans 8589942392 rc 0/0 00000100:00100000:3.0:1746143694.836587:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8289 00000100:00100000:1.0:1746143694.842245:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.842402:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592275200 00000100:00100000:0.0:1746143694.842413:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592275200 00000100:00100000:0.0:1746143694.842479:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 568 00000100:00100000:0.0:1746143694.842490:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:1962:x1830963592275200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143694.842508:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143694.842538:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5600/0xe984082ccd725b08 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a189c expref: 250 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.842582:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:0.0:1746143694.842588:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143694.842646:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1962:x1830963592275200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 157us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143694.842653:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 568 00000100:00100000:0.0:1746143694.848318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.848604:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592275072 00000100:00100000:1.0:1746143694.848614:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592275072 00000100:00100000:1.0:1746143694.848673:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9637 00000100:00100000:1.0:1746143694.848682:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592275072:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143694.848702:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.848722:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800952eea00/0xe984082ccd725b16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18a3 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.848746:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.848748:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.848757:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800952eea00/0xe984082ccd725b16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18a3 expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.848773:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800952eea00/0xe984082ccd725b16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18a3 expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.848785:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952eea00, rc 0) 00000100:00100000:1.0:1746143694.848846:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592275072:12345-192.168.202.48@tcp:101:cat.0 Request processed in 154us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.848856:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9637 00000100:00100000:0.0:1746143694.848942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.849169:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592275328 00000100:00100000:1.0:1746143694.849173:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592275328 00000100:00100000:1.0:1746143694.849201:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9638 00000100:00100000:1.0:1746143694.849206:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592275328:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143694.849213:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143694.849376:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c2c000/0xe984082ccd725b1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18aa expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.849388:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.849389:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.849393:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2c000/0xe984082ccd725b1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18aa expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.849402:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c2c000/0xe984082ccd725b1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18aa expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143694.849409:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2c000, rc 0) 00000100:00100000:1.0:1746143694.849427:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592275328:12345-192.168.202.48@tcp:101:cat.0 Request processed in 221us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.849431:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9638 00000100:00100000:0.0:1746143694.860260:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.860367:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592275456 00000100:00100000:3.0:1746143694.860377:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592275456 00000100:00100000:3.0:1746143694.860429:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9639 00000100:00100000:3.0:1746143694.860437:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28446:x1830963592275456:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143694.860457:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.860476:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18b1 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.860506:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725987 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17df expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.860515:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009518b200/0xe984082ccd725a1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1825 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.860522:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7c00/0xe984082ccd7259e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1802 expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.860533:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.860535:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.860538:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [69632->540671] (req 69632->540671) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.860567:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7c00/0xe984082ccd7259e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1802 expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.860577:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7c00/0xe984082ccd7259e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1802 expref: 9 pid: 9527 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746143694.860589:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593743872:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143694.863441:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009518b200/0xe984082ccd725a1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1825 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.863459:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009518b200/0xe984082ccd725a1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1825 expref: 8 pid: 9527 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746143694.863472:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593744000:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143694.863757:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17df expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.863766:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725987 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17df expref: 23 pid: 25369 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746143694.863779:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593744128:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143694.863805:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143694.863998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.864076:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592275584 00000100:00100000:0.0:1746143694.864084:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592275584 00010000:00010000:0.0:1746143694.864113:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7c00/0xe984082ccd7259e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1802 expref: 10 pid: 9527 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746143694.864168:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4966 00000100:00100000:0.0:1746143694.864176:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592275584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143694.864187:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143694.864212:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7c00/0xe984082ccd7259e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1802 expref: 10 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746143694.864223:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7c00/0xe984082ccd7259e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1802 expref: 10 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746143694.864243:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7c00/0xe984082ccd7259e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1802 expref: 10 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746143694.864262:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143694.864288:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963592275584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 112us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143694.864294:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4966 00000100:00100000:3.0:1746143694.864385:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593743872:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143694.866210:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.866241:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.866363:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592275840 00000100:00100000:2.0:1746143694.866370:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592275840 00002000:00100000:2.0:1746143694.866407:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880130fd7800 x1830963592275840/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.866417:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd7800 with x1830963592275840 ext(1048576->2097151) 00002000:00010000:2.0:1746143694.866422:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd7800 00000100:00100000:2.0:1746143694.866435:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592276096 00000100:00100000:2.0:1746143694.866436:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592276096 00002000:00100000:2.0:1746143694.866444:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880130fd5c00 x1830963592276096/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.866456:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5c00 with x1830963592276096 ext(1048576->2097151) 00002000:00010000:2.0:1746143694.866458:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd5c00 00000100:00100000:2.0:1746143694.866478:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3564 00000100:00100000:2.0:1746143694.866484:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592275840:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143694.866981:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3565 00000100:00100000:0.0:1746143694.866990:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592276096:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143694.868624:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593744000:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143694.868639:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593744128:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143694.868674:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [69632->540671] (req 69632->540671) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.868691:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e5200, rc 0) 00000100:00100000:3.0:1746143694.868732:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28446:x1830963592275456:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8295us (8483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.868740:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9639 00000100:00100000:2.0:1746143694.874050:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.874109:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.874118:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592276224 00000100:00100000:1.0:1746143694.874128:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592276224 00010000:00010000:1.0:1746143694.874199:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009518b200/0xe984082ccd725a1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1825 expref: 9 pid: 9527 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746143694.874239:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592276352 00000100:00100000:1.0:1746143694.874243:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592276352 00010000:00010000:1.0:1746143694.874254:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725987 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17df expref: 23 pid: 25369 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746143694.874270:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4967 00000100:00100000:1.0:1746143694.874277:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592276224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.874291:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.874313:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009518b200/0xe984082ccd725a1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1825 expref: 9 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.874325:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009518b200/0xe984082ccd725a1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1825 expref: 9 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.874348:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009518b200/0xe984082ccd725a1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1825 expref: 9 pid: 9527 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746143694.874369:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.874425:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592276224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 144us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.874432:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4967 00000100:00100000:1.0:1746143694.874460:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4968 00000100:00100000:1.0:1746143694.874466:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592276352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143694.874475:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143694.874482:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725987 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17df expref: 23 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.874492:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17df expref: 23 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.874505:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd725987 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17df expref: 23 pid: 25369 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.874515:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.874517:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143694.874524:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 22 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.874533:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 22 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143694.874566:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 22 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143694.874579:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593744256:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143694.874633:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143694.879653:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592275840:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 13154us (13436us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143694.879668:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3564 00002000:00100000:2.0:1746143694.879679:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880130fd7800 x1830963592275840/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.879689:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd7800 with x1830963592275840 ext(1048576->2097151) 00002000:00010000:2.0:1746143694.879694:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd7800 00000100:00100000:1.0:1746143694.882761:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593744256:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143694.882788:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143694.882862:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592276352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8394us (8751us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143694.882874:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4968 00000100:00100000:0.0:1746143694.883989:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.884295:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592276608 00000100:00100000:2.0:1746143694.884304:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592276608 00002000:00100000:2.0:1746143694.884353:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (69632->73727) req@ffff880130fd6300 x1830963592276608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.884364:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6300 with x1830963592276608 ext(69632->73727) 00002000:00010000:2.0:1746143694.884370:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd6300 00000100:00100000:2.0:1746143694.886117:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3566 00000100:00100000:2.0:1746143694.886134:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592276608:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143694.886371:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592276608:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 244us (2385us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143694.886381:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3566 00002000:00100000:2.0:1746143694.886387:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (69632->73727) req@ffff880130fd6300 x1830963592276608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/4536 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.886395:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6300 with x1830963592276608 ext(69632->73727) 00002000:00010000:2.0:1746143694.886400:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd6300 00000100:00100000:0.0:1746143694.893828:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.894431:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592276096:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 27440us (28186us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143694.894442:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3565 00002000:00100000:1.0:1746143694.894454:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880130fd5c00 x1830963592276096/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.894465:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5c00 with x1830963592276096 ext(1048576->2097151) 00002000:00010000:1.0:1746143694.894471:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd5c00 00000100:00100000:3.0:1746143694.894897:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592276736 00000100:00100000:3.0:1746143694.894905:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592276736 00000100:00100000:3.0:1746143694.894941:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9640 00000100:00100000:3.0:1746143694.894948:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28444:x1830963592276736:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143694.894964:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.894982:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18b8 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.895012:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd600/0xe984082ccd725830 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1730 expref: 7 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.895023:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd725980 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ca expref: 21 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.895028:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a21ff800/0xe984082ccd7258fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a176f expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.895034:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.895036:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.895039:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2416640->3071999] (req 2416640->3071999) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 10 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.895069:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a21ff800/0xe984082ccd7258fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a176f expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.895080:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a21ff800/0xe984082ccd7258fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a176f expref: 10 pid: 8497 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746143694.895090:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593744384:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143694.895181:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd725980 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ca expref: 21 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.895189:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd725980 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ca expref: 21 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746143694.895196:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593744512:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143694.895234:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd600/0xe984082ccd725830 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1730 expref: 7 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143694.895243:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd600/0xe984082ccd725830 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1730 expref: 7 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746143694.895249:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593744640:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143694.895266:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143694.895935:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.897196:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592276992 00000100:00100000:1.0:1746143694.897205:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592276992 00002000:00100000:1.0:1746143694.897245:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34c:0x0] (536576->540671) req@ffff880130fd7480 x1830963592276992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.897254:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd7480 with x1830963592276992 ext(536576->540671) 00002000:00010000:1.0:1746143694.897259:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd7480 00000100:00100000:1.0:1746143694.897285:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3567 00000100:00100000:1.0:1746143694.897291:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592276992:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143694.897468:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592276992:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 176us (1534us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143694.897474:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3567 00002000:00100000:1.0:1746143694.897479:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34c:0x0] (536576->540671) req@ffff880130fd7480 x1830963592276992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/4536 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.897485:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd7480 with x1830963592276992 ext(536576->540671) 00002000:00010000:1.0:1746143694.897487:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd7480 00000100:00100000:0.0:1746143694.904282:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.904315:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.904426:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592277248 00000100:00100000:3.0:1746143694.904436:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592277248 00010000:00010000:3.0:1746143694.904477:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd600/0xe984082ccd725830 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1730 expref: 8 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746143694.904504:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592277120 00000100:00100000:3.0:1746143694.904507:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592277120 00010000:00010000:3.0:1746143694.904519:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd725980 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ca expref: 22 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746143694.904534:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4969 00000100:00100000:3.0:1746143694.904541:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592277248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143694.904555:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143694.904578:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd600/0xe984082ccd725830 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1730 expref: 8 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.904588:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd600/0xe984082ccd725830 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1730 expref: 8 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.904619:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143694.904656:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592277248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 116us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.904662:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4969 00000100:00100000:3.0:1746143694.904677:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4970 00000100:00100000:3.0:1746143694.904681:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592277120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143694.904687:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143694.904692:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd725980 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ca expref: 22 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.904699:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd725980 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ca expref: 22 pid: 15784 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746143694.904710:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143694.904724:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592277120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 42us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.904728:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4970 00000100:00100000:3.0:1746143694.904770:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593744384:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143694.904781:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd725980 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17ca expref: 21 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746143694.904796:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593744512:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143694.904805:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd600/0xe984082ccd725830 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1730 expref: 7 pid: 15784 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746143694.904816:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593744640:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143694.904852:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2416640->3071999] (req 2416640->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 10 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.904863:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e4000, rc 0) 00000100:00100000:3.0:1746143694.904888:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28444:x1830963592276736:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 9940us (11073us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.904894:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9640 00000100:00100000:0.0:1746143694.907135:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.907226:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.907313:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592277376 00000100:00100000:2.0:1746143694.907321:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592277376 00010000:00010000:2.0:1746143694.907357:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21ff800/0xe984082ccd7258fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a176f expref: 10 pid: 8497 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746143694.907385:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4971 00000100:00100000:2.0:1746143694.907390:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963592277376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143694.907403:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143694.907431:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a21ff800/0xe984082ccd7258fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a176f expref: 10 pid: 8497 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.907441:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a21ff800/0xe984082ccd7258fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a176f expref: 10 pid: 8497 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.907464:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a21ff800/0xe984082ccd7258fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a176f expref: 10 pid: 8497 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746143694.907480:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.907482:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143694.907489:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.907501:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143694.907531:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143694.907541:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593744768:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143694.907609:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52fc900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143694.909631:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592277504 00000100:00100000:3.0:1746143694.909642:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592277504 00000100:00100000:3.0:1746143694.909702:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9641 00000100:00100000:3.0:1746143694.909709:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28450:x1830963592277504:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143694.909726:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143694.909742:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4e00/0xe984082ccd725b32 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18bf expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.909770:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.909777:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143694.909778:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143694.909782:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4e00/0xe984082ccd725b32 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18bf expref: 22 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.909807:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.909818:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746143694.909829:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593744896:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143694.911572:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949cbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143694.911819:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.911987:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.912123:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592278016 00000100:00100000:3.0:1746143694.912207:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592277760 00000100:00100000:3.0:1746143694.912213:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592277760 00000100:00100000:3.0:1746143694.912251:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3374 00000100:00100000:3.0:1746143694.912258:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:28446:x1830963592277760:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143694.912469:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:28446:x1830963592277760:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 210us (654us total) trans 8589942393 rc 0/0 00000100:00100000:3.0:1746143694.912475:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3374 00000100:00100000:3.0:1746143694.912540:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593744768:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143694.912560:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143694.912579:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963592277376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5188us (5454us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.912586:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4971 00000100:00100000:0.0:1746143694.912695:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592278016 00002000:00100000:0.0:1746143694.912724:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2416640->2420735) req@ffff88008f1eca80 x1830963592278016/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143694.912733:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eca80 with x1830963592278016 ext(2416640->2420735) 00010000:00010000:0.0:1746143694.912741:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746143694.912753:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746143694.912915:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f1eca80 00000100:00100000:0.0:1746143694.912931:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 865 00000100:00100000:0.0:1746143694.912937:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963592278016:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143694.913071:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963592278016:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 133us (1083us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143694.913077:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 865 00002000:00100000:0.0:1746143694.913082:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2416640->2420735) req@ffff88008f1eca80 x1830963592278016/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/4536 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143694.913088:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eca80 with x1830963592278016 ext(2416640->2420735) 00010000:00010000:0.0:1746143694.913092:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746143694.913101:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746143694.913106:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f1eca80 00000100:00100000:0.0:1746143694.917579:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593744896:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143694.917619:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4e00/0xe984082ccd725b32 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18bf expref: 22 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143694.917638:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e4e00, rc 0) 00000100:00100000:0.0:1746143694.917720:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28450:x1830963592277504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8011us (10492us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143694.917729:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9641 00000100:00100000:0.0:1746143694.924753:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.925796:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592278272 00000100:00100000:1.0:1746143694.925808:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592278272 00002000:00100000:1.0:1746143694.925874:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3067904->3071999) req@ffff88009445b480 x1830963592278272/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.925891:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445b480 with x1830963592278272 ext(3067904->3071999) 00010000:00010000:1.0:1746143694.925900:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.925914:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 873 lvb_type: 0 00002000:00010000:1.0:1746143694.925921:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009445b480 00000100:00100000:1.0:1746143694.925953:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 866 00000100:00100000:1.0:1746143694.925960:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963592278272:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143694.926188:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963592278272:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 228us (1445us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143694.926195:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 866 00002000:00100000:1.0:1746143694.926200:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3067904->3071999) req@ffff88009445b480 x1830963592278272/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/4536 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.926207:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445b480 with x1830963592278272 ext(3067904->3071999) 00010000:00010000:1.0:1746143694.926211:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746143694.926219:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 873 lvb_type: 0 00002000:00010000:1.0:1746143694.926224:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009445b480 00000100:00100000:0.0:1746143694.928500:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143694.928728:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592278528 00000100:00100000:2.0:1746143694.928738:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592278528 00002000:00100000:2.0:1746143694.929583:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2416640->3071999) req@ffff880094459c00 x1830963592278528/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.929594:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459c00 with x1830963592278528 ext(2416640->3071999) 00010000:00010000:2.0:1746143694.929604:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.929618:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 9 pid: 4582 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746143694.929625:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094459c00 00000100:00100000:2.0:1746143694.929660:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 867 00000100:00100000:2.0:1746143694.929670:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963592278528:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:2.0:1746143694.942322:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592278528:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 12640us (13819us total) trans 17179872462 rc 0/0 00000100:00100000:2.0:1746143694.942339:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 867 00002000:00100000:2.0:1746143694.942352:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2416640->3071999) req@ffff880094459c00 x1830963592278528/t17179872462(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:90/0 lens 488/448 e 0 to 0 dl 1746143705 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.942362:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459c00 with x1830963592278528 ext(2416640->3071999) 00010000:00010000:2.0:1746143694.942373:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 11 pid: 4582 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746143694.942390:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 11 pid: 4582 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746143694.942396:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094459c00 00000100:00100000:0.0:1746143694.945338:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143694.945436:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592278656 00000100:00100000:3.0:1746143694.945446:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592278656 00010000:00010000:3.0:1746143694.945485:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 11 pid: 4582 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746143694.945592:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4972 00000100:00100000:3.0:1746143694.945600:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592278656:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143694.945616:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143694.945638:0:23335:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143692 -> 1746143694 00002000:00010000:3.0:1746143694.945641:0:23335:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143691 -> 1746143694 00010000:00010000:3.0:1746143694.945646:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 11 pid: 4582 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.945657:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 11 pid: 4582 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.945678:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4000/0xe984082ccd725b2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2416640->3071999) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b8 expref: 11 pid: 4582 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746143694.945861:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.945863:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143694.945872:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4e00/0xe984082ccd725b32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18bf expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.945879:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4e00/0xe984082ccd725b32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18bf expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143694.945912:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4e00/0xe984082ccd725b32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18bf expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143694.946096:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593745024:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143694.946461:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3889c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143694.948318:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593745024:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143694.948343:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143694.948381:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592278656:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2780us (3052us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143694.948390:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4972 00000100:00100000:0.0:1746143694.957194:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143694.957237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143694.957368:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592278912 00000100:00100000:1.0:1746143694.957380:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592278912 00002000:00100000:1.0:1746143694.957433:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800930ddf80 x1830963592278912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.957444:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ddf80 with x1830963592278912 ext(2097152->3145727) 00002000:00010000:1.0:1746143694.957449:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930ddf80 00000100:00100000:1.0:1746143694.957481:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592279040 00000100:00100000:1.0:1746143694.957483:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592279040 00002000:00100000:1.0:1746143694.957494:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800930dc700 x1830963592279040/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/0 e 0 to 0 dl 1746143705 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.957501:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc700 with x1830963592279040 ext(3145728->4194303) 00002000:00010000:1.0:1746143694.957504:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dc700 00000100:00100000:1.0:1746143694.957515:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3568 00000100:00100000:1.0:1746143694.957522:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592278912:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143694.957642:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3569 00000100:00100000:2.0:1746143694.957650:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592279040:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143694.980219:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592278912:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22683us (23024us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143694.980233:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3568 00002000:00100000:1.0:1746143694.980245:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800930ddf80 x1830963592278912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143694.980254:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ddf80 with x1830963592278912 ext(2097152->3145727) 00002000:00010000:1.0:1746143694.980261:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930ddf80 00000100:00100000:2.0:1746143694.988129:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592279040:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30467us (30877us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143694.988159:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3569 00002000:00100000:2.0:1746143694.988172:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800930dc700 x1830963592279040/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:90/0 lens 488/440 e 0 to 0 dl 1746143705 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143694.988182:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc700 with x1830963592279040 ext(3145728->4194303) 00002000:00010000:2.0:1746143694.988188:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dc700 00000100:00100000:0.0:1746143695.012788:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.012852:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592279424 00000100:00100000:2.0:1746143695.012863:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592279424 00002000:00100000:2.0:1746143695.012909:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800930dd500 x1830963592279424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.012924:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd500 with x1830963592279424 ext(4194304->4898815) 00002000:00010000:2.0:1746143695.012930:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dd500 00000100:00100000:2.0:1746143695.012960:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3570 00000100:00100000:2.0:1746143695.012968:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592279424:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143695.028269:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592279424:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15289us (15480us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143695.028282:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3570 00002000:00100000:3.0:1746143695.028295:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800930dd500 x1830963592279424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.028304:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd500 with x1830963592279424 ext(4194304->4898815) 00002000:00010000:3.0:1746143695.028312:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dd500 00000100:00100000:0.0:1746143695.040704:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.042334:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.042438:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592279936 00000100:00100000:2.0:1746143695.042448:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592279936 00000100:00100000:2.0:1746143695.042714:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3375 00000100:00100000:2.0:1746143695.042723:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:28450:x1830963592279936:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143695.043668:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:28450:x1830963592279936:12345-192.168.202.48@tcp:35:cat.0 Request processed in 942us (1337us total) trans 8589942394 rc 0/0 00000100:00100000:2.0:1746143695.043676:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3375 00000100:00100000:3.0:1746143695.044037:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592279680 00000100:00100000:3.0:1746143695.044043:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592279680 00000100:00100000:3.0:1746143695.044074:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8290 00000100:00100000:3.0:1746143695.044079:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28456:x1830963592279680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143695.044096:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.044112:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5e00/0xe984082ccd725b39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18c6 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.044599:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4400/0xe984082ccd725b40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.044612:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4400/0xe984082ccd725b40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.044625:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4400/0xe984082ccd725b40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.044642:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4200/0xe984082ccd725b47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.044646:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4200/0xe984082ccd725b47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.044650:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4200/0xe984082ccd725b47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045207:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5800/0xe984082ccd725b4e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045216:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5800/0xe984082ccd725b4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045222:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5800/0xe984082ccd725b4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143695.045231:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143695.045314:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4400/0xe984082ccd725b40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045322:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4400/0xe984082ccd725b40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045328:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4400/0xe984082ccd725b40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045333:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4e4400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143695.045337:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4400/0xe984082ccd725b40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045343:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4400/0xe984082ccd725b40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045354:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143695.045357:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143695.045361:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4400/0xe984082ccd725b40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045366:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4400/0xe984082ccd725b40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045400:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4200/0xe984082ccd725b47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045404:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4200/0xe984082ccd725b47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045408:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4200/0xe984082ccd725b47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045412:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4e4200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143695.045414:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4200/0xe984082ccd725b47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045419:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4200/0xe984082ccd725b47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045424:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f1f4a00) 00010000:00010000:3.0:1746143695.045426:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143695.045428:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4200/0xe984082ccd725b47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045432:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4200/0xe984082ccd725b47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.045468:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5e00/0xe984082ccd725b39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18c6 expref: 18 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.045481:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5800/0xe984082ccd725b4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18c6 expref: 17 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.045487:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143695.045489:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143695.045492:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e5800, rc 0) 00000100:00100000:3.0:1746143695.045555:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28456:x1830963592279680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1474us (4861us total) trans 8589942395 rc 0/0 00000100:00100000:3.0:1746143695.045564:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8290 00000100:00100000:0.0:1746143695.061304:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.061388:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592280064 00000100:00100000:0.0:1746143695.061390:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.061397:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592280064 00000100:00100000:0.0:1746143695.061420:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.061439:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592280192 00000100:00100000:2.0:1746143695.061440:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592280192 00000100:00100000:2.0:1746143695.061459:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9642 00000100:00100000:2.0:1746143695.061467:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592280064:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.061487:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143695.061492:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143695.061506:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c905400/0xe984082ccd725b5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18cd expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.061733:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593745152:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143695.061813:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52fc900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143695.061844:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9643 00000100:00100000:2.0:1746143695.061851:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592280192:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.061859:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.061866:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cff4600/0xe984082ccd725b63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18d4 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.061878:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.061880:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.061888:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cff4600/0xe984082ccd725b63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18d4 expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.061906:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cff4600/0xe984082ccd725b63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18d4 expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143695.061915:0:14758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592280320 00010000:00010000:2.0:1746143695.061916:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cff4600, rc 0) 00000100:00100000:1.0:1746143695.061919:0:14758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592280320 00000100:00100000:2.0:1746143695.061939:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592280192:12345-192.168.202.48@tcp:101:cat.0 Request processed in 88us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.061945:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9643 00000100:00100000:1.0:1746143695.061945:0:14758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 173 00000100:00100000:1.0:1746143695.061951:0:14758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1962:x1830963592280320:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1746143695.061978:0:14758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1962:x1830963592280320:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 28us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.061984:0:14758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 173 00000100:00100000:3.0:1746143695.062453:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592280576 00000100:00100000:3.0:1746143695.062458:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592280576 00000100:00100000:3.0:1746143695.062486:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8291 00000100:00100000:3.0:1746143695.062491:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:28459:x1830963592280576:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143695.062504:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.062517:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd725b6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18db expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.062618:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5400/0xe984082ccd725b71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.062629:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5400/0xe984082ccd725b71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.062639:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5400/0xe984082ccd725b71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.062650:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4a00/0xe984082ccd725b78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.062660:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4a00/0xe984082ccd725b78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.062665:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4a00/0xe984082ccd725b78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063683:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5a00/0xe984082ccd725b7f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063696:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5a00/0xe984082ccd725b7f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063704:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5a00/0xe984082ccd725b7f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143695.063713:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143695.063805:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5400/0xe984082ccd725b71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063811:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5400/0xe984082ccd725b71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063815:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5400/0xe984082ccd725b71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063821:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4e5400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143695.063824:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5400/0xe984082ccd725b71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063829:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5400/0xe984082ccd725b71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063849:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143695.063852:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143695.063856:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5400/0xe984082ccd725b71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063861:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5400/0xe984082ccd725b71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063891:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4a00/0xe984082ccd725b78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063896:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4a00/0xe984082ccd725b78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063900:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4a00/0xe984082ccd725b78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063904:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4e4a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143695.063906:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4a00/0xe984082ccd725b78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063911:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4a00/0xe984082ccd725b78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063917:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f1f4500) 00010000:00010000:3.0:1746143695.063918:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143695.063920:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4a00/0xe984082ccd725b78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063924:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4a00/0xe984082ccd725b78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.063963:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e4000/0xe984082ccd725b6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18db expref: 254 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.063977:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5a00/0xe984082ccd725b7f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18db expref: 253 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.063982:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143695.063984:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143695.063986:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e5a00, rc 0) 00000100:00100000:3.0:1746143695.064040:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:28459:x1830963592280576:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1547us (2647us total) trans 8589942396 rc 0/0 00000100:00100000:3.0:1746143695.064046:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8291 00000100:00100000:0.0:1746143695.069501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.069552:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.069857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:2.0:1746143695.070020:0:4582:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime: 1746143693 -> 1746143694 00002000:00010000:2.0:1746143695.070025:0:4582:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime: 1746143690 -> 1746143694 00002000:00010000:2.0:1746143695.070027:0:4582:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime: 1746143693 -> 1746143694 00000100:00100000:2.0:1746143695.070050:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593745152:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143695.070084:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c905400/0xe984082ccd725b5c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18cd expref: 12 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.070101:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c905400/0xe984082ccd725b5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18cd expref: 12 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.070126:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c905400, rc 0) 00000100:00100000:2.0:1746143695.070202:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592280064:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8734us (11228us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143695.070211:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9642 00000100:00100000:2.0:1746143695.070237:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592280704 00000100:00100000:2.0:1746143695.070244:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592280704 00000100:00100000:2.0:1746143695.070273:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9644 00000100:00100000:2.0:1746143695.070280:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28459:x1830963592280704:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143695.070295:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.070310:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18e2 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.070337:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725ab4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1887 expref: 12 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.070345:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c2c000/0xe984082ccd725b1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18aa expref: 22 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.070351:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.070352:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.070356:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1646592->1777663] (req 1646592->1777663) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 22 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.070384:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c2c000/0xe984082ccd725b1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18aa expref: 22 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.070400:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c2c000/0xe984082ccd725b1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18aa expref: 22 pid: 25369 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746143695.070417:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593745280:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.070481:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725ab4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1887 expref: 12 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.070489:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725ab4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1887 expref: 12 pid: 25369 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.070496:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593745408:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143695.070514:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52fc900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143695.070541:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592280832 00000100:00100000:2.0:1746143695.070544:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592280832 00000100:00100000:2.0:1746143695.070571:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 569 00000100:00100000:2.0:1746143695.070576:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:1964:x1830963592280832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143695.070585:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143695.070604:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5a00/0xe984082ccd725b7f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18db expref: 253 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.070618:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143695.070622:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143695.070636:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1964:x1830963592280832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 61us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.070645:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 569 00000100:00100000:2.0:1746143695.070695:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592281088 00000100:00100000:2.0:1746143695.070698:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592281088 00000100:00100000:2.0:1746143695.070724:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8292 00000100:00100000:2.0:1746143695.070729:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28460:x1830963592281088:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143695.070743:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.070751:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff4000/0xe984082ccd725b94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18e9 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.070858:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5a00/0xe984082ccd725b9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.070869:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5a00/0xe984082ccd725b9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.070878:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5a00/0xe984082ccd725b9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.070890:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5c00/0xe984082ccd725ba2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.070895:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5c00/0xe984082ccd725ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.070900:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5c00/0xe984082ccd725ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071004:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff4200/0xe984082ccd725ba9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071013:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff4200/0xe984082ccd725ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071019:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff4200/0xe984082ccd725ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143695.071027:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143695.071110:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5a00/0xe984082ccd725b9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071117:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5a00/0xe984082ccd725b9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071122:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5a00/0xe984082ccd725b9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071128:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cff5a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143695.071131:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5a00/0xe984082ccd725b9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071161:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5a00/0xe984082ccd725b9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071169:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143695.071172:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143695.071175:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5a00/0xe984082ccd725b9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071180:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5a00/0xe984082ccd725b9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071189:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5c00/0xe984082ccd725ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071193:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5c00/0xe984082ccd725ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071203:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5c00/0xe984082ccd725ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071207:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cff5c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143695.071209:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5c00/0xe984082ccd725ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071213:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5c00/0xe984082ccd725ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071219:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a300) 00010000:00010000:2.0:1746143695.071221:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143695.071223:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5c00/0xe984082ccd725ba2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071228:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff5c00/0xe984082ccd725ba2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.071260:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff4000/0xe984082ccd725b94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e9 expref: 20 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.071270:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff4200/0xe984082ccd725ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e9 expref: 19 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.071275:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143695.071276:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143695.071278:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cff4200, rc 0) 00000100:00100000:2.0:1746143695.071303:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28460:x1830963592281088:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 573us (1446us total) trans 8589942397 rc 0/0 00000100:00100000:2.0:1746143695.071309:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8292 00000100:00100000:0.0:1746143695.074528:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.074563:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.074591:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.074668:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592281216 00000100:00100000:3.0:1746143695.074677:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592281216 00000100:00100000:3.0:1746143695.074720:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9645 00000100:00100000:3.0:1746143695.074726:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28456:x1830963592281216:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143695.074745:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.074763:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4600/0xe984082ccd725bb7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18f0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.074793:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.074801:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143695.074802:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143695.074805:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4600/0xe984082ccd725bb7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f0 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.074848:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.074861:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 21 pid: 4582 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.074874:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593745536:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143695.075189:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593745280:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143695.075205:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593745408:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.075233:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1646592->1777663] (req 1646592->1777663) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 22 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.075245:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cff4e00, rc 0) 00000100:00100000:2.0:1746143695.075270:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28459:x1830963592280704:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4990us (5780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.075276:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9644 00000100:00100000:0.0:1746143695.076178:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.076254:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.076532:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3889c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143695.076558:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592281856 00000100:00100000:3.0:1746143695.076563:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592281856 00000100:00100000:3.0:1746143695.076597:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3376 00000100:00100000:3.0:1746143695.076603:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28460:x1830963592281856:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143695.076795:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28460:x1830963592281856:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 190us (617us total) trans 8589942398 rc 0/0 00000100:00100000:3.0:1746143695.076800:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3376 00000100:00100000:1.0:1746143695.077266:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592281472 00000100:00100000:1.0:1746143695.077271:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592281472 00000100:00100000:1.0:1746143695.077311:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592281344 00000100:00100000:1.0:1746143695.077313:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592281344 00010000:00010000:1.0:1746143695.077327:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2c000/0xe984082ccd725b1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18aa expref: 22 pid: 25369 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746143695.077345:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592281600 00000100:00100000:1.0:1746143695.077347:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592281600 00010000:00010000:1.0:1746143695.077355:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725ab4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1887 expref: 13 pid: 25369 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.077368:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4973 00000100:00100000:1.0:1746143695.077372:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592281344:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143695.077382:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143695.077401:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c2c000/0xe984082ccd725b1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18aa expref: 22 pid: 25369 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746143695.077411:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c2c000/0xe984082ccd725b1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18aa expref: 22 pid: 25369 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746143695.077432:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c2c000/0xe984082ccd725b1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18aa expref: 22 pid: 25369 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746143695.077445:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143695.077465:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963592281344:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 92us (2873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.077471:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4973 00000100:00100000:1.0:1746143695.077491:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4974 00000100:00100000:1.0:1746143695.077495:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592281600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143695.077500:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143695.077505:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725ab4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1887 expref: 13 pid: 25369 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.077512:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725ab4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1887 expref: 13 pid: 25369 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.077521:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210800/0xe984082ccd725ab4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1887 expref: 13 pid: 25369 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.077528:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.077530:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.077536:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.077544:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.077571:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.077580:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593745664:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143695.077613:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143695.077629:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 570 00000100:00100000:1.0:1746143695.077634:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963592281472:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143695.077640:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143695.077651:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cff4200/0xe984082ccd725ba9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e9 expref: 20 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.077663:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143695.077666:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143695.077676:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592281472:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 43us (3114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.077681:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 570 00000100:00100000:3.0:1746143695.084520:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593745536:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143695.084521:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.084574:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592281984 00000100:00100000:2.0:1746143695.084581:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592281984 00002000:00100000:2.0:1746143695.084630:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34c:0x0] (69632->540671) req@ffff8800a5c23100 x1830963592281984/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.084639:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23100 with x1830963592281984 ext(69632->540671) 00010000:00010000:2.0:1746143695.084648:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 22 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.084663:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 22 pid: 4582 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746143695.084670:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c23100 00000100:00100000:2.0:1746143695.084693:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 868 00000100:00100000:2.0:1746143695.084701:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592281984:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143695.084911:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143695.084973:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4600/0xe984082ccd725bb7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f0 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.084989:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e4600, rc 0) 00000100:00100000:1.0:1746143695.085098:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593745664:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143695.085112:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143695.085662:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28456:x1830963592281216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 10934us (11144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.085670:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9645 00000100:00100000:3.0:1746143695.085696:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592282240 00000100:00100000:3.0:1746143695.085699:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592282240 00002000:00100000:3.0:1746143695.085715:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1646592->1650687) req@ffff8800a5c22d80 x1830963592282240/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.085729:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22d80 with x1830963592282240 ext(1646592->1650687) 00002000:00010000:3.0:1746143695.085733:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c22d80 00000100:00100000:3.0:1746143695.085752:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3571 00000100:00100000:3.0:1746143695.085759:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592282240:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143695.086426:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592281600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8927us (10169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.086435:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4974 00000100:00100000:3.0:1746143695.087195:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592282240:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 1435us (2283us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143695.087203:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3571 00002000:00100000:3.0:1746143695.087210:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1646592->1650687) req@ffff8800a5c22d80 x1830963592282240/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/4536 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.087217:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22d80 with x1830963592282240 ext(1646592->1650687) 00002000:00010000:3.0:1746143695.087222:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c22d80 00000100:00100000:0.0:1746143695.101919:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.102518:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592282496 00000100:00100000:3.0:1746143695.103642:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592282496 00002000:00100000:3.0:1746143695.104227:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1773568->1777663) req@ffff8800a5c20a80 x1830963592282496/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.104239:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20a80 with x1830963592282496 ext(1773568->1777663) 00002000:00010000:3.0:1746143695.104245:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c20a80 00000100:00100000:3.0:1746143695.104276:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3572 00000100:00100000:3.0:1746143695.104283:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592282496:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143695.104462:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592282496:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 178us (2553us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143695.104468:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3572 00002000:00100000:3.0:1746143695.104473:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1773568->1777663) req@ffff8800a5c20a80 x1830963592282496/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/4536 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.104480:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20a80 with x1830963592282496 ext(1773568->1777663) 00002000:00010000:3.0:1746143695.104483:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c20a80 00000100:00100000:2.0:1746143695.108065:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592281984:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 23352us (23541us total) trans 17179872463 rc 0/0 00000100:00100000:2.0:1746143695.108082:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 868 00002000:00100000:2.0:1746143695.108094:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34c:0x0] (69632->540671) req@ffff8800a5c23100 x1830963592281984/t17179872463(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/448 e 0 to 0 dl 1746143706 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.108103:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23100 with x1830963592281984 ext(69632->540671) 00010000:00010000:2.0:1746143695.108113:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 24 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.108133:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 24 pid: 4582 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746143695.108163:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c23100 00000100:00100000:0.0:1746143695.108498:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.112374:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592282752 00000100:00100000:2.0:1746143695.112391:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592282752 00000100:00100000:2.0:1746143695.112463:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3377 00000100:00100000:2.0:1746143695.112472:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:28459:x1830963592282752:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143695.113559:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:28459:x1830963592282752:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 1085us (5059us total) trans 8589942399 rc 0/0 00000100:00100000:2.0:1746143695.113568:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3377 00000100:00100000:2.0:1746143695.115040:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.115109:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592282880 00000100:00100000:1.0:1746143695.115118:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592282880 00010000:00010000:1.0:1746143695.115175:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 24 pid: 4582 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.115210:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4975 00000100:00100000:1.0:1746143695.115216:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592282880:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143695.115230:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143695.115254:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 24 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.115271:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 24 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.115294:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5200/0xe984082ccd725b24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 69632->540671) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18b1 expref: 24 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.115322:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.115324:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.115332:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4600/0xe984082ccd725bb7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f0 expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.115342:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4600/0xe984082ccd725bb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f0 expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.115377:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4600/0xe984082ccd725bb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f0 expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.115389:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593745792:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143695.115466:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143695.125576:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593745792:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143695.125600:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143695.126103:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592282880:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10884us (11273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.126116:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4975 00000100:00100000:0.0:1746143695.130441:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.130926:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592283136 00000100:00100000:2.0:1746143695.130937:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592283136 00002000:00100000:2.0:1746143695.130988:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800a5c20380 x1830963592283136/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.130998:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20380 with x1830963592283136 ext(0->1048575) 00002000:00010000:2.0:1746143695.131003:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c20380 00000100:00100000:2.0:1746143695.131038:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3573 00000100:00100000:2.0:1746143695.131046:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592283136:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143695.151611:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592283136:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20552us (21168us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143695.151625:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3573 00002000:00100000:2.0:1746143695.151637:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800a5c20380 x1830963592283136/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.151646:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20380 with x1830963592283136 ext(0->1048575) 00002000:00010000:2.0:1746143695.151652:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c20380 00000100:00100000:0.0:1746143695.163523:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.163739:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592283264 00000100:00100000:3.0:1746143695.163750:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592283264 00000100:00100000:3.0:1746143695.163812:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9646 00000100:00100000:3.0:1746143695.163821:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28456:x1830963592283264:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143695.163853:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.163874:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725bbe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18f7 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.163912:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.163921:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143695.163922:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143695.163926:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725bbe lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f7 expref: 13 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.163961:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.163973:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 20 pid: 4582 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.163986:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593745920:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143695.164084:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143695.172209:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593745920:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.172246:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725bbe lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f7 expref: 13 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.172267:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e4c00, rc 0) 00000100:00100000:3.0:1746143695.172320:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28456:x1830963592283264:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8499us (8807us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.172328:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9646 00000100:00100000:0.0:1746143695.172770:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.172856:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592283392 00000100:00100000:2.0:1746143695.172864:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592283392 00002000:00100000:2.0:1746143695.172908:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1646592->1777663) req@ffff8800a5c22300 x1830963592283392/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.172917:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22300 with x1830963592283392 ext(1646592->1777663) 00010000:00010000:2.0:1746143695.172923:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 21 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.172934:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 21 pid: 4582 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746143695.172939:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5c22300 00000100:00100000:2.0:1746143695.172967:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 869 00000100:00100000:2.0:1746143695.172974:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592283392:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143695.179325:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592283392:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 6338us (6543us total) trans 21474839731 rc 0/0 00000100:00100000:0.0:1746143695.179338:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 869 00002000:00100000:0.0:1746143695.179351:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1646592->1777663) req@ffff8800a5c22300 x1830963592283392/t21474839731(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/448 e 0 to 0 dl 1746143706 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143695.179361:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22300 with x1830963592283392 ext(1646592->1777663) 00010000:00010000:0.0:1746143695.179373:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 23 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746143695.179388:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 23 pid: 4582 timeout: 874 lvb_type: 0 00002000:00010000:0.0:1746143695.179395:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5c22300 00000100:00100000:0.0:1746143695.182817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.185130:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592283520 00000100:00100000:1.0:1746143695.185159:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592283520 00010000:00010000:1.0:1746143695.185206:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 23 pid: 4582 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.192155:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4976 00000100:00100000:3.0:1746143695.192178:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592283520:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.192201:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143695.192234:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 23 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.192250:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 23 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.192276:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cff4e00/0xe984082ccd725b8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1646592->1777663) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18e2 expref: 23 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.192319:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.192321:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.192329:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725bbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f7 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.192343:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725bbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f7 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.192380:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725bbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f7 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.192392:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593746048:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143695.192493:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143695.197713:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593746048:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143695.197738:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143695.198114:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592283520:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5944us (15303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.198124:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4976 00000100:00100000:0.0:1746143695.198338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.199011:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592283776 00000100:00100000:1.0:1746143695.199019:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592283776 00002000:00100000:1.0:1746143695.199058:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880095098380 x1830963592283776/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143695.199068:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098380 with x1830963592283776 ext(1048576->2097151) 00002000:00010000:1.0:1746143695.199073:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095098380 00000100:00100000:1.0:1746143695.199101:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3574 00000100:00100000:1.0:1746143695.199107:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592283776:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143695.211609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.211687:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592284032 00000100:00100000:2.0:1746143695.211698:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592284032 00000100:00100000:2.0:1746143695.211763:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8293 00000100:00100000:2.0:1746143695.211772:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:28466:x1830963592284032:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.211804:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.211828:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652aa00/0xe984082ccd725bc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a18fe expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.211951:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a800/0xe984082ccd725bcc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.211964:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a800/0xe984082ccd725bcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.211975:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a800/0xe984082ccd725bcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.211988:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a000/0xe984082ccd725bd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.211993:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a000/0xe984082ccd725bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.211997:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a000/0xe984082ccd725bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212317:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652bc00/0xe984082ccd725bda lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212326:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652bc00/0xe984082ccd725bda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212331:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652bc00/0xe984082ccd725bda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143695.212339:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143695.212422:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a800/0xe984082ccd725bcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212428:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a800/0xe984082ccd725bcc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212433:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a800/0xe984082ccd725bcc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212438:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a652a800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143695.212441:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a800/0xe984082ccd725bcc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212447:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a800/0xe984082ccd725bcc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212457:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143695.212459:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143695.212463:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a800/0xe984082ccd725bcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212467:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a800/0xe984082ccd725bcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212487:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a000/0xe984082ccd725bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212492:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a000/0xe984082ccd725bd3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212497:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a000/0xe984082ccd725bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212500:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a652a000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143695.212502:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a000/0xe984082ccd725bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212507:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a000/0xe984082ccd725bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212512:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5ab00) 00010000:00010000:2.0:1746143695.212514:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143695.212516:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a000/0xe984082ccd725bd3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212520:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a000/0xe984082ccd725bd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.212555:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652aa00/0xe984082ccd725bc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18fe expref: 256 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.212565:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652bc00/0xe984082ccd725bda lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18fe expref: 255 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.212570:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143695.212572:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143695.212574:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a652bc00, rc 0) 00000100:00100000:2.0:1746143695.212619:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:28466:x1830963592284032:12345-192.168.202.48@tcp:101:cat.0 Request processed in 848us (1021us total) trans 8589942400 rc 0/0 00000100:00100000:2.0:1746143695.212625:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8293 00000100:00100000:0.0:1746143695.214974:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.215031:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592284160 00000100:00100000:3.0:1746143695.215039:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592284160 00000100:00100000:0.0:1746143695.215062:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.215095:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592284288 00000100:00100000:3.0:1746143695.215097:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592284288 00000100:00100000:3.0:1746143695.215114:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9647 00000100:00100000:3.0:1746143695.215121:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592284160:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143695.215127:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9648 00000100:00100000:2.0:1746143695.215136:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592284288:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143695.215137:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.215171:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.215177:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd725be8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1905 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.215181:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a652a600/0xe984082ccd725bef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a190c expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.215200:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.215200:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.215201:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.215202:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.215209:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a652a600/0xe984082ccd725bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a190c expref: 23 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.215210:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd725be8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1905 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.215221:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a652a600/0xe984082ccd725bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a190c expref: 23 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.215222:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd725be8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1905 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.215230:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4e5c00, rc 0) 00010000:00010000:2.0:1746143695.215230:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a652a600, rc 0) 00000100:00100000:2.0:1746143695.215855:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592284288:12345-192.168.202.48@tcp:101:cat.0 Request processed in 718us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.215863:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9648 00000100:00100000:3.0:1746143695.217481:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592284160:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2353us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.217489:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9647 00000100:00100000:1.0:1746143695.218380:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592283776:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19267us (20037us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143695.218391:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3574 00002000:00100000:1.0:1746143695.218403:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880095098380 x1830963592283776/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143695.218412:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098380 with x1830963592283776 ext(1048576->2097151) 00002000:00010000:1.0:1746143695.218418:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095098380 00000100:00100000:2.0:1746143695.223780:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.223939:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592284416 00000100:00100000:3.0:1746143695.223949:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592284416 00000100:00100000:3.0:1746143695.224002:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 571 00000100:00100000:3.0:1746143695.224010:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1964:x1830963592284416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.224027:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143695.224052:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652bc00/0xe984082ccd725bda lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18fe expref: 255 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.224085:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143695.224089:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143695.224137:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:1964:x1830963592284416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 127us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.224160:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 571 00000100:00100000:0.0:1746143695.238918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.238978:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.239012:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592284672 00000100:00100000:1.0:1746143695.239023:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592284672 00000100:00100000:2.0:1746143695.239058:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592284928 00000100:00100000:2.0:1746143695.239063:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592284928 00002000:00100000:1.0:1746143695.239070:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009ff6dc00 x1830963592284672/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143695.239080:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6dc00 with x1830963592284672 ext(0->1048575) 00002000:00100000:2.0:1746143695.239084:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880099c13050 x1830963592284928/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746143695.239085:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6dc00 00002000:00100000:2.0:1746143695.239091:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099c13050 with x1830963592284928 ext(1048576->2097151) 00002000:00010000:2.0:1746143695.239095:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099c13050 00000100:00100000:1.0:1746143695.239615:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3575 00000100:00100000:1.0:1746143695.239624:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592284672:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143695.239687:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3576 00000100:00100000:2.0:1746143695.239694:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592284928:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143695.251246:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.251501:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592285312 00000100:00100000:1.0:1746143695.251510:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592285312 00002000:00100000:1.0:1746143695.251554:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009ff6df80 x1830963592285312/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143695.251564:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6df80 with x1830963592285312 ext(3145728->4194303) 00002000:00010000:1.0:1746143695.251570:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6df80 00000100:00100000:2.0:1746143695.254271:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3577 00000100:00100000:2.0:1746143695.254512:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592285312:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143695.257249:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592284672:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17617us (18333us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143695.257260:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3575 00002000:00100000:3.0:1746143695.257271:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009ff6dc00 x1830963592284672/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.257282:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6dc00 with x1830963592284672 ext(0->1048575) 00002000:00010000:3.0:1746143695.257288:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6dc00 00000100:00100000:1.0:1746143695.261959:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.262246:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592285184 00000100:00100000:2.0:1746143695.262257:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592285184 00002000:00100000:2.0:1746143695.262309:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f1ee300 x1830963592285184/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.262319:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ee300 with x1830963592285184 ext(2097152->3145727) 00002000:00010000:2.0:1746143695.262325:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ee300 00000100:00100000:2.0:1746143695.262358:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3578 00000100:00100000:2.0:1746143695.262365:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592285184:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143695.272808:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592284928:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33101us (33816us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143695.272821:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3576 00002000:00100000:0.0:1746143695.272845:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880099c13050 x1830963592284928/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143695.272855:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099c13050 with x1830963592284928 ext(1048576->2097151) 00002000:00010000:0.0:1746143695.272862:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099c13050 00000100:00100000:3.0:1746143695.281557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.281585:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592285568 00000100:00100000:3.0:1746143695.281594:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592285568 00000100:00100000:3.0:1746143695.281649:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9649 00000100:00100000:3.0:1746143695.281656:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28460:x1830963592285568:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143695.281675:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.281693:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1913 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.281723:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725bbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f7 expref: 14 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.281732:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a652a600/0xe984082ccd725bef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a190c expref: 22 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.281737:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.281738:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.281741:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1232896->2097151] (req 1232896->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 14 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.281769:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a652a600/0xe984082ccd725bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a190c expref: 22 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.281779:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a652a600/0xe984082ccd725bef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a190c expref: 22 pid: 4582 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746143695.281791:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593746176:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.281891:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725bbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f7 expref: 14 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.281899:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725bbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f7 expref: 14 pid: 21542 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.281907:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593746304:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143695.281925:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143695.283465:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592285184:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21094us (21516us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143695.283476:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3578 00002000:00100000:3.0:1746143695.283486:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f1ee300 x1830963592285184/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.283495:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ee300 with x1830963592285184 ext(2097152->3145727) 00002000:00010000:3.0:1746143695.283500:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f1ee300 00000100:00100000:0.0:1746143695.285910:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.286036:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592285824 00000100:00100000:3.0:1746143695.286047:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592285824 00000100:00100000:3.0:1746143695.286096:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8294 00000100:00100000:3.0:1746143695.286104:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:28468:x1830963592285824:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143695.286130:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.286187:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cca00/0xe984082ccd725bfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a191a expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.286302:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc800/0xe984082ccd725c04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286315:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc800/0xe984082ccd725c04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286326:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc800/0xe984082ccd725c04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286339:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc000/0xe984082ccd725c0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286345:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc000/0xe984082ccd725c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286350:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc000/0xe984082ccd725c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286452:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc400/0xe984082ccd725c12 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286461:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc400/0xe984082ccd725c12 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286467:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc400/0xe984082ccd725c12 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143695.286476:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143695.286563:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc800/0xe984082ccd725c04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286570:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc800/0xe984082ccd725c04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286579:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc800/0xe984082ccd725c04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286585:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06cc800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143695.286588:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc800/0xe984082ccd725c04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286595:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc800/0xe984082ccd725c04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286606:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143695.286609:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143695.286613:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc800/0xe984082ccd725c04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286617:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc800/0xe984082ccd725c04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286633:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc000/0xe984082ccd725c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286638:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc000/0xe984082ccd725c0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286643:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc000/0xe984082ccd725c0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286647:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06cc000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143695.286649:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc000/0xe984082ccd725c0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286653:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc000/0xe984082ccd725c0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286662:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f1f4a00) 00010000:00010000:3.0:1746143695.286664:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143695.286667:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc000/0xe984082ccd725c0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286671:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc000/0xe984082ccd725c0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.286707:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cca00/0xe984082ccd725bfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a191a expref: 257 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.286720:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc400/0xe984082ccd725c12 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a191a expref: 256 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.286725:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143695.286727:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143695.286729:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06cc400, rc 0) 00000100:00100000:3.0:1746143695.286772:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:28468:x1830963592285824:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 668us (872us total) trans 8589942401 rc 0/0 00000100:00100000:3.0:1746143695.286779:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8294 00000100:00100000:2.0:1746143695.287322:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592285312:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33040us (36088us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143695.287332:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3577 00002000:00100000:2.0:1746143695.287339:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009ff6df80 x1830963592285312/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.287348:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6df80 with x1830963592285312 ext(3145728->4194303) 00002000:00010000:2.0:1746143695.287352:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6df80 00000100:00100000:0.0:1746143695.288051:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.288127:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593746176:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143695.288158:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593746304:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.288183:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1232896->2097151] (req 1232896->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 14 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.288197:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06cc600, rc 0) 00000100:00100000:3.0:1746143695.288222:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28460:x1830963592285568:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6566us (6676us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.288230:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9649 00000100:00100000:1.0:1746143695.288837:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592285952 00000100:00100000:1.0:1746143695.288843:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592285952 00010000:00010000:1.0:1746143695.288871:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725bbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f7 expref: 14 pid: 21542 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.288903:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4977 00000100:00100000:1.0:1746143695.288910:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592285952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143695.288923:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143695.288944:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725bbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f7 expref: 14 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.288954:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725bbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f7 expref: 14 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.288975:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4c00/0xe984082ccd725bbe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f7 expref: 14 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.290462:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143695.290531:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592285952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1613us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.290541:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4977 00000100:00100000:0.0:1746143695.292051:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.292187:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.292874:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.293057:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592286080 00000100:00100000:1.0:1746143695.293067:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592286080 00000100:00100000:0.0:1746143695.293292:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.293307:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592286336 00000100:00100000:0.0:1746143695.293310:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592286336 00000100:00100000:1.0:1746143695.293536:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592286208 00000100:00100000:1.0:1746143695.293540:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592286208 00010000:00010000:1.0:1746143695.293554:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a652a600/0xe984082ccd725bef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a190c expref: 24 pid: 4582 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746143695.293625:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4978 00000100:00100000:3.0:1746143695.293635:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592286208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.293649:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143695.293674:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a652a600/0xe984082ccd725bef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a190c expref: 24 pid: 4582 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746143695.293686:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a652a600/0xe984082ccd725bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a190c expref: 24 pid: 4582 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746143695.293710:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a652a600/0xe984082ccd725bef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a190c expref: 24 pid: 4582 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746143695.293728:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.293731:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.293739:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.293748:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.293788:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.293802:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593746432:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143695.293884:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143695.293931:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592286464 00000100:00100000:0.0:1746143695.293934:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592286464 00000100:00100000:2.0:1746143695.293969:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9650 00000100:00100000:2.0:1746143695.293977:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592286336:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.293993:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.294005:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd725c20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1921 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.294037:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593746560:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143695.294061:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143695.294079:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 572 00000100:00100000:2.0:1746143695.294084:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:1963:x1830963592286080:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143695.294093:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143695.294107:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc400/0xe984082ccd725c12 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a191a expref: 256 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.294122:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143695.294150:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143695.294170:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1963:x1830963592286080:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 85us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.294175:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 572 00000100:00100000:2.0:1746143695.294208:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9651 00000100:00100000:2.0:1746143695.294212:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28468:x1830963592286464:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143695.294219:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.294228:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1928 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.294243:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4e00/0xe984082ccd725b32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18bf expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.294251:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cff4600/0xe984082ccd725b63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18d4 expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.294256:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.294257:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.294259:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2699264->2805759] (req 2699264->2805759) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.294273:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cff4600/0xe984082ccd725b63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18d4 expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.294283:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cff4600/0xe984082ccd725b63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18d4 expref: 11 pid: 9527 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746143695.294290:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593746688:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.294312:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4e00/0xe984082ccd725b32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18bf expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.294318:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4e00/0xe984082ccd725b32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18bf expref: 25 pid: 4582 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.294324:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593746816:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143695.294336:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136801f00 going to sleep for 11 seconds 00002000:00010000:2.0:1746143695.300503:0:21542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime: 1746143694 -> 1746143695 00000100:00100000:2.0:1746143695.300534:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593746560:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143695.300570:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd725c20 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1921 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.300584:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800950aae00/0xe984082ccd725c20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1921 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.300596:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950aae00, rc 0) 00000100:00100000:2.0:1746143695.300652:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592286336:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6674us (7776us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143695.300660:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9650 00000100:00100000:2.0:1746143695.300712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.300785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.300802:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592286848 00000100:00100000:2.0:1746143695.300808:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592286848 00010000:00010000:2.0:1746143695.300840:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4e00/0xe984082ccd725b32 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18bf expref: 26 pid: 4582 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.300863:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4979 00000100:00100000:2.0:1746143695.300869:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592286848:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143695.300880:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143695.300895:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4e00/0xe984082ccd725b32 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18bf expref: 26 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.300904:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4e00/0xe984082ccd725b32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18bf expref: 26 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.300926:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143695.300943:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592286848:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 74us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.300948:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4979 00000100:00100000:3.0:1746143695.301171:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593746432:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143695.301181:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143695.301196:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592286208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7564us (9009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.301202:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4978 00000100:00100000:0.0:1746143695.301276:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593746688:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143695.301286:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4e00/0xe984082ccd725b32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18bf expref: 25 pid: 4582 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746143695.301300:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593746816:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143695.301317:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2699264->2805759] (req 2699264->2805759) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 24 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.301325:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093238a00, rc 0) 00000100:00100000:0.0:1746143695.301341:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28468:x1830963592286464:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7129us (8049us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143695.301346:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9651 00000100:00100000:2.0:1746143695.301445:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592286720 00000100:00100000:2.0:1746143695.301448:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592286720 00002000:00100000:2.0:1746143695.301475:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1232896->1236991) req@ffff8800930c0000 x1830963592286720/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.301484:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0000 with x1830963592286720 ext(1232896->1236991) 00002000:00010000:2.0:1746143695.301488:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930c0000 00000100:00100000:2.0:1746143695.301827:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3579 00000100:00100000:2.0:1746143695.301843:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592286720:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143695.302865:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592286720:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 1018us (2148us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143695.302872:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3579 00002000:00100000:2.0:1746143695.302879:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1232896->1236991) req@ffff8800930c0000 x1830963592286720/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/4536 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.302886:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0000 with x1830963592286720 ext(1232896->1236991) 00002000:00010000:2.0:1746143695.302890:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930c0000 00000100:00100000:0.0:1746143695.305127:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.305189:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.305260:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592287104 00000100:00100000:3.0:1746143695.305269:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592287104 00010000:00010000:3.0:1746143695.305303:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cff4600/0xe984082ccd725b63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18d4 expref: 12 pid: 9527 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746143695.305334:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4980 00000100:00100000:3.0:1746143695.305340:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592287104:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.305355:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143695.305378:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cff4600/0xe984082ccd725b63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18d4 expref: 12 pid: 9527 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746143695.305390:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cff4600/0xe984082ccd725b63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18d4 expref: 12 pid: 9527 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746143695.305413:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cff4600/0xe984082ccd725b63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18d4 expref: 12 pid: 9527 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746143695.305432:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.305433:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.305441:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.305452:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.305487:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.305499:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593746944:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143695.305588:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143695.305918:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592286976 00000100:00100000:2.0:1746143695.305923:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592286976 00000100:00100000:2.0:1746143695.305945:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9652 00000100:00100000:2.0:1746143695.305950:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592286976:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.305965:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.305977:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093238600/0xe984082ccd725c2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a192f expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.306008:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593747072:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143695.306031:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136801540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143695.306690:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.306742:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592287232 00000100:00100000:3.0:1746143695.306745:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592287232 00000100:00100000:3.0:1746143695.306769:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9653 00000100:00100000:3.0:1746143695.306773:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28466:x1830963592287232:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143695.306781:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.306788:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd400/0xe984082ccd725c35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1936 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.306804:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.306811:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143695.306813:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143695.306816:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd400/0xe984082ccd725c35 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1936 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.306844:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.306860:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.306868:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593747200:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143695.307955:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783000 going to sleep for 11 seconds 00002000:00010000:2.0:1746143695.309825:0:4582:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime: 1746143692 -> 1746143695 00000100:00100000:2.0:1746143695.309862:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593747072:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143695.310698:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093238600/0xe984082ccd725c2e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a192f expref: 13 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.310712:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093238600/0xe984082ccd725c2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a192f expref: 13 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.310729:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093238600, rc 0) 00000100:00100000:2.0:1746143695.310778:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592286976:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4826us (5658us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143695.310787:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9652 00000100:00100000:3.0:1746143695.311164:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593747200:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.311182:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd400/0xe984082ccd725c35 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1936 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.311195:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06cd400, rc 0) 00000100:00100000:3.0:1746143695.311214:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28466:x1830963592287232:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4441us (4527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.311219:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9653 00000100:00100000:3.0:1746143695.311806:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593746944:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143695.311816:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143695.311845:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592287104:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6504us (6654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.311852:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4980 00000100:00100000:0.0:1746143695.313427:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.313607:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592287488 00000100:00100000:2.0:1746143695.313616:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592287488 00002000:00100000:2.0:1746143695.313660:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2699264->2703359) req@ffff88009ff6e300 x1830963592287488/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.314162:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6e300 with x1830963592287488 ext(2699264->2703359) 00010000:00010000:2.0:1746143695.314173:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.314187:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746143695.314193:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6e300 00000100:00100000:2.0:1746143695.314222:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 870 00000100:00100000:2.0:1746143695.314230:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592287488:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143695.314397:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592287488:12345-192.168.202.48@tcp:3:cat.0 Request processed in 168us (974us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143695.314403:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 870 00002000:00100000:2.0:1746143695.314409:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2699264->2703359) req@ffff88009ff6e300 x1830963592287488/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/4536 e 0 to 0 dl 1746143706 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.314421:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6e300 with x1830963592287488 ext(2699264->2703359) 00010000:00010000:2.0:1746143695.314426:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.314434:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746143695.314439:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6e300 00000100:00100000:0.0:1746143695.318233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.318300:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592287616 00000100:00100000:3.0:1746143695.318310:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592287616 00000100:00100000:3.0:1746143695.318366:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9654 00000100:00100000:3.0:1746143695.318378:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28456:x1830963592287616:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143695.318398:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.318418:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725c3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a193d expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.318445:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143695.318450:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725c3c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a193d expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.318468:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725c3c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a193d expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.318478:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06cce00, rc 0) 00000100:00100000:3.0:1746143695.318524:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28456:x1830963592287616:12345-192.168.202.48@tcp:101:cat.0 Request processed in 147us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.318530:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9654 00000100:00100000:0.0:1746143695.321816:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.321879:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592287872 00000100:00100000:3.0:1746143695.321888:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592287872 00002000:00100000:3.0:1746143695.321936:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2801664->2805759) req@ffff88009ff6c700 x1830963592287872/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.321945:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c700 with x1830963592287872 ext(2801664->2805759) 00010000:00010000:3.0:1746143695.321955:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.321969:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746143695.321976:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6c700 00000100:00100000:3.0:1746143695.322010:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 871 00000100:00100000:3.0:1746143695.322017:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592287872:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143695.322240:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592287872:12345-192.168.202.48@tcp:3:cat.0 Request processed in 223us (433us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143695.322247:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 871 00002000:00100000:3.0:1746143695.322253:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2801664->2805759) req@ffff88009ff6c700 x1830963592287872/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/4536 e 0 to 0 dl 1746143706 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.322260:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c700 with x1830963592287872 ext(2801664->2805759) 00010000:00010000:3.0:1746143695.322264:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.322273:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746143695.322279:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6c700 00000100:00100000:0.0:1746143695.326200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.327285:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592288000 00000100:00100000:2.0:1746143695.327295:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592288000 00000100:00100000:2.0:1746143695.327347:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9655 00000100:00100000:2.0:1746143695.327356:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28460:x1830963592288000:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143695.327376:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.327396:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1944 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.327428:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd72583e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1729 expref: 6 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.327436:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6000/0xe984082ccd72596b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17c3 expref: 24 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.327442:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a21ffe00/0xe984082ccd7258df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1768 expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.327447:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.327449:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.327452:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1048576->1204223] (req 1048576->1204223) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 13 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.327479:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a21ffe00/0xe984082ccd7258df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1768 expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.327488:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a21ffe00/0xe984082ccd7258df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1768 expref: 13 pid: 9527 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746143695.327499:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593747328:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.327575:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6000/0xe984082ccd72596b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17c3 expref: 24 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.327582:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6000/0xe984082ccd72596b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17c3 expref: 24 pid: 25369 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746143695.327588:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593747456:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.327604:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd72583e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1729 expref: 6 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.327610:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd72583e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1729 expref: 6 pid: 15784 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746143695.327617:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593747584:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143695.327630:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136801d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143695.327738:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.327800:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.327992:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592288512 00000100:00100000:3.0:1746143695.327996:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592288512 00000100:00100000:3.0:1746143695.328023:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3378 00000100:00100000:3.0:1746143695.328029:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:28468:x1830963592288512:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143695.328254:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:28468:x1830963592288512:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 225us (453us total) trans 8589942402 rc 0/0 00000100:00100000:3.0:1746143695.328260:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3378 00000100:00100000:2.0:1746143695.329455:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592288256 00000100:00100000:2.0:1746143695.329460:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592288256 00002000:00100000:2.0:1746143695.329486:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2699264->2805759) req@ffff88009ff6dc00 x1830963592288256/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.329495:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6dc00 with x1830963592288256 ext(2699264->2805759) 00010000:00010000:2.0:1746143695.329502:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.329512:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 25 pid: 4582 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746143695.329519:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6dc00 00000100:00100000:2.0:1746143695.329532:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 872 00000100:00100000:2.0:1746143695.329536:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592288256:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143695.331092:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593747328:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143695.331104:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593747456:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143695.331112:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593747584:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.331182:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1048576->1204223] (req 1048576->1204223) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 13 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.331198:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093238400, rc 0) 00000100:00100000:2.0:1746143695.331232:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28460:x1830963592288000:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3877us (5043us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.331240:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9655 00000100:00100000:0.0:1746143695.336912:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.336978:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592288640 00000100:00100000:3.0:1746143695.336989:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592288640 00010000:00010000:3.0:1746143695.337031:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd72583e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1729 expref: 7 pid: 15784 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746143695.337073:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4981 00000100:00100000:3.0:1746143695.337083:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963592288640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.337099:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143695.337103:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143695.337123:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd72583e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1729 expref: 7 pid: 15784 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746143695.337124:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592288768 00000100:00100000:2.0:1746143695.337127:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592288768 00010000:00010000:3.0:1746143695.337135:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd72583e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1729 expref: 7 pid: 15784 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746143695.337168:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6000/0xe984082ccd72596b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17c3 expref: 27 pid: 25369 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746143695.337183:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4982 00010000:00010000:3.0:1746143695.337185:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd72583e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1729 expref: 7 pid: 15784 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746143695.337188:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592288768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143695.337194:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143695.337203:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143695.337211:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6000/0xe984082ccd72596b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17c3 expref: 27 pid: 25369 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746143695.337219:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6000/0xe984082ccd72596b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17c3 expref: 27 pid: 25369 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746143695.337230:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6000/0xe984082ccd72596b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a17c3 expref: 27 pid: 25369 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746143695.337241:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143695.337290:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592288768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 101us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.337296:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4982 00000100:00100000:1.0:1746143695.337348:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.337362:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592288896 00000100:00100000:2.0:1746143695.337365:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592288896 00010000:00010000:2.0:1746143695.337376:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21ffe00/0xe984082ccd7258df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1768 expref: 13 pid: 9527 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746143695.337393:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4983 00000100:00100000:2.0:1746143695.337397:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592288896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143695.337404:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1965:x1830963592288640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 323us (503us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143695.337404:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143695.337410:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4981 00010000:00010000:2.0:1746143695.337410:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a21ffe00/0xe984082ccd7258df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1768 expref: 13 pid: 9527 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746143695.337417:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a21ffe00/0xe984082ccd7258df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1768 expref: 13 pid: 9527 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746143695.337428:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a21ffe00/0xe984082ccd7258df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1768 expref: 13 pid: 9527 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746143695.337441:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.337443:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.337450:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 12 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.337459:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 12 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.337507:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 12 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.337520:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593747712:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143695.337581:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136801d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143695.339933:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592288256:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10388us (12187us total) trans 17179872464 rc 0/0 00000100:00100000:2.0:1746143695.339944:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 872 00002000:00100000:2.0:1746143695.339956:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2699264->2805759) req@ffff88009ff6dc00 x1830963592288256/t17179872464(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/448 e 0 to 0 dl 1746143706 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.339965:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6dc00 with x1830963592288256 ext(2699264->2805759) 00010000:00010000:2.0:1746143695.339975:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 26 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.339990:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 26 pid: 4582 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746143695.339996:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6dc00 00000100:00100000:2.0:1746143695.344589:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593747712:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143695.344613:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143695.345443:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592288896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8040us (8090us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.345454:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4983 00000100:00100000:0.0:1746143695.345615:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.345713:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.345764:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592289152 00000100:00100000:2.0:1746143695.345771:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592289152 00002000:00100000:2.0:1746143695.345807:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1200128->1204223) req@ffff88009ff6c380 x1830963592289152/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.345816:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c380 with x1830963592289152 ext(1200128->1204223) 00002000:00010000:2.0:1746143695.345821:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6c380 00000100:00100000:2.0:1746143695.345843:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3580 00000100:00100000:2.0:1746143695.345850:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592289152:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143695.346049:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592289152:12345-192.168.202.48@tcp:3:cat.0 Request processed in 198us (433us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143695.346058:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3580 00002000:00100000:2.0:1746143695.346063:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1200128->1204223) req@ffff88009ff6c380 x1830963592289152/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/4536 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.346070:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c380 with x1830963592289152 ext(1200128->1204223) 00002000:00010000:2.0:1746143695.346072:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6c380 00000100:00100000:3.0:1746143695.346400:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592289280 00000100:00100000:3.0:1746143695.346405:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592289280 00010000:00010000:3.0:1746143695.346427:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 26 pid: 4582 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.346446:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4984 00000100:00100000:3.0:1746143695.346450:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592289280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.346459:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143695.346472:0:11106:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143694 -> 1746143695 00002000:00010000:3.0:1746143695.346475:0:11106:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143694 -> 1746143695 00010000:00010000:3.0:1746143695.346479:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 26 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.346491:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 26 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.346514:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093238a00/0xe984082ccd725c27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2699264->2805759) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1928 expref: 26 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.346527:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.346529:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.346536:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd400/0xe984082ccd725c35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1936 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.346545:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd400/0xe984082ccd725c35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1936 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.346554:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.346555:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.346559:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725c3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a193d expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.346565:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725c3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a193d expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.346593:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725c3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a193d expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.346605:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593747840:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143695.348977:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd400/0xe984082ccd725c35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1936 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.348995:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593747968:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143695.349066:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143695.351430:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593747840:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143695.351753:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.353792:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963593747968:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143695.353817:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143695.353885:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592289280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7432us (8168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.353895:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4984 00000100:00100000:3.0:1746143695.354008:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592289536 00000100:00100000:3.0:1746143695.354015:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592289536 00002000:00100000:3.0:1746143695.354055:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009ff6ce00 x1830963592289536/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.354064:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ce00 with x1830963592289536 ext(4194304->4898815) 00002000:00010000:3.0:1746143695.354069:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ce00 00000100:00100000:3.0:1746143695.354093:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3581 00000100:00100000:3.0:1746143695.354100:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592289536:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143695.360431:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.361082:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592289792 00000100:00100000:2.0:1746143695.361092:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592289792 00002000:00100000:2.0:1746143695.361171:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009ff6ed80 x1830963592289792/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.361182:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ed80 with x1830963592289792 ext(4194304->4898815) 00002000:00010000:2.0:1746143695.361187:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ed80 00000100:00100000:2.0:1746143695.361213:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3582 00000100:00100000:2.0:1746143695.361221:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592289792:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143695.364104:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592289536:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9993us (12343us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143695.364115:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3581 00002000:00100000:3.0:1746143695.364124:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009ff6ce00 x1830963592289536/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.364134:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ce00 with x1830963592289536 ext(4194304->4898815) 00002000:00010000:3.0:1746143695.364154:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ce00 00000100:00100000:2.0:1746143695.380479:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592289792:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19246us (20046us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143695.380492:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3582 00002000:00100000:2.0:1746143695.380504:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009ff6ed80 x1830963592289792/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.380520:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ed80 with x1830963592289792 ext(4194304->4898815) 00002000:00010000:2.0:1746143695.380526:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ed80 00000100:00100000:1.0:1746143695.381004:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.381071:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592290048 00000100:00100000:2.0:1746143695.381078:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592290048 00000100:00100000:2.0:1746143695.381699:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3379 00000100:00100000:2.0:1746143695.381707:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ecd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28456:x1830963592290048:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143695.382650:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ecd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28456:x1830963592290048:12345-192.168.202.48@tcp:35:cat.0 Request processed in 942us (1645us total) trans 8589942403 rc 0/0 00000100:00100000:3.0:1746143695.382658:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3379 00000100:00100000:0.0:1746143695.386240:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.386286:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.386385:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592290176 00000100:00100000:2.0:1746143695.386394:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592290176 00000100:00100000:2.0:1746143695.386432:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592290304 00000100:00100000:2.0:1746143695.386434:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592290304 00000100:00100000:2.0:1746143695.386457:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9656 00000100:00100000:2.0:1746143695.386464:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592290176:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.386483:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.386500:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093238200/0xe984082ccd725c4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a194b expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.386556:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593748096:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143695.386630:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368019c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143695.386651:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9657 00000100:00100000:2.0:1746143695.386656:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592290304:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.386664:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.386673:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093239e00/0xe984082ccd725c51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1952 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.386697:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593748224:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143695.386719:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136801c00 going to sleep for 11 seconds 00002000:00010000:2.0:1746143695.387980:0:25369:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143692 -> 1746143695 00002000:00010000:2.0:1746143695.387984:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143691 -> 1746143695 00002000:00010000:2.0:1746143695.387986:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143692 -> 1746143695 00000100:00100000:2.0:1746143695.388006:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593748224:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143695.388028:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093239e00/0xe984082ccd725c51 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1952 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.388039:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093239e00/0xe984082ccd725c51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1952 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.388049:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093239e00, rc 0) 00000100:00100000:2.0:1746143695.388074:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592290304:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1417us (1787us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143695.388080:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9657 00002000:00010000:3.0:1746143695.388205:0:4582:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime: 1746143694 -> 1746143695 00002000:00010000:3.0:1746143695.388208:0:4582:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime: 1746143694 -> 1746143695 00000100:00100000:3.0:1746143695.388220:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593748096:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143695.388233:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093238200/0xe984082ccd725c4a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a194b expref: 23 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.388241:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093238200/0xe984082ccd725c4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a194b expref: 23 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.388252:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093238200, rc 0) 00000100:00100000:3.0:1746143695.388272:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592290176:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1809us (2041us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143695.388277:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9656 00000100:00100000:2.0:1746143695.397157:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.397198:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.397219:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592290560 00000100:00100000:2.0:1746143695.397227:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592290560 00000100:00100000:2.0:1746143695.397261:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592290432 00000100:00100000:2.0:1746143695.397263:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592290432 00000100:00100000:2.0:1746143695.397278:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9658 00000100:00100000:2.0:1746143695.397284:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592290560:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.397304:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.397320:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093239400/0xe984082ccd725c58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1960 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.397375:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593748352:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143695.397437:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136801c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143695.398483:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9659 00000100:00100000:1.0:1746143695.398495:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592290432:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143695.398506:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.398519:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5fde400/0xe984082ccd725c5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1959 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.398554:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593748480:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143695.398594:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143695.400482:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593748352:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143695.400510:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093239400/0xe984082ccd725c58 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1960 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.400523:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093239400/0xe984082ccd725c58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1960 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.400538:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093239400, rc 0) 00000100:00100000:3.0:1746143695.400569:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592290560:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3284us (3442us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143695.400576:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9658 00000100:00100000:1.0:1746143695.402040:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593748480:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143695.402062:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5fde400/0xe984082ccd725c5f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1959 expref: 23 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.402078:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5fde400/0xe984082ccd725c5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1959 expref: 23 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.402102:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fde400, rc 0) 00000100:00100000:1.0:1746143695.402752:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592290432:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4258us (5550us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143695.402759:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9659 00000100:00100000:0.0:1746143695.408076:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.408163:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592290816 00000100:00100000:3.0:1746143695.408174:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592290816 00000100:00100000:3.0:1746143695.408219:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3380 00000100:00100000:3.0:1746143695.408227:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:28466:x1830963592290816:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143695.408985:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:28466:x1830963592290816:12345-192.168.202.48@tcp:35:cat.0 Request processed in 757us (919us total) trans 8589942404 rc 0/0 00000100:00100000:3.0:1746143695.408992:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3380 00000100:00100000:0.0:1746143695.417886:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.418005:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592290944 00000100:00100000:2.0:1746143695.418014:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592290944 00000100:00100000:2.0:1746143695.418066:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8295 00000100:00100000:2.0:1746143695.418073:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28473:x1830963592290944:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143695.418098:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.418116:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725c66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1967 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.418202:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093238000/0xe984082ccd725c6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.418215:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093238000/0xe984082ccd725c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.418227:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093238000/0xe984082ccd725c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.418242:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093239400/0xe984082ccd725c74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.418248:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093239400/0xe984082ccd725c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.418252:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093239400/0xe984082ccd725c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.418363:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.418377:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a188e expref: 19 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.418384:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.418416:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a188e expref: 19 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.418428:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a188e expref: 19 pid: 21713 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.418440:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593748608:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143695.418513:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136801840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143695.421025:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593748608:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.421048:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143695.421684:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.421966:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592291200 00000100:00100000:3.0:1746143695.421973:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592291200 00000100:00100000:3.0:1746143695.422016:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3381 00000100:00100000:3.0:1746143695.422024:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:23699:x1830963592291200:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143695.424096:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:23699:x1830963592291200:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 2066us (2409us total) trans 8589942405 rc 0/0 00000100:00100000:3.0:1746143695.424106:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3381 00000100:00100000:0.0:1746143695.426908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.427005:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592291328 00000100:00100000:3.0:1746143695.427013:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592291328 00010000:00010000:3.0:1746143695.427047:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a188e expref: 21 pid: 21713 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.427796:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4985 00000100:00100000:3.0:1746143695.427805:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592291328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.427819:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143695.427825:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a188e expref: 21 pid: 21713 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.427847:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a188e expref: 21 pid: 21713 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.427869:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2211800/0xe984082ccd725ac2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a188e expref: 21 pid: 21713 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.428290:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143695.428297:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143695.428308:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143695.428315:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143695.428346:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143695.428371:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428379:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:3.0:1746143695.428392:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592291328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 587us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.428399:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4985 00000004:00200000:2.0:1746143695.428420:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:2.0:1746143695.428424:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143695.428440:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428450:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428459:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093238000/0xe984082ccd725c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428465:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093238000/0xe984082ccd725c6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428471:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093238000/0xe984082ccd725c6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428476:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093238000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143695.428480:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093238000/0xe984082ccd725c6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428486:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093238000/0xe984082ccd725c6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428495:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143695.428497:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143695.428501:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093238000/0xe984082ccd725c6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428505:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093238000/0xe984082ccd725c6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428525:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093239400/0xe984082ccd725c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428530:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093239400/0xe984082ccd725c74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428534:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093239400/0xe984082ccd725c74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428538:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093239400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143695.428540:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093239400/0xe984082ccd725c74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428544:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093239400/0xe984082ccd725c74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428550:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a800) 00010000:00010000:2.0:1746143695.428552:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143695.428554:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093239400/0xe984082ccd725c74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428558:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093239400/0xe984082ccd725c74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.428591:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725c66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1967 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.428603:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1967 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.428609:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143695.428611:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143695.428612:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093239000, rc 0) 00000100:00100000:2.0:1746143695.428640:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28473:x1830963592290944:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 10568us (10765us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.428646:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8295 00000100:00100000:0.0:1746143695.433631:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.434170:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.434404:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.434543:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.434580:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592291456 00000100:00100000:1.0:1746143695.434589:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592291456 00000100:00100000:1.0:1746143695.434627:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592291712 00000100:00100000:1.0:1746143695.434628:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592291712 00000100:00100000:1.0:1746143695.434640:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592291968 00000100:00100000:1.0:1746143695.434641:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592291968 00000100:00100000:1.0:1746143695.434654:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9660 00000100:00100000:1.0:1746143695.434660:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963592291456:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143695.434678:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.434696:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5fde600/0xe984082ccd725c82 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a196e expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.434723:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.434725:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.434735:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5fde600/0xe984082ccd725c82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a196e expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.434750:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5fde600/0xe984082ccd725c82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a196e expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.434767:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fde600, rc 0) 00000100:00100000:1.0:1746143695.434814:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592291456:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 153us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.434819:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9660 00000100:00100000:1.0:1746143695.434856:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9661 00000100:00100000:1.0:1746143695.434861:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963592291712:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143695.434868:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.434877:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdea00/0xe984082ccd725c89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a197c expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.434917:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593748736:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143695.434961:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143695.434981:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9662 00000100:00100000:1.0:1746143695.434986:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963592291968:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143695.434991:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.434997:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725c90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a198a expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.435006:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.435007:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.435012:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725c90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a198a expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.435019:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725c90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a198a expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.435029:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fdfc00, rc 0) 00000100:00100000:1.0:1746143695.435043:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592291968:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 57us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.435047:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9662 00000100:00100000:0.0:1746143695.435553:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.435781:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592291584 00000100:00100000:3.0:1746143695.435785:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592291584 00000100:00100000:3.0:1746143695.435805:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592291840 00000100:00100000:3.0:1746143695.435806:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592291840 00000100:00100000:3.0:1746143695.435815:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9663 00000100:00100000:3.0:1746143695.435819:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592291584:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143695.435825:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.435841:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06cca00/0xe984082ccd725c97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1975 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.435854:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.435855:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.435861:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06cca00/0xe984082ccd725c97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1975 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.435877:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a06cca00/0xe984082ccd725c97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1975 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.435884:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06cca00, rc 0) 00000100:00100000:3.0:1746143695.435903:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592291584:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 84us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.435908:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9663 00000100:00100000:3.0:1746143695.435918:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9664 00000100:00100000:3.0:1746143695.435922:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592291840:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143695.435927:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.435932:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725c9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1983 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.435953:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593748864:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143695.435976:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7830c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143695.438109:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593748864:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143695.438248:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593748736:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143695.438269:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdea00/0xe984082ccd725c89 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a197c expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.438279:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdea00/0xe984082ccd725c89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a197c expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.438608:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725c9e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1983 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.438617:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725c9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1983 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.438625:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06cc200, rc 0) 00010000:00010000:1.0:1746143695.438668:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fdea00, rc 0) 00000100:00100000:3.0:1746143695.438890:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592291840:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2965us (3336us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143695.438898:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9664 00000100:00100000:1.0:1746143695.439814:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592291712:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4949us (5641us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143695.439820:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9661 00000100:00100000:0.0:1746143695.444560:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.444726:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592292224 00000100:00100000:2.0:1746143695.444736:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592292224 00000100:00100000:2.0:1746143695.445601:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8296 00000100:00100000:2.0:1746143695.445611:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28473:x1830963592292224:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143695.445636:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.445654:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093239e00/0xe984082ccd725ca5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1991 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.445751:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.445767:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1967 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.445774:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.445806:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1967 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.445818:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1967 expref: 10 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.445843:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593748992:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143695.445939:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136801840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143695.449522:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593748992:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.449550:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143695.449892:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.450329:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592292352 00000100:00100000:2.0:1746143695.450336:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592292352 00010000:00010000:2.0:1746143695.450370:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1967 expref: 11 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.450407:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4986 00000100:00100000:2.0:1746143695.450413:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592292352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143695.450425:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143695.450429:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1967 expref: 11 pid: 16090 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.450439:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1967 expref: 11 pid: 16090 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.450461:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093239000/0xe984082ccd725c7b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1967 expref: 11 pid: 16090 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.451006:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143695.451012:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.451021:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.451028:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.451057:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143695.451110:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592292352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 695us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.451117:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4986 00010000:00010000:3.0:1746143695.451400:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143695.451408:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143695.451426:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143695.451568:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093239e00/0xe984082ccd725ca5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1991 expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.451587:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1991 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.451592:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143695.451595:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143695.451597:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093239a00, rc 0) 00000100:00100000:3.0:1746143695.451624:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28473:x1830963592292224:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 6015us (7075us total) trans 8589942406 rc 0/0 00000100:00100000:3.0:1746143695.451631:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8296 00000100:00100000:0.0:1746143695.455318:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.456266:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592292480 00000100:00100000:3.0:1746143695.456276:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592292480 00000100:00100000:3.0:1746143695.456390:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8297 00000100:00100000:3.0:1746143695.456399:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28473:x1830963592292480:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143695.456427:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.456448:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc200/0xe984082ccd725cba lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1998 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.456533:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06ccc00/0xe984082ccd725cc1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143695.456547:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1991 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.456553:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06ccc00/0xe984082ccd725cc1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143695.456587:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1991 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.456599:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1991 expref: 11 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.456611:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593749120:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143695.456704:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7830c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143695.459950:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593749120:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.459978:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06ccc00/0xe984082ccd725cc1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143695.460650:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.461034:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592292608 00000100:00100000:2.0:1746143695.461041:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592292608 00010000:00010000:2.0:1746143695.461073:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1991 expref: 12 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.461110:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4987 00000100:00100000:2.0:1746143695.461117:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592292608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143695.461129:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143695.461134:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1991 expref: 12 pid: 16090 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.461176:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1991 expref: 12 pid: 16090 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.461198:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093239a00/0xe984082ccd725cac lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1991 expref: 12 pid: 16090 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.461227:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143695.461232:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06ccc00/0xe984082ccd725cc1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.461241:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06ccc00/0xe984082ccd725cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.461247:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06ccc00/0xe984082ccd725cc1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.461263:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143695.461303:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592292608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 186us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.461309:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4987 00010000:00010000:3.0:1746143695.462594:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06ccc00/0xe984082ccd725cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143695.462604:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06ccc00/0xe984082ccd725cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143695.462646:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:3.0:1746143695.462651:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143695.462667:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06ccc00/0xe984082ccd725cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143695.462700:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cc200/0xe984082ccd725cba lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1998 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.462730:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06ccc00/0xe984082ccd725cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1998 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.462736:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143695.462739:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143695.462742:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06ccc00, rc 0) 00000100:00100000:3.0:1746143695.462779:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28473:x1830963592292480:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 6380us (7470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.462787:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8297 00000100:00100000:0.0:1746143695.467565:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.467597:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.467660:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592292864 00000100:00100000:3.0:1746143695.467670:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592292864 00000100:00100000:3.0:1746143695.467706:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592292736 00000100:00100000:3.0:1746143695.467708:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592292736 00000100:00100000:3.0:1746143695.467722:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9665 00000100:00100000:3.0:1746143695.467729:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592292864:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143695.467749:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.467766:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd800/0xe984082ccd725cc8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a19a6 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.467815:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593749248:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143695.467896:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7830c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143695.468080:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9666 00000100:00100000:1.0:1746143695.468088:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592292736:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143695.468096:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.468107:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725ccf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a199f expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.468133:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593749376:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143695.468191:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143695.471090:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593749248:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143695.471168:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd800/0xe984082ccd725cc8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19a6 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.471182:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd800/0xe984082ccd725cc8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19a6 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143695.471310:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593749376:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143695.471328:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725ccf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a199f expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.471337:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725ccf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a199f expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.471360:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fdfe00, rc 0) 00000100:00100000:1.0:1746143695.471402:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592292736:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3314us (3803us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143695.471411:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9666 00010000:00010000:3.0:1746143695.471904:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06cd800, rc 0) 00000100:00100000:3.0:1746143695.471927:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592292864:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4198us (4373us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143695.471933:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9665 00000100:00100000:0.0:1746143695.474807:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.475430:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592293120 00000100:00100000:3.0:1746143695.475439:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592293120 00000100:00100000:3.0:1746143695.475483:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8298 00000100:00100000:3.0:1746143695.475489:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28473:x1830963592293120:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143695.475508:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.475527:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cd200/0xe984082ccd725cd6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a19ad expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.475610:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cd600/0xe984082ccd725cdd lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143695.475623:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cd600/0xe984082ccd725cdd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143695.475633:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cd600/0xe984082ccd725cdd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143695.475642:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143695.475743:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cd200/0xe984082ccd725cd6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19ad expref: 13 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.475759:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cd600/0xe984082ccd725cdd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19ad expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.475766:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143695.475769:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143695.475772:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06cd600, rc 0) 00000100:00100000:3.0:1746143695.475825:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28473:x1830963592293120:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 335us (1025us total) trans 8589942407 rc 0/0 00000100:00100000:3.0:1746143695.475838:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8298 00000100:00100000:0.0:1746143695.478443:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.478477:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.478500:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.478524:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592293248 00000100:00100000:0.0:1746143695.478531:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592293248 00000100:00100000:0.0:1746143695.478568:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592293504 00000100:00100000:0.0:1746143695.478571:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592293504 00000100:00100000:0.0:1746143695.478594:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592293760 00000100:00100000:0.0:1746143695.478597:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592293760 00000100:00100000:0.0:1746143695.478610:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9667 00000100:00100000:0.0:1746143695.478617:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592293248:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143695.478659:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.478677:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4600/0xe984082ccd725bb7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f0 expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.478684:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5fde600/0xe984082ccd725c82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a196e expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143695.478692:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd725be8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1905 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143695.478697:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143695.478699:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143695.478702:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.478731:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd725be8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1905 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143695.478743:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd725be8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1905 expref: 24 pid: 21542 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746143695.478755:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593749504:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143695.478847:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5fde600/0xe984082ccd725c82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a196e expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143695.478855:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5fde600/0xe984082ccd725c82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a196e expref: 9 pid: 9527 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746143695.478862:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f02680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593749632:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143695.478887:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4600/0xe984082ccd725bb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f0 expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.478894:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4600/0xe984082ccd725bb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f0 expref: 11 pid: 21542 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746143695.478900:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593749760:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143695.478913:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0736c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143695.478932:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9668 00000100:00100000:0.0:1746143695.478937:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963592293504:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143695.478957:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.478967:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.478972:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143695.478973:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143695.478975:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.478988:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.478995:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 12 pid: 21542 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746143695.479003:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593749888:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143695.479019:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143695.479039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.479087:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.479119:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.479717:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592293376 00000100:00100000:3.0:1746143695.479722:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592293376 00000100:00100000:3.0:1746143695.479746:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592293632 00000100:00100000:3.0:1746143695.479747:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592293632 00000100:00100000:3.0:1746143695.479757:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592293888 00000100:00100000:3.0:1746143695.479758:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592293888 00000100:00100000:3.0:1746143695.479768:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9669 00000100:00100000:3.0:1746143695.479773:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592293760:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143695.479792:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.479803:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd400/0xe984082ccd725c35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1936 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.479810:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725c90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a198a expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.479817:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725c3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a193d expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.479823:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.479824:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.479826:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.479850:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725c3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a193d expref: 11 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.479858:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725c3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a193d expref: 11 pid: 21542 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.479866:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593750016:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.479914:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725c90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a198a expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.479922:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725c90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a198a expref: 10 pid: 4581 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746143695.479928:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593750144:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.479953:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd400/0xe984082ccd725c35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1936 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.479960:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd400/0xe984082ccd725c35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1936 expref: 24 pid: 21542 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.479973:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593750272:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143695.479990:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143695.480007:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9670 00000100:00100000:3.0:1746143695.480013:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592293376:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143695.480029:0:8495:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.480040:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd725aad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1880 expref: 12 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.480046:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06cca00/0xe984082ccd725c97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1975 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.480054:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800952eea00/0xe984082ccd725b16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18a3 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.480059:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.480060:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.480062:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.480077:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800952eea00/0xe984082ccd725b16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18a3 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.480083:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800952eea00/0xe984082ccd725b16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18a3 expref: 21 pid: 25369 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746143695.480091:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593750400:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.480112:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06cca00/0xe984082ccd725c97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1975 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.480119:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a06cca00/0xe984082ccd725c97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1975 expref: 10 pid: 8495 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746143695.480125:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593750528:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.480159:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd725aad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1880 expref: 12 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.480164:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd725aad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1880 expref: 12 pid: 25369 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.480170:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593750656:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143695.480184:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143695.480299:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9671 00000100:00100000:1.0:1746143695.480306:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592293632:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143695.480322:0:6929:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.480331:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 11 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.480335:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143695.480336:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143695.480338:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.480350:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 11 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.480362:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 11 pid: 4582 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.480369:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593750784:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143695.480396:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143695.480412:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9672 00000100:00100000:1.0:1746143695.480416:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592293888:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143695.480429:0:12618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.480438:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800952eb800/0xe984082ccd7259f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1810 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.480444:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210600/0xe984082ccd725a9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1879 expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.480449:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b30a00/0xe984082ccd725a52 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1848 expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.480453:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.480454:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.480456:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.480467:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093b30a00/0xe984082ccd725a52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1848 expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.480473:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093b30a00/0xe984082ccd725a52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1848 expref: 10 pid: 21542 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746143695.480480:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593750912:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.480497:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2210600/0xe984082ccd725a9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1879 expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.480503:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a2210600/0xe984082ccd725a9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1879 expref: 12 pid: 25369 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746143695.480509:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593751040:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.480522:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800952eb800/0xe984082ccd7259f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1810 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.480527:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800952eb800/0xe984082ccd7259f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1810 expref: 21 pid: 25369 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.480533:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593751168:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143695.480546:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143695.488257:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593749504:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143695.500113:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.500129:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.500166:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.500195:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592294144 00000100:00100000:0.0:1746143695.500204:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592294144 00010000:00010000:0.0:1746143695.500242:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5fde600/0xe984082ccd725c82 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a196e expref: 11 pid: 9527 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746143695.500268:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592294400 00000100:00100000:0.0:1746143695.500270:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592294400 00010000:00010000:0.0:1746143695.500281:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4600/0xe984082ccd725bb7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f0 expref: 12 pid: 21542 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746143695.500293:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592294016 00000100:00100000:0.0:1746143695.500296:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592294016 00010000:00010000:0.0:1746143695.500306:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd725be8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1905 expref: 25 pid: 21542 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746143695.500320:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4988 00000100:00100000:0.0:1746143695.500327:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592294144:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143695.500342:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143695.500367:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5fde600/0xe984082ccd725c82 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a196e expref: 11 pid: 9527 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.500378:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5fde600/0xe984082ccd725c82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a196e expref: 11 pid: 9527 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.500405:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143695.500449:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592294144:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 122us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143695.500455:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4988 00000100:00100000:0.0:1746143695.500473:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4989 00000100:00100000:0.0:1746143695.500478:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592294400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143695.500484:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143695.500491:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4600/0xe984082ccd725bb7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f0 expref: 12 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746143695.500499:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4600/0xe984082ccd725bb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f0 expref: 12 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746143695.500509:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143695.500523:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592294400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 45us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143695.500527:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4989 00000100:00100000:0.0:1746143695.500537:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4990 00000100:00100000:0.0:1746143695.500541:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592294016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143695.500545:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143695.500551:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd725be8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1905 expref: 25 pid: 21542 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.500559:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd725be8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1905 expref: 25 pid: 21542 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.500571:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5c00/0xe984082ccd725be8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1905 expref: 25 pid: 21542 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.500588:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143695.500590:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143695.500595:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.500602:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.500618:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143695.500632:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963592294016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 91us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143695.500636:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4990 00000100:00100000:0.0:1746143695.500694:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.500707:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592294272 00000100:00100000:0.0:1746143695.500710:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592294272 00010000:00010000:0.0:1746143695.500721:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800952eea00/0xe984082ccd725b16 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18a3 expref: 22 pid: 25369 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746143695.500732:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4991 00000100:00100000:0.0:1746143695.500735:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592294272:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143695.500742:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143695.500755:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800952eea00/0xe984082ccd725b16 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18a3 expref: 22 pid: 25369 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.500762:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800952eea00/0xe984082ccd725b16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18a3 expref: 22 pid: 25369 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.500773:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143695.500787:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592294272:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143695.500791:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4991 00000100:00100000:0.0:1746143695.500851:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.500874:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.500883:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592294656 00000100:00100000:0.0:1746143695.500886:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592294656 00010000:00010000:0.0:1746143695.500896:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725c90 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a198a expref: 11 pid: 4581 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746143695.500905:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4992 00000100:00100000:0.0:1746143695.500909:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592294656:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143695.500916:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143695.500924:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725c90 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a198a expref: 11 pid: 4581 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.500930:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725c90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a198a expref: 11 pid: 4581 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.500939:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143695.500952:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592294656:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 42us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143695.500956:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4992 00000100:00100000:0.0:1746143695.500983:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.500992:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592294912 00000100:00100000:0.0:1746143695.500995:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592294912 00010000:00010000:0.0:1746143695.501003:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06cca00/0xe984082ccd725c97 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1975 expref: 11 pid: 8495 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746143695.501013:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4993 00000100:00100000:0.0:1746143695.501017:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592294912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143695.501022:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143695.501028:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a06cca00/0xe984082ccd725c97 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1975 expref: 11 pid: 8495 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.501035:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a06cca00/0xe984082ccd725c97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1975 expref: 11 pid: 8495 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.501045:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143695.501058:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592294912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 40us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143695.501063:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4993 00000100:00100000:0.0:1746143695.501088:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.501096:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592294784 00000100:00100000:0.0:1746143695.501098:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592294784 00010000:00010000:0.0:1746143695.501105:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd400/0xe984082ccd725c35 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1936 expref: 24 pid: 21542 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746143695.501113:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4994 00000100:00100000:0.0:1746143695.501117:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592294784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143695.501121:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143695.501127:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd400/0xe984082ccd725c35 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1936 expref: 24 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746143695.501134:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd400/0xe984082ccd725c35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1936 expref: 24 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746143695.501164:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143695.501176:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592294784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 58us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143695.501180:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4994 00000100:00100000:0.0:1746143695.501209:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.501218:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592295040 00000100:00100000:0.0:1746143695.501221:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592295040 00010000:00010000:0.0:1746143695.501231:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd725aad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1880 expref: 13 pid: 25369 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746143695.501246:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4995 00000100:00100000:0.0:1746143695.501250:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592295040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143695.501257:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143695.501264:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd725aad lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1880 expref: 13 pid: 25369 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746143695.501272:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd725aad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1880 expref: 13 pid: 25369 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746143695.501282:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143695.501283:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143695.501286:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.501292:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.501303:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143695.501314:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592295040:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 63us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143695.501319:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4995 00000100:00100000:0.0:1746143695.501392:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593750912:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143695.501479:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593751040:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143695.501505:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593751168:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143695.501529:0:12618:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143695.501554:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.501590:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.501600:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592295296 00000100:00100000:0.0:1746143695.501602:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592295296 00010000:00010000:0.0:1746143695.501611:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093b30a00/0xe984082ccd725a52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1848 expref: 11 pid: 21542 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746143695.501621:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4996 00000100:00100000:0.0:1746143695.501625:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592295296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143695.501630:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143695.501638:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093b30a00/0xe984082ccd725a52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1848 expref: 11 pid: 21542 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.501645:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093b30a00/0xe984082ccd725a52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1848 expref: 11 pid: 21542 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.501655:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b30a00/0xe984082ccd725a52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1848 expref: 11 pid: 21542 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746143695.501663:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143695.501681:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592295296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 55us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143695.501685:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4996 00010000:00010000:2.0:1746143695.501889:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5fde600/0xe984082ccd725c82 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a196e expref: 10 pid: 9527 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746143695.501901:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f02680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593749632:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.501910:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e4600/0xe984082ccd725bb7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18f0 expref: 11 pid: 21542 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.501917:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593749760:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.501932:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.501938:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.501943:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.501962:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.501968:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.501974:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.501980:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4e5a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143695.501983:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.501991:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.501999:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.502004:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4e5a00/0xe984082ccd725ceb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.502042:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592293248:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 23425us (23609us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.502048:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9667 00000100:00100000:2.0:1746143695.502078:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592294528 00000100:00100000:2.0:1746143695.502080:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592294528 00002000:00100000:2.0:1746143695.502104:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1232896->2097151) req@ffff880093f01c00 x1830963592294528/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.502112:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01c00 with x1830963592294528 ext(1232896->2097151) 00010000:00010000:2.0:1746143695.502117:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 13 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.502125:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 13 pid: 21542 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746143695.502130:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f01c00 00000100:00100000:2.0:1746143695.502156:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592295168 00000100:00100000:2.0:1746143695.502158:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592295168 00002000:00100000:2.0:1746143695.502168:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1204223) req@ffff880093f01500 x1830963592295168/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.502174:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01500 with x1830963592295168 ext(1048576->1204223) 00010000:00010000:2.0:1746143695.502178:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 11 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.502184:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 11 pid: 4582 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746143695.502189:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f01500 00000100:00100000:2.0:1746143695.502196:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 873 00000100:00100000:2.0:1746143695.502201:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592294528:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143695.502862:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 874 00000100:00100000:2.0:1746143695.502868:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592295168:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143695.503131:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593749888:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.503169:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.503198:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593750784:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.503207:0:6929:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.503512:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593750016:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.503524:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725c90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a198a expref: 8 pid: 4581 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746143695.503538:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593750144:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.503547:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cd400/0xe984082ccd725c35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1936 expref: 23 pid: 21542 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.503558:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593750272:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.503574:0:4582:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.503596:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800952eea00/0xe984082ccd725b16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18a3 expref: 21 pid: 25369 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746143695.503604:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593750400:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.503614:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06cca00/0xe984082ccd725c97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1975 expref: 9 pid: 8495 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746143695.503621:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593750528:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.503631:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2211e00/0xe984082ccd725aad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1880 expref: 14 pid: 25369 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.503638:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593750656:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143695.503651:0:8495:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.503658:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.503664:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.503684:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.503691:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.503697:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.503702:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091025000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143695.503704:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.503711:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.503724:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.503730:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091025000/0xe984082ccd725d00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.503767:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963592293376:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 23754us (24726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.503774:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9670 00000100:00100000:0.0:1746143695.506482:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.506547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.506636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.506732:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592295552 00000100:00100000:1.0:1746143695.506741:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592295552 00010000:00010000:1.0:1746143695.506777:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800952eb800/0xe984082ccd7259f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1810 expref: 21 pid: 25369 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.506803:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592295424 00000100:00100000:1.0:1746143695.506805:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592295424 00010000:00010000:1.0:1746143695.506815:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2210600/0xe984082ccd725a9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1879 expref: 14 pid: 25369 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746143695.506826:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592295680 00000100:00100000:1.0:1746143695.506839:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592295680 00010000:00010000:1.0:1746143695.506849:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725c3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a193d expref: 13 pid: 21542 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.506864:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4997 00000100:00100000:1.0:1746143695.506871:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592295552:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143695.506883:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143695.506908:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800952eb800/0xe984082ccd7259f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1810 expref: 21 pid: 25369 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.506918:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800952eb800/0xe984082ccd7259f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1810 expref: 21 pid: 25369 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.506941:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800952eb800/0xe984082ccd7259f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1810 expref: 21 pid: 25369 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.506959:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143695.506995:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592295552:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 124us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.507002:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4997 00000100:00100000:1.0:1746143695.507051:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4998 00000100:00100000:1.0:1746143695.507056:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592295424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143695.507063:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143695.507070:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a2210600/0xe984082ccd725a9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1879 expref: 14 pid: 25369 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746143695.507077:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a2210600/0xe984082ccd725a9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1879 expref: 14 pid: 25369 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746143695.507088:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210600/0xe984082ccd725a9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1879 expref: 14 pid: 25369 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746143695.507097:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.507099:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.507104:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.507112:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.507135:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143695.507170:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592295424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 113us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.507176:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4998 00000100:00100000:1.0:1746143695.507188:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4999 00000100:00100000:1.0:1746143695.507192:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592295680:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143695.507201:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143695.507214:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725c3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a193d expref: 13 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.507223:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725c3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a193d expref: 13 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.507235:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cce00/0xe984082ccd725c3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a193d expref: 13 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.507243:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.507245:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.507248:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.507254:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.507267:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143695.507282:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592295680:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 89us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.507288:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4999 00010000:00010000:1.0:1746143695.507309:0:12618:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.507317:0:12618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.507336:0:12618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.507344:0:12618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.507350:0:12618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.507357:0:12618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5fdfe00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143695.507360:0:12618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.507368:0:12618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.507377:0:12618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.507383:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdfe00/0xe984082ccd725d0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.507418:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963592293888:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 27002us (28299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.507426:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9672 00010000:00010000:3.0:1746143695.509602:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.509616:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.509646:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.509653:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.509659:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.509666:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06cc200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143695.509669:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.509676:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.509693:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.509700:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06cc200/0xe984082ccd725cf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.509775:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963592293760:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 29997us (31269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.509784:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9669 00000100:00100000:3.0:1746143695.546605:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592295168:12345-192.168.202.48@tcp:4:cat.0 Request processed in 43725us (45039us total) trans 17179872465 rc 0/0 00000100:00100000:3.0:1746143695.546618:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 874 00002000:00100000:3.0:1746143695.546632:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1204223) req@ffff880093f01500 x1830963592295168/t17179872465(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/448 e 0 to 0 dl 1746143706 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.546641:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01500 with x1830963592295168 ext(1048576->1204223) 00010000:00010000:3.0:1746143695.546652:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 12 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.546666:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 12 pid: 4582 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746143695.546673:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f01500 00000100:00100000:3.0:1746143695.550820:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592294528:12345-192.168.202.48@tcp:4:cat.0 Request processed in 48605us (49955us total) trans 21474839732 rc 0/0 00000100:00100000:3.0:1746143695.550848:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 873 00002000:00100000:3.0:1746143695.550860:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1232896->2097151) req@ffff880093f01c00 x1830963592294528/t21474839732(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/448 e 0 to 0 dl 1746143706 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.550870:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01c00 with x1830963592294528 ext(1232896->2097151) 00010000:00010000:3.0:1746143695.550881:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 13 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.550895:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 13 pid: 21542 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746143695.550902:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f01c00 00000100:00100000:0.0:1746143695.551625:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.551760:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592295808 00000100:00100000:2.0:1746143695.551770:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592295808 00010000:00010000:2.0:1746143695.551806:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 12 pid: 4582 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.551839:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5000 00000100:00100000:2.0:1746143695.551846:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592295808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143695.551860:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143695.551880:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 12 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.551894:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 12 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.551918:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093238400/0xe984082ccd725c43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1944 expref: 12 pid: 4582 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.551950:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.551953:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.551958:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.551966:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.551990:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143695.552015:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592295808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 170us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.552021:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5000 00010000:00010000:1.0:1746143695.552083:0:6929:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.552093:0:6929:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.552114:0:6929:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.552121:0:6929:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.552127:0:6929:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.552134:0:6929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5fdf200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143695.552163:0:6929:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.552172:0:6929:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.552182:0:6929:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.552189:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdf200/0xe984082ccd725d07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.552239:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1963:x1830963592293632:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 71933us (73150us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.552246:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9671 00000100:00100000:0.0:1746143695.554649:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.554730:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592295936 00000100:00100000:1.0:1746143695.554740:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592295936 00010000:00010000:1.0:1746143695.554775:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 13 pid: 21542 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.554814:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5001 00000100:00100000:1.0:1746143695.554822:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592295936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143695.554842:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143695.554864:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 13 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.554875:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 13 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.554894:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06cc600/0xe984082ccd725bf6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1232896->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1913 expref: 13 pid: 21542 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.554909:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.554911:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.554916:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.554925:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.554948:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143695.554988:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592295936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 166us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.554994:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5001 00010000:00010000:0.0:1746143695.555589:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.555597:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.555618:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.555624:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.555631:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.555636:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4e4e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143695.555640:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.555646:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.555655:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.555665:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4e4e00/0xe984082ccd725cf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143695.555721:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1963:x1830963592293504:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 76783us (77243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143695.555727:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9668 00000100:00100000:0.0:1746143695.557129:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.557204:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592296192 00000100:00100000:1.0:1746143695.557212:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592296192 00000100:00100000:1.0:1746143695.557613:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8299 00000100:00100000:1.0:1746143695.557620:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28473:x1830963592296192:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:1.0:1746143695.557675:0:21713:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143695.557698:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06ccc00/0xe984082ccd725cc1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1998 expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.557714:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143695.557718:0:21713:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143695.557747:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.557759:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1784 expref: 256 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.557766:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 19 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.557775:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1799 expref: 256 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.557781:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0a00/0xe984082ccd725ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1895 expref: 256 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.557786:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5800/0xe984082ccd725b4e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18c6 expref: 19 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.557791:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.557820:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5800/0xe984082ccd725b4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18c6 expref: 19 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.557841:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5800/0xe984082ccd725b4e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18c6 expref: 19 pid: 21713 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.557854:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593751296:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.560069:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0a00/0xe984082ccd725ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1895 expref: 256 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.560085:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0a00/0xe984082ccd725ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1895 expref: 256 pid: 21713 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.560099:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593751424:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.560170:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1799 expref: 256 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.560178:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1799 expref: 256 pid: 14764 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.560185:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593751552:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.560205:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 19 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.560212:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 19 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.560218:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593751680:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.560232:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1784 expref: 256 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.560237:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1784 expref: 256 pid: 14763 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.560242:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593751808:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143695.560255:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143695.563032:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.563080:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.563096:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.563119:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.563178:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.563246:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592296320 00000100:00100000:3.0:1746143695.563255:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592296320 00010000:00010000:3.0:1746143695.563297:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5800/0xe984082ccd725b4e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18c6 expref: 20 pid: 21713 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.563327:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592296448 00000100:00100000:3.0:1746143695.563330:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592296448 00010000:00010000:3.0:1746143695.563339:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0a00/0xe984082ccd725ae5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1895 expref: 257 pid: 21713 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.563347:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592296576 00000100:00100000:3.0:1746143695.563348:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592296576 00010000:00010000:3.0:1746143695.563356:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1799 expref: 258 pid: 14764 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.563363:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592296704 00000100:00100000:3.0:1746143695.563365:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592296704 00010000:00010000:3.0:1746143695.563373:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 21 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.563380:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592296832 00000100:00100000:3.0:1746143695.563381:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592296832 00010000:00010000:3.0:1746143695.563389:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1784 expref: 259 pid: 14763 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.563398:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5002 00000100:00100000:3.0:1746143695.563406:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592296320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.563427:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143695.563433:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5800/0xe984082ccd725b4e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18c6 expref: 21 pid: 21713 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.563444:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5800/0xe984082ccd725b4e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18c6 expref: 21 pid: 21713 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.563470:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143695.563476:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.563484:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143695.563526:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592296320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 120us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.563532:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5002 00000100:00100000:3.0:1746143695.563549:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5003 00000100:00100000:3.0:1746143695.563554:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1965:x1830963592296448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.563562:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143695.563566:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0a00/0xe984082ccd725ae5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1895 expref: 259 pid: 21713 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.563573:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0a00/0xe984082ccd725ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1895 expref: 259 pid: 21713 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.563583:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143695.563586:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.563594:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143695.563607:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1965:x1830963592296448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 53us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.563612:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5003 00000100:00100000:3.0:1746143695.563620:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5004 00000100:00100000:3.0:1746143695.563624:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:1965:x1830963592296576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.563630:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143695.563633:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1799 expref: 258 pid: 14764 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.563640:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1799 expref: 258 pid: 14764 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.563648:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143695.563651:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.563655:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143695.563668:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:1965:x1830963592296576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 42us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.563672:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5004 00000100:00100000:3.0:1746143695.563703:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5005 00000100:00100000:3.0:1746143695.563708:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592296704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.563714:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143695.563718:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 20 pid: 16090 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.563729:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 20 pid: 16090 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.563737:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143695.563740:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.563745:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143695.563758:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592296704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.563763:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5005 00000100:00100000:3.0:1746143695.563772:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5006 00000100:00100000:3.0:1746143695.563776:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:1965:x1830963592296832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.563781:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143695.563784:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1784 expref: 257 pid: 14763 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.563791:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1784 expref: 257 pid: 14763 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.563798:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:3.0:1746143695.563801:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.563807:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.563813:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143695.563835:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143695.563846:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:1965:x1830963592296832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 70us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.563851:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5006 00010000:00010000:1.0:1746143695.564050:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4e5800/0xe984082ccd725b4e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a18c6 expref: 19 pid: 21713 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.564067:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593751296:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.564077:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0a00/0xe984082ccd725ae5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1895 expref: 256 pid: 21713 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.564090:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593751424:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.564099:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6c00/0xe984082ccd725941 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1799 expref: 255 pid: 14764 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.564106:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593751552:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.564115:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21ffa00/0xe984082ccd72593a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1792 expref: 18 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.564122:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593751680:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.564130:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135778000/0xe984082ccd725933 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1784 expref: 254 pid: 14763 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.564172:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593751808:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.564200:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.564208:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.564213:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000040:00080000:1.0:1746143695.564914:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2285, 88 off192024 00000004:00080000:1.0:1746143695.564922:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774574782031ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.564961:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2233, 88 off187264 00000004:00080000:1.0:1746143695.564966:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774574826351ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.564980:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2234, 88 off187352 00000004:00080000:1.0:1746143695.564982:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774574842254ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.564989:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2286, 88 off192112 00000004:00080000:1.0:1746143695.564991:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774574851477ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.564997:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2287, 88 off192200 00000004:00080000:1.0:1746143695.564999:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774574859771ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.565006:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2235, 88 off187440 00000004:00080000:1.0:1746143695.565008:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774574868362ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.565015:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2236, 88 off187528 00000004:00080000:1.0:1746143695.565017:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774574877586ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.565024:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2237, 88 off187616 00000004:00080000:1.0:1746143695.565026:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774574886504ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.565033:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2288, 88 off192288 00000004:00080000:1.0:1746143695.565035:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774574895559ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.565041:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2238, 88 off187704 00000004:00080000:1.0:1746143695.565044:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774574903987ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.565049:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2289, 88 off192376 00000004:00080000:1.0:1746143695.565051:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774574911930ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.565058:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2239, 88 off187792 00000004:00080000:1.0:1746143695.565060:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774574920942ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.565067:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2290, 88 off192464 00000004:00080000:1.0:1746143695.565069:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774574929440ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.565075:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2291, 88 off192552 00000004:00080000:1.0:1746143695.565078:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774574938432ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.565084:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2292, 88 off192640 00000004:00080000:1.0:1746143695.565087:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774574947642ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.565093:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2293, 88 off192728 00000004:00080000:1.0:1746143695.565097:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774574957407ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.565103:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2240, 88 off187880 00000004:00080000:1.0:1746143695.565106:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774574966402ns, next at 718087967394ns, rc = 0 00010000:00010000:1.0:1746143695.591294:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1746143695.615391:0:21713:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093f00700 reply state ffff8800a54cf400 transno 8589942408 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:1.0:1746143695.615403:0:21713:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746143695.615519:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28473:x1830963592296192:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 57894us (58390us total) trans 8589942408 rc 0/0 00000100:00100000:1.0:1746143695.615528:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8299 00000001:00080000:0.0:1746143695.616172:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942408 is committed 00000004:00080000:0.0:1746143695.616178:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1586 committed 00000004:00080000:0.0:1746143695.616185:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1638 committed 00000004:00080000:0.0:1746143695.616190:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1637 committed 00000004:00080000:0.0:1746143695.616191:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1636 committed 00000004:00080000:0.0:1746143695.616198:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1635 committed 00000004:00080000:0.0:1746143695.616199:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1585 committed 00000004:00080000:0.0:1746143695.616201:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1634 committed 00000004:00080000:0.0:1746143695.616202:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1584 committed 00000004:00080000:0.0:1746143695.616204:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1633 committed 00000004:00080000:0.0:1746143695.616205:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1583 committed 00000004:00080000:0.0:1746143695.616207:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1582 committed 00000004:00080000:0.0:1746143695.616208:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1581 committed 00000004:00080000:0.0:1746143695.616209:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1632 committed 00000004:00080000:0.0:1746143695.616211:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1631 committed 00000004:00080000:0.0:1746143695.616213:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1580 committed 00000004:00080000:0.0:1746143695.616215:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1579 committed 00000004:00080000:0.0:1746143695.616216:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1630 committed 00000001:00080000:0.0:1746143695.616223:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942387 is committed 00000001:00080000:0.0:1746143695.616237:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942380 is committed 00000001:00080000:0.0:1746143695.616241:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942400 is committed 00000001:00080000:0.0:1746143695.616250:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942397 is committed 00000001:00080000:0.0:1746143695.616274:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942405 is committed 00000001:00080000:0.0:1746143695.616276:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942404 is committed 00000100:00100000:3.0:1746143695.616432:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593751936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143695.616487:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143695.616967:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.616977:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.616984:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.616990:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5fdf000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143695.616995:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.617002:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.617019:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143695.617022:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143695.617025:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.617031:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d15 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00000100:00100000:2.0:1746143695.617057:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593752192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143695.617084:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593752320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.617394:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593752064:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143695.617501:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593752448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143695.617520:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143695.617537:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593752960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143695.617554:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143695.617565:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593753472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143695.617578:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143695.617600:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593751936 00000100:00100000:3.0:1746143695.617607:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593751936 00000100:00100000:3.0:1746143695.617639:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593752448 00000100:00100000:3.0:1746143695.617641:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593752448 00000100:00100000:3.0:1746143695.617651:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593752960 00000100:00100000:3.0:1746143695.617653:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593752960 00000100:00100000:3.0:1746143695.617664:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593753472 00000100:00100000:3.0:1746143695.617666:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593753472 00000100:00100000:3.0:1746143695.617679:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9673 00000100:00100000:3.0:1746143695.617686:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3292:x1830963593751936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143695.617923:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3292:x1830963593751936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (1435us total) trans 17179872466 rc 0/0 00000100:00100000:3.0:1746143695.617930:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9673 00000100:00100000:3.0:1746143695.617943:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9674 00000100:00100000:3.0:1746143695.617948:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3292:x1830963593752448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143695.618025:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3292:x1830963593752448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (504us total) trans 17179872467 rc 0/0 00000100:00100000:3.0:1746143695.618030:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9674 00000100:00100000:3.0:1746143695.618040:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9675 00000100:00100000:3.0:1746143695.618044:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963593752960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143695.618179:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3292:x1830963593752960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (624us total) trans 21474839733 rc 0/0 00000100:00100000:3.0:1746143695.618184:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9675 00000100:00100000:3.0:1746143695.618192:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9676 00000100:00100000:3.0:1746143695.618196:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963593753472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143695.618262:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:3.0:1746143695.618265:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:3.0:1746143695.618267:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143695.618269:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:3.0:1746143695.618270:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:3.0:1746143695.618288:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3292:x1830963593753472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (708us total) trans 21474839734 rc 0/0 00000100:00100000:3.0:1746143695.618293:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9676 00000004:00080000:3.0:1746143695.618327:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ee680/2, rc 0, transno 21474839733 00000100:00100000:3.0:1746143695.618332:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593752960:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143695.618338:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ec700/2, rc 0, transno 21474839734 00000100:00100000:3.0:1746143695.618341:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593753472:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143695.618348:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0878a80/2, rc 0, transno 17179872466 00000100:00100000:3.0:1746143695.618354:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593751936:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143695.618361:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0879f80/2, rc 0, transno 17179872467 00000100:00100000:3.0:1746143695.618364:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593752448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143695.618395:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593753984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143695.618414:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143695.618437:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593753984 00000100:00100000:3.0:1746143695.618440:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593753984 00000100:00100000:3.0:1746143695.618454:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9677 00000100:00100000:3.0:1746143695.618459:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3292:x1830963593753984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143695.618536:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3292:x1830963593753984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (121us total) trans 17179872468 rc 0/0 00000100:00100000:3.0:1746143695.618541:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9677 00000004:00080000:3.0:1746143695.618560:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0879180/2, rc 0, transno 17179872468 00000100:00100000:3.0:1746143695.618563:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593753984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.618671:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.618693:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593752576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.618712:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.618722:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593753088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.618733:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.618741:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593753600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.618751:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.618770:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593752064 00000100:00100000:1.0:1746143695.618773:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593752064 00000100:00100000:1.0:1746143695.618788:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593752576 00000100:00100000:1.0:1746143695.618789:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593752576 00000100:00100000:1.0:1746143695.618799:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593753088 00000100:00100000:1.0:1746143695.618800:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593753088 00000100:00100000:1.0:1746143695.618809:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593753600 00000100:00100000:1.0:1746143695.618811:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593753600 00000100:00100000:1.0:1746143695.618821:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9678 00000100:00100000:1.0:1746143695.618833:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3293:x1830963593752064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.618933:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3293:x1830963593752064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (261us total) trans 17179872469 rc 0/0 00000100:00100000:1.0:1746143695.618938:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9678 00000100:00100000:1.0:1746143695.618959:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9679 00000100:00100000:1.0:1746143695.618963:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3293:x1830963593752576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.619037:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3293:x1830963593752576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (323us total) trans 17179872470 rc 0/0 00000100:00100000:1.0:1746143695.619043:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9679 00000100:00100000:1.0:1746143695.619053:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9680 00000100:00100000:1.0:1746143695.619057:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3293:x1830963593753088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.619165:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3293:x1830963593753088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (429us total) trans 21474839735 rc 0/0 00000100:00100000:1.0:1746143695.619169:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9680 00000100:00100000:1.0:1746143695.619179:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9681 00000100:00100000:1.0:1746143695.619182:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3293:x1830963593753600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.619251:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3293:x1830963593753600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (498us total) trans 21474839736 rc 0/0 00000100:00100000:1.0:1746143695.619256:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9681 00000004:00080000:1.0:1746143695.619291:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0878000/2, rc 0, transno 17179872469 00000100:00100000:1.0:1746143695.619294:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593752064:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143695.619302:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0879880/2, rc 0, transno 17179872470 00000100:00100000:1.0:1746143695.619305:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593752576:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143695.619311:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ef100/2, rc 0, transno 21474839735 00000100:00100000:1.0:1746143695.619314:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593753088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143695.619319:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1edf80/2, rc 0, transno 21474839736 00000100:00100000:1.0:1746143695.619322:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593753600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143695.619358:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143695.619384:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593752832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143695.619406:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143695.619418:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593753344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.619419:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593752320 00000100:00100000:1.0:1746143695.619423:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593752320 00000100:00100000:2.0:1746143695.619433:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.619438:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593752832 00000100:00100000:1.0:1746143695.619441:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593752832 00000100:00100000:2.0:1746143695.619445:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593753856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.619447:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593753344 00000100:00100000:1.0:1746143695.619449:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593753344 00000100:00100000:1.0:1746143695.619457:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9682 00000100:00100000:2.0:1746143695.619459:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.619462:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3295:x1830963593752320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143695.619481:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593753856 00000100:00100000:2.0:1746143695.619484:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593753856 00000100:00100000:2.0:1746143695.619497:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9683 00000100:00100000:2.0:1746143695.619502:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3295:x1830963593752832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143695.619530:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143695.619532:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746143695.619534:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143695.619535:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746143695.619537:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143695.619559:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3295:x1830963593752320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (203us total) trans 17179872471 rc 0/0 00000100:00100000:1.0:1746143695.619564:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9682 00000100:00100000:1.0:1746143695.619575:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9684 00000100:00100000:1.0:1746143695.619579:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3295:x1830963593753344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143695.619593:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3295:x1830963593752832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (185us total) trans 17179872472 rc 0/0 00000100:00100000:2.0:1746143695.619600:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9683 00000100:00100000:2.0:1746143695.619612:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9685 00000100:00100000:2.0:1746143695.619616:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3295:x1830963593753856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143695.619641:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143695.619643:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:1.0:1746143695.619645:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:1.0:1746143695.619647:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:1.0:1746143695.619649:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143695.619665:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3295:x1830963593753344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (231us total) trans 21474839737 rc 0/0 00000100:00100000:1.0:1746143695.619670:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9684 00000100:00100000:2.0:1746143695.619696:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3295:x1830963593753856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (235us total) trans 21474839738 rc 0/0 00000100:00100000:2.0:1746143695.619702:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9685 00000100:00100000:2.0:1746143695.619719:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143695.619735:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593752704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.619743:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593752192 00000100:00100000:0.0:1746143695.619747:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593752192 00000100:00100000:2.0:1746143695.619752:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143695.619762:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593753216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143695.619763:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593752704 00000100:00100000:0.0:1746143695.619765:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593752704 00000100:00100000:0.0:1746143695.619774:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9686 00000100:00100000:2.0:1746143695.619776:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143695.619779:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963593752192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143695.619786:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593753728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143695.619799:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746143695.619851:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0878380/2, rc 0, transno 17179872471 00000100:00100000:2.0:1746143695.619854:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593752320:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143695.619863:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a087b100/2, rc 0, transno 17179872472 00000100:00100000:2.0:1746143695.619865:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593752832:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143695.619872:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1edc00/2, rc 0, transno 21474839737 00000100:00100000:2.0:1746143695.619875:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593753344:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143695.619881:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ef800/2, rc 0, transno 21474839738 00000100:00100000:2.0:1746143695.619883:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593753856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143695.619893:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593753216 00000100:00100000:2.0:1746143695.619895:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593753216 00000100:00100000:0.0:1746143695.619897:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3294:x1830963593752192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (177us total) trans 17179872473 rc 0/0 00000100:00100000:0.0:1746143695.619902:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9686 00000100:00100000:2.0:1746143695.619906:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593753728 00000100:00100000:2.0:1746143695.619908:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593753728 00000100:00100000:0.0:1746143695.619914:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9687 00000100:00100000:0.0:1746143695.619919:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963593752704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.620008:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3294:x1830963593752704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (254us total) trans 17179872474 rc 0/0 00000100:00100000:2.0:1746143695.621333:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9688 00000100:00100000:2.0:1746143695.621351:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3294:x1830963593753216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143695.621518:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3294:x1830963593753216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (1740us total) trans 21474839739 rc 0/0 00000100:00100000:2.0:1746143695.621524:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9688 00000100:00100000:2.0:1746143695.621542:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9689 00000100:00100000:2.0:1746143695.621546:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3294:x1830963593753728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143695.621620:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3294:x1830963593753728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1819us total) trans 21474839740 rc 0/0 00000100:00100000:2.0:1746143695.621624:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9689 00000100:00100000:0.0:1746143695.621948:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9687 00000004:00080000:0.0:1746143695.622017:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0878700/2, rc 0, transno 17179872473 00000100:00100000:0.0:1746143695.622023:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593752192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143695.622036:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0878e00/2, rc 0, transno 17179872474 00000100:00100000:0.0:1746143695.622039:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593752704:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143695.622048:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1eed80/2, rc 0, transno 21474839739 00000100:00100000:0.0:1746143695.622051:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593753216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143695.622058:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ec000/2, rc 0, transno 21474839740 00000100:00100000:0.0:1746143695.622061:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593753728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143695.624097:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.624122:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592296960 00000100:00100000:1.0:1746143695.624130:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592296960 00000100:00100000:1.0:1746143695.632324:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8300 00000100:00100000:1.0:1746143695.632338:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28473:x1830963592296960:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143695.632366:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.632386:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd725d1c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a19b4 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.632459:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd725d1c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19b4 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.632474:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd725d1c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19b4 expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.632492:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143695.632495:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143695.632499:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a652be00, rc 0) 00000100:00100000:1.0:1746143695.632574:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28473:x1830963592296960:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 239us (8483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.632580:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8300 00000100:00100000:0.0:1746143695.637119:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.637218:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592297088 00000100:00100000:2.0:1746143695.637232:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592297088 00000100:00100000:2.0:1746143695.637279:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8301 00000100:00100000:2.0:1746143695.637287:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28473:x1830963592297088:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143695.637309:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.637347:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0c00/0xe984082ccd725d23 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a19bb expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.637425:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd725d2a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.637437:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd725d2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.637448:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd725d2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143695.637473:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:2.0:1746143695.637476:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143695.637489:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd725d2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.637510:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0c00/0xe984082ccd725d23 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19bb expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.637535:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd725d2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19bb expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.637542:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143695.637545:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143695.637548:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cde0600, rc 0) 00000100:00100000:2.0:1746143695.637725:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28473:x1830963592297088:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 438us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.637731:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8301 00000100:00100000:2.0:1746143695.640930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.641005:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592297216 00000100:00100000:1.0:1746143695.641015:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592297216 00000100:00100000:1.0:1746143695.641062:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9690 00000100:00100000:1.0:1746143695.641070:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1964:x1830963592297216:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143695.641090:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.641109:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd725d31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a19c2 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143695.641156:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409ce, atime: 0x681409ca, ctime: 0x681409ce, blocks: 0x809 00010000:00010000:1.0:1746143695.641177:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.641179:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.641188:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd725d31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c2 expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.641204:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd725d31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c2 expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.641215:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a652aa00, rc 0) 00000100:00100000:1.0:1746143695.641263:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592297216:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 193us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.641269:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9690 00000100:00100000:0.0:1746143695.642063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.642236:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592297344 00000100:00100000:3.0:1746143695.642241:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592297344 00000100:00100000:3.0:1746143695.642266:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9691 00000100:00100000:3.0:1746143695.642272:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1965:x1830963592297344:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143695.642280:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.642293:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c45200/0xe984082ccd725d38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a19c9 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143695.642312:0:12618:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34a:0x0] initial LVB size: 2097152, mtime: 0x681409ce, atime: 0x681409cb, ctime: 0x681409ce, blocks: 0x81f 00010000:00010000:3.0:1746143695.642323:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.642324:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.642330:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c45200/0xe984082ccd725d38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c9 expref: 7 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.642345:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c45200/0xe984082ccd725d38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c9 expref: 7 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143695.642352:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c45200, rc 0) 00000100:00100000:3.0:1746143695.642377:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963592297344:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 105us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.642382:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9691 00000100:00100000:0.0:1746143695.644583:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.644615:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.644640:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.644711:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.644740:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592297600 00000100:00100000:1.0:1746143695.644748:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592297600 00000100:00100000:2.0:1746143695.644767:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592297472 00000100:00100000:2.0:1746143695.644771:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592297472 00000100:00100000:1.0:1746143695.644781:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592297728 00000100:00100000:1.0:1746143695.644782:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592297728 00000100:00100000:2.0:1746143695.644788:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592297856 00000100:00100000:2.0:1746143695.644789:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592297856 00000100:00100000:1.0:1746143695.644795:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9692 00000100:00100000:1.0:1746143695.644801:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592297600:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143695.644817:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.644842:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd725d3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a19d7 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143695.644865:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409cf, atime: 0x681409cb, ctime: 0x681409cf, blocks: 0x821 00010000:00010000:1.0:1746143695.644883:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.644885:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.644894:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd725d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d7 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.644906:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd725d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d7 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.644916:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a652a800, rc 0) 00000100:00100000:2.0:1746143695.644944:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9693 00000100:00100000:2.0:1746143695.644950:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592297472:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:1.0:1746143695.644954:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592297600:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 153us (379us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143695.644958:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143695.644960:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9692 00010000:00010000:2.0:1746143695.644967:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cde0c00/0xe984082ccd725d46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a19d0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143695.644986:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34b:0x0] initial LVB size: 2097152, mtime: 0x681409cf, atime: 0x681409ce, ctime: 0x681409cf, blocks: 0x821 00000100:00100000:1.0:1746143695.644987:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9694 00000100:00100000:1.0:1746143695.644991:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592297728:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143695.644995:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.644996:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.644997:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.645001:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cde0c00/0xe984082ccd725d46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d0 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.645002:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd725d4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a19de expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.645010:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cde0c00/0xe984082ccd725d46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d0 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746143695.645012:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 4897312, mtime: 0x681409cf, atime: 0x681409cc, ctime: 0x681409cf, blocks: 0x15a5 00010000:00010000:2.0:1746143695.645016:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cde0c00, rc 0) 00010000:00010000:1.0:1746143695.645017:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.645018:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.645021:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd725d4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19de expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.645028:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd725d4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19de expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143695.645032:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592297472:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 83us (417us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143695.645034:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a652bc00, rc 0) 00000100:00100000:2.0:1746143695.645037:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9693 00000100:00100000:2.0:1746143695.645046:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9695 00000100:00100000:1.0:1746143695.645046:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592297728:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 54us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.645050:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592297856:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:1.0:1746143695.645051:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9694 00010000:00010000:2.0:1746143695.645055:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.645061:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cde0200/0xe984082ccd725d54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a19e5 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143695.645071:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409ce, atime: 0x681409cb, ctime: 0x681409ce, blocks: 0x1029 00010000:00010000:2.0:1746143695.645077:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.645078:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.645082:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cde0200/0xe984082ccd725d54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19e5 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.645090:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cde0200/0xe984082ccd725d54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19e5 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143695.645096:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cde0200, rc 0) 00000100:00100000:2.0:1746143695.645111:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592297856:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 60us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.645115:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9695 00000100:00100000:0.0:1746143695.654874:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.654914:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.654944:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.654958:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.654971:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.654984:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.655010:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.655039:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.655121:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592298368 00000100:00100000:3.0:1746143695.655131:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592298368 00000100:00100000:3.0:1746143695.655222:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592298624 00000100:00100000:3.0:1746143695.655225:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592298624 00000100:00100000:3.0:1746143695.655237:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592299008 00000100:00100000:3.0:1746143695.655239:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592299008 00000100:00100000:3.0:1746143695.655259:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592299264 00000100:00100000:3.0:1746143695.655261:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592299264 00000100:00100000:3.0:1746143695.655269:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592298880 00000100:00100000:3.0:1746143695.655271:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592298880 00000100:00100000:3.0:1746143695.655277:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592299136 00000100:00100000:3.0:1746143695.655279:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592299136 00000100:00100000:3.0:1746143695.655285:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592298240 00000100:00100000:3.0:1746143695.655287:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592298240 00000100:00100000:3.0:1746143695.655294:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592298496 00000100:00100000:3.0:1746143695.655296:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592298496 00000100:00100000:3.0:1746143695.655308:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3583 00000100:00100000:3.0:1746143695.655315:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592298368:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143695.655357:0:8500:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d5b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.655376:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.655378:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.655383:0:8500:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.655397:0:8500:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.655822:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3584 00000100:00100000:1.0:1746143695.655839:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592298624:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143695.655854:0:26144:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a652a000/0xe984082ccd725d62 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.655861:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.655862:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.655865:0:26144:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a652a000/0xe984082ccd725d62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.655873:0:26144:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a652a000/0xe984082ccd725d62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.656622:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3585 00000100:00100000:3.0:1746143695.656629:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963592299008:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143695.656647:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d69 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.656655:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.656656:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.656659:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.656667:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.657298:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3586 00000100:00100000:1.0:1746143695.657306:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1962:x1830963592299264:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143695.657323:0:21518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd725d70 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.657331:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.657332:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.657335:0:21518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd725d70 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.657342:0:21518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd725d70 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.658811:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3587 00000100:00100000:1.0:1746143695.658820:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963592298880:12345-192.168.202.48@tcp:3:lfs.0 00000100:00100000:2.0:1746143695.659016:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3588 00000100:00100000:2.0:1746143695.659024:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963592299136:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143695.659054:0:25544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd725d77 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.659067:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.659068:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.659073:0:25544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd725d77 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.659083:0:25544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd725d77 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.660304:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3589 00000100:00100000:2.0:1746143695.660312:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1963:x1830963592298240:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143695.660337:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd725d7e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.660347:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.660348:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.660352:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd725d7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.660365:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd725d7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.661634:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3590 00000100:00100000:2.0:1746143695.661643:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1963:x1830963592298496:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143695.661671:0:26145:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5792200/0xe984082ccd725d85 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.661681:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.661682:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.661686:0:26145:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5792200/0xe984082ccd725d85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.661695:0:26145:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5792200/0xe984082ccd725d85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.663451:0:8501:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd725d8c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.663467:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.663469:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.663472:0:8501:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd725d8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.663483:0:8501:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd725d8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.673617:0:8500:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.673638:0:8500:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.673646:0:8500:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.673655:0:8500:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5fdf000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143695.673658:0:8500:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.673667:0:8500:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.673688:0:8500:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.673695:0:8500:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725d5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.674580:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1963:x1830963592298368:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 19257us (19709us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143695.674591:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3583 00010000:00010000:1.0:1746143695.683062:0:26144:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a652a000/0xe984082ccd725d62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.683086:0:26144:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a652a000/0xe984082ccd725d62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.683094:0:26144:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a652a000/0xe984082ccd725d62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.683102:0:26144:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a652a000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143695.683105:0:26144:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a652a000/0xe984082ccd725d62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.683113:0:26144:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a652a000/0xe984082ccd725d62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.683135:0:26144:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a652a000/0xe984082ccd725d62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.683177:0:26144:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a652a000/0xe984082ccd725d62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.683276:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1963:x1830963592298624:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 27441us (28354us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143695.683287:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3584 00010000:00010000:1.0:1746143695.690172:0:21518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd725d70 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.690193:0:21518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd725d70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.690202:0:21518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd725d70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.690209:0:21518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a652a600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143695.690213:0:21518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd725d70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.690221:0:21518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd725d70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.690242:0:21518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd725d70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.690252:0:21518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd725d70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.690335:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1962:x1830963592299264:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 33024us (35369us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143695.690345:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3586 00010000:00010000:2.0:1746143695.694620:0:25544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd725d77 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.694637:0:25544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd725d77 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.694645:0:25544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd725d77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.694651:0:25544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5793800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143695.694655:0:25544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd725d77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.694662:0:25544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd725d77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.694679:0:25544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd725d77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.694685:0:25544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd725d77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.694773:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963592299136:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 35745us (39782us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143695.694783:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3588 00010000:00010000:2.0:1746143695.698605:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd725d7e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.698624:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd725d7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.698631:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd725d7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.698637:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5792e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143695.698641:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd725d7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.698648:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd725d7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.698666:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd725d7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.698671:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd725d7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.698754:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592298240:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 38438us (43737us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143695.698764:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3589 00010000:00010000:1.0:1746143695.702605:0:8501:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd725d8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.702623:0:8501:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd725d8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.702630:0:8501:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd725d8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.702637:0:8501:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6264000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143695.702641:0:8501:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd725d8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.702649:0:8501:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd725d8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.702667:0:8501:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd725d8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.702672:0:8501:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd725d8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.702777:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592298880:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 43952us (47798us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143695.702786:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3587 00010000:00010000:2.0:1746143695.709230:0:26145:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5792200/0xe984082ccd725d85 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.709248:0:26145:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5792200/0xe984082ccd725d85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.709256:0:26145:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5792200/0xe984082ccd725d85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.709262:0:26145:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5792200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143695.709265:0:26145:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5792200/0xe984082ccd725d85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.709272:0:26145:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5792200/0xe984082ccd725d85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.709290:0:26145:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5792200/0xe984082ccd725d85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.709300:0:26145:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5792200/0xe984082ccd725d85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.709401:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592298496:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 47753us (54354us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143695.709411:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3590 00010000:00010000:3.0:1746143695.713336:0:31338:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.713356:0:31338:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.713365:0:31338:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.713372:0:31338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5fdfc00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143695.713376:0:31338:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.713385:0:31338:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.713406:0:31338:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.713412:0:31338:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.713516:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592299008:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 56881us (58564us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143695.713527:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3585 00000100:00100000:0.0:1746143695.718523:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.718734:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592299648 00000100:00100000:2.0:1746143695.718745:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592299648 00000100:00100000:2.0:1746143695.718807:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8302 00000100:00100000:2.0:1746143695.718816:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28473:x1830963592299648:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:2.0:1746143695.718883:0:16090:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143695.718913:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd725d2a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19bb expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.718946:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143695.718951:0:16090:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143695.718991:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725d93 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.719003:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725d93 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.719011:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725d93 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00010000:2.0:1746143695.719256:0:16090:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e1e1180 reply state ffff8800a042f000 transno 8589942409 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725d93 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143695.719266:0:16090:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143695.719344:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28473:x1830963592299648:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 529us (831us total) trans 8589942409 rc 0/0 00000100:00100000:2.0:1746143695.719350:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8302 00010000:00010000:2.0:1746143695.720590:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725d93 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.720599:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725d93 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.720605:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725d93 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.720610:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5793800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143695.720614:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725d93 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.720619:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725d93 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.720630:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143695.720633:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143695.720635:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725d93 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.720640:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd725d93 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143695.722178:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.722206:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.722227:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.722239:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.722255:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.722310:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.722372:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592299776 00000100:00100000:1.0:1746143695.722381:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592299776 00000100:00100000:1.0:1746143695.722429:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592299904 00000100:00100000:1.0:1746143695.722431:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592299904 00000100:00100000:1.0:1746143695.722448:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592300160 00000100:00100000:1.0:1746143695.722449:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592300160 00000100:00100000:1.0:1746143695.722458:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592300416 00000100:00100000:1.0:1746143695.722459:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592300416 00000100:00100000:1.0:1746143695.722469:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592300032 00000100:00100000:1.0:1746143695.722470:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592300032 00000100:00100000:1.0:1746143695.722478:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592300288 00000100:00100000:1.0:1746143695.722479:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592300288 00000100:00100000:1.0:1746143695.722489:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9696 00000100:00100000:1.0:1746143695.722495:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592299776:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:1.0:1746143695.722689:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143695.722692:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143694 -> 1746143695 00002000:00010000:1.0:1746143695.722694:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143690 -> 1746143695 00002000:00010000:1.0:1746143695.722696:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143694 -> 1746143695 00002000:00010000:1.0:1746143695.722698:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:1.0:1746143695.722743:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592299776:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 248us (611us total) trans 17179872475 rc 0/0 00000100:00100000:1.0:1746143695.722750:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9696 00000100:00100000:1.0:1746143695.722781:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9697 00000100:00100000:1.0:1746143695.722786:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592299904:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:1.0:1746143695.722890:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143695.722892:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143694 -> 1746143695 00002000:00010000:1.0:1746143695.722894:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143691 -> 1746143695 00002000:00010000:1.0:1746143695.722896:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143694 -> 1746143695 00002000:00010000:1.0:1746143695.722898:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746143695.722912:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592299904:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 126us (705us total) trans 21474839741 rc 0/0 00000100:00100000:1.0:1746143695.722916:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9697 00000100:00100000:1.0:1746143695.723045:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9698 00000100:00100000:1.0:1746143695.723050:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592300160:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:1.0:1746143695.723109:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143695.723112:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:1.0:1746143695.723113:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143691 -> 1746143695 00002000:00010000:1.0:1746143695.723115:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:1.0:1746143695.723117:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143695.723131:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592300160:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 80us (902us total) trans 17179872476 rc 0/0 00000100:00100000:1.0:1746143695.723135:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9698 00000100:00100000:1.0:1746143695.723166:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9699 00000100:00100000:1.0:1746143695.723170:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592300416:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:1.0:1746143695.723228:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143695.723230:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143694 -> 1746143695 00002000:00010000:1.0:1746143695.723232:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143691 -> 1746143695 00002000:00010000:1.0:1746143695.723234:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143694 -> 1746143695 00002000:00010000:1.0:1746143695.723236:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746143695.723253:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592300416:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 82us (1012us total) trans 21474839742 rc 0/0 00000100:00100000:1.0:1746143695.723258:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9699 00000100:00100000:1.0:1746143695.723270:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9700 00000100:00100000:1.0:1746143695.723275:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592300032:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:1.0:1746143695.723332:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143695.723334:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:1.0:1746143695.723336:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143694 -> 1746143695 00002000:00010000:1.0:1746143695.723338:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:1.0:1746143695.723339:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143695.723360:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592300032:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 84us (1104us total) trans 21474839743 rc 0/0 00000100:00100000:1.0:1746143695.723365:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9700 00000100:00100000:1.0:1746143695.723376:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9701 00000100:00100000:1.0:1746143695.723381:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592300288:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:1.0:1746143695.723440:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:1.0:1746143695.723442:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:1.0:1746143695.723443:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143692 -> 1746143695 00002000:00010000:1.0:1746143695.723445:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:1.0:1746143695.723446:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5541 -> 5541 00000100:00100000:1.0:1746143695.723463:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592300288:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 82us (1152us total) trans 17179872477 rc 0/0 00000100:00100000:1.0:1746143695.723468:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9701 00000100:00100000:0.0:1746143695.725622:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.726107:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592300672 00000100:00100000:3.0:1746143695.726117:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592300672 00000100:00100000:3.0:1746143695.726188:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3382 00000100:00100000:3.0:1746143695.726196:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28473:x1830963592300672:12345-192.168.202.48@tcp:35:lfs.0 00000004:00010000:3.0:1746143695.726257:0:16141:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x2d6:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cd600/0xe984082ccd725cdd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19ad expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.726551:0:16141:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16141 initiator: MDT0 00010000:00010000:3.0:1746143695.726564:0:16141:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd725d1c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19b4 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.726570:0:16141:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16141 initiator: MDT0 00010000:00010000:3.0:1746143695.726723:0:16141:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd725d1c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19b4 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.726734:0:16141:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd725d1c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19b4 expref: 9 pid: 21713 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.726749:0:16141:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16141:1830963593754112:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143695.729335:0:16141:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143695.732111:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.732222:0:16141:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16141:1830963593754112:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.732247:0:16141:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16141 initiator: MDT0 00000100:00100000:2.0:1746143695.732746:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592300800 00000100:00100000:2.0:1746143695.732753:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592300800 00010000:00010000:2.0:1746143695.732786:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd725d1c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19b4 expref: 10 pid: 21713 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.732834:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5007 00000100:00100000:2.0:1746143695.732842:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592300800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143695.732856:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143695.732861:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd725d1c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19b4 expref: 10 pid: 21713 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.732871:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd725d1c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19b4 expref: 10 pid: 21713 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.732892:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd725d1c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19b4 expref: 10 pid: 21713 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746143695.732923:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:2.0:1746143695.732928:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16141 initiator: MDT0 00010000:00010000:2.0:1746143695.732936:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16141 initiator: MDT0 00010000:00010000:2.0:1746143695.732943:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16141 initiator: MDT0 00010000:00010000:2.0:1746143695.732961:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143695.733002:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592300800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 160us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.733008:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5007 00010000:00010000:1.0:1746143695.733111:0:16141:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16141 initiator: MDT0 00010000:00010000:1.0:1746143695.733117:0:16141:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16141 initiator: MDT0 00000040:00080000:1.0:1746143695.733755:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2294, 88 off192816 00000004:00080000:1.0:1746143695.733761:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774743621266ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.733819:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2241, 88 off187968 00000004:00080000:1.0:1746143695.733823:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774743683259ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.733846:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2242, 88 off188056 00000004:00080000:1.0:1746143695.733849:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774743709590ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.733856:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2295, 88 off192904 00000004:00080000:1.0:1746143695.733858:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774743718876ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.733864:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2296, 88 off192992 00000004:00080000:1.0:1746143695.733866:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774743726316ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.733871:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2243, 88 off188144 00000004:00080000:1.0:1746143695.733874:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774743734107ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.733879:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2244, 88 off188232 00000004:00080000:1.0:1746143695.733882:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774743742069ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.733887:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2245, 88 off188320 00000004:00080000:1.0:1746143695.733889:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774743749164ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.733894:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2297, 88 off193080 00000004:00080000:1.0:1746143695.733895:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774743755957ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.733921:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2247, 88 off188504 00000004:00080000:1.0:1746143695.733924:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774743784220ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.733930:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2298, 88 off193168 00000004:00080000:1.0:1746143695.733932:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774743792279ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.733937:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2248, 88 off188592 00000004:00080000:1.0:1746143695.733939:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774743799064ns, next at 718087967394ns, rc = 0 00000040:00080000:1.0:1746143695.733944:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2299, 88 off193256 00000004:00080000:1.0:1746143695.733946:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774743806062ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.733950:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2300, 88 off193344 00000004:00080000:1.0:1746143695.733952:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774743812667ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.733957:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2301, 88 off193432 00000004:00080000:1.0:1746143695.733959:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774743819309ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.733964:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2302, 88 off193520 00000004:00080000:1.0:1746143695.733965:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774743825797ns, next at 758183694006ns, rc = 0 00000040:00080000:1.0:1746143695.733970:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2249, 88 off188680 00000004:00080000:1.0:1746143695.733972:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774743832224ns, next at 718087967394ns, rc = 0 00000004:00010000:1.0:1746143695.785054:0:16141:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e1e2a00 reply state ffff88012f00ec00 transno 8589942410 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16141 initiator: MDT0 00000100:00100000:1.0:1746143695.785070:0:16141:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746143695.785080:0:16141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143695.785083:0:16141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143695.785093:0:16141:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06cd600/0xe984082ccd725cdd lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19ad expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143695.785223:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28473:x1830963592300672:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 59027us (59610us total) trans 8589942410 rc 0/0 00000100:00100000:1.0:1746143695.785232:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3382 00000001:00080000:0.0:1746143695.785536:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942410 is committed 00000004:00080000:0.0:1746143695.785543:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1594 committed 00000004:00080000:0.0:1746143695.785550:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1647 committed 00010000:00010000:1.0:1746143695.785556:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16141 initiator: MDT0 00000004:00080000:0.0:1746143695.785556:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1646 committed 00000004:00080000:0.0:1746143695.785558:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1645 committed 00000004:00080000:0.0:1746143695.785559:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1644 committed 00000004:00080000:0.0:1746143695.785561:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1593 committed 00000004:00080000:0.0:1746143695.785562:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1643 committed 00010000:00010000:1.0:1746143695.785563:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16141 initiator: MDT0 00000004:00080000:0.0:1746143695.785564:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1592 committed 00000004:00080000:0.0:1746143695.785565:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1642 committed 00000004:00080000:0.0:1746143695.785566:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1591 committed 00000004:00080000:0.0:1746143695.785568:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1590 committed 00010000:00010000:1.0:1746143695.785569:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16141 initiator: MDT0 00000004:00080000:0.0:1746143695.785569:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1589 committed 00000004:00080000:0.0:1746143695.785570:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1641 committed 00000004:00080000:0.0:1746143695.785572:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1640 committed 00000004:00080000:0.0:1746143695.785573:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1588 committed 00000004:00080000:0.0:1746143695.785574:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1587 committed 00010000:00010000:1.0:1746143695.785575:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5fdfc00 already unused, calling callback (ffffffffa1387690) 00000004:00080000:0.0:1746143695.785576:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1639 committed 00010000:00010000:1.0:1746143695.785578:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16141 initiator: MDT0 00010000:00010000:1.0:1746143695.785584:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16141 initiator: MDT0 00010000:00010000:1.0:1746143695.785596:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff8800933c0e00) 00010000:00010000:1.0:1746143695.785597:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143695.785600:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16141 initiator: MDT0 00010000:00010000:1.0:1746143695.785604:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725d9a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16141 initiator: MDT0 00000100:00100000:1.0:1746143695.785760:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593754240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.785805:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.785855:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593754752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.785874:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.785887:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593755264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143695.785889:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593754496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.785899:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143695.785912:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.785914:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143695.785917:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593754624:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143695.785925:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593755008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.785930:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143695.785943:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593754240 00000100:00100000:1.0:1746143695.785943:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593755136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143695.785951:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593754240 00000100:00100000:1.0:1746143695.785953:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.785971:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143695.785976:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593754752 00000100:00100000:2.0:1746143695.785978:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593754752 00000100:00100000:0.0:1746143695.786047:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593755648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.786068:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143695.786083:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593756160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.786095:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143695.786104:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143695.786108:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593755776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.786121:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143695.786134:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593754368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143695.786168:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143695.786180:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593754880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143695.786193:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143695.786198:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593755392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143695.786209:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143695.786214:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593755904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.786225:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143695.786233:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143695.786241:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593755520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.786255:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143695.786261:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593756032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.786272:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143695.786285:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593755264 00000100:00100000:0.0:1746143695.786287:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593755264 00000100:00100000:0.0:1746143695.786298:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593754496 00000100:00100000:0.0:1746143695.786300:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593754496 00000100:00100000:0.0:1746143695.786306:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593754624 00000100:00100000:0.0:1746143695.786308:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593754624 00000100:00100000:0.0:1746143695.786314:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593755136 00000100:00100000:0.0:1746143695.786315:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593755136 00000100:00100000:0.0:1746143695.786320:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593755008 00000100:00100000:0.0:1746143695.786321:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593755008 00000100:00100000:0.0:1746143695.786327:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593755648 00000100:00100000:0.0:1746143695.786329:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593755648 00000100:00100000:0.0:1746143695.786334:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593756160 00000100:00100000:0.0:1746143695.786336:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593756160 00000100:00100000:0.0:1746143695.786341:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593755776 00000100:00100000:0.0:1746143695.786342:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593755776 00000100:00100000:0.0:1746143695.786348:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593754368 00000100:00100000:0.0:1746143695.786349:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593754368 00000100:00100000:0.0:1746143695.786354:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593754880 00000100:00100000:0.0:1746143695.786356:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593754880 00000100:00100000:0.0:1746143695.786360:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593755392 00000100:00100000:0.0:1746143695.786361:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593755392 00000100:00100000:0.0:1746143695.786366:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593755904 00000100:00100000:0.0:1746143695.786367:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593755904 00000100:00100000:0.0:1746143695.786373:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593755520 00000100:00100000:0.0:1746143695.786374:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593755520 00000100:00100000:0.0:1746143695.786379:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593756032 00000100:00100000:0.0:1746143695.786380:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593756032 00000100:00100000:0.0:1746143695.786388:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9702 00000100:00100000:0.0:1746143695.786394:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3293:x1830963593754240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143695.786567:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143695.786570:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.786572:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.786573:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.786575:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1746143695.786595:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3293:x1830963593754240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 202us (790us total) trans 17179872478 rc 0/0 00000100:00100000:0.0:1746143695.786601:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9702 00000100:00100000:0.0:1746143695.786611:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9703 00000100:00100000:0.0:1746143695.786615:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3293:x1830963593754752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143695.786715:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143695.786718:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.786720:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.786721:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.786723:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143695.786742:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3293:x1830963593754752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (866us total) trans 21474839744 rc 0/0 00000100:00100000:0.0:1746143695.786747:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9703 00000100:00100000:0.0:1746143695.786756:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9704 00000100:00100000:0.0:1746143695.786761:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3293:x1830963593755264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143695.786844:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3293:x1830963593755264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (943us total) trans 21474839745 rc 0/0 00000100:00100000:0.0:1746143695.786849:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9704 00000100:00100000:0.0:1746143695.786860:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9705 00000100:00100000:0.0:1746143695.786864:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3295:x1830963593754496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143695.786936:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143695.786938:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.786940:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.786942:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.786943:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143695.786957:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3295:x1830963593754496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (1045us total) trans 17179872479 rc 0/0 00000100:00100000:0.0:1746143695.786961:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9705 00000100:00100000:0.0:1746143695.786983:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9706 00000100:00100000:0.0:1746143695.786986:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3293:x1830963593754624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143695.787039:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143695.787042:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.787043:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.787045:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.787047:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143695.787060:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3293:x1830963593754624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (1130us total) trans 21474839746 rc 0/0 00000100:00100000:0.0:1746143695.787064:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9706 00000100:00100000:0.0:1746143695.787072:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9707 00000100:00100000:0.0:1746143695.787076:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3293:x1830963593755136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143695.787130:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3293:x1830963593755136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (1175us total) trans 21474839747 rc 0/0 00000100:00100000:0.0:1746143695.787135:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9707 00000100:00100000:0.0:1746143695.787161:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9708 00000100:00100000:0.0:1746143695.787164:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3295:x1830963593755008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143695.787219:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:0.0:1746143695.787221:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:0.0:1746143695.787222:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143695.787224:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:0.0:1746143695.787226:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:0.0:1746143695.787244:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3295:x1830963593755008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (1272us total) trans 21474839748 rc 0/0 00000100:00100000:0.0:1746143695.787248:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9708 00000100:00100000:0.0:1746143695.787257:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9709 00000100:00100000:0.0:1746143695.787261:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3292:x1830963593755648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143695.787317:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143695.787320:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143695.787321:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143695.787323:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143695.787325:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143695.787346:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963593755648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (1276us total) trans 17179872480 rc 0/0 00000100:00100000:0.0:1746143695.787350:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9709 00000100:00100000:0.0:1746143695.787359:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9710 00000100:00100000:0.0:1746143695.787363:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3292:x1830963593756160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.787434:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963593756160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1338us total) trans 17179872481 rc 0/0 00000100:00100000:0.0:1746143695.787439:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9710 00000100:00100000:0.0:1746143695.787448:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9711 00000100:00100000:0.0:1746143695.787452:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3292:x1830963593755776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.787520:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963593755776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1398us total) trans 17179872482 rc 0/0 00000100:00100000:0.0:1746143695.787525:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9711 00000004:00080000:1.0:1746143695.787527:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e3800/2, rc 0, transno 17179872479 00000100:00100000:0.0:1746143695.787532:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9712 00000100:00100000:1.0:1746143695.787535:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593754496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.787537:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3294:x1830963593754368:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143695.787545:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ed180/2, rc 0, transno 21474839748 00000100:00100000:1.0:1746143695.787549:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593755008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.787565:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9713 00000100:00100000:1.0:1746143695.787572:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3294:x1830963593754880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143695.787598:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143695.787601:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.787603:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.787605:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.787606:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746143695.787626:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3294:x1830963593754368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1457us total) trans 21474839749 rc 0/0 00000100:00100000:0.0:1746143695.787630:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9712 00000100:00100000:0.0:1746143695.787639:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9714 00000100:00100000:0.0:1746143695.787642:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3294:x1830963593755392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143695.787643:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143695.787645:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:1.0:1746143695.787647:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:1.0:1746143695.787649:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:1.0:1746143695.787650:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143695.787670:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3294:x1830963593754880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (1476us total) trans 21474839750 rc 0/0 00000100:00100000:1.0:1746143695.787675:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9713 00000100:00100000:1.0:1746143695.787684:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9715 00000100:00100000:1.0:1746143695.787689:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3294:x1830963593755904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.787722:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3294:x1830963593755392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (1512us total) trans 21474839751 rc 0/0 00000100:00100000:0.0:1746143695.787728:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9714 00000100:00100000:0.0:1746143695.787736:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9716 00000100:00100000:0.0:1746143695.787740:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3294:x1830963593755520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.787762:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3294:x1830963593755904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1535us total) trans 17179872483 rc 0/0 00000100:00100000:1.0:1746143695.787767:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9715 00000100:00100000:1.0:1746143695.787775:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9717 00000100:00100000:1.0:1746143695.787779:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3294:x1830963593756032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143695.787803:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:0.0:1746143695.787805:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.787807:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.787808:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143695.787810:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5541 -> 5541 00000100:00100000:0.0:1746143695.787840:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3294:x1830963593755520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (1583us total) trans 17179872484 rc 0/0 00000100:00100000:0.0:1746143695.787845:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9716 00000100:00100000:1.0:1746143695.787866:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3294:x1830963593756032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (1593us total) trans 17179872485 rc 0/0 00000004:00080000:0.0:1746143695.787866:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e1500/2, rc 0, transno 17179872482 00000100:00100000:0.0:1746143695.787869:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593755776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.787871:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9717 00000004:00080000:0.0:1746143695.787876:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e0000/2, rc 0, transno 17179872480 00000100:00100000:0.0:1746143695.787878:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593755648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143695.787884:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009445b800/2, rc 0, transno 17179872481 00000100:00100000:0.0:1746143695.787886:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593756160:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143695.787896:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ed880/2, rc 0, transno 21474839746 00000004:00080000:0.0:1746143695.787897:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e1f80/2, rc 0, transno 17179872484 00000100:00100000:1.0:1746143695.787900:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593754624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143695.787900:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593755520:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143695.787905:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1efb80/2, rc 0, transno 21474839747 00000004:00080000:0.0:1746143695.787905:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009445ad80/2, rc 0, transno 17179872485 00000100:00100000:0.0:1746143695.787907:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593756032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.787908:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593755136:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143695.787912:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ec380/2, rc 0, transno 21474839749 00000004:00080000:1.0:1746143695.787914:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e1880/2, rc 0, transno 17179872478 00000100:00100000:0.0:1746143695.787914:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593754368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.787917:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593754240:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143695.787920:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ed500/2, rc 0, transno 21474839750 00000004:00080000:1.0:1746143695.787922:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1eca80/2, rc 0, transno 21474839744 00000100:00100000:0.0:1746143695.787922:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593754880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.787924:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593754752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143695.787927:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ef480/2, rc 0, transno 21474839751 00000004:00080000:1.0:1746143695.787929:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ece00/2, rc 0, transno 21474839745 00000100:00100000:0.0:1746143695.787929:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593755392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.787932:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593755264:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143695.787934:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e3100/2, rc 0, transno 17179872483 00000100:00100000:0.0:1746143695.787936:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593755904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.787968:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143695.787975:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593756288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.788453:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143695.788526:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593756288 00000100:00100000:3.0:1746143695.788532:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593756288 00000100:00100000:3.0:1746143695.788556:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9718 00000100:00100000:3.0:1746143695.788560:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963593756288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143695.788658:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3292:x1830963593756288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (205us total) trans 17179872486 rc 0/0 00000100:00100000:0.0:1746143695.788700:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.789067:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592300928 00000100:00100000:1.0:1746143695.789071:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592300928 00000100:00100000:1.0:1746143695.789097:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8303 00000100:00100000:1.0:1746143695.789102:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:28473:x1830963592300928:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143695.789117:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.789134:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd725da1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a19ec expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.789196:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd725da1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19ec expref: 7 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.789214:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd725da1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19ec expref: 7 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.789228:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143695.789231:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143695.789233:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cab8000, rc 0) 00000100:00100000:1.0:1746143695.789271:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28473:x1830963592300928:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 169us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.789276:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8303 00000004:00080000:1.0:1746143695.789308:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009445b480/2, rc 0, transno 17179872486 00000100:00100000:1.0:1746143695.789312:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593756288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143695.791308:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9718 00000100:00100000:0.0:1746143695.792294:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.792727:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592301184 00000100:00100000:1.0:1746143695.792737:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592301184 00000100:00100000:1.0:1746143695.792773:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3383 00000100:00100000:1.0:1746143695.792779:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28473:x1830963592301184:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:1.0:1746143695.793046:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28473:x1830963592301184:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 265us (755us total) trans 8589942411 rc 0/0 00000100:00100000:1.0:1746143695.793052:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3383 00000100:00100000:0.0:1746143695.812611:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.812809:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592301440 00000100:00100000:2.0:1746143695.812821:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592301440 00000100:00100000:2.0:1746143695.812893:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8304 00000100:00100000:2.0:1746143695.812902:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+6:28483:x1830963592301440:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143695.812930:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.812951:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdee00/0xe984082ccd725da8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a19f3 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143695.812973:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.813022:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592301696 00000100:00100000:1.0:1746143695.813027:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592301696 00010000:00010000:2.0:1746143695.813059:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfa00/0xe984082ccd725daf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00000100:00100000:1.0:1746143695.813066:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8305 00000100:00100000:1.0:1746143695.813071:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:28480:x1830963592301696:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143695.813072:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfa00/0xe984082ccd725daf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.813082:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfa00/0xe984082ccd725daf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143695.813082:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.813090:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd725db6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a19fa expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.813092:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde000/0xe984082ccd725dbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.813097:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde000/0xe984082ccd725dbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.813102:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde000/0xe984082ccd725dbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143695.813136:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725dc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813164:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813172:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143695.813228:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde200/0xe984082ccd725dcb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.813234:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde200/0xe984082ccd725dcb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.813239:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde200/0xe984082ccd725dcb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143695.813246:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143695.813327:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfa00/0xe984082ccd725daf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.813333:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfa00/0xe984082ccd725daf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.813339:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfa00/0xe984082ccd725daf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.813345:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5fdfa00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143695.813348:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfa00/0xe984082ccd725daf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.813356:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfa00/0xe984082ccd725daf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.813366:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143695.813369:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143695.813373:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfa00/0xe984082ccd725daf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.813377:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfa00/0xe984082ccd725daf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143695.813602:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2400/0xe984082ccd725dd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813608:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2400/0xe984082ccd725dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813614:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2400/0xe984082ccd725dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813664:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725de0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813670:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725de0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813675:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725de0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143695.813680:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143695.813838:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813845:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725dc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813853:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813858:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801368a3c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143695.813860:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813865:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725dc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813872:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143695.813874:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143695.813877:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725dc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813881:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725dc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813913:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2400/0xe984082ccd725dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813918:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2400/0xe984082ccd725dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813922:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2400/0xe984082ccd725dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813926:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801368a2400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143695.813928:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2400/0xe984082ccd725dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813933:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2400/0xe984082ccd725dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813942:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a800) 00010000:00010000:1.0:1746143695.813945:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143695.813946:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2400/0xe984082ccd725dd9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813950:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2400/0xe984082ccd725dd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.813985:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3000/0xe984082ccd725db6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19fa expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.813996:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725de0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19fa expref: 242 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.814001:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143695.814003:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143695.814005:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a2a00, rc 0) 00000100:00100000:1.0:1746143695.814055:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28480:x1830963592301696:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 983us (1082us total) trans 8589942413 rc 0/0 00000100:00100000:1.0:1746143695.814061:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8305 00010000:00010000:2.0:1746143695.814801:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde000/0xe984082ccd725dbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.814810:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde000/0xe984082ccd725dbd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.814815:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde000/0xe984082ccd725dbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.814819:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5fde000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143695.814822:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde000/0xe984082ccd725dbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.814959:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde000/0xe984082ccd725dbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.814968:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a800) 00010000:00010000:2.0:1746143695.814971:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143695.814973:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde000/0xe984082ccd725dbd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.814981:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde000/0xe984082ccd725dbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.815014:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdee00/0xe984082ccd725da8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19f3 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.815025:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde200/0xe984082ccd725dcb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19f3 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.815030:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143695.815033:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143695.815034:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fde200, rc 0) 00000100:00100000:2.0:1746143695.815060:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28483:x1830963592301440:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2159us (2461us total) trans 8589942412 rc 0/0 00000100:00100000:2.0:1746143695.815065:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8304 00000100:00100000:0.0:1746143695.820387:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.820434:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.820483:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592301952 00000100:00100000:1.0:1746143695.820493:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592301952 00000100:00100000:1.0:1746143695.820531:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592302208 00000100:00100000:1.0:1746143695.820534:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592302208 00000100:00100000:1.0:1746143695.821306:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8306 00000100:00100000:1.0:1746143695.821315:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28485:x1830963592301952:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143695.821319:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8307 00000100:00100000:2.0:1746143695.821329:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28486:x1830963592302208:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.821340:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.821340:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.821359:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725dee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a08 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.821359:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2400/0xe984082ccd725df5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a01 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.821447:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde800/0xe984082ccd725dfc lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143695.821447:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725e03 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.821460:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725e03 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143695.821470:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725e03 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143695.821479:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143695.821514:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde800/0xe984082ccd725dfc lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.821522:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde800/0xe984082ccd725dfc lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143695.821529:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143695.821588:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2400/0xe984082ccd725df5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a01 expref: 245 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.821589:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdf000/0xe984082ccd725dee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a08 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.821603:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde800/0xe984082ccd725dfc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a08 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.821610:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143695.821613:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143695.821616:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fde800, rc 0) 00010000:00010000:1.0:1746143695.821628:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725e03 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a01 expref: 244 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.821634:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143695.821637:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143695.821639:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a3c00, rc 0) 00000100:00100000:1.0:1746143695.821665:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28485:x1830963592301952:12345-192.168.202.48@tcp:101:cat.0 Request processed in 351us (1289us total) trans 8589942414 rc 0/0 00000100:00100000:1.0:1746143695.821671:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8306 00000100:00100000:2.0:1746143695.821700:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28486:x1830963592302208:12345-192.168.202.48@tcp:101:cat.0 Request processed in 373us (1265us total) trans 8589942415 rc 0/0 00000100:00100000:2.0:1746143695.821706:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8307 00000100:00100000:0.0:1746143695.826907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.826997:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592302336 00000100:00100000:2.0:1746143695.827008:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592302336 00000100:00100000:2.0:1746143695.827063:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9719 00000100:00100000:2.0:1746143695.827071:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28485:x1830963592302336:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.827091:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.827111:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd725e18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a0f expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.827164:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.827166:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.827176:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd725e18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a0f expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.827191:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd725e18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a0f expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.827202:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fdfe00, rc 0) 00000100:00100000:2.0:1746143695.827250:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28485:x1830963592302336:12345-192.168.202.48@tcp:101:cat.0 Request processed in 179us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.827256:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9719 00000100:00100000:0.0:1746143695.827428:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.827538:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592302464 00000100:00100000:3.0:1746143695.827543:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592302464 00000100:00100000:3.0:1746143695.827565:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9720 00000100:00100000:3.0:1746143695.827570:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28486:x1830963592302464:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143695.827578:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143695.827585:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd725e1f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a16 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.827597:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.827599:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.827603:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd725e1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a16 expref: 12 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.827617:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd725e1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a16 expref: 12 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.827623:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c176000, rc 0) 00000100:00100000:3.0:1746143695.827663:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28486:x1830963592302464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 92us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.827669:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9720 00000100:00100000:0.0:1746143695.834636:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.834741:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.834744:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592302720 00000100:00100000:3.0:1746143695.834754:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592302720 00002000:00100000:3.0:1746143695.834798:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800930dc380 x1830963592302720/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.834806:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc380 with x1830963592302720 ext(0->1048575) 00002000:00010000:3.0:1746143695.834812:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dc380 00000100:00100000:3.0:1746143695.834839:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3591 00000100:00100000:0.0:1746143695.834846:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.834847:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592302720:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143695.834937:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592303232 00000100:00100000:1.0:1746143695.834941:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592303232 00002000:00100000:1.0:1746143695.834960:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800930ded80 x1830963592303232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143695.834966:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ded80 with x1830963592303232 ext(0->1048575) 00002000:00010000:1.0:1746143695.834968:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930ded80 00000100:00100000:1.0:1746143695.834982:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3592 00000100:00100000:1.0:1746143695.834986:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592303232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143695.835350:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592302976 00000100:00100000:2.0:1746143695.835355:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592302976 00000100:00100000:2.0:1746143695.835384:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8308 00000100:00100000:2.0:1746143695.835389:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28480:x1830963592302976:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143695.835405:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.835408:0:16090:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746143695.835435:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3c00/0xe984082ccd725e03 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a01 expref: 244 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.835470:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725de0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19fa expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.835487:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143695.835492:0:16090:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143695.835504:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfa00/0xe984082ccd725e26 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a1d expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.835547:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.835557:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd725da1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19ec expref: 7 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.835564:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde800/0xe984082ccd725dfc lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a08 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.835569:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde200/0xe984082ccd725dcb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19f3 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.835574:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 6/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.835604:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde200/0xe984082ccd725dcb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19f3 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.835620:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde200/0xe984082ccd725dcb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19f3 expref: 9 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.835631:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593756416:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.835780:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde800/0xe984082ccd725dfc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a08 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.835786:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde800/0xe984082ccd725dfc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a08 expref: 9 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.835793:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593756544:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.835862:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd725da1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19ec expref: 7 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.835869:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd725da1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19ec expref: 7 pid: 21713 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.835875:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593756672:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143695.835896:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143695.842186:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.842218:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.842269:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.842282:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592303488 00000100:00100000:3.0:1746143695.842291:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592303488 00010000:00010000:3.0:1746143695.842333:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde800/0xe984082ccd725dfc lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a08 expref: 10 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.842337:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592303360 00000100:00100000:1.0:1746143695.842341:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592303360 00010000:00010000:1.0:1746143695.842357:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde200/0xe984082ccd725dcb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19f3 expref: 11 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746143695.842362:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5008 00000100:00100000:3.0:1746143695.842370:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592303488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143695.842373:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592303616 00000100:00100000:1.0:1746143695.842375:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592303616 00010000:00010000:1.0:1746143695.842383:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd725da1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19ec expref: 8 pid: 21713 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746143695.842385:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143695.842391:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde800/0xe984082ccd725dfc lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a08 expref: 11 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746143695.842394:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5009 00000100:00100000:1.0:1746143695.842399:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592303360:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.842402:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde800/0xe984082ccd725dfc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a08 expref: 11 pid: 16090 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.842407:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143695.842410:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde200/0xe984082ccd725dcb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19f3 expref: 11 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746143695.842921:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5010 00000100:00100000:0.0:1746143695.842930:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963592303616:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143695.842931:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde200/0xe984082ccd725dcb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19f3 expref: 11 pid: 16090 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746143695.842939:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143695.842944:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143695.842944:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd725da1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19ec expref: 8 pid: 21713 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746143695.842949:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143695.842956:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143695.842961:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143695.842966:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd725da1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19ec expref: 8 pid: 21713 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746143695.842979:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143695.842982:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143695.842989:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143695.842995:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 16090 initiator: MDT0 00000100:00100000:1.0:1746143695.843005:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592303360:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 606us (786us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143695.843011:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143695.843012:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5009 00000100:00100000:0.0:1746143695.843029:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963592303616:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 101us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143695.843035:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5010 00010000:00010000:3.0:1746143695.843818:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143695.843832:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143695.843864:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963592303488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1494us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.843870:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5008 00010000:00010000:2.0:1746143695.850491:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde200/0xe984082ccd725dcb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19f3 expref: 9 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.850534:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593756416:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.850548:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fde800/0xe984082ccd725dfc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a08 expref: 8 pid: 16090 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.850560:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593756544:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.850570:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cab8000/0xe984082ccd725da1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19ec expref: 7 pid: 21713 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746143695.850590:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593756672:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143695.850616:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.850625:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143695.850630:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:02000000:2.0:1746143695.850684:0:16090:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:2.0:1746143695.851322:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2303, 88 off193608 00000004:00080000:2.0:1746143695.851328:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774861187705ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143695.851386:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2250, 88 off188768 00000004:00080000:2.0:1746143695.851389:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774861249559ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143695.851402:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2251, 88 off188856 00000004:00080000:2.0:1746143695.851405:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774861265198ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143695.851412:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2304, 88 off193696 00000004:00080000:2.0:1746143695.851414:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774861274433ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143695.851420:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2305, 88 off193784 00000004:00080000:2.0:1746143695.851422:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774861282565ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143695.851428:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2252, 88 off188944 00000004:00080000:2.0:1746143695.851430:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774861290233ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143695.851436:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2253, 88 off189032 00000004:00080000:2.0:1746143695.851438:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774861298413ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143695.851444:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2254, 88 off189120 00000004:00080000:2.0:1746143695.851446:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774861306405ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143695.851452:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2306, 88 off193872 00000004:00080000:2.0:1746143695.851454:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774861314573ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143695.851461:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2255, 88 off189208 00000004:00080000:2.0:1746143695.851463:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774861323363ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143695.851469:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2307, 88 off193960 00000004:00080000:2.0:1746143695.851471:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774861331270ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143695.851476:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2256, 88 off189296 00000004:00080000:2.0:1746143695.851479:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774861338973ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143695.851485:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2308, 88 off194048 00000004:00080000:2.0:1746143695.851487:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774861347719ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143695.851493:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2309, 88 off194136 00000004:00080000:2.0:1746143695.851496:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774861356106ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143695.851501:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2310, 88 off194224 00000004:00080000:2.0:1746143695.851503:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774861363599ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143695.851509:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2311, 88 off194312 00000004:00080000:2.0:1746143695.851511:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774861371363ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143695.851516:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2257, 88 off189384 00000004:00080000:2.0:1746143695.851519:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774861379159ns, next at 718087967394ns, rc = 0 00000100:00100000:3.0:1746143695.853806:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592302720:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18952us (19174us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143695.853817:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3591 00002000:00100000:3.0:1746143695.853839:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800930dc380 x1830963592302720/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.853848:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc380 with x1830963592302720 ext(0->1048575) 00002000:00010000:3.0:1746143695.853853:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dc380 00000100:00100000:1.0:1746143695.861049:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592303232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26052us (26193us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143695.861062:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3592 00002000:00100000:1.0:1746143695.861073:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff8800930ded80 x1830963592303232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143695.861084:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ded80 with x1830963592303232 ext(0->1048575) 00002000:00010000:1.0:1746143695.861091:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930ded80 00000100:00100000:3.0:1746143695.868684:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.869628:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592303744 00000100:00100000:1.0:1746143695.869640:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592303744 00000100:00100000:1.0:1746143695.869694:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9721 00000100:00100000:1.0:1746143695.869702:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28485:x1830963592303744:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143695.869720:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.869739:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd725e34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a24 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.869766:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.869768:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.869776:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd725e34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a24 expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.869793:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd725e34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a24 expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.869803:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a2c00, rc 0) 00000100:00100000:1.0:1746143695.869868:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28485:x1830963592303744:12345-192.168.202.48@tcp:101:cat.0 Request processed in 166us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.869874:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9721 00000100:00100000:2.0:1746143695.883891:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.884019:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592303872 00000100:00100000:1.0:1746143695.884029:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592303872 00000100:00100000:1.0:1746143695.884074:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8309 00000100:00100000:1.0:1746143695.884082:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28485:x1830963592303872:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143695.884104:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.884126:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a2b expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.884211:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143695.884222:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.884242:0:21713:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143695.884256:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.884268:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143695.884271:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143695.884274:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.884280:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a2a00, rc 0) 00000100:00100000:1.0:1746143695.884341:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:28485:x1830963592303872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 258us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.884347:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8309 00000100:00100000:0.0:1746143695.884632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.884676:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592304000 00000100:00100000:0.0:1746143695.884680:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592304000 00000100:00100000:0.0:1746143695.884704:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9722 00000100:00100000:0.0:1746143695.884709:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28486:x1830963592304000:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143695.884717:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143695.884728:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd725e42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a32 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.884745:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143695.884748:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143695.884755:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd725e42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a32 expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.884767:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd725e42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a32 expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143695.884774:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b5d200, rc 0) 00000100:00100000:0.0:1746143695.884795:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28486:x1830963592304000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 87us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143695.884800:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9722 00010000:00010000:3.0:1746143695.887765:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a1d expref: 246 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.887780:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143695.887783:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746143695.887787:0:16090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.887796:0:16090:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.887804:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.887855:0:16090:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.887870:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593756800:192.168.202.48@tcp:105: 00000001:00080000:1.0:1746143695.887870:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942414 is committed 00000001:00080000:1.0:1746143695.887881:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942411 is committed 00000001:00080000:1.0:1746143695.887885:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942416 is committed 00000004:00080000:1.0:1746143695.887889:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1602 committed 00000004:00080000:1.0:1746143695.887896:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1656 committed 00000004:00080000:1.0:1746143695.887901:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1655 committed 00000004:00080000:1.0:1746143695.887903:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1654 committed 00000004:00080000:1.0:1746143695.887904:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1653 committed 00000004:00080000:1.0:1746143695.887906:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1601 committed 00000004:00080000:1.0:1746143695.887907:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1652 committed 00000004:00080000:1.0:1746143695.887908:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1600 committed 00000004:00080000:1.0:1746143695.887909:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1651 committed 00000004:00080000:1.0:1746143695.887910:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1599 committed 00000004:00080000:1.0:1746143695.887911:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1598 committed 00000004:00080000:1.0:1746143695.887912:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1597 committed 00000004:00080000:1.0:1746143695.887913:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1650 committed 00000004:00080000:1.0:1746143695.887914:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1649 committed 00000004:00080000:1.0:1746143695.887916:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1596 committed 00000004:00080000:1.0:1746143695.887917:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1595 committed 00000004:00080000:1.0:1746143695.887918:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1648 committed 00000001:00080000:1.0:1746143695.887922:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942415 is committed 00000100:00100000:3.0:1746143695.887953:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143695.888016:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593757056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.888439:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143695.888505:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593756928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.888591:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593757568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.888605:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.888619:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593758080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.888632:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.888755:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593758592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.888770:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143695.888928:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593757056 00000100:00100000:2.0:1746143695.888936:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593757056 00000100:00100000:1.0:1746143695.888941:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593757184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.888959:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.889239:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593757696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.889255:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.889464:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593758208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.889481:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143695.889499:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593757568 00000100:00100000:2.0:1746143695.889499:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593758080 00000100:00100000:3.0:1746143695.889503:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593757568 00000100:00100000:2.0:1746143695.889503:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593758080 00000100:00100000:3.0:1746143695.889521:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593758592 00000100:00100000:3.0:1746143695.889523:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593758592 00000100:00100000:2.0:1746143695.889524:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593757184 00000100:00100000:2.0:1746143695.889525:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593757184 00000100:00100000:3.0:1746143695.889532:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593757696 00000100:00100000:3.0:1746143695.889534:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593757696 00000100:00100000:2.0:1746143695.889538:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9723 00000100:00100000:3.0:1746143695.889542:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9724 00000100:00100000:2.0:1746143695.889544:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3295:x1830963593757056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143695.889546:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3295:x1830963593757568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143695.889562:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9725 00000100:00100000:3.0:1746143695.889565:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3295:x1830963593758080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143695.889728:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143695.889728:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143695.889731:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:2.0:1746143695.889731:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:3.0:1746143695.889733:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00002000:00010000:2.0:1746143695.889733:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00002000:00010000:3.0:1746143695.889735:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:2.0:1746143695.889735:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:3.0:1746143695.889737:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746143695.889737:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143695.889767:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3295:x1830963593758080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (1133us total) trans 21474839752 rc 0/0 00000100:00100000:2.0:1746143695.889769:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3295:x1830963593757056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 226us (1332us total) trans 17179872487 rc 0/0 00000100:00100000:3.0:1746143695.889773:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9725 00000100:00100000:2.0:1746143695.889776:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9723 00000100:00100000:2.0:1746143695.889787:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9726 00000100:00100000:3.0:1746143695.889790:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9727 00000100:00100000:2.0:1746143695.889792:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3295:x1830963593758592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143695.889794:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3292:x1830963593757184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143695.889871:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:3.0:1746143695.889874:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:3.0:1746143695.889875:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00002000:00010000:3.0:1746143695.889877:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:3.0:1746143695.889879:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5541 -> 5541 00000100:00100000:2.0:1746143695.889884:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3295:x1830963593758592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (1112us total) trans 21474839753 rc 0/0 00000100:00100000:2.0:1746143695.889889:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9726 00000100:00100000:3.0:1746143695.889893:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3292:x1830963593757184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (934us total) trans 17179872488 rc 0/0 00000100:00100000:3.0:1746143695.889898:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9727 00000100:00100000:2.0:1746143695.889900:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9728 00000100:00100000:2.0:1746143695.889904:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3292:x1830963593757696:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143695.889948:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c21f80/2, rc 0, transno 21474839752 00000100:00100000:3.0:1746143695.889953:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593758080:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143695.889960:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c23480/2, rc 0, transno 21474839753 00000100:00100000:3.0:1746143695.889962:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593758592:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143695.889969:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79f480/2, rc 0, transno 17179872487 00000100:00100000:3.0:1746143695.889976:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593757056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143695.889997:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3292:x1830963593757696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (740us total) trans 17179872489 rc 0/0 00000100:00100000:2.0:1746143695.890002:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9728 00000100:00100000:3.0:1746143695.890074:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3295:x1830963593757568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 526us (1467us total) trans 17179872490 rc 0/0 00000100:00100000:3.0:1746143695.890079:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9724 00000004:00080000:3.0:1746143695.890095:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f00e00/2, rc 0, transno 17179872490 00000100:00100000:3.0:1746143695.890098:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593757568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143695.890104:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746143695.890107:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593758976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143695.890285:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593758208 00000100:00100000:2.0:1746143695.890289:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593758208 00000100:00100000:2.0:1746143695.890306:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9729 00000100:00100000:2.0:1746143695.890310:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3292:x1830963593758208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143695.890388:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143695.890391:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:2.0:1746143695.890392:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00000100:00100000:0.0:1746143695.890392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:2.0:1746143695.890394:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:2.0:1746143695.890396:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746143695.890415:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963593758208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (932us total) trans 21474839754 rc 0/0 00000100:00100000:2.0:1746143695.890420:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9729 00000100:00100000:2.0:1746143695.890437:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592304128 00000100:00100000:2.0:1746143695.890440:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592304128 00000100:00100000:2.0:1746143695.890458:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8310 00000100:00100000:2.0:1746143695.890463:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+6:28486:x1830963592304128:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.890479:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143695.890493:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143695.890495:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd725e49 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a39 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143695.890515:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592304256 00000100:00100000:0.0:1746143695.890518:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592304256 00000100:00100000:0.0:1746143695.890539:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3384 00010000:00010000:2.0:1746143695.890541:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd725e49 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a39 expref: 7 pid: 14764 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143695.890543:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ecec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28485:x1830963592304256:12345-192.168.202.48@tcp:49:cat.0 00010000:00010000:2.0:1746143695.890554:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd725e49 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a39 expref: 7 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.890569:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143695.890572:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143695.890575:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a7400, rc 0) 00000100:00100000:2.0:1746143695.890604:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+7:28486:x1830963592304128:12345-192.168.202.48@tcp:101:cat.0 Request processed in 141us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.890612:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8310 00000100:00100000:0.0:1746143695.890679:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ecec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28485:x1830963592304256:12345-192.168.202.48@tcp:49:cat.0 Request processed in 134us (184us total) trans 0 rc 0/0 00000004:00080000:1.0:1746143695.890685:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c20000/2, rc 0, transno 21474839754 00000100:00100000:0.0:1746143695.890685:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3384 00000100:00100000:1.0:1746143695.890689:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593758208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.890694:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593758720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.890709:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143695.890727:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79f800/2, rc 0, transno 17179872488 00000100:00100000:1.0:1746143695.890730:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593757184:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143695.890735:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f01f80/2, rc 0, transno 17179872489 00000100:00100000:1.0:1746143695.890738:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593757696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.890742:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746143695.890747:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593757312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.890765:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143695.890772:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593758720 00000100:00100000:1.0:1746143695.890775:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593757824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.890775:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593758720 00000100:00100000:0.0:1746143695.890787:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593757312 00000100:00100000:0.0:1746143695.890789:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593757312 00000100:00100000:1.0:1746143695.890790:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.890799:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593758336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143695.890799:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593757824 00000100:00100000:0.0:1746143695.890800:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593757824 00000100:00100000:0.0:1746143695.890810:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9730 00000100:00100000:1.0:1746143695.890814:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143695.890815:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963593758720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143695.890912:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3292:x1830963593758720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (201us total) trans 21474839755 rc 0/0 00000100:00100000:0.0:1746143695.890918:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9730 00000100:00100000:0.0:1746143695.890925:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593758336 00000100:00100000:0.0:1746143695.890928:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593758336 00000100:00100000:0.0:1746143695.890936:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9731 00000100:00100000:0.0:1746143695.890939:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3292:x1830963593757312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.890965:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593758848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.890985:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143695.890998:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c20e00/2, rc 0, transno 21474839755 00000100:00100000:1.0:1746143695.891000:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593758720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.891019:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593758848 00000100:00100000:1.0:1746143695.891021:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593758848 00002000:00010000:0.0:1746143695.891021:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143695.891023:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746143695.891024:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143695.891026:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746143695.891027:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143695.891035:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9732 00000100:00100000:1.0:1746143695.891040:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3292:x1830963593757824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.891049:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3292:x1830963593757312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (282us total) trans 17179872491 rc 0/0 00000100:00100000:0.0:1746143695.891053:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9731 00000100:00100000:0.0:1746143695.891063:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9733 00000100:00100000:0.0:1746143695.891066:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3292:x1830963593758336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143695.891121:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143695.891124:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143695.891126:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143695.891128:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00000100:00100000:1.0:1746143695.891130:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3292:x1830963593757824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (340us total) trans 17179872492 rc 0/0 00002000:00010000:0.0:1746143695.891130:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143695.891136:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9732 00000100:00100000:1.0:1746143695.891162:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9734 00000100:00100000:0.0:1746143695.891163:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3292:x1830963593758336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (348us total) trans 21474839756 rc 0/0 00000100:00100000:1.0:1746143695.891167:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3292:x1830963593758848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143695.891168:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9733 00000004:00080000:0.0:1746143695.891189:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f02300/2, rc 0, transno 17179872491 00000100:00100000:0.0:1746143695.891192:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593757312:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143695.891198:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f03b80/2, rc 0, transno 17179872492 00000100:00100000:0.0:1746143695.891200:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593757824:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143695.891206:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c23800/2, rc 0, transno 21474839756 00000100:00100000:0.0:1746143695.891209:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593758336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143695.891552:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593756800:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143695.891579:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfa00/0xe984082ccd725e26 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a1d expref: 243 pid: 16090 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746143695.891592:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a1d expref: 242 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.891608:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fdfc00, rc 0) 00000100:00100000:3.0:1746143695.891631:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28480:x1830963592302976:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 56241us (56890us total) trans 8589942416 rc 0/0 00000100:00100000:3.0:1746143695.891637:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8308 00000100:00100000:3.0:1746143695.891706:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143695.891719:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593758976 00000100:00100000:2.0:1746143695.891723:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593758976 00000100:00100000:2.0:1746143695.891738:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9735 00000100:00100000:2.0:1746143695.891742:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3295:x1830963593758976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143695.891853:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3295:x1830963593758976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (147us total) trans 17179872493 rc 0/0 00000100:00100000:2.0:1746143695.891858:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9735 00000100:00100000:1.0:1746143695.892014:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3292:x1830963593758848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 845us (1026us total) trans 21474839757 rc 0/0 00000100:00100000:1.0:1746143695.892019:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9734 00000100:00100000:1.0:1746143695.892046:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.892063:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593757440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143695.892081:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.892090:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593757952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.892105:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.892115:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593758464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143695.892129:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143695.892166:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593756928 00000100:00100000:1.0:1746143695.892169:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593756928 00000100:00100000:1.0:1746143695.892182:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593757440 00000100:00100000:1.0:1746143695.892184:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593757440 00000100:00100000:1.0:1746143695.892191:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593757952 00000100:00100000:1.0:1746143695.892193:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593757952 00000100:00100000:1.0:1746143695.892200:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593758464 00000100:00100000:1.0:1746143695.892202:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593758464 00000100:00100000:1.0:1746143695.892212:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9736 00000100:00100000:1.0:1746143695.892216:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963593756928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143695.892294:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143695.892297:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:1.0:1746143695.892299:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00002000:00010000:1.0:1746143695.892301:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:1.0:1746143695.892302:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:1.0:1746143695.892324:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3294:x1830963593756928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (278us total) trans 17179872494 rc 0/0 00000100:00100000:1.0:1746143695.892329:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9736 00000100:00100000:2.0:1746143695.892441:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9737 00000100:00100000:2.0:1746143695.892447:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963593757440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143695.892523:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3294:x1830963593757440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (441us total) trans 17179872495 rc 0/0 00000100:00100000:2.0:1746143695.892528:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9737 00000100:00100000:2.0:1746143695.892537:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9738 00000100:00100000:2.0:1746143695.892542:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3294:x1830963593757952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143695.892617:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143695.892619:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:2.0:1746143695.892621:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00002000:00010000:2.0:1746143695.892623:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:2.0:1746143695.892624:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746143695.892643:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3294:x1830963593757952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (537us total) trans 21474839758 rc 0/0 00000100:00100000:2.0:1746143695.892648:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9738 00000100:00100000:2.0:1746143695.892657:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9739 00000100:00100000:2.0:1746143695.892661:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3294:x1830963593758464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143695.892735:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:2.0:1746143695.892738:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:2.0:1746143695.892739:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143695.892741:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:2.0:1746143695.892743:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:2.0:1746143695.892761:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3294:x1830963593758464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (631us total) trans 21474839759 rc 0/0 00000100:00100000:2.0:1746143695.892766:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9739 00000004:00080000:1.0:1746143695.893218:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79e680/2, rc 0, transno 17179872494 00000100:00100000:1.0:1746143695.893222:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593756928:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143695.893229:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f00a80/2, rc 0, transno 17179872495 00000100:00100000:1.0:1746143695.893232:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593757440:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143695.893239:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dd500/2, rc 0, transno 21474839758 00000100:00100000:1.0:1746143695.893241:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593757952:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143695.893246:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c21c00/2, rc 0, transno 21474839759 00000100:00100000:1.0:1746143695.893249:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593758464:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143695.893332:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c21880/2, rc 0, transno 21474839757 00000100:00100000:0.0:1746143695.893337:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593758848:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143695.893367:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a087a300/2, rc 0, transno 17179872493 00000100:00100000:3.0:1746143695.893371:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593758976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143695.895109:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.895190:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592304384 00000100:00100000:1.0:1746143695.895198:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592304384 00000100:00100000:1.0:1746143695.895397:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9740 00000100:00100000:1.0:1746143695.895405:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28480:x1830963592304384:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143695.895421:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.895436:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a40 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.895464:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd725d4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19de expref: 11 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.895472:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.895473:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.895477:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3002368->3145727] (req 3002368->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.895503:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd725d4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19de expref: 11 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.895513:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd725d4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19de expref: 11 pid: 15784 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746143695.895524:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593759104:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143695.896455:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52fccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143695.899569:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.899643:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593759104:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.899674:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3002368->3145727] (req 3002368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.899697:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cab8000, rc 0) 00000100:00100000:1.0:1746143695.899745:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28480:x1830963592304384:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4341us (4641us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.899753:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9740 00000100:00100000:0.0:1746143695.900089:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.900188:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592304512 00000100:00100000:2.0:1746143695.900195:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592304512 00010000:00010000:2.0:1746143695.900223:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd725d4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19de expref: 12 pid: 15784 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746143695.900252:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5011 00000100:00100000:2.0:1746143695.900264:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592304512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143695.900276:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143695.900298:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd725d4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19de expref: 12 pid: 15784 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746143695.900308:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd725d4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19de expref: 12 pid: 15784 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746143695.900330:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a652bc00/0xe984082ccd725d4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19de expref: 12 pid: 15784 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746143695.900346:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.900349:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.900355:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.900362:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.900391:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.900402:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593759232:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143695.900464:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52b5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143695.900769:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592304768 00000100:00100000:1.0:1746143695.900773:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592304768 00002000:00100000:1.0:1746143695.900798:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a5c21180 x1830963592304768/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143695.900806:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21180 with x1830963592304768 ext(1048576->2097151) 00002000:00010000:1.0:1746143695.900809:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c21180 00000100:00100000:1.0:1746143695.900837:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3593 00000100:00100000:1.0:1746143695.900841:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592304768:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143695.904909:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.907427:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592305024 00000100:00100000:3.0:1746143695.907440:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592305024 00002000:00100000:3.0:1746143695.907490:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a5c23b80 x1830963592305024/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.907500:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23b80 with x1830963592305024 ext(1048576->2097151) 00002000:00010000:3.0:1746143695.907506:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c23b80 00000100:00100000:3.0:1746143695.907527:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3594 00000100:00100000:3.0:1746143695.907534:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592305024:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143695.909777:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593759232:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143695.909802:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143695.909846:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592304512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9586us (10284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.909858:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5011 00000100:00100000:2.0:1746143695.911125:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.911188:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592305280 00000100:00100000:0.0:1746143695.911197:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592305280 00002000:00100000:0.0:1746143695.911236:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3002368->3006463) req@ffff8800930c0e00 x1830963592305280/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143695.911245:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0e00 with x1830963592305280 ext(3002368->3006463) 00002000:00010000:0.0:1746143695.911249:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c0e00 00000100:00100000:0.0:1746143695.911275:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3595 00000100:00100000:0.0:1746143695.911283:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592305280:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143695.911443:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592305280:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 160us (319us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143695.911449:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3595 00002000:00100000:0.0:1746143695.911454:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3002368->3006463) req@ffff8800930c0e00 x1830963592305280/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/4536 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143695.911462:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0e00 with x1830963592305280 ext(3002368->3006463) 00002000:00010000:0.0:1746143695.911465:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930c0e00 00000100:00100000:1.0:1746143695.917968:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592304768:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 17111us (17864us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143695.917979:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3593 00002000:00100000:1.0:1746143695.917994:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a5c21180 x1830963592304768/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143695.918003:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21180 with x1830963592304768 ext(1048576->2097151) 00002000:00010000:1.0:1746143695.918009:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c21180 00000100:00100000:3.0:1746143695.920224:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592305024:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12679us (15314us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143695.920236:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3594 00002000:00100000:3.0:1746143695.920248:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800a5c23b80 x1830963592305024/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.920259:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23b80 with x1830963592305024 ext(1048576->2097151) 00002000:00010000:3.0:1746143695.920265:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c23b80 00000100:00100000:0.0:1746143695.921362:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.921477:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592305408 00000100:00100000:1.0:1746143695.921486:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592305408 00000100:00100000:1.0:1746143695.921537:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9741 00000100:00100000:1.0:1746143695.921544:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28480:x1830963592305408:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143695.921564:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143695.921584:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a47 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.921615:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cde0200/0xe984082ccd725d54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19e5 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.921622:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.921623:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143695.921627:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->2232319] (req 2097152->2232319) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.921659:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cde0200/0xe984082ccd725d54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19e5 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143695.921670:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cde0200/0xe984082ccd725d54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19e5 expref: 11 pid: 4581 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746143695.921682:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593759360:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143695.921774:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52fccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143695.925178:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.925305:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.925367:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592305664 00000100:00100000:3.0:1746143695.925376:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592305664 00010000:00010000:3.0:1746143695.925414:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cde0200/0xe984082ccd725d54 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19e5 expref: 12 pid: 4581 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746143695.925448:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5012 00000100:00100000:3.0:1746143695.925456:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592305664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143695.925470:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143695.925494:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cde0200/0xe984082ccd725d54 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19e5 expref: 12 pid: 4581 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746143695.925505:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cde0200/0xe984082ccd725d54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19e5 expref: 12 pid: 4581 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746143695.925530:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.925532:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143695.925539:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.925548:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143695.925580:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.925596:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593759488:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143695.925671:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143695.925737:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592305536 00000100:00100000:2.0:1746143695.925741:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592305536 00000100:00100000:2.0:1746143695.925766:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9742 00000100:00100000:2.0:1746143695.925772:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28486:x1830963592305536:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.925786:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.925798:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801368a6a00/0xe984082ccd725e5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a4e expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.925816:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.925818:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.925833:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a6a00/0xe984082ccd725e5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a4e expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.925845:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801368a6a00/0xe984082ccd725e5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a4e expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.925853:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a6a00, rc 0) 00000100:00100000:2.0:1746143695.925878:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28486:x1830963592305536:12345-192.168.202.48@tcp:101:cat.0 Request processed in 105us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.925883:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9742 00010000:00010000:1.0:1746143695.926120:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cde0200/0xe984082ccd725d54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19e5 expref: 12 pid: 4581 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746143695.926136:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593759360:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143695.926190:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143695.926201:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cab9200, rc 0) 00000100:00100000:1.0:1746143695.926233:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28480:x1830963592305408:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4689us (4875us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143695.926239:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9741 00000100:00100000:3.0:1746143695.929449:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593759488:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143695.929469:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143695.929511:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592305664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4054us (4205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143695.929522:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5012 00000100:00100000:0.0:1746143695.931328:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.931363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143695.931388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.931428:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592306048 00000100:00100000:1.0:1746143695.931437:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592306048 00000100:00100000:3.0:1746143695.931448:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592306304 00000100:00100000:3.0:1746143695.931452:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592306304 00002000:00100000:3.0:1746143695.931481:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2228224->2232319) req@ffff8800a5c22300 x1830963592306304/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143695.931481:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a5c20380 x1830963592306048/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.931491:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22300 with x1830963592306304 ext(2228224->2232319) 00002000:00100000:1.0:1746143695.931491:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20380 with x1830963592306048 ext(1048576->2097151) 00002000:00010000:3.0:1746143695.931496:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c22300 00002000:00010000:1.0:1746143695.931496:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c20380 00000100:00100000:1.0:1746143695.931835:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3596 00000100:00100000:3.0:1746143695.931841:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3597 00000100:00100000:1.0:1746143695.931844:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592306048:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143695.931848:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592306304:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143695.932003:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592306304:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 155us (613us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143695.932009:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3597 00002000:00100000:3.0:1746143695.932014:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2228224->2232319) req@ffff8800a5c22300 x1830963592306304/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/4536 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143695.932021:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22300 with x1830963592306304 ext(2228224->2232319) 00002000:00010000:3.0:1746143695.932023:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c22300 00000100:00100000:2.0:1746143695.934239:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592305792 00000100:00100000:2.0:1746143695.934250:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592305792 00000100:00100000:2.0:1746143695.934298:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9743 00000100:00100000:2.0:1746143695.934306:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28485:x1830963592305792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.934322:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.934342:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095710000/0xe984082ccd725e65 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a55 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.934366:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.934367:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.934375:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095710000/0xe984082ccd725e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a55 expref: 23 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.934390:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095710000/0xe984082ccd725e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a55 expref: 23 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.934401:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095710000, rc 0) 00000100:00100000:2.0:1746143695.934445:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28485:x1830963592305792:12345-192.168.202.48@tcp:101:cat.0 Request processed in 140us (3123us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.934450:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9743 00000100:00100000:0.0:1746143695.944282:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.945259:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592306560 00000100:00100000:2.0:1746143695.945271:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592306560 00000100:00100000:2.0:1746143695.945335:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3385 00000100:00100000:2.0:1746143695.945344:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28480:x1830963592306560:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143695.947990:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28480:x1830963592306560:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 2634us (3706us total) trans 8589942417 rc 0/0 00000100:00100000:2.0:1746143695.948004:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3385 00000100:00100000:0.0:1746143695.948379:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.949057:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592306816 00000100:00100000:1.0:1746143695.949067:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592306816 00002000:00100000:1.0:1746143695.949107:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009ff6ca80 x1830963592306816/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143695.949115:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ca80 with x1830963592306816 ext(1048576->2097151) 00002000:00010000:1.0:1746143695.949121:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6ca80 00000100:00100000:1.0:1746143695.949154:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3598 00000100:00100000:1.0:1746143695.949161:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592306816:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143695.952018:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592306048:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20165us (20642us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143695.952028:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3596 00002000:00100000:0.0:1746143695.952038:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a5c20380 x1830963592306048/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143695.952046:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20380 with x1830963592306048 ext(1048576->2097151) 00002000:00010000:0.0:1746143695.952052:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c20380 00000100:00100000:0.0:1746143695.961745:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.961816:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592306944 00000100:00100000:2.0:1746143695.961837:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592306944 00000100:00100000:2.0:1746143695.961890:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9744 00000100:00100000:2.0:1746143695.961897:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28486:x1830963592306944:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.961916:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.961932:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095395400/0xe984082ccd725e6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a5c expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.961957:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.961959:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.961966:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095395400/0xe984082ccd725e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a5c expref: 13 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.961979:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095395400/0xe984082ccd725e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a5c expref: 13 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.961987:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095395400, rc 0) 00000100:00100000:2.0:1746143695.962044:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28486:x1830963592306944:12345-192.168.202.48@tcp:101:cat.0 Request processed in 147us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.962050:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9744 00000100:00100000:1.0:1746143695.964670:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592306816:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 15498us (16279us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143695.964683:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3598 00002000:00100000:1.0:1746143695.964696:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009ff6ca80 x1830963592306816/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143695.964705:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ca80 with x1830963592306816 ext(1048576->2097151) 00002000:00010000:1.0:1746143695.964711:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6ca80 00000100:00100000:0.0:1746143695.966772:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143695.966940:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592307200 00000100:00100000:1.0:1746143695.966949:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592307200 00002000:00100000:1.0:1746143695.966993:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009ff6e680 x1830963592307200/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143695.967003:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6e680 with x1830963592307200 ext(1048576->2097151) 00002000:00010000:1.0:1746143695.967007:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6e680 00000100:00100000:1.0:1746143695.967025:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3599 00000100:00100000:1.0:1746143695.967032:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592307200:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143695.967496:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.967570:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592307328 00000100:00100000:2.0:1746143695.967575:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592307328 00000100:00100000:2.0:1746143695.967611:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9745 00000100:00100000:2.0:1746143695.967616:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28485:x1830963592307328:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.967627:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.967645:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095394600/0xe984082ccd725e73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a63 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.967667:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.967669:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143695.967677:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095394600/0xe984082ccd725e73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a63 expref: 26 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.967691:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095394600/0xe984082ccd725e73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a63 expref: 26 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143695.967701:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095394600, rc 0) 00000100:00100000:2.0:1746143695.967740:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28485:x1830963592307328:12345-192.168.202.48@tcp:101:cat.0 Request processed in 123us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143695.967745:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9745 00000100:00100000:0.0:1746143695.979835:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143695.981203:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592307584 00000100:00100000:2.0:1746143695.981215:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592307584 00002000:00100000:2.0:1746143695.981258:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009ff6ea00 x1830963592307584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/0 e 0 to 0 dl 1746143706 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.981275:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ea00 with x1830963592307584 ext(1048576->2097151) 00002000:00010000:2.0:1746143695.981280:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ea00 00000100:00100000:2.0:1746143695.981318:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3600 00000100:00100000:2.0:1746143695.981325:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592307584:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143695.982929:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592307200:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15889us (16158us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143695.982939:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3599 00002000:00100000:1.0:1746143695.982949:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009ff6e680 x1830963592307200/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143695.982957:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6e680 with x1830963592307200 ext(1048576->2097151) 00002000:00010000:1.0:1746143695.982962:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6e680 00000100:00100000:2.0:1746143695.990254:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592307584:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 8913us (10425us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143695.990266:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3600 00002000:00100000:2.0:1746143695.990280:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009ff6ea00 x1830963592307584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:91/0 lens 488/440 e 0 to 0 dl 1746143706 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143695.990289:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ea00 with x1830963592307584 ext(1048576->2097151) 00002000:00010000:2.0:1746143695.990296:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ea00 00000100:00100000:0.0:1746143695.998320:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.998380:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592307712 00000100:00100000:3.0:1746143695.998390:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592307712 00000100:00100000:0.0:1746143695.998413:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143695.998440:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9746 00000100:00100000:3.0:1746143695.998447:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592307712:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143695.998466:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592307840 00010000:00010000:3.0:1746143695.998468:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143695.998470:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592307840 00010000:00010000:3.0:1746143695.998485:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c2c400/0xe984082ccd725e7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a6a expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143695.998506:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9747 00000100:00100000:2.0:1746143695.998511:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592307840:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143695.998520:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143695.998531:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801368a6c00/0xe984082ccd725e81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a71 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143695.998537:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593759616:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143695.998563:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593759744:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143695.999489:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143695.999565:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52b5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143696.002554:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593759616:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143696.002588:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c2c400/0xe984082ccd725e7a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a6a expref: 14 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.002601:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c2c400/0xe984082ccd725e7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a6a expref: 14 pid: 25369 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143696.002609:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593759744:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143696.002617:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2c400, rc 0) 00010000:00010000:2.0:1746143696.002632:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801368a6c00/0xe984082ccd725e81 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a71 expref: 15 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.002643:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368a6c00/0xe984082ccd725e81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a71 expref: 15 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.002669:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a6c00, rc 0) 00000100:00100000:3.0:1746143696.003597:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592307712:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5147us (5328us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143696.003606:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9746 00000100:00100000:2.0:1746143696.004300:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592307840:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5786us (5884us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143696.004307:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9747 00000100:00100000:0.0:1746143696.007533:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.007635:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592307968 00000100:00100000:2.0:1746143696.007645:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592307968 00000100:00100000:2.0:1746143696.007714:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9748 00000100:00100000:2.0:1746143696.007723:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28486:x1830963592307968:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143696.007745:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.007763:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd725e88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a78 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.007794:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.007802:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143696.007804:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143696.007807:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd725e88 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a78 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.007849:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.007866:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 25 pid: 12618 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.007877:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593759872:192.168.202.48@tcp:104: 00000100:00080000:1.0:1746143696.007950:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143696.007958:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52b5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143696.008751:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.011046:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592308096 00000100:00100000:3.0:1746143696.011060:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592308096 00000100:00100000:3.0:1746143696.011110:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9749 00000100:00100000:3.0:1746143696.011118:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28483:x1830963592308096:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143696.011137:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.011168:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a7f expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.011196:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143696.011199:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143696.011204:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3289088->4194303] (req 3289088->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.011215:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3289088->4194303] (req 3289088->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.011226:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2cc00, rc 0) 00000100:00100000:3.0:1746143696.011285:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28483:x1830963592308096:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 166us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.011291:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9749 00000100:00100000:2.0:1746143696.011386:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593759872:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.011408:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd725e88 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a78 expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.011417:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d510600, rc 0) 00000100:00100000:2.0:1746143696.011441:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28486:x1830963592307968:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3719us (3919us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.011446:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9748 00000100:00100000:0.0:1746143696.011562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.011610:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592308224 00000100:00100000:2.0:1746143696.011614:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592308224 00000100:00080000:1.0:1746143696.011644:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:2.0:1746143696.011651:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (3002368->3145727) req@ffff88012e1e3b80 x1830963592308224/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.011659:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e3b80 with x1830963592308224 ext(3002368->3145727) 00010000:00010000:2.0:1746143696.011664:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 26 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.011676:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 26 pid: 12618 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746143696.011687:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e1e3b80 00000100:00100000:2.0:1746143696.011699:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 875 00000100:00100000:2.0:1746143696.011704:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592308224:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143696.024865:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592308224:12345-192.168.202.48@tcp:4:cat.0 Request processed in 13143us (13286us total) trans 17179872496 rc 0/0 00000100:00100000:2.0:1746143696.024880:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 875 00002000:00100000:2.0:1746143696.024893:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (3002368->3145727) req@ffff88012e1e3b80 x1830963592308224/t17179872496(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/448 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.024904:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e3b80 with x1830963592308224 ext(3002368->3145727) 00010000:00010000:2.0:1746143696.024915:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 28 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.024933:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 28 pid: 12618 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746143696.024939:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e1e3b80 00000100:00100000:0.0:1746143696.030400:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.030599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.030628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.030664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.030690:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592308608 00000100:00100000:3.0:1746143696.030700:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592308608 00002000:00100000:3.0:1746143696.030749:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3289087) req@ffff88012e1e0380 x1830963592308608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 504/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.030759:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0380 with x1830963592308608 ext(2097152->3289087) 00000100:00100000:2.0:1746143696.030760:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592308736 00000100:00100000:2.0:1746143696.030764:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592308736 00010000:00010000:3.0:1746143696.030768:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 29 pid: 12618 timeout: 875 lvb_type: 0 00002000:00100000:2.0:1746143696.030780:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34f:0x0] (3289088->4194303) req@ffff88012e1e2a00 x1830963592308736/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143696.030782:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 29 pid: 12618 timeout: 875 lvb_type: 0 00002000:00100000:2.0:1746143696.030787:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e2a00 with x1830963592308736 ext(3289088->4194303) 00000100:00100000:1.0:1746143696.030788:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592309120 00002000:00010000:3.0:1746143696.030790:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e1e0380 00010000:00010000:2.0:1746143696.030791:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 29 pid: 12618 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746143696.030792:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592309120 00010000:00010000:2.0:1746143696.030802:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 29 pid: 12618 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746143696.030809:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e1e2a00 00000100:00100000:3.0:1746143696.030812:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592308992 00000100:00100000:3.0:1746143696.030814:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592308992 00002000:00100000:1.0:1746143696.030830:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3280896->4194303) req@ffff8800930df800 x1830963592309120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.030835:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (2232320->3280895) req@ffff8800930ddf80 x1830963592308992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.030842:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ddf80 with x1830963592308992 ext(2232320->3280895) 00002000:00100000:1.0:1746143696.030843:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df800 with x1830963592309120 ext(3280896->4194303) 00002000:00010000:3.0:1746143696.030845:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930ddf80 00002000:00010000:1.0:1746143696.030846:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930df800 00000100:00100000:2.0:1746143696.030856:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 876 00000100:00100000:3.0:1746143696.030859:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 877 00000100:00100000:3.0:1746143696.030863:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592308736:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143696.030863:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592308608:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143696.030871:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3601 00000100:00100000:2.0:1746143696.030876:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3602 00000100:00100000:1.0:1746143696.030879:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963592308992:12345-192.168.202.48@tcp:3:cat.0 00000100:00080000:0.0:1746143696.031109:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143696.031942:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963592309120:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143696.057621:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592308608:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26748us (27223us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143696.057634:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 876 00002000:00100000:2.0:1746143696.057648:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3289087) req@ffff88012e1e0380 x1830963592308608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 504/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.057657:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0380 with x1830963592308608 ext(2097152->3289087) 00010000:00010000:2.0:1746143696.057667:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 30 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.057682:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 30 pid: 12618 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746143696.057688:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e1e0380 00000100:00100000:1.0:1746143696.063558:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592308736:12345-192.168.202.48@tcp:3:cat.0 Request processed in 32684us (32950us total) trans 0 rc 905216/905216 00000100:00100000:1.0:1746143696.063569:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 877 00002000:00100000:1.0:1746143696.063578:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (3289088->4194303) req@ffff88012e1e2a00 x1830963592308736/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 905216/905216 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.063586:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e2a00 with x1830963592308736 ext(3289088->4194303) 00010000:00010000:1.0:1746143696.063594:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 28 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.063606:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 28 pid: 12618 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746143696.063612:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e1e2a00 00000100:00100000:2.0:1746143696.063943:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592309120:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33059us (33313us total) trans 0 rc 913408/913408 00000100:00100000:2.0:1746143696.063953:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3602 00002000:00100000:2.0:1746143696.063958:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (3280896->4194303) req@ffff8800930df800 x1830963592309120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 913408/913408 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.063964:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df800 with x1830963592309120 ext(3280896->4194303) 00002000:00010000:2.0:1746143696.063968:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930df800 00000100:00100000:3.0:1746143696.073093:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592308992:12345-192.168.202.48@tcp:3:cat.0 Request processed in 42207us (42420us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143696.073103:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3601 00002000:00100000:3.0:1746143696.073112:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2232320->3280895) req@ffff8800930ddf80 x1830963592308992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.073120:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ddf80 with x1830963592308992 ext(2232320->3280895) 00002000:00010000:3.0:1746143696.073125:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930ddf80 00000100:00100000:0.0:1746143696.083083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.083459:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592309376 00000100:00100000:3.0:1746143696.083472:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592309376 00010000:00010000:3.0:1746143696.083514:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 28 pid: 12618 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.083558:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5013 00000100:00100000:3.0:1746143696.083565:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592309376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.083579:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.083600:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 28 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.083616:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 28 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.083635:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cab8000/0xe984082ccd725e50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a40 expref: 28 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.083669:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.083671:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.083678:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd725e88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a78 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.083686:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd725e88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a78 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.083692:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.083693:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.083696:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 14 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.083702:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 14 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.083728:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 14 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.083737:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593760000:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143696.083836:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd725e88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a78 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.083843:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593760128:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143696.083857:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143696.086255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.086373:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592309632 00000100:00100000:2.0:1746143696.086381:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592309632 00002000:00100000:2.0:1746143696.086420:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3289088->3293183) req@ffff88009bfe2300 x1830963592309632/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.086429:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2300 with x1830963592309632 ext(3289088->3293183) 00002000:00010000:2.0:1746143696.086434:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2300 00000100:00100000:3.0:1746143696.087370:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593760000:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143696.088309:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3603 00000100:00100000:2.0:1746143696.088320:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592309632:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143696.088506:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592309632:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 189us (2259us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143696.088512:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3603 00002000:00100000:2.0:1746143696.088518:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3289088->3293183) req@ffff88009bfe2300 x1830963592309632/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.088525:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2300 with x1830963592309632 ext(3289088->3293183) 00002000:00010000:2.0:1746143696.088528:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2300 00000100:00100000:0.0:1746143696.092751:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.092795:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.092809:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592309760 00000100:00100000:2.0:1746143696.092815:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592309760 00000100:00100000:3.0:1746143696.092839:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593760128:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143696.092858:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.093661:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9750 00000100:00100000:2.0:1746143696.093667:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28485:x1830963592309760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143696.093683:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.093696:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a2210a00/0xe984082ccd725e96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a86 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.093717:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 14 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.093723:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143696.093725:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143696.093728:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2210a00/0xe984082ccd725e96 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a86 expref: 29 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.093751:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 14 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.093762:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 14 pid: 25369 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.093770:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593760256:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.093818:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52b5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143696.093840:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592310016 00000100:00100000:2.0:1746143696.093844:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592310016 00002000:00100000:2.0:1746143696.093864:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800930dfb80 x1830963592310016/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.093871:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dfb80 with x1830963592310016 ext(2097152->3145727) 00002000:00010000:2.0:1746143696.093875:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dfb80 00000100:00100000:2.0:1746143696.093887:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3604 00000100:00100000:2.0:1746143696.093892:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1962:x1830963592310016:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143696.094509:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592309376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10942us (11435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.094517:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5013 00000100:00100000:3.0:1746143696.096721:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593760256:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.096744:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a2210a00/0xe984082ccd725e96 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a86 expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.096758:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2210a00, rc 0) 00000100:00100000:3.0:1746143696.096788:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28485:x1830963592309760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3120us (4044us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.096794:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9750 00000100:00100000:0.0:1746143696.109862:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.109939:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592310272 00000100:00100000:3.0:1746143696.109948:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592310272 00000100:00080000:0.0:1746143696.110027:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143696.110255:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8311 00000100:00100000:3.0:1746143696.110263:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28490:x1830963592310272:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143696.110284:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.110401:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c000/0xe984082ccd725e9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a8d expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.110497:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd725ea4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110507:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd725ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110517:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd725ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110529:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2da00/0xe984082ccd725eab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110534:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2da00/0xe984082ccd725eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110538:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2da00/0xe984082ccd725eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110629:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd725eb2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110636:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd725eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110642:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd725eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143696.110649:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143696.110717:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd725ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110724:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd725ea4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110730:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd725ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110734:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c2d600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143696.110738:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd725ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110743:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd725ea4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110752:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143696.110754:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143696.110757:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd725ea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.110762:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd725ea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143696.111447:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1962:x1830963592310016:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 17549us (18647us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143696.111454:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3604 00002000:00100000:2.0:1746143696.111462:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800930dfb80 x1830963592310016/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.111470:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dfb80 with x1830963592310016 ext(2097152->3145727) 00002000:00010000:2.0:1746143696.111474:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dfb80 00000100:00100000:0.0:1746143696.112124:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143696.112197:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2da00/0xe984082ccd725eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.112204:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2da00/0xe984082ccd725eab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.112210:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2da00/0xe984082ccd725eab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.112214:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c2da00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143696.112216:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2da00/0xe984082ccd725eab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.112221:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2da00/0xe984082ccd725eab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.112233:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009343fc00) 00010000:00010000:3.0:1746143696.112235:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143696.112237:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2da00/0xe984082ccd725eab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.112242:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2da00/0xe984082ccd725eab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.112275:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c000/0xe984082ccd725e9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a8d expref: 246 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.112285:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd725eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a8d expref: 245 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.112291:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143696.112293:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143696.112295:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2c400, rc 0) 00000100:00100000:3.0:1746143696.112315:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28490:x1830963592310272:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2054us (2461us total) trans 8589942418 rc 0/0 00000100:00100000:3.0:1746143696.112321:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8311 00000100:00100000:2.0:1746143696.112405:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592310528 00000100:00100000:2.0:1746143696.112410:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592310528 00002000:00100000:2.0:1746143696.112430:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3289088->4194303) req@ffff8800930dd880 x1830963592310528/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.112437:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd880 with x1830963592310528 ext(3289088->4194303) 00010000:00010000:2.0:1746143696.112443:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 15 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.112453:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 15 pid: 25369 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746143696.112458:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930dd880 00000100:00100000:2.0:1746143696.112471:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 878 00000100:00100000:2.0:1746143696.112476:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592310528:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143696.112714:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.113045:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592310656 00000100:00100000:3.0:1746143696.113049:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592310656 00000100:00100000:3.0:1746143696.113075:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9751 00000100:00100000:3.0:1746143696.113079:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28483:x1830963592310656:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143696.113087:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.113097:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a94 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.113118:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.113124:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143696.113126:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143696.113130:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->3190783] (req 3145728->3190783) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.113166:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.113175:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 22 pid: 12618 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.113184:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593760384:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.113231:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9600 going to sleep for 11 seconds 00000100:00080000:0.0:1746143696.113847:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143696.127600:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593760384:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.127626:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->3190783] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.127642:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2c800, rc 0) 00000100:00100000:2.0:1746143696.127679:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28483:x1830963592310656:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 14597us (14964us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.127686:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9751 00000100:00100000:0.0:1746143696.129613:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.132942:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.133029:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592310912 00000100:00100000:1.0:1746143696.133037:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592310912 00002000:00100000:1.0:1746143696.133069:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2232319) req@ffff88009509a300 x1830963592310912/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.133078:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509a300 with x1830963592310912 ext(2097152->2232319) 00010000:00010000:1.0:1746143696.133086:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 23 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.133096:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 23 pid: 12618 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746143696.133103:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009509a300 00000100:00100000:1.0:1746143696.133117:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 879 00000100:00100000:1.0:1746143696.133123:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592310912:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143696.133613:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592310784 00000100:00100000:3.0:1746143696.133617:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592310784 00000100:00100000:3.0:1746143696.133638:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9752 00000100:00100000:3.0:1746143696.133642:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28486:x1830963592310784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.133650:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.133663:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd725ec7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1a9b expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.133680:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143696.133682:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143696.133685:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd725ec7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a9b expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.133694:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd725ec7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a9b expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.133701:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2210200, rc 0) 00000100:00100000:3.0:1746143696.133723:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28486:x1830963592310784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 80us (4116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.133728:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9752 00000100:00100000:1.0:1746143696.143123:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592310912:12345-192.168.202.48@tcp:4:cat.0 Request processed in 9991us (10178us total) trans 21474839760 rc 0/0 00000100:00100000:1.0:1746143696.143134:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 879 00002000:00100000:1.0:1746143696.143160:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2232319) req@ffff88009509a300 x1830963592310912/t21474839760(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/448 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.143169:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509a300 with x1830963592310912 ext(2097152->2232319) 00010000:00010000:1.0:1746143696.143177:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 25 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.143188:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 25 pid: 12618 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746143696.143194:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009509a300 00000100:00100000:2.0:1746143696.151683:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592310528:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 39199us (39551us total) trans 17179872497 rc 0/0 00000100:00100000:2.0:1746143696.151694:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 878 00002000:00100000:2.0:1746143696.151704:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3289088->4194303) req@ffff8800930dd880 x1830963592310528/t17179872497(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/448 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.151712:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd880 with x1830963592310528 ext(3289088->4194303) 00010000:00010000:2.0:1746143696.151720:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 17 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.151732:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 17 pid: 25369 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746143696.151738:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930dd880 00000100:00100000:0.0:1746143696.167111:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.167496:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592311040 00000100:00100000:3.0:1746143696.167505:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592311040 00010000:00010000:3.0:1746143696.167542:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 25 pid: 12618 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.167911:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5014 00000100:00100000:3.0:1746143696.167919:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592311040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.167931:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.167949:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 25 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.167959:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 25 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.167978:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cab9200/0xe984082ccd725e57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a47 expref: 25 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.168542:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.168545:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.168552:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.168560:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.168568:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.168569:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.168572:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd725ec7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a9b expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.168578:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd725ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a9b expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.168604:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd725ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a9b expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.168614:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593760512:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143696.170628:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.170641:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593760640:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143696.171582:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143696.171925:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.171968:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592311168 00000100:00100000:0.0:1746143696.171975:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592311168 00010000:00010000:0.0:1746143696.172001:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 17 pid: 25369 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746143696.172789:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5015 00000100:00100000:1.0:1746143696.172798:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592311168:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143696.172809:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143696.172837:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 17 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.172848:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 17 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.172867:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c2cc00/0xe984082ccd725e8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3289088->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a7f expref: 17 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.173041:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.173043:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.173049:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a2210a00/0xe984082ccd725e96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a86 expref: 27 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.173057:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2210a00/0xe984082ccd725e96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a86 expref: 27 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.173071:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593760512:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143696.173347:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a2210a00/0xe984082ccd725e96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a86 expref: 27 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143696.173358:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593760768:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143696.174066:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52fccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143696.175851:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.176093:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592311424 00000100:00100000:2.0:1746143696.176101:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592311424 00002000:00100000:2.0:1746143696.176173:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880095098e00 x1830963592311424/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.176183:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098e00 with x1830963592311424 ext(2097152->3145727) 00002000:00010000:2.0:1746143696.176188:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095098e00 00000100:00100000:2.0:1746143696.176225:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3605 00000100:00100000:2.0:1746143696.176235:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592311424:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143696.177947:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593760640:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143696.177976:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.178038:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592311040:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10116us (10935us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.178050:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5014 00000100:00100000:1.0:1746143696.178315:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593760768:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143696.178328:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143696.178347:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963592311168:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5551us (6424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.178353:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5015 00000100:00100000:0.0:1746143696.178976:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.179255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.179274:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592311680 00000100:00100000:0.0:1746143696.179279:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592311680 00002000:00100000:0.0:1746143696.179318:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (3186688->3190783) req@ffff880095099c00 x1830963592311680/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143696.179333:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099c00 with x1830963592311680 ext(3186688->3190783) 00002000:00010000:0.0:1746143696.179338:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095099c00 00000100:00100000:0.0:1746143696.179365:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592311936 00000100:00100000:0.0:1746143696.179368:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592311936 00002000:00100000:0.0:1746143696.179381:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880095099880 x1830963592311936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143696.179388:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099880 with x1830963592311936 ext(3145728->4194303) 00002000:00010000:0.0:1746143696.179390:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095099880 00000100:00100000:0.0:1746143696.181297:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3606 00000100:00100000:0.0:1746143696.181308:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592311680:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143696.181415:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592311680:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 110us (2441us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143696.181421:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3606 00002000:00100000:0.0:1746143696.181428:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (3186688->3190783) req@ffff880095099c00 x1830963592311680/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143696.181436:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099c00 with x1830963592311680 ext(3186688->3190783) 00002000:00010000:0.0:1746143696.181441:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095099c00 00000100:00100000:0.0:1746143696.181454:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3607 00000100:00100000:0.0:1746143696.181459:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592311936:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143696.193346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.193582:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592312192 00000100:00100000:3.0:1746143696.193874:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592312192 00000100:00100000:3.0:1746143696.193934:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3386 00000100:00100000:3.0:1746143696.193942:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+7:28483:x1830963592312192:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143696.193996:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592311424:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 17761us (18152us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143696.194005:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3605 00002000:00100000:2.0:1746143696.194013:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880095098e00 x1830963592311424/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.194021:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098e00 with x1830963592311424 ext(2097152->3145727) 00002000:00010000:2.0:1746143696.194026:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095098e00 00000100:00100000:3.0:1746143696.194118:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28483:x1830963592312192:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 177us (785us total) trans 8589942419 rc 0/0 00000100:00100000:3.0:1746143696.194124:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3386 00000100:00080000:0.0:1746143696.200529:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143696.202061:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592311936:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20591us (22796us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143696.202074:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3607 00002000:00100000:1.0:1746143696.202086:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880095099880 x1830963592311936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.202095:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099880 with x1830963592311936 ext(3145728->4194303) 00002000:00010000:1.0:1746143696.202100:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095099880 00000100:00100000:0.0:1746143696.206116:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.206431:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592312320 00000100:00100000:3.0:1746143696.206442:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592312320 00000100:00100000:3.0:1746143696.206492:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9753 00000100:00100000:3.0:1746143696.206498:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28486:x1830963592312320:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.206518:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.206536:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff92600/0xe984082ccd725ece lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1aa2 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.206561:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.206563:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.206572:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff92600/0xe984082ccd725ece lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa2 expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.206587:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff92600/0xe984082ccd725ece lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa2 expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.206597:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff92600, rc 0) 00000100:00100000:3.0:1746143696.206667:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28486:x1830963592312320:12345-192.168.202.48@tcp:101:cat.0 Request processed in 166us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.206677:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9753 00000100:00100000:0.0:1746143696.218323:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.218418:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592312448 00000100:00100000:3.0:1746143696.218428:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592312448 00000100:00100000:3.0:1746143696.218474:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9754 00000100:00100000:3.0:1746143696.218482:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28485:x1830963592312448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.218503:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.218523:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff92a00/0xe984082ccd725ed5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1aa9 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.218556:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.218563:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143696.218564:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143696.218567:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff92a00/0xe984082ccd725ed5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa9 expref: 25 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.218597:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.218608:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 15 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.218624:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593760896:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.222080:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143696.224224:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.224272:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.224347:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592312832 00000100:00100000:2.0:1746143696.224356:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592312832 00002000:00100000:2.0:1746143696.224403:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880095099f80 x1830963592312832/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.224413:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099f80 with x1830963592312832 ext(3145728->4194303) 00002000:00010000:2.0:1746143696.224419:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095099f80 00000100:00100000:2.0:1746143696.224445:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592312960 00000100:00100000:2.0:1746143696.224447:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592312960 00002000:00100000:2.0:1746143696.224462:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3190784->4194303) req@ffff88009509b480 x1830963592312960/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.224469:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509b480 with x1830963592312960 ext(3190784->4194303) 00010000:00010000:2.0:1746143696.224477:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.224491:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746143696.224503:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009509b480 00000100:00100000:2.0:1746143696.224517:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 880 00000100:00100000:2.0:1746143696.224525:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963592312960:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143696.226010:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3608 00000100:00100000:1.0:1746143696.226022:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592312832:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143696.231373:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.232198:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593760896:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.232232:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff92a00/0xe984082ccd725ed5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa9 expref: 25 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.232251:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff92a00, rc 0) 00000100:00100000:3.0:1746143696.232305:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28485:x1830963592312448:12345-192.168.202.48@tcp:101:cat.0 Request processed in 13823us (13990us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.232314:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9754 00000100:00100000:0.0:1746143696.238918:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592313088 00000100:00100000:0.0:1746143696.238932:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592313088 00002000:00100000:1.0:1746143696.239492:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3190783) req@ffff8800930c0380 x1830963592313088/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.239503:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0380 with x1830963592313088 ext(3145728->3190783) 00010000:00010000:1.0:1746143696.239513:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.239527:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746143696.239534:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930c0380 00000100:00100000:1.0:1746143696.239735:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 881 00000100:00100000:1.0:1746143696.239744:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592313088:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143696.249261:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592312960:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 24725us (24976us total) trans 0 rc 1003520/1003520 00000100:00100000:3.0:1746143696.249274:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 880 00002000:00100000:3.0:1746143696.249287:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3190784->4194303) req@ffff88009509b480 x1830963592312960/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 1003520/1003520 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.249297:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009509b480 with x1830963592312960 ext(3190784->4194303) 00010000:00010000:3.0:1746143696.249307:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.249324:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746143696.249331:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009509b480 00000100:00100000:1.0:1746143696.253716:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592313088:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 13960us (22341us total) trans 21474839761 rc 0/0 00000100:00100000:1.0:1746143696.253730:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 881 00002000:00100000:1.0:1746143696.253744:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3190783) req@ffff8800930c0380 x1830963592313088/t21474839761(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/448 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.253754:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c0380 with x1830963592313088 ext(3145728->3190783) 00010000:00010000:1.0:1746143696.253764:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.253779:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746143696.253786:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930c0380 00000100:00100000:1.0:1746143696.256027:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592312832:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 30000us (31805us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143696.256038:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3608 00002000:00100000:1.0:1746143696.256048:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880095099f80 x1830963592312832/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.256056:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099f80 with x1830963592312832 ext(3145728->4194303) 00002000:00010000:1.0:1746143696.256062:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095099f80 00000100:00100000:1.0:1746143696.259390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.259460:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592313216 00000100:00100000:0.0:1746143696.259470:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592313216 00010000:00010000:0.0:1746143696.259508:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746143696.259536:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5016 00000100:00100000:0.0:1746143696.259543:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592313216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143696.259559:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143696.259582:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.259594:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.259617:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd725ec0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a94 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.259650:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.259652:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.259667:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff92a00/0xe984082ccd725ed5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa9 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.259676:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff92a00/0xe984082ccd725ed5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa9 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.259712:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff92a00/0xe984082ccd725ed5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa9 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.259724:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095099500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593761024:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143696.259801:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143696.266235:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095099500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593761024:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143696.266236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143696.266256:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.266351:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592313216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6806us (6970us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.266362:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5016 00000100:00100000:1.0:1746143696.266445:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592313472 00000100:00100000:1.0:1746143696.266453:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592313472 00002000:00100000:1.0:1746143696.266494:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880095098380 x1830963592313472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.266503:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098380 with x1830963592313472 ext(3145728->4194303) 00002000:00010000:1.0:1746143696.266508:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095098380 00000100:00100000:1.0:1746143696.266524:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3609 00000100:00100000:1.0:1746143696.266531:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592313472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143696.267408:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.267475:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592313600 00000100:00100000:3.0:1746143696.267479:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592313600 00000100:00100000:3.0:1746143696.267503:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9755 00000100:00100000:3.0:1746143696.267508:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28486:x1830963592313600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.267518:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.267538:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e612e00/0xe984082ccd725edc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ab0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.267558:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.267560:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.267567:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e612e00/0xe984082ccd725edc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab0 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.267581:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e612e00/0xe984082ccd725edc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab0 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.267589:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e612e00, rc 0) 00000100:00100000:3.0:1746143696.267619:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28486:x1830963592313600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 111us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.267624:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9755 00000100:00100000:0.0:1746143696.275430:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.275534:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592313856 00000100:00100000:2.0:1746143696.275545:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592313856 00002000:00100000:2.0:1746143696.275593:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880095099500 x1830963592313856/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.275605:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099500 with x1830963592313856 ext(3145728->4194303) 00002000:00010000:2.0:1746143696.275610:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095099500 00000100:00100000:2.0:1746143696.275645:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3610 00000100:00100000:2.0:1746143696.275653:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592313856:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143696.278433:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592313472:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11889us (12192us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143696.278444:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3609 00002000:00100000:1.0:1746143696.278455:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880095098380 x1830963592313472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.278465:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098380 with x1830963592313472 ext(3145728->4194303) 00002000:00010000:1.0:1746143696.278470:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095098380 00000100:00100000:0.0:1746143696.287547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.287653:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592314112 00000100:00100000:1.0:1746143696.287663:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592314112 00002000:00100000:1.0:1746143696.287710:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88012f187b80 x1830963592314112/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.287725:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187b80 with x1830963592314112 ext(4194304->4898815) 00002000:00010000:1.0:1746143696.287731:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f187b80 00000100:00100000:1.0:1746143696.287765:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3611 00000100:00100000:1.0:1746143696.287773:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592314112:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143696.291810:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.292038:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592314240 00000100:00100000:2.0:1746143696.292047:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592314240 00000100:00100000:2.0:1746143696.292093:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9756 00000100:00100000:2.0:1746143696.292102:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28490:x1830963592314240:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143696.292123:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.292165:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ab7 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.292197:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff92a00/0xe984082ccd725ed5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa9 expref: 26 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.292205:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e612e00/0xe984082ccd725edc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab0 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.292212:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.292214:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.292217:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3719168->4194303] (req 3719168->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 26 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.292248:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e612e00/0xe984082ccd725edc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab0 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.292260:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e612e00/0xe984082ccd725edc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab0 expref: 19 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.292272:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593761152:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.292351:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff92a00/0xe984082ccd725ed5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa9 expref: 26 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.292358:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff92a00/0xe984082ccd725ed5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa9 expref: 26 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.292364:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593761280:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.292380:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143696.296121:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593761152:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.296136:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593761280:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.296184:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3719168->4194303] (req 3719168->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 26 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.296201:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06dfa00, rc 0) 00000100:00100000:2.0:1746143696.296264:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592313856:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 20609us (20843us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143696.296274:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3610 00002000:00100000:2.0:1746143696.296286:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880095099500 x1830963592313856/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.296296:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095099500 with x1830963592313856 ext(3145728->4194303) 00010000:00010000:2.0:1746143696.296304:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e612e00/0xe984082ccd725edc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab0 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.296314:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e612e00/0xe984082ccd725edc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab0 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746143696.296320:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095099500 00000100:00100000:3.0:1746143696.296409:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28490:x1830963592314240:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4308us (4609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.296416:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9756 00000100:00100000:0.0:1746143696.296752:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.296986:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592314368 00000100:00100000:2.0:1746143696.296994:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592314368 00010000:00010000:2.0:1746143696.297017:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff92a00/0xe984082ccd725ed5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa9 expref: 26 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.297038:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5017 00000100:00100000:2.0:1746143696.297045:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592314368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.297057:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.297077:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff92a00/0xe984082ccd725ed5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa9 expref: 26 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.297086:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff92a00/0xe984082ccd725ed5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa9 expref: 26 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.297110:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff92a00/0xe984082ccd725ed5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa9 expref: 26 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.297551:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143696.300223:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592314112:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12437us (12673us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746143696.300239:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3611 00002000:00100000:1.0:1746143696.300253:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88012f187b80 x1830963592314112/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.300263:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187b80 with x1830963592314112 ext(4194304->4898815) 00002000:00010000:1.0:1746143696.300269:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f187b80 00000100:00100000:2.0:1746143696.300358:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592314368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3311us (3605us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.300369:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5017 00000100:00100000:3.0:1746143696.300583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.300689:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592314496 00000100:00100000:2.0:1746143696.300696:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592314496 00000100:00100000:2.0:1746143696.300729:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9757 00000100:00100000:2.0:1746143696.300736:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592314496:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143696.300751:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.300768:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06df200/0xe984082ccd725eea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1abe expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.300790:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.300800:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a06df200/0xe984082ccd725eea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1abe expref: 19 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.300810:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06df200/0xe984082ccd725eea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1abe expref: 19 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.300828:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06df200, rc 0) 00000100:00100000:2.0:1746143696.300866:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592314496:12345-192.168.202.48@tcp:101:cat.0 Request processed in 130us (284us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143696.300871:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9757 00000100:00100000:0.0:1746143696.301966:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.302034:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592314624 00000100:00100000:2.0:1746143696.302039:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592314624 00010000:00010000:2.0:1746143696.302059:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e612e00/0xe984082ccd725edc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab0 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.302090:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5018 00000100:00100000:2.0:1746143696.302096:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592314624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.302106:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.302128:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e612e00/0xe984082ccd725edc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab0 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.302168:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e612e00/0xe984082ccd725edc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab0 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.302188:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e612e00/0xe984082ccd725edc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab0 expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.302199:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.302201:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.302209:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.302218:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.302254:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143696.302272:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593761408:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143696.302346:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143696.308726:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593761408:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143696.308751:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.309616:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592314624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7515us (7648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.309628:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5018 00000100:00100000:0.0:1746143696.309804:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.309948:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.309969:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592315008 00000100:00100000:0.0:1746143696.309975:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592315008 00000100:00100000:0.0:1746143696.310010:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9758 00000100:00100000:0.0:1746143696.310017:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592315008:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143696.310035:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143696.310053:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e612c00/0xe984082ccd725ef1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ac5 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.310106:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593761536:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143696.310182:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592314880 00000100:00100000:2.0:1746143696.310185:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592314880 00002000:00100000:2.0:1746143696.310211:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (3719168->3723263) req@ffff88012f186d80 x1830963592314880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.310219:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f186d80 with x1830963592314880 ext(3719168->3723263) 00002000:00010000:2.0:1746143696.310223:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f186d80 00000100:00100000:2.0:1746143696.310237:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3612 00000100:00100000:2.0:1746143696.310241:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592314880:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143696.311497:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592314880:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 1251us (1690us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143696.311506:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3612 00002000:00100000:2.0:1746143696.311514:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (3719168->3723263) req@ffff88012f186d80 x1830963592314880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.311521:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f186d80 with x1830963592314880 ext(3719168->3723263) 00002000:00010000:2.0:1746143696.311525:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f186d80 00000100:00100000:0.0:1746143696.312095:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143696.312348:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.312411:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592315264 00000100:00100000:2.0:1746143696.312417:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592315264 00002000:00100000:2.0:1746143696.312446:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009bfe3800 x1830963592315264/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.312460:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3800 with x1830963592315264 ext(4194304->4898815) 00002000:00010000:2.0:1746143696.312463:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3800 00000100:00100000:2.0:1746143696.312477:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3613 00000100:00100000:2.0:1746143696.312482:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592315264:12345-192.168.202.48@tcp:3:cat.0 00002000:00010000:2.0:1746143696.315127:0:25369:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime: 1746143695 -> 1746143696 00002000:00010000:2.0:1746143696.315135:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143695 -> 1746143696 00002000:00010000:2.0:1746143696.315161:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime: 1746143695 -> 1746143696 00000100:00100000:2.0:1746143696.315187:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593761536:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143696.315221:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e612c00/0xe984082ccd725ef1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ac5 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.315236:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e612c00/0xe984082ccd725ef1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ac5 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.315263:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e612c00, rc 0) 00000100:00100000:2.0:1746143696.315833:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592315008:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5804us (5872us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143696.315843:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9758 00000100:00100000:0.0:1746143696.322860:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.323914:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592315392 00000100:00100000:2.0:1746143696.323925:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592315392 00000100:00100000:2.0:1746143696.323991:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9759 00000100:00100000:2.0:1746143696.324000:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28490:x1830963592315392:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143696.324021:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.324042:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1acc expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.324074:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a2210a00/0xe984082ccd725e96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a86 expref: 29 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.324082:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff92600/0xe984082ccd725ece lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa2 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.324087:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.324089:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.324091:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4194304->4595711] (req 4194304->4595711) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.324123:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff92600/0xe984082ccd725ece lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa2 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.324134:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff92600/0xe984082ccd725ece lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa2 expref: 18 pid: 25369 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.324163:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593761664:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.324260:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a2210a00/0xe984082ccd725e96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a86 expref: 29 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.324268:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a2210a00/0xe984082ccd725e96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a86 expref: 29 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.324276:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593761792:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.324293:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143696.325702:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.326345:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592315264:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13860us (13995us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143696.326355:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3613 00002000:00100000:2.0:1746143696.326365:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009bfe3800 x1830963592315264/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.326373:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3800 with x1830963592315264 ext(4194304->4898815) 00010000:00010000:2.0:1746143696.326381:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff92600/0xe984082ccd725ece lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa2 expref: 17 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.326391:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff92600/0xe984082ccd725ece lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa2 expref: 17 pid: 25369 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746143696.326396:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe3800 00000100:00100000:3.0:1746143696.329233:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592315520 00000100:00100000:3.0:1746143696.329248:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592315520 00000100:00100000:3.0:1746143696.329315:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9760 00000100:00100000:3.0:1746143696.329325:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592315520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.329345:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.329365:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff93c00/0xe984082ccd725eff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ad3 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.329422:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593761920:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143696.329524:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143696.330078:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593761664:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.330093:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593761792:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.330120:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4194304->4595711] (req 4194304->4595711) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.330135:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06df200, rc 0) 00000100:00100000:2.0:1746143696.330204:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28490:x1830963592315392:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6204us (7355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.330211:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9759 00000100:00100000:3.0:1746143696.333766:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593761920:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143696.333805:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff93c00/0xe984082ccd725eff lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ad3 expref: 26 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.333828:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff93c00/0xe984082ccd725eff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ad3 expref: 26 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.333854:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff93c00, rc 0) 00000100:00100000:3.0:1746143696.334116:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592315520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4790us (8416us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143696.334128:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9760 00000100:00100000:0.0:1746143696.336743:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.336798:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.338302:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592315648 00000100:00100000:3.0:1746143696.338313:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592315648 00000100:00100000:3.0:1746143696.338358:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592315776 00000100:00100000:3.0:1746143696.338360:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592315776 00000100:00100000:3.0:1746143696.338388:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9761 00000100:00100000:3.0:1746143696.338396:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592315648:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.338416:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.338436:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff92400/0xe984082ccd725f06 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ada expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.338461:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.338472:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff92400/0xe984082ccd725f06 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ada expref: 18 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.338482:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff92400/0xe984082ccd725f06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ada expref: 18 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.338493:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff92400, rc 0) 00000100:00100000:0.0:1746143696.338577:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9762 00000100:00100000:0.0:1746143696.338585:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592315776:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143696.338594:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143696.338604:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd725f0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ae1 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.338647:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593762048:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143696.339397:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592315648:12345-192.168.202.48@tcp:101:cat.0 Request processed in 999us (2662us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143696.339405:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9761 00000100:00100000:0.0:1746143696.340334:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143696.347550:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.347640:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.347659:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.347672:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.347694:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592316032 00000100:00100000:0.0:1746143696.347702:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592316032 00010000:00010000:0.0:1746143696.347736:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2210a00/0xe984082ccd725e96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a86 expref: 29 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746143696.347757:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592315904 00000100:00100000:0.0:1746143696.347759:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592315904 00010000:00010000:0.0:1746143696.347766:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff92600/0xe984082ccd725ece lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa2 expref: 17 pid: 25369 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746143696.347778:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5019 00000100:00100000:0.0:1746143696.347784:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592316032:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143696.347799:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143696.347831:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a2210a00/0xe984082ccd725e96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a86 expref: 29 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.347842:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a2210a00/0xe984082ccd725e96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a86 expref: 29 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.347863:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a2210a00/0xe984082ccd725e96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a86 expref: 29 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.347878:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143696.347915:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592316032:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 131us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.347920:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5019 00000100:00100000:0.0:1746143696.347933:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5020 00000100:00100000:0.0:1746143696.347937:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592315904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143696.347943:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143696.347950:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff92600/0xe984082ccd725ece lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa2 expref: 17 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.347957:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff92600/0xe984082ccd725ece lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa2 expref: 17 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.347968:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff92600/0xe984082ccd725ece lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aa2 expref: 17 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.347977:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.347980:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.347987:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.347995:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.348028:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.348041:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593762176:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143696.348099:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143696.348230:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f185500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593762048:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143696.348254:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd725f0d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ae1 expref: 18 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.348264:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd725f0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ae1 expref: 18 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.348272:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e613800, rc 0) 00000100:00100000:0.0:1746143696.348293:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592315776:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9710us (11495us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143696.348299:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9762 00000100:00100000:3.0:1746143696.348430:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592316544 00000100:00100000:3.0:1746143696.348434:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592316544 00000100:00100000:3.0:1746143696.348460:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8312 00000100:00100000:3.0:1746143696.348466:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28493:x1830963592316544:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143696.348491:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.348505:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92200/0xe984082ccd725f14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ae8 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.348599:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93e00/0xe984082ccd725f1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348611:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93e00/0xe984082ccd725f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348620:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93e00/0xe984082ccd725f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348631:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92400/0xe984082ccd725f22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348636:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92400/0xe984082ccd725f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348641:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92400/0xe984082ccd725f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348745:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725f29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348752:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725f29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348759:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725f29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143696.348766:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143696.348861:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93e00/0xe984082ccd725f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348872:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93e00/0xe984082ccd725f1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348878:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93e00/0xe984082ccd725f1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348884:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff93e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143696.348887:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93e00/0xe984082ccd725f1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348894:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93e00/0xe984082ccd725f1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348903:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143696.348905:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143696.348909:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93e00/0xe984082ccd725f1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348913:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93e00/0xe984082ccd725f1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348929:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92400/0xe984082ccd725f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348934:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92400/0xe984082ccd725f22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348938:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92400/0xe984082ccd725f22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348941:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff92400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143696.348943:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92400/0xe984082ccd725f22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348951:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92400/0xe984082ccd725f22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348956:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009343fc00) 00010000:00010000:3.0:1746143696.348958:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143696.348960:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92400/0xe984082ccd725f22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348963:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92400/0xe984082ccd725f22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.348994:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92200/0xe984082ccd725f14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ae8 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.349005:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725f29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ae8 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.349011:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143696.349012:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143696.349014:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff93c00, rc 0) 00000100:00100000:3.0:1746143696.349042:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28493:x1830963592316544:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 576us (1402us total) trans 8589942420 rc 0/0 00000100:00100000:3.0:1746143696.349047:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8312 00000100:00100000:3.0:1746143696.349069:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592316288 00000100:00100000:3.0:1746143696.349073:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592316288 00000100:00100000:3.0:1746143696.349093:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3387 00000100:00100000:3.0:1746143696.349098:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28485:x1830963592316288:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143696.353838:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:28485:x1830963592316288:12345-192.168.202.48@tcp:35:cat.0 Request processed in 4721us (6158us total) trans 8589942421 rc 0/0 00000100:00100000:3.0:1746143696.353850:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3387 00000100:00100000:0.0:1746143696.354552:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593762176:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143696.354568:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143696.354586:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963592315904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6648us (6913us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.354597:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5020 00000100:00100000:0.0:1746143696.354668:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.354692:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592316672 00000100:00100000:0.0:1746143696.354698:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592316672 00000100:00100000:0.0:1746143696.354730:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9763 00000100:00100000:0.0:1746143696.354735:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28486:x1830963592316672:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143696.354750:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143696.354766:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e613e00/0xe984082ccd725f37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1aef expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.354796:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.354804:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143696.354806:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143696.354809:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e613e00/0xe984082ccd725f37 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4894720->5242879] (req 4894720->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aef expref: 17 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.354842:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.354853:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 27 pid: 25369 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746143696.354864:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593762304:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143696.354908:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143696.360290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.360525:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f185500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593762304:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143696.360558:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e613e00/0xe984082ccd725f37 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4894720->5242879] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aef expref: 17 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.360577:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e613e00, rc 0) 00000100:00100000:0.0:1746143696.360636:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28486:x1830963592316672:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5899us (5967us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.360645:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9763 00000100:00100000:3.0:1746143696.360952:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592316928 00000100:00100000:3.0:1746143696.360961:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592316928 00002000:00100000:3.0:1746143696.361004:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4591616->4595711) req@ffff8800930c2d80 x1830963592316928/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.361013:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c2d80 with x1830963592316928 ext(4591616->4595711) 00010000:00010000:3.0:1746143696.361019:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 28 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.361032:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 28 pid: 25369 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746143696.361039:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930c2d80 00000100:00100000:3.0:1746143696.361068:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 882 00000100:00100000:3.0:1746143696.361076:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592316928:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143696.361282:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592316928:12345-192.168.202.48@tcp:3:cat.0 Request processed in 206us (1004us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143696.361287:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 882 00002000:00100000:3.0:1746143696.361292:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4591616->4595711) req@ffff8800930c2d80 x1830963592316928/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.361297:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c2d80 with x1830963592316928 ext(4591616->4595711) 00010000:00010000:3.0:1746143696.361301:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 28 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.361314:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 28 pid: 25369 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746143696.361319:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930c2d80 00000100:00100000:0.0:1746143696.370034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.370504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.370566:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592317440 00000100:00100000:0.0:1746143696.370576:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592317440 00002000:00100000:0.0:1746143696.370625:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4595711) req@ffff88009bfe0a80 x1830963592317440/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143696.370636:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0a80 with x1830963592317440 ext(4194304->4595711) 00010000:00010000:0.0:1746143696.370646:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 28 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.370660:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 28 pid: 25369 timeout: 875 lvb_type: 0 00002000:00010000:0.0:1746143696.370667:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe0a80 00000100:00100000:0.0:1746143696.370701:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 883 00000100:00100000:0.0:1746143696.370709:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592317440:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143696.370954:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592317312 00000100:00100000:3.0:1746143696.370959:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592317312 00000100:00100000:3.0:1746143696.370999:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3388 00000100:00100000:3.0:1746143696.371004:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:28490:x1830963592317312:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143696.371243:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:28490:x1830963592317312:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 238us (1220us total) trans 8589942422 rc 0/0 00000100:00100000:3.0:1746143696.371250:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3388 00000100:00100000:2.0:1746143696.384180:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963592317440:12345-192.168.202.48@tcp:4:cat.0 Request processed in 13458us (13663us total) trans 17179872498 rc 0/0 00000100:00100000:2.0:1746143696.384195:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 883 00002000:00100000:2.0:1746143696.384208:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4595711) req@ffff88009bfe0a80 x1830963592317440/t17179872498(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/448 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.384217:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0a80 with x1830963592317440 ext(4194304->4595711) 00010000:00010000:2.0:1746143696.384227:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 30 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.384244:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 30 pid: 25369 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746143696.384251:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe0a80 00000100:00100000:0.0:1746143696.388442:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.391426:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592317568 00000100:00100000:2.0:1746143696.391442:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592317568 00010000:00010000:2.0:1746143696.391490:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 30 pid: 25369 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.391527:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5021 00000100:00100000:2.0:1746143696.391535:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592317568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.391549:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143696.391572:0:7151:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143695 -> 1746143696 00002000:00010000:2.0:1746143696.391574:0:7151:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143695 -> 1746143696 00010000:00010000:2.0:1746143696.391580:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 30 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.391592:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 30 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.391616:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06df200/0xe984082ccd725ef8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4595711) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1acc expref: 30 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.391643:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.391645:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.391652:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e613e00/0xe984082ccd725f37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aef expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.391660:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e613e00/0xe984082ccd725f37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aef expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.391696:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e613e00/0xe984082ccd725f37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aef expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143696.391708:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593762432:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143696.392380:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143696.398241:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.398346:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.398491:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593762432:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143696.398512:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.398558:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592317568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7023us (10126us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.398570:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5021 00000100:00100000:0.0:1746143696.398649:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592317696 00000100:00100000:0.0:1746143696.398657:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592317696 00000100:00100000:0.0:1746143696.398702:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592317824 00000100:00100000:0.0:1746143696.398705:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592317824 00000100:00100000:0.0:1746143696.398720:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9764 00000100:00100000:0.0:1746143696.398727:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28493:x1830963592317696:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143696.398746:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143696.398766:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1af6 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.398796:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd725ec7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a9b expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.398810:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143696.398812:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143696.398816:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2846720->3145727] (req 2846720->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 19 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.398855:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd725ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a9b expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.398869:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd725ec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a9b expref: 19 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746143696.398882:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593762560:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143696.398938:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143696.400262:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9765 00000100:00100000:3.0:1746143696.400276:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592317824:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.400544:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.400559:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff92600/0xe984082ccd725f45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1afd expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.400605:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593762688:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143696.400661:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143696.402753:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593762688:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143696.402753:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f185c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593762560:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.402779:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff92600/0xe984082ccd725f45 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1afd expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.402779:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [2846720->3145727] (req 2846720->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.402797:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff92600/0xe984082ccd725f45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1afd expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.402799:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e612600, rc 0) 00000100:00100000:2.0:1746143696.402881:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28493:x1830963592317696:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4153us (4648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.402889:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9764 00010000:00010000:3.0:1746143696.403923:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff92600, rc 0) 00000100:00100000:3.0:1746143696.404252:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592317824:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3979us (5902us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143696.404258:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9765 00000100:00100000:0.0:1746143696.406707:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.407215:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592317952 00000100:00100000:3.0:1746143696.407225:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592317952 00010000:00010000:3.0:1746143696.407265:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd725ec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a9b expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.407301:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5022 00000100:00100000:0.0:1746143696.407620:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.407659:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592317952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.407676:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143696.407685:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592318208 00000100:00100000:2.0:1746143696.407690:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592318208 00010000:00010000:3.0:1746143696.407702:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd725ec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a9b expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.407715:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd725ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a9b expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00002000:00100000:2.0:1746143696.407721:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff88008f530a80 x1830963592318208/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.407729:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f530a80 with x1830963592318208 ext(4894720->4898815) 00002000:00010000:2.0:1746143696.407734:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f530a80 00010000:00010000:3.0:1746143696.407737:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2210200/0xe984082ccd725ec7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a9b expref: 18 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.407746:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3614 00000100:00100000:2.0:1746143696.407751:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592318208:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:3.0:1746143696.407753:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.407755:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.407764:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 17 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.407771:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 17 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.407804:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 17 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.407816:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593762816:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143696.407914:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592318208:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 162us (294us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143696.407918:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143696.407920:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3614 00002000:00100000:2.0:1746143696.407926:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff88008f530a80 x1830963592318208/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.407932:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f530a80 with x1830963592318208 ext(4894720->4898815) 00002000:00010000:2.0:1746143696.407934:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f530a80 00000100:00100000:3.0:1746143696.410660:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593762816:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143696.410677:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.410724:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592317952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3415us (4025us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.410733:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5022 00000100:00100000:1.0:1746143696.416305:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.416356:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.416426:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592318464 00000100:00100000:0.0:1746143696.416437:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592318464 00002000:00100000:0.0:1746143696.416482:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2846720->2850815) req@ffff88009bfe1880 x1830963592318464/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143696.416492:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1880 with x1830963592318464 ext(2846720->2850815) 00002000:00010000:0.0:1746143696.416497:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe1880 00000100:00100000:0.0:1746143696.416529:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3615 00000100:00100000:0.0:1746143696.416536:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592318464:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143696.416723:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592318720 00000100:00100000:2.0:1746143696.416727:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592318720 00000100:00100000:2.0:1746143696.416752:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3389 00000100:00100000:2.0:1746143696.416757:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28486:x1830963592318720:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143696.416968:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28486:x1830963592318720:12345-192.168.202.48@tcp:35:cat.0 Request processed in 209us (609us total) trans 8589942423 rc 0/0 00000100:00100000:2.0:1746143696.416975:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3389 00000100:00100000:0.0:1746143696.417695:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592318464:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 1157us (1399us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143696.417701:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3615 00002000:00100000:0.0:1746143696.417707:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2846720->2850815) req@ffff88009bfe1880 x1830963592318464/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143696.417716:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1880 with x1830963592318464 ext(2846720->2850815) 00002000:00010000:0.0:1746143696.417720:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe1880 00000100:00100000:0.0:1746143696.432568:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.432666:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592318848 00000100:00100000:3.0:1746143696.432674:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592318848 00000100:00100000:3.0:1746143696.432720:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9766 00000100:00100000:3.0:1746143696.432726:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28493:x1830963592318848:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143696.432745:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.432761:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b04 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.432790:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e613e00/0xe984082ccd725f37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aef expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.432800:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.432801:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.432803:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3354623] (req 3145728->3354623) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.432842:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e613e00/0xe984082ccd725f37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aef expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.432854:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e613e00/0xe984082ccd725f37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aef expref: 18 pid: 4582 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.432864:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593762944:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.432959:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143696.437893:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593762944:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.437932:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3354623] (req 3145728->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.437953:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff92000, rc 0) 00000100:00100000:3.0:1746143696.438031:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28493:x1830963592318848:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5303us (5469us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.438046:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9766 00000100:00100000:0.0:1746143696.438171:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.438697:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592318976 00000100:00100000:3.0:1746143696.438705:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592318976 00010000:00010000:3.0:1746143696.438736:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e613e00/0xe984082ccd725f37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aef expref: 18 pid: 4582 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.438774:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5023 00000100:00100000:3.0:1746143696.438782:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592318976:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.438796:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.438817:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e613e00/0xe984082ccd725f37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aef expref: 18 pid: 4582 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.438842:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e613e00/0xe984082ccd725f37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aef expref: 18 pid: 4582 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.438868:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e613e00/0xe984082ccd725f37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1aef expref: 18 pid: 4582 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.439260:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.439263:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.439271:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.439279:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.439312:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.439324:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593763072:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143696.439411:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143696.443364:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593763072:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143696.443384:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.444336:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592318976:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5550us (6195us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.444347:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5023 00000100:00100000:0.0:1746143696.446352:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.446420:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592319232 00000100:00100000:2.0:1746143696.446431:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592319232 00002000:00100000:2.0:1746143696.446480:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3350528->3354623) req@ffff88008f531f80 x1830963592319232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.446490:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f531f80 with x1830963592319232 ext(3350528->3354623) 00002000:00010000:2.0:1746143696.446495:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f531f80 00000100:00100000:2.0:1746143696.446528:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3616 00000100:00100000:2.0:1746143696.446536:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592319232:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143696.446720:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592319232:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 183us (373us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143696.446726:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3616 00002000:00100000:2.0:1746143696.446731:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3350528->3354623) req@ffff88008f531f80 x1830963592319232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.446738:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f531f80 with x1830963592319232 ext(3350528->3354623) 00002000:00010000:2.0:1746143696.446740:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f531f80 00000100:00100000:0.0:1746143696.449601:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.449843:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592319488 00000100:00100000:3.0:1746143696.449853:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592319488 00000100:00100000:3.0:1746143696.449911:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3390 00000100:00100000:3.0:1746143696.449919:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ecf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28493:x1830963592319488:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143696.450222:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ecf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28493:x1830963592319488:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 303us (630us total) trans 8589942424 rc 0/0 00000100:00100000:3.0:1746143696.450229:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3390 00000100:00100000:0.0:1746143696.529447:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.529696:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592319616 00000100:00100000:2.0:1746143696.529706:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592319616 00000100:00100000:2.0:1746143696.529779:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8313 00000100:00100000:2.0:1746143696.529787:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:28498:x1830963592319616:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143696.529813:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.529856:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609a00/0xe984082ccd725f53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b0b expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.529920:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609c00/0xe984082ccd725f5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.529933:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609c00/0xe984082ccd725f5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.529944:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609c00/0xe984082ccd725f5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.529957:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725f61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.529962:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.529967:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530075:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725f68 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530083:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725f68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530088:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725f68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143696.530117:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:2.0:1746143696.530121:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143696.530134:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725f68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530178:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725f68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530186:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609c00/0xe984082ccd725f5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530191:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609c00/0xe984082ccd725f5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530197:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609c00/0xe984082ccd725f5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530203:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e609c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143696.530206:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609c00/0xe984082ccd725f5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530213:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609c00/0xe984082ccd725f5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530223:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143696.530226:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143696.530230:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609c00/0xe984082ccd725f5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530235:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609c00/0xe984082ccd725f5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530268:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725f61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530273:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725f61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530277:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725f61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530282:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e609e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143696.530285:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725f61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530289:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725f61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530294:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a500) 00010000:00010000:2.0:1746143696.530297:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143696.530299:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725f61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530303:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725f61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.530329:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609a00/0xe984082ccd725f53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b0b expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.530340:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725f68 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b0b expref: 7 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.530345:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143696.530347:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143696.530349:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e609800, rc 0) 00000100:00100000:2.0:1746143696.530401:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28498:x1830963592319616:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 615us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.530407:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8313 00000100:00080000:0.0:1746143696.531986:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143696.534270:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.534361:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.534440:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592319872 00000100:00100000:3.0:1746143696.534449:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592319872 00000100:00100000:3.0:1746143696.534493:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592319744 00000100:00100000:3.0:1746143696.534495:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592319744 00000100:00100000:3.0:1746143696.534518:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9767 00000100:00100000:3.0:1746143696.534525:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592319872:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143696.534543:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.534560:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725f6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b19 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.534614:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593763200:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143696.534709:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143696.534725:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9768 00000100:00100000:3.0:1746143696.534730:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592319744:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143696.534738:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.534747:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff93200/0xe984082ccd725f76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b12 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.534770:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593763328:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143696.534791:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9000 going to sleep for 11 seconds 00000100:00080000:0.0:1746143696.535199:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143696.535202:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1746143696.538771:0:4581:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime: 1746143695 -> 1746143696 00000100:00100000:2.0:1746143696.538803:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593763328:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143696.538856:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff93200/0xe984082ccd725f76 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b12 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143696.539106:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593763200:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143696.539122:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725f6f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b19 expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.539136:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725f6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b19 expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.539187:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff92c00, rc 0) 00000100:00100000:3.0:1746143696.539249:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592319872:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4723us (4986us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143696.539257:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9767 00010000:00010000:2.0:1746143696.539546:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff93200/0xe984082ccd725f76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b12 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.539565:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff93200, rc 0) 00000100:00100000:2.0:1746143696.539590:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592319744:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4860us (5229us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143696.539596:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9768 00000100:00100000:0.0:1746143696.543615:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.543947:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592320128 00000100:00100000:3.0:1746143696.543959:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592320128 00000100:00100000:3.0:1746143696.544506:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8314 00000100:00100000:3.0:1746143696.544517:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28498:x1830963592320128:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143696.544540:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.544559:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92800/0xe984082ccd725f7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b20 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.544657:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.544671:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd725eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a8d expref: 246 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.544677:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725f29 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ae8 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.544684:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725f68 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b0b expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.544690:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143696.544723:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725f68 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b0b expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.544736:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725f68 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b0b expref: 8 pid: 21713 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.544747:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593763456:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.544850:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725f29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ae8 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.544858:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725f29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ae8 expref: 11 pid: 16090 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.544865:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593763584:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.544895:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd725eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a8d expref: 246 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.544903:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd725eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a8d expref: 246 pid: 16090 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.544909:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593763712:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.544928:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143696.550901:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.551333:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593763456:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.551346:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593763584:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143696.551433:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.551852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.553182:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593763712:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143696.553214:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143696.553332:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592320384 00000100:00100000:2.0:1746143696.553341:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592320384 00010000:00010000:2.0:1746143696.553381:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725f68 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b0b expref: 9 pid: 21713 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.553404:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5024 00000100:00100000:2.0:1746143696.553411:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592320384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.553426:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.553432:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725f68 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b0b expref: 9 pid: 21713 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.553441:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725f68 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b0b expref: 9 pid: 21713 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.553463:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725f68 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b0b expref: 9 pid: 21713 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.553480:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143696.553485:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.553494:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.553498:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.553540:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592320384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 129us (2652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.553547:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5024 00000100:00100000:2.0:1746143696.553563:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592320256 00000100:00100000:2.0:1746143696.553566:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592320256 00010000:00010000:2.0:1746143696.553574:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725f29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ae8 expref: 12 pid: 16090 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.553586:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592320512 00000100:00100000:2.0:1746143696.553588:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592320512 00010000:00010000:2.0:1746143696.553597:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd725eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a8d expref: 247 pid: 16090 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.553608:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5025 00000100:00100000:2.0:1746143696.553613:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592320256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.553619:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.553622:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725f29 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ae8 expref: 12 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.553628:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725f29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ae8 expref: 12 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.553639:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725f29 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ae8 expref: 12 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.553664:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143696.553667:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.553671:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.553675:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.553689:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592320256:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 76us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.553694:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5025 00000100:00100000:2.0:1746143696.553730:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5026 00000100:00100000:2.0:1746143696.553734:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:1962:x1830963592320512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.553740:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.553743:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd725eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a8d expref: 247 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.553751:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd725eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a8d expref: 247 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.553762:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd725eb2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a8d expref: 247 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.553771:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143696.553773:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.553782:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.553788:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.553803:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.553832:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:1962:x1830963592320512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 83us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.553837:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5026 00010000:00010000:0.0:1746143696.554255:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.554262:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:0.0:1746143696.554280:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143696.554409:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92800/0xe984082ccd725f7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b20 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.554427:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b20 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.554434:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143696.554437:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143696.554439:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff93000, rc 0) 00000100:00100000:0.0:1746143696.554465:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28498:x1830963592320128:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 9950us (10862us total) trans 8589942425 rc 0/0 00000100:00100000:0.0:1746143696.554471:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8314 00000100:00100000:0.0:1746143696.559656:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.561667:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592320640 00000100:00100000:2.0:1746143696.561681:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592320640 00000100:00100000:2.0:1746143696.561751:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8315 00000100:00100000:2.0:1746143696.561759:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28498:x1830963592320640:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143696.561787:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.561809:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609c00/0xe984082ccd725f92 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b27 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.561904:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609400/0xe984082ccd725f99 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.561919:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b20 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.561927:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609400/0xe984082ccd725f99 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.561961:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b20 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.561977:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b20 expref: 9 pid: 16090 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.561989:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593763840:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.562095:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143696.565071:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593763840:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.565098:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609400/0xe984082ccd725f99 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143696.567508:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.567981:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592320768 00000100:00100000:1.0:1746143696.567990:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592320768 00010000:00010000:1.0:1746143696.568025:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b20 expref: 10 pid: 16090 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746143696.568058:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5027 00000100:00100000:1.0:1746143696.568064:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592320768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143696.568077:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143696.568082:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b20 expref: 10 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.568095:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b20 expref: 10 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.568115:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93000/0xe984082ccd725f84 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b20 expref: 10 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.568164:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143696.568168:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609400/0xe984082ccd725f99 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143696.568177:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609400/0xe984082ccd725f99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143696.568185:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609400/0xe984082ccd725f99 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143696.568209:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143696.568250:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592320768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 185us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.568256:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5027 00010000:00010000:0.0:1746143696.569254:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609400/0xe984082ccd725f99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.569263:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609400/0xe984082ccd725f99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:0.0:1746143696.569308:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:0.0:1746143696.569311:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143696.569327:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609400/0xe984082ccd725f99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.569356:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609c00/0xe984082ccd725f92 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b27 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.569373:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609400/0xe984082ccd725f99 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b27 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.569379:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143696.569382:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143696.569384:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e609400, rc 0) 00000100:00100000:0.0:1746143696.569415:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28498:x1830963592320640:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 7658us (9772us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.569609:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8315 00000100:00100000:0.0:1746143696.574670:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.574751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.574920:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592320896 00000100:00100000:2.0:1746143696.574930:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592320896 00000100:00100000:2.0:1746143696.574975:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592321024 00000100:00100000:2.0:1746143696.574977:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592321024 00000100:00100000:2.0:1746143696.574995:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9769 00000100:00100000:2.0:1746143696.575003:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592320896:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143696.575026:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.575043:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e609a00/0xe984082ccd725fa0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b2e expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143696.575099:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593763968:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143696.575242:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9770 00000100:00100000:0.0:1746143696.575249:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592321024:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143696.575258:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143696.575269:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e612400/0xe984082ccd725fa7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b35 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.575297:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593764096:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143696.576943:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143696.577060:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143696.578520:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593764096:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143696.578552:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e612400/0xe984082ccd725fa7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b35 expref: 12 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.578566:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e612400/0xe984082ccd725fa7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b35 expref: 12 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.578592:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e612400, rc 0) 00000100:00100000:2.0:1746143696.578730:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593763968:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143696.578750:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e609a00/0xe984082ccd725fa0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b2e expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.578766:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e609a00/0xe984082ccd725fa0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b2e expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143696.579290:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592321024:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4038us (4535us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143696.579299:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9770 00010000:00010000:2.0:1746143696.579864:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e609a00, rc 0) 00000100:00100000:2.0:1746143696.579896:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592320896:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4893us (5236us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143696.579902:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9769 00000100:00100000:0.0:1746143696.584606:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.584870:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592321280 00000100:00100000:2.0:1746143696.584880:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592321280 00000100:00100000:2.0:1746143696.584940:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8316 00000100:00100000:2.0:1746143696.584949:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28498:x1830963592321280:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143696.584971:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.584990:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725fae lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b3c expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.585090:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725fb5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.585104:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.585115:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725fb5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143696.585126:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143696.585288:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609800/0xe984082ccd725fae lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b3c expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.585310:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b3c expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.585317:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143696.585321:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143696.585324:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e609e00, rc 0) 00000100:00100000:2.0:1746143696.585375:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28498:x1830963592321280:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 427us (780us total) trans 8589942426 rc 0/0 00000100:00100000:2.0:1746143696.585381:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8316 00000100:00100000:0.0:1746143696.593095:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.593901:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592322304 00000100:00100000:3.0:1746143696.593912:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592322304 00000100:00100000:3.0:1746143696.593967:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8317 00000100:00100000:3.0:1746143696.593975:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:28501:x1830963592322304:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.593999:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.594019:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92600/0xe984082ccd725fc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b43 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.594124:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92800/0xe984082ccd725fca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594137:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92800/0xe984082ccd725fca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594178:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92800/0xe984082ccd725fca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594189:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725fd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594195:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594201:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594299:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93600/0xe984082ccd725fd8 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594306:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93600/0xe984082ccd725fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594312:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93600/0xe984082ccd725fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143696.594319:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143696.594387:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93600/0xe984082ccd725fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594393:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93600/0xe984082ccd725fd8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594399:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93600/0xe984082ccd725fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594405:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff93600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143696.594408:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93600/0xe984082ccd725fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594414:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93600/0xe984082ccd725fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594423:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143696.594426:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143696.594429:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93600/0xe984082ccd725fd8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594438:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93600/0xe984082ccd725fd8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594471:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92800/0xe984082ccd725fca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594476:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92800/0xe984082ccd725fca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594480:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92800/0xe984082ccd725fca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594484:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff92800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143696.594486:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92800/0xe984082ccd725fca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594490:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92800/0xe984082ccd725fca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594495:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143696.594497:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143696.594499:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92800/0xe984082ccd725fca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594503:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92800/0xe984082ccd725fca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594509:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594513:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594517:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594522:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff93c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143696.594525:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594529:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725fd1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594534:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009343f600) 00010000:00010000:3.0:1746143696.594535:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143696.594537:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725fd1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594541:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93c00/0xe984082ccd725fd1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.594571:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92600/0xe984082ccd725fc3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b43 expref: 248 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.594578:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92600/0xe984082ccd725fc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b43 expref: 248 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.594584:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff92600, rc 0) 00000100:00100000:3.0:1746143696.594644:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:28501:x1830963592322304:12345-192.168.202.48@tcp:101:cat.0 Request processed in 669us (1560us total) trans 8589942427 rc 301/301 00000100:00100000:3.0:1746143696.594651:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8317 00000100:00100000:0.0:1746143696.594877:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.594962:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.594975:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.594988:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.595262:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.595304:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592321408 00000100:00100000:2.0:1746143696.595316:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592321408 00000100:00100000:2.0:1746143696.595369:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592321792 00000100:00100000:2.0:1746143696.595372:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592321792 00000100:00100000:2.0:1746143696.595385:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592322048 00010000:00010000:3.0:1746143696.595921:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746143696.595936:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592321664 00000100:00100000:3.0:1746143696.595940:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592321664 00000100:00100000:3.0:1746143696.595969:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9771 00000100:00100000:3.0:1746143696.595976:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592321408:12345-192.168.202.48@tcp:1:lfs.0 00000100:00100000:1.0:1746143696.595984:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9772 00000100:00100000:1.0:1746143696.595994:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592321792:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143696.596012:0:12618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.596027:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.596028:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd725d31 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c2 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.596035:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd725e1f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a16 expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.596042:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd725e18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a0f expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.596042:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cde0c00/0xe984082ccd725d46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d0 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.596048:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.596050:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.596053:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.596054:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095710000/0xe984082ccd725e65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a55 expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.596061:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368a6a00/0xe984082ccd725e5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a4e expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.596066:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.596068:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.596071:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.596082:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd725e18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a0f expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.596094:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd725e18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a0f expref: 28 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.596094:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801368a6a00/0xe984082ccd725e5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a4e expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.596103:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801368a6a00/0xe984082ccd725e5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a4e expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.596106:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593764224:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143696.596114:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593764352:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.596204:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd725e1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a16 expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.596217:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd725e1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a16 expref: 16 pid: 12618 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.596224:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593764480:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.596265:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd725d31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c2 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.596272:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd725d31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c2 expref: 11 pid: 4581 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.596278:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593764608:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.596293:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143696.596314:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9773 00000100:00100000:3.0:1746143696.596320:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592321664:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143696.596339:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.596350:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c45200/0xe984082ccd725d38 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c9 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.596356:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd725e42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a32 expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.596363:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd725e34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a24 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.596368:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.596369:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.596371:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.596389:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd725e34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a24 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.596397:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd725e34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a24 expref: 24 pid: 8495 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.596404:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593764736:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.596430:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd725e42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a32 expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.596437:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd725e42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a32 expref: 16 pid: 12618 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.596443:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593764864:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.596462:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c45200/0xe984082ccd725d38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c9 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.596469:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c45200/0xe984082ccd725d38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c9 expref: 12 pid: 12618 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.596481:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593764992:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.596516:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143696.596610:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592322048 00000100:00100000:2.0:1746143696.596639:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9774 00000100:00100000:2.0:1746143696.596645:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592322048:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143696.596664:0:8496:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.596674:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.596681:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd725e88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a78 expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.596685:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143696.596688:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143696.596690:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 5/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.596776:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.596910:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592321920 00000100:00100000:3.0:1746143696.596914:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592321920 00010000:00010000:2.0:1746143696.597022:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd725e88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a78 expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.597031:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd725e88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a78 expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.597040:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593765120:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.597068:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592322176 00000100:00100000:3.0:1746143696.597072:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592322176 00000100:00100000:3.0:1746143696.597193:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9775 00000100:00100000:3.0:1746143696.597199:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1963:x1830963592321920:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143696.597216:0:8497:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.597226:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd725d3f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d7 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.597234:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095394600/0xe984082ccd725e73 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a63 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.597240:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095395400/0xe984082ccd725e6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a5c expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.597245:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.597247:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.597249:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.597266:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095395400/0xe984082ccd725e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a5c expref: 16 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.597275:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095395400/0xe984082ccd725e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a5c expref: 16 pid: 25369 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.597283:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593765248:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143696.597345:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9776 00000100:00100000:0.0:1746143696.597352:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1963:x1830963592322176:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143696.597370:0:6929:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.597380:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.597388:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.597393:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143696.597394:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143696.597396:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.597412:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.597420:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 24 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746143696.597429:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593765376:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.597540:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.597549:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.597556:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593765504:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143696.597560:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095710000/0xe984082ccd725e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a55 expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.597569:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095710000/0xe984082ccd725e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a55 expref: 24 pid: 12618 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746143696.597577:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593765632:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.597579:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32240 going to sleep for 11 seconds 00010000:00010000:0.0:1746143696.597606:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cde0c00/0xe984082ccd725d46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d0 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.597614:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cde0c00/0xe984082ccd725d46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d0 expref: 13 pid: 4581 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746143696.597621:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593765760:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143696.597635:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52fccc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143696.597748:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095394600/0xe984082ccd725e73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a63 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.597757:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095394600/0xe984082ccd725e73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a63 expref: 28 pid: 12618 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.597766:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593765888:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.597789:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd725d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d7 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.597796:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd725d3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d7 expref: 13 pid: 15784 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.597803:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593766016:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.597815:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c388300 going to sleep for 11 seconds 00010000:00010000:0.0:1746143696.597875:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.597883:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 16 pid: 4582 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746143696.597891:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593766144:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143696.597911:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143696.603279:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593764224:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143696.603513:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.603527:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.603545:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.603556:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.603578:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592322688 00000100:00100000:0.0:1746143696.603584:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592322688 00000100:00100000:1.0:1746143696.603614:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592323072 00010000:00010000:0.0:1746143696.603621:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd725d31 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c2 expref: 14 pid: 4581 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746143696.603627:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592323072 00000100:00100000:0.0:1746143696.603646:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592322560 00000100:00100000:0.0:1746143696.603649:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592322560 00010000:00010000:0.0:1746143696.603660:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd725e1f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a16 expref: 17 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.603663:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c45200/0xe984082ccd725d38 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c9 expref: 14 pid: 12618 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746143696.603673:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592322944 00000100:00100000:0.0:1746143696.603675:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592322944 00010000:00010000:0.0:1746143696.603685:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd725e34 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a24 expref: 25 pid: 8495 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746143696.603687:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5028 00000100:00100000:1.0:1746143696.603694:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1962:x1830963592322688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143696.603697:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5029 00000100:00100000:0.0:1746143696.603703:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592322560:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143696.603708:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143696.603715:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143696.603728:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd725d31 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c2 expref: 14 pid: 4581 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746143696.603734:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd725e1f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a16 expref: 17 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.603740:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd725d31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c2 expref: 14 pid: 4581 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.603788:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593764736:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.603798:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593764864:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.603810:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593764992:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.603842:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.603865:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593764480:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.603874:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963593764608:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.603889:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5030 00000100:00100000:2.0:1746143696.603901:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1962:x1830963592323072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.603908:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143696.603911:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd725e1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a16 expref: 17 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.603923:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c45200/0xe984082ccd725d38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c9 expref: 14 pid: 12618 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.603931:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c45200/0xe984082ccd725d38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c9 expref: 14 pid: 12618 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746143696.603938:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd725e1f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a16 expref: 17 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.603948:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c45200/0xe984082ccd725d38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c9 expref: 14 pid: 12618 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746143696.603957:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143696.603973:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143696.604001:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592322560:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 296us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.604008:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5029 00000100:00100000:2.0:1746143696.604017:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963592323072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 116us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.604023:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5030 00010000:00010000:1.0:1746143696.604126:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd725d31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19c2 expref: 14 pid: 4581 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.604127:0:12618:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.604169:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.604185:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593765248:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143696.604190:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1962:x1830963592322688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 497us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.604351:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5031 00000100:00100000:0.0:1746143696.604358:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592322944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143696.604366:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143696.604378:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd725e34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a24 expref: 25 pid: 8495 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.604386:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd725e34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a24 expref: 25 pid: 8495 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.604398:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd725e34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a24 expref: 25 pid: 8495 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.604408:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143696.604426:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963592322944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 69us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.604431:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5031 00000100:00100000:0.0:1746143696.604467:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.604481:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592323328 00000100:00100000:0.0:1746143696.604485:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592323328 00010000:00010000:0.0:1746143696.604496:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd725e88 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a78 expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746143696.604508:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5032 00000100:00100000:0.0:1746143696.604512:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592323328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143696.604517:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143696.604527:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd725e88 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a78 expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.604535:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd725e88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a78 expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.604545:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143696.604560:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592323328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.604564:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5032 00000100:00100000:0.0:1746143696.604612:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.604623:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592322432 00000100:00100000:0.0:1746143696.604625:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592322432 00010000:00010000:0.0:1746143696.604636:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd725e18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a0f expref: 29 pid: 12618 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746143696.604649:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5033 00000100:00100000:0.0:1746143696.604653:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592322432:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143696.604659:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143696.604666:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd725e18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a0f expref: 29 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.604676:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd725e18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a0f expref: 29 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.604687:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5fdfe00/0xe984082ccd725e18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a0f expref: 29 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.604695:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.604697:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.604701:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.604709:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.604734:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143696.604750:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592322432:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 96us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.604754:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5033 00000100:00100000:0.0:1746143696.604791:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.605361:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5028 00010000:00010000:2.0:1746143696.605445:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd725e88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a78 expref: 15 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.605458:0:12618:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143696.605459:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593765120:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.605466:0:12618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143696.605475:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592323200 00000100:00100000:2.0:1746143696.605479:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592323200 00010000:00010000:3.0:1746143696.605487:0:12618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.605493:0:12618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.605498:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd725e42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a32 expref: 17 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.605499:0:12618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.605510:0:12618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff92e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143696.605514:0:12618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.605520:0:12618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143696.605524:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5034 00000100:00100000:2.0:1746143696.605529:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592323200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.605530:0:12618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.605534:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff92e00/0xe984082ccd725fe6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.605791:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.605809:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd725e42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a32 expref: 17 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.605827:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd725e42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a32 expref: 17 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.605850:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd725e42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a32 expref: 17 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.605859:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.605861:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.605865:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.605872:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.605891:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143696.606014:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.606041:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592322816 00000100:00100000:1.0:1746143696.606045:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592322816 00010000:00010000:1.0:1746143696.606060:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a6a00/0xe984082ccd725e5e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a4e expref: 17 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746143696.606086:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5035 00000100:00100000:1.0:1746143696.606091:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592322816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143696.606097:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143696.606116:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.606132:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592323456 00000100:00100000:0.0:1746143696.606136:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592323456 00010000:00010000:0.0:1746143696.606165:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095395400/0xe984082ccd725e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a5c expref: 15 pid: 25369 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746143696.606181:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5036 00000100:00100000:0.0:1746143696.606185:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592323456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143696.606192:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143696.606203:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095395400/0xe984082ccd725e6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a5c expref: 15 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.606210:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095395400/0xe984082ccd725e6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a5c expref: 15 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.606221:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095395400/0xe984082ccd725e6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a5c expref: 15 pid: 25369 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.606233:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143696.606251:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592323456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 66us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.606256:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5036 00010000:00010000:1.0:1746143696.606462:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801368a6a00/0xe984082ccd725e5e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a4e expref: 17 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.606471:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801368a6a00/0xe984082ccd725e5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a4e expref: 17 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.606474:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592321408:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 10496us (11594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.606483:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9771 00010000:00010000:1.0:1746143696.606484:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143696.606509:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143696.606514:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592322816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 422us (501us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143696.606516:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143696.606519:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5035 00010000:00010000:3.0:1746143696.606534:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.606541:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.606547:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.606552:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff92c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143696.606555:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.606561:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.606571:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.606577:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff92c00/0xe984082ccd725ff4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.606613:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592321664:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 10293us (11623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.606618:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9773 00000100:00100000:2.0:1746143696.606699:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592323200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1167us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.606705:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5034 00010000:00010000:2.0:1746143696.606743:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368a6a00/0xe984082ccd725e5e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a4e expref: 15 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.606751:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593764352:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143696.609308:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.609384:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592323584 00000100:00100000:3.0:1746143696.609392:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592323584 00000100:00100000:3.0:1746143696.609444:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8318 00000100:00100000:3.0:1746143696.609452:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:28501:x1830963592323584:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.609475:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.609495:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619400/0xe984082ccd726010 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b4a expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.609574:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619600/0xe984082ccd726017 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.609588:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619600/0xe984082ccd726017 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.609598:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619600/0xe984082ccd726017 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143696.609623:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:3.0:1746143696.609627:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143696.609641:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619600/0xe984082ccd726017 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.609663:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619400/0xe984082ccd726010 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b4a expref: 249 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.609690:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619600/0xe984082ccd726017 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b4a expref: 248 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.609698:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143696.609701:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143696.609704:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0619600, rc 0) 00000100:00100000:3.0:1746143696.609764:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:28501:x1830963592323584:12345-192.168.202.48@tcp:101:cat.0 Request processed in 313us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.609770:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8318 00000100:00100000:1.0:1746143696.614748:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593765376:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.614852:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593765504:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.614882:0:8496:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143696.615297:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593765632:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.615308:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593765760:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.615335:0:4582:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.622699:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.623403:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593766144:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143696.623432:0:6929:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.623498:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593765888:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.623509:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593766016:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.623530:0:8497:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.623610:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.623630:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.623649:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.623662:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.623678:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.623692:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.623715:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592324608 00000100:00100000:0.0:1746143696.623722:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592324608 00000100:00100000:0.0:1746143696.623759:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592324864 00000100:00100000:0.0:1746143696.623761:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592324864 00000100:00100000:1.0:1746143696.623798:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592323968 00000100:00100000:1.0:1746143696.623801:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592323968 00010000:00010000:1.0:1746143696.623833:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095710000/0xe984082ccd725e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a55 expref: 25 pid: 12618 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746143696.623851:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592324224 00000100:00100000:1.0:1746143696.623853:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592324224 00010000:00010000:1.0:1746143696.623862:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095394600/0xe984082ccd725e73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a63 expref: 29 pid: 12618 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746143696.623873:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592324096 00000100:00100000:1.0:1746143696.623875:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592324096 00010000:00010000:1.0:1746143696.623883:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cde0c00/0xe984082ccd725d46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d0 expref: 12 pid: 4581 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746143696.623891:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592324352 00000100:00100000:1.0:1746143696.623892:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592324352 00010000:00010000:1.0:1746143696.623902:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd725d3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d7 expref: 12 pid: 15784 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746143696.623912:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5037 00000100:00100000:1.0:1746143696.623919:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592323968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143696.623933:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143696.623957:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095710000/0xe984082ccd725e65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a55 expref: 25 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.623967:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095710000/0xe984082ccd725e65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a55 expref: 25 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.623990:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095710000/0xe984082ccd725e65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a55 expref: 25 pid: 12618 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.624105:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5038 00000100:00100000:2.0:1746143696.624114:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592324224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.624123:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.624151:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095394600/0xe984082ccd725e73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a63 expref: 29 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.624159:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095394600/0xe984082ccd725e73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a63 expref: 29 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.624171:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095394600/0xe984082ccd725e73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a63 expref: 29 pid: 12618 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.624185:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.624227:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592324224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 114us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.624233:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5038 00000100:00100000:2.0:1746143696.624248:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5039 00000100:00100000:2.0:1746143696.624253:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592324096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.624261:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.624269:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cde0c00/0xe984082ccd725d46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d0 expref: 12 pid: 4581 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.624277:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cde0c00/0xe984082ccd725d46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d0 expref: 12 pid: 4581 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.624288:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cde0c00/0xe984082ccd725d46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d0 expref: 12 pid: 4581 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.624301:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.624303:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.624308:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.624316:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.624335:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.624349:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592324096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 96us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.624353:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5039 00000100:00100000:2.0:1746143696.624362:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5040 00000100:00100000:2.0:1746143696.624367:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592324352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.624374:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.624381:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd725d3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d7 expref: 12 pid: 15784 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.624388:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd725d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d7 expref: 12 pid: 15784 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.624398:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd725d3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a19d7 expref: 12 pid: 15784 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.624405:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.624407:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.624409:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.624415:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.624427:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.624443:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592324352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 75us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.624447:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5040 00010000:00010000:2.0:1746143696.624468:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.624475:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.624496:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.624503:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.624510:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.624516:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0af8200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143696.624519:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.624531:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.624541:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.624547:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0af8200/0xe984082ccd725fed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143696.624577:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592321792:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 28585us (29614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.624583:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9772 00000100:00100000:2.0:1746143696.624598:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9777 00000100:00100000:2.0:1746143696.624603:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592324608:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143696.624616:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.624629:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c068600/0xe984082ccd72601e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b51 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143696.624642:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409cf, atime: 0x681409cf, ctime: 0x681409cf, blocks: 0x809 00010000:00010000:2.0:1746143696.624652:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.624653:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.624658:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c068600/0xe984082ccd72601e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b51 expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.624667:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c068600/0xe984082ccd72601e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b51 expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.624675:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c068600, rc 0) 00000100:00100000:2.0:1746143696.624691:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592324608:12345-192.168.202.48@tcp:101:cat.0 Request processed in 88us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.624695:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9777 00000100:00100000:2.0:1746143696.624706:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9778 00000100:00100000:2.0:1746143696.624710:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592324864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143696.624716:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.624722:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c068800/0xe984082ccd726025 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b5f expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.624730:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.624731:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.624735:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c068800/0xe984082ccd726025 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b5f expref: 25 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.624743:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c068800/0xe984082ccd726025 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b5f expref: 25 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.624749:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c068800, rc 0) 00000100:00100000:2.0:1746143696.624763:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592324864:12345-192.168.202.48@tcp:101:cat.0 Request processed in 53us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.624767:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9778 00010000:00010000:3.0:1746143696.624874:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.624881:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.624895:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.624901:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.624907:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.624912:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0618600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143696.624914:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.624920:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.624930:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.624936:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0618600/0xe984082ccd726002 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.624971:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592321920:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 27773us (29709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.624977:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9775 00000100:00100000:3.0:1746143696.625010:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592323840 00000100:00100000:3.0:1746143696.625013:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592323840 00002000:00100000:3.0:1746143696.625038:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (3719168->4194303) req@ffff88013691bb80 x1830963592323840/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.625047:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691bb80 with x1830963592323840 ext(3719168->4194303) 00010000:00010000:3.0:1746143696.625053:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 25 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.625062:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 25 pid: 4581 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746143696.625068:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013691bb80 00000100:00100000:3.0:1746143696.625088:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 884 00000100:00100000:3.0:1746143696.625094:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592323840:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:1.0:1746143696.625639:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143696.625661:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592323968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1742us (2972us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.625668:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5037 00000100:00100000:2.0:1746143696.627741:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.627815:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.627857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.627874:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.627910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.628284:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592325120 00000100:00100000:1.0:1746143696.628292:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592325120 00000100:00100000:1.0:1746143696.628329:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592324736 00000100:00100000:1.0:1746143696.628331:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592324736 00000100:00100000:1.0:1746143696.628341:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592324992 00000100:00100000:1.0:1746143696.628342:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592324992 00000100:00100000:1.0:1746143696.628348:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592325248 00000100:00100000:1.0:1746143696.628350:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592325248 00000100:00100000:1.0:1746143696.628359:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9779 00000100:00100000:1.0:1746143696.628366:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592325120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.628385:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.628403:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0af8800/0xe984082ccd72602c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b6d expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143696.628458:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593766272:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143696.628505:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143696.628524:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9780 00000100:00100000:1.0:1746143696.628530:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592324736:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.628538:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.628562:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0586000/0xe984082ccd726033 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b58 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143696.628585:0:9527:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34a:0x0] initial LVB size: 2097152, mtime: 0x681409cf, atime: 0x681409cf, ctime: 0x681409cf, blocks: 0x81f 00010000:00010000:1.0:1746143696.628597:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.628598:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.628605:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0586000/0xe984082ccd726033 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b58 expref: 28 pid: 9527 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143696.628618:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9781 00010000:00010000:1.0:1746143696.628620:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0586000/0xe984082ccd726033 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b58 expref: 28 pid: 9527 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143696.628627:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592324992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.628630:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0586000, rc 0) 00010000:00010000:3.0:1746143696.628634:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.628643:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0619000/0xe984082ccd72603a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b66 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143696.628652:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592324736:12345-192.168.202.48@tcp:101:cat.0 Request processed in 122us (794us total) trans 0 rc 0/0 00002000:00010000:3.0:1746143696.628659:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409cf, atime: 0x681409cf, ctime: 0x681409cf, blocks: 0x821 00000100:00100000:1.0:1746143696.628659:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9780 00010000:00010000:3.0:1746143696.628667:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.628668:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.628673:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0619000/0xe984082ccd72603a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b66 expref: 31 pid: 21542 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143696.628673:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9782 00000100:00100000:1.0:1746143696.628679:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592325248:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.628683:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0619000/0xe984082ccd72603a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b66 expref: 31 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.628684:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.628689:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0619000, rc 0) 00010000:00010000:1.0:1746143696.628691:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0586200/0xe984082ccd726041 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b74 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.628706:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592324992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 81us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.628711:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9781 00000100:00100000:1.0:1746143696.628712:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593766400:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143696.628731:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592323712 00000100:00100000:1.0:1746143696.628732:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143696.628735:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592323712 00002000:00100000:3.0:1746143696.628759:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3354623) req@ffff8800930c3b80 x1830963592323712/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.628768:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c3b80 with x1830963592323712 ext(3145728->3354623) 00010000:00010000:3.0:1746143696.628785:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 14 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.628796:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 14 pid: 4581 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746143696.628802:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930c3b80 00000100:00100000:3.0:1746143696.628839:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 885 00000100:00100000:3.0:1746143696.628844:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592323712:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143696.629220:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.629583:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592325504 00000100:00100000:3.0:1746143696.629587:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592325504 00000100:00100000:3.0:1746143696.629619:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8319 00000100:00100000:3.0:1746143696.629624:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:28503:x1830963592325504:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143696.629634:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.629647:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618e00/0xe984082ccd726048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b7b expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.629737:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618800/0xe984082ccd72604f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.629749:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618800/0xe984082ccd72604f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.629759:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618800/0xe984082ccd72604f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.629770:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618a00/0xe984082ccd726056 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.629775:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618a00/0xe984082ccd726056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.629780:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618a00/0xe984082ccd726056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:2.0:1746143696.629802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143696.629908:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.629918:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725fb5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b3c expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.629924:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.629944:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b3c expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.629953:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725fb5 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b3c expref: 9 pid: 16090 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.629961:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593766528:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.629997:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143696.630011:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592324480 00000100:00100000:3.0:1746143696.630014:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592324480 00002000:00100000:3.0:1746143696.630031:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (2846720->3145727) req@ffff8800930c2680 x1830963592324480/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.630038:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c2680 with x1830963592324480 ext(2846720->3145727) 00010000:00010000:3.0:1746143696.630043:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 15 pid: 4582 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.630051:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 15 pid: 4582 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746143696.630062:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930c2680 00000100:00100000:3.0:1746143696.630075:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 886 00000100:00100000:3.0:1746143696.630080:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1962:x1830963592324480:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143696.635346:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593766272:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143696.635385:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0af8800/0xe984082ccd72602c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b6d expref: 30 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.635402:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0af8800/0xe984082ccd72602c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b6d expref: 30 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.635415:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0af8800, rc 0) 00000100:00100000:1.0:1746143696.635493:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592325120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7124us (7756us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143696.635504:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9779 00000100:00100000:1.0:1746143696.635888:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593766400:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143696.635907:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0586200/0xe984082ccd726041 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b74 expref: 28 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.635917:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0586200/0xe984082ccd726041 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b74 expref: 28 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.635929:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0586200, rc 0) 00000100:00100000:1.0:1746143696.635956:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592325248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7276us (8044us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143696.635961:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9782 00000100:00100000:2.0:1746143696.636331:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593766528:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.636352:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143696.636948:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.637031:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592325632 00000100:00100000:1.0:1746143696.637039:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592325632 00010000:00010000:1.0:1746143696.637065:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725fb5 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b3c expref: 10 pid: 16090 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746143696.637358:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5041 00000100:00100000:1.0:1746143696.637366:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592325632:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143696.637379:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143696.637385:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725fb5 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b3c expref: 10 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.637395:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725fb5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b3c expref: 10 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.637413:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609e00/0xe984082ccd725fb5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b3c expref: 10 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.637427:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143696.637432:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.637893:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.637902:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.637930:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143696.637962:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592325632:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 596us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.637969:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5041 00010000:00010000:3.0:1746143696.638269:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638276:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143696.638290:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143696.638397:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638403:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638408:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638413:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0618000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143696.638416:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638422:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638431:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143696.638433:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143696.638436:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638443:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618000/0xe984082ccd72605d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638468:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618800/0xe984082ccd72604f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638472:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618800/0xe984082ccd72604f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638475:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618800/0xe984082ccd72604f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638478:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0618800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143696.638479:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618800/0xe984082ccd72604f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638483:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618800/0xe984082ccd72604f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638488:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143696.638489:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143696.638491:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618800/0xe984082ccd72604f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638495:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618800/0xe984082ccd72604f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638502:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618a00/0xe984082ccd726056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638505:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618a00/0xe984082ccd726056 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638509:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618a00/0xe984082ccd726056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638513:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0618a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143696.638515:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618a00/0xe984082ccd726056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638519:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618a00/0xe984082ccd726056 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638523:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094e98400) 00010000:00010000:3.0:1746143696.638524:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143696.638526:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618a00/0xe984082ccd726056 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638529:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618a00/0xe984082ccd726056 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.638576:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618e00/0xe984082ccd726048 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b7b expref: 250 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.638583:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0618e00/0xe984082ccd726048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b7b expref: 250 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.638590:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0618e00, rc 0) 00000100:00100000:3.0:1746143696.638617:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:28503:x1830963592325504:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8993us (9398us total) trans 8589942428 rc 301/301 00000100:00100000:3.0:1746143696.638623:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8319 00000100:00100000:3.0:1746143696.642714:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592323712:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 13858us (14885us total) trans 17179872499 rc 0/0 00000100:00100000:3.0:1746143696.642728:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 885 00002000:00100000:3.0:1746143696.642741:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3354623) req@ffff8800930c3b80 x1830963592323712/t17179872499(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/448 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.642752:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c3b80 with x1830963592323712 ext(3145728->3354623) 00010000:00010000:3.0:1746143696.642762:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.642774:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746143696.642780:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930c3b80 00000100:00100000:2.0:1746143696.647587:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592324480:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 17494us (17773us total) trans 21474839762 rc 0/0 00000100:00100000:2.0:1746143696.647600:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 886 00002000:00100000:2.0:1746143696.647614:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2846720->3145727) req@ffff8800930c2680 x1830963592324480/t21474839762(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/448 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.647624:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930c2680 with x1830963592324480 ext(2846720->3145727) 00010000:00010000:2.0:1746143696.647635:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 17 pid: 4582 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.647648:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 17 pid: 4582 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746143696.647655:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930c2680 00000100:00100000:1.0:1746143696.647800:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592323840:12345-192.168.202.48@tcp:4:cat.0 Request processed in 22705us (24168us total) trans 21474839763 rc 0/0 00000100:00100000:1.0:1746143696.647806:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 884 00002000:00100000:1.0:1746143696.647811:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (3719168->4194303) req@ffff88013691bb80 x1830963592323840/t21474839763(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/448 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.647825:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691bb80 with x1830963592323840 ext(3719168->4194303) 00010000:00010000:1.0:1746143696.647830:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 27 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.647838:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 27 pid: 4581 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746143696.647843:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013691bb80 00000100:00100000:0.0:1746143696.652987:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.653171:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592325888 00000100:00100000:3.0:1746143696.653182:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592325888 00000100:00100000:3.0:1746143696.653242:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8320 00000100:00100000:3.0:1746143696.653251:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28506:x1830963592325888:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.653280:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.653302:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd72606b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b82 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.653417:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76c00/0xe984082ccd726072 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653430:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76c00/0xe984082ccd726072 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653441:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76c00/0xe984082ccd726072 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653453:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76e00/0xe984082ccd726079 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653458:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76e00/0xe984082ccd726079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653464:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76e00/0xe984082ccd726079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653566:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77000/0xe984082ccd726080 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653573:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77000/0xe984082ccd726080 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653578:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77000/0xe984082ccd726080 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143696.653586:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143696.653663:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77000/0xe984082ccd726080 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653669:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77000/0xe984082ccd726080 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653675:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77000/0xe984082ccd726080 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653681:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca77000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143696.653685:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77000/0xe984082ccd726080 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653691:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77000/0xe984082ccd726080 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653701:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143696.653703:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143696.653706:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77000/0xe984082ccd726080 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653715:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77000/0xe984082ccd726080 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653763:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76c00/0xe984082ccd726072 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653767:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76c00/0xe984082ccd726072 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653771:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76c00/0xe984082ccd726072 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653775:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca76c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143696.653778:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76c00/0xe984082ccd726072 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653782:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76c00/0xe984082ccd726072 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653787:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143696.653789:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143696.653792:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76c00/0xe984082ccd726072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653796:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76c00/0xe984082ccd726072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653803:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76e00/0xe984082ccd726079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653808:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76e00/0xe984082ccd726079 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653812:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76e00/0xe984082ccd726079 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653827:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca76e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143696.653829:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76e00/0xe984082ccd726079 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653833:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76e00/0xe984082ccd726079 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653839:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012bf78000) 00010000:00010000:3.0:1746143696.653840:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143696.653842:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76e00/0xe984082ccd726079 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653847:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76e00/0xe984082ccd726079 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.653898:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd72606b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b82 expref: 13 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.653905:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd72606b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b82 expref: 13 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.653913:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca76a00, rc 0) 00000100:00100000:3.0:1746143696.653962:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28506:x1830963592325888:12345-192.168.202.48@tcp:101:cat.0 Request processed in 712us (986us total) trans 8589942429 rc 301/301 00000100:00100000:3.0:1746143696.653968:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8320 00000100:00100000:3.0:1746143696.654524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.654560:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.654651:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592326144 00000100:00100000:1.0:1746143696.654651:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592326016 00000100:00100000:1.0:1746143696.654655:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592326016 00000100:00100000:2.0:1746143696.654656:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592326144 00010000:00010000:2.0:1746143696.654679:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 27 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.654679:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 17 pid: 4582 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746143696.655460:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5042 00000100:00100000:1.0:1746143696.655468:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592326016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143696.655476:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5043 00010000:00010000:1.0:1746143696.655480:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143696.655481:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592326144:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.655488:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.655501:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 27 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.655502:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 17 pid: 4582 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.655511:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 27 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.655739:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 17 pid: 4582 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.655758:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e612600/0xe984082ccd725f3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [2846720->3719167] (req 2846720->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1af6 expref: 17 pid: 4582 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.655783:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143696.655964:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963592326016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 496us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.655971:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5042 00010000:00010000:2.0:1746143696.656237:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06dfa00/0xe984082ccd725ee3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3719168->18446744073709551615] (req 3719168->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ab7 expref: 27 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.656256:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.656258:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.656263:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.656271:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.656531:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.656568:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592326144:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1086us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.656575:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5043 00010000:00010000:1.0:1746143696.656628:0:6929:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.656636:0:6929:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.656659:0:6929:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.656665:0:6929:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.656677:0:6929:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.656683:0:6929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e613800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143696.656686:0:6929:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.656692:0:6929:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.656700:0:6929:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.656705:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e613800/0xe984082ccd726009 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143696.656741:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592322176:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 59391us (59965us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.656747:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9776 00000100:00100000:0.0:1746143696.658126:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.658658:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.658686:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.658710:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.658745:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.658800:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592327296 00000100:00100000:1.0:1746143696.658810:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592327296 00000100:00100000:1.0:1746143696.658857:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9783 00000100:00100000:1.0:1746143696.658865:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28503:x1830963592327296:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:2.0:1746143696.658879:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592326656 00000100:00100000:2.0:1746143696.658884:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592326656 00010000:00010000:1.0:1746143696.658884:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.658904:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b89 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143696.658916:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880136918380 x1830963592326656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.658925:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136918380 with x1830963592326656 ext(1048576->2097151) 00002000:00010000:1.0:1746143696.658927:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409d0, atime: 0x681409d0, ctime: 0x681409d0, blocks: 0x1029 00002000:00010000:2.0:1746143696.658929:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136918380 00000100:00100000:2.0:1746143696.658950:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592326400 00010000:00010000:1.0:1746143696.658950:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.658952:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143696.658953:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592326400 00010000:00010000:1.0:1746143696.658960:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2359296->2564095) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b89 expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143696.658969:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880136918700 x1830963592326400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746143696.658974:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2359296->2564095) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b89 expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143696.658982:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136918700 with x1830963592326400 ext(0->1048575) 00010000:00010000:1.0:1746143696.658984:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e32600, rc 0) 00002000:00010000:2.0:1746143696.658985:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136918700 00000100:00100000:2.0:1746143696.658996:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592326912 00000100:00100000:2.0:1746143696.658998:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592326912 00002000:00100000:2.0:1746143696.659007:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88013691aa00 x1830963592326912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.659013:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691aa00 with x1830963592326912 ext(1048576->2097151) 00002000:00010000:2.0:1746143696.659015:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013691aa00 00000100:00100000:1.0:1746143696.659020:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28503:x1830963592327296:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 156us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.659022:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592327168 00000100:00100000:2.0:1746143696.659023:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592327168 00000100:00100000:1.0:1746143696.659026:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9783 00002000:00100000:2.0:1746143696.659031:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880136919880 x1830963592327168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.659037:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919880 with x1830963592327168 ext(1048576->2097151) 00002000:00010000:2.0:1746143696.659039:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136919880 00000100:00100000:2.0:1746143696.659049:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3617 00000100:00100000:2.0:1746143696.659055:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592326656:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143696.659340:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3618 00000100:00100000:1.0:1746143696.659346:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963592326400:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143696.660831:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3619 00000100:00100000:2.0:1746143696.660839:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592326912:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143696.662733:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.662764:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592327424 00000100:00100000:0.0:1746143696.662773:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592327424 00000100:00100000:0.0:1746143696.662826:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8321 00000100:00100000:0.0:1746143696.662833:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28506:x1830963592327424:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143696.662853:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143696.662871:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009465c800/0xe984082ccd726095 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b90 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.662951:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009465ca00/0xe984082ccd72609c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.662965:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009465ca00/0xe984082ccd72609c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.662976:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009465ca00/0xe984082ccd72609c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:0.0:1746143696.662997:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:0.0:1746143696.663000:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143696.663013:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009465ca00/0xe984082ccd72609c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.663039:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009465c800/0xe984082ccd726095 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b90 expref: 14 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.663058:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009465ca00/0xe984082ccd72609c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b90 expref: 13 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.663065:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143696.663068:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143696.663071:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009465ca00, rc 0) 00000100:00100000:0.0:1746143696.663098:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28506:x1830963592327424:12345-192.168.202.48@tcp:101:cat.0 Request processed in 265us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.663103:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8321 00000100:00100000:2.0:1746143696.663109:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3620 00000100:00100000:2.0:1746143696.663117:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963592327168:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143696.675691:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.677740:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.677843:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592327808 00000100:00100000:3.0:1746143696.677853:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592327808 00010000:00010000:3.0:1746143696.677894:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.677928:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5044 00000100:00100000:3.0:1746143696.677936:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592327808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.677951:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.677976:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.677988:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.678013:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff92000/0xe984082ccd725f4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b04 expref: 16 pid: 4581 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.678036:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.678039:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.678044:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.678052:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.678075:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.678120:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592327808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 185us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.678127:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5044 00010000:00010000:3.0:1746143696.678190:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.678198:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.678219:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.678226:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.678233:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.678240:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e609c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143696.678244:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.678252:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.678261:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.678272:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e609c00/0xe984082ccd725ffb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.678316:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592322048:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 81671us (83339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.678323:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9774 00000100:00100000:1.0:1746143696.679032:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592327680 00000100:00100000:1.0:1746143696.679038:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592327680 00002000:00100000:1.0:1746143696.679078:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2560000->2564095) req@ffff880136918a80 x1830963592327680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.679086:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136918a80 with x1830963592327680 ext(2560000->2564095) 00002000:00010000:1.0:1746143696.679090:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136918a80 00000100:00100000:1.0:1746143696.679117:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3621 00000100:00100000:1.0:1746143696.679125:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592327680:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143696.679295:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592327680:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 170us (3616us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143696.679302:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3621 00002000:00100000:1.0:1746143696.679306:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2560000->2564095) req@ffff880136918a80 x1830963592327680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.679313:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136918a80 with x1830963592327680 ext(2560000->2564095) 00002000:00010000:1.0:1746143696.679315:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136918a80 00000100:00100000:0.0:1746143696.681376:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.681514:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.681539:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592328192 00000100:00100000:3.0:1746143696.681546:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592328192 00000100:00100000:3.0:1746143696.681595:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9784 00000100:00100000:3.0:1746143696.681602:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963592328192:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.681621:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.681640:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca76c00/0xe984082ccd7260a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b9e expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.681661:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.681663:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.681672:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca76c00/0xe984082ccd7260a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b9e expref: 16 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.681688:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca76c00/0xe984082ccd7260a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b9e expref: 16 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.681699:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca76c00, rc 0) 00000100:00100000:3.0:1746143696.683511:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592328192:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1899us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.683525:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9784 00000100:00100000:1.0:1746143696.683756:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592328064 00000100:00100000:1.0:1746143696.683763:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592328064 00000100:00100000:1.0:1746143696.683799:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8322 00000100:00100000:1.0:1746143696.683805:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28508:x1830963592328064:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143696.683833:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.683849:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32a00/0xe984082ccd7260aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1b97 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.683954:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32c00/0xe984082ccd7260b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.683967:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32c00/0xe984082ccd7260b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.683977:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32c00/0xe984082ccd7260b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.683989:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32e00/0xe984082ccd7260b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.683995:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32e00/0xe984082ccd7260b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684001:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32e00/0xe984082ccd7260b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684107:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e33000/0xe984082ccd7260bf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684115:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e33000/0xe984082ccd7260bf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684120:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e33000/0xe984082ccd7260bf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143696.684128:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143696.684222:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e33000/0xe984082ccd7260bf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684229:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e33000/0xe984082ccd7260bf lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684235:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e33000/0xe984082ccd7260bf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684241:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e33000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143696.684244:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e33000/0xe984082ccd7260bf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684251:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e33000/0xe984082ccd7260bf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684260:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143696.684263:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143696.684266:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e33000/0xe984082ccd7260bf lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684271:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e33000/0xe984082ccd7260bf lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684297:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32c00/0xe984082ccd7260b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684302:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32c00/0xe984082ccd7260b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684306:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32c00/0xe984082ccd7260b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684310:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e32c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143696.684312:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32c00/0xe984082ccd7260b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684316:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32c00/0xe984082ccd7260b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684321:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143696.684323:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143696.684325:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32c00/0xe984082ccd7260b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684329:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32c00/0xe984082ccd7260b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684334:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32e00/0xe984082ccd7260b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684338:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32e00/0xe984082ccd7260b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684342:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32e00/0xe984082ccd7260b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684346:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e32e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143696.684348:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32e00/0xe984082ccd7260b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684352:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32e00/0xe984082ccd7260b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684357:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094e98400) 00010000:00010000:1.0:1746143696.684358:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143696.684360:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32e00/0xe984082ccd7260b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684363:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32e00/0xe984082ccd7260b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143696.684398:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32a00/0xe984082ccd7260aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b97 expref: 15 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.684404:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e32a00/0xe984082ccd7260aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b97 expref: 15 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.684411:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e32a00, rc 0) 00000100:00100000:2.0:1746143696.685370:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592326656:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26310us (27245us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143696.685382:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3617 00002000:00100000:2.0:1746143696.685394:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880136918380 x1830963592326656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.685403:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136918380 with x1830963592326656 ext(1048576->2097151) 00002000:00010000:2.0:1746143696.685407:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136918380 00000100:00100000:2.0:1746143696.685653:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592326912:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24815us (26964us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143696.685658:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3619 00002000:00100000:2.0:1746143696.685664:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88013691aa00 x1830963592326912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.685671:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691aa00 with x1830963592326912 ext(1048576->2097151) 00002000:00010000:2.0:1746143696.685674:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013691aa00 00000100:00100000:1.0:1746143696.686427:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28508:x1830963592328064:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2619us (5057us total) trans 8589942430 rc 301/301 00000100:00100000:1.0:1746143696.686435:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8322 00000100:00100000:0.0:1746143696.690723:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.690758:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.690778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.690797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.690809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.690836:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.691389:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592328448 00000100:00100000:1.0:1746143696.691399:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592328448 00000100:00100000:1.0:1746143696.691439:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592328704 00000100:00100000:1.0:1746143696.691440:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592328704 00000100:00100000:1.0:1746143696.691450:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592328320 00000100:00100000:1.0:1746143696.691452:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592328320 00000100:00100000:1.0:1746143696.691460:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592328576 00000100:00100000:1.0:1746143696.691461:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592328576 00000100:00100000:1.0:1746143696.691471:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592328832 00000100:00100000:1.0:1746143696.691472:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592328832 00000100:00100000:1.0:1746143696.691486:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9785 00000100:00100000:1.0:1746143696.691493:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592328448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.691513:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.691531:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e33a00/0xe984082ccd7260cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1bac expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.691553:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.691555:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.691564:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e33a00/0xe984082ccd7260cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bac expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.691579:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e33a00/0xe984082ccd7260cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bac expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.691589:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e33a00, rc 0) 00000100:00100000:1.0:1746143696.691637:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592328448:12345-192.168.202.48@tcp:101:cat.0 Request processed in 144us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.691643:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9785 00000100:00100000:1.0:1746143696.691658:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9786 00000100:00100000:1.0:1746143696.691662:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592328704:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.691669:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143696.691674:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9787 00010000:00010000:1.0:1746143696.691680:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e32800/0xe984082ccd7260d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1bba expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.691691:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592328320:12345-192.168.202.48@tcp:101:cat.0 00002000:00010000:1.0:1746143696.691702:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 4897312, mtime: 0x681409d0, atime: 0x681409cf, ctime: 0x681409d0, blocks: 0x15a5 00010000:00010000:0.0:1746143696.691710:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.691713:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.691715:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.691718:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e32800/0xe984082ccd7260d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bba expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.691727:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e32800/0xe984082ccd7260d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bba expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.691730:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130638a00/0xe984082ccd7260db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ba5 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.691732:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e32800, rc 0) 00000100:00100000:1.0:1746143696.691743:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592328704:12345-192.168.202.48@tcp:101:cat.0 Request processed in 81us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.691748:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9786 00000100:00100000:1.0:1746143696.691756:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9788 00010000:00010000:0.0:1746143696.691756:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.691758:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143696.691760:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592328576:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.691764:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143696.691766:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130638a00/0xe984082ccd7260db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ba5 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.691768:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e33200/0xe984082ccd7260e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1bb3 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.691776:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.691777:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.691781:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e33200/0xe984082ccd7260e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bb3 expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.691783:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130638a00/0xe984082ccd7260db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ba5 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.691788:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e33200/0xe984082ccd7260e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bb3 expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.691793:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130638a00, rc 0) 00010000:00010000:1.0:1746143696.691794:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e33200, rc 0) 00000100:00100000:1.0:1746143696.691805:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592328576:12345-192.168.202.48@tcp:101:cat.0 Request processed in 45us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.691809:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9788 00000100:00100000:1.0:1746143696.691828:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9789 00000100:00100000:1.0:1746143696.691832:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592328832:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.691838:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.691843:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e33600/0xe984082ccd7260e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1bc1 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.691855:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592328320:12345-192.168.202.48@tcp:101:cat.0 Request processed in 169us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.691862:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9787 00000100:00100000:1.0:1746143696.691882:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593766656:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143696.694107:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143696.694650:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963592326400:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35297us (35985us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143696.694663:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3618 00002000:00100000:2.0:1746143696.694676:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880136918700 x1830963592326400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.694686:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136918700 with x1830963592326400 ext(0->1048575) 00002000:00010000:2.0:1746143696.694691:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136918700 00000100:00100000:2.0:1746143696.694726:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592329088 00000100:00100000:2.0:1746143696.694733:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592329088 00000100:00100000:2.0:1746143696.695257:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8323 00000100:00100000:2.0:1746143696.695265:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28498:x1830963592329088:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:2.0:1746143696.695315:0:21713:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.695343:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e609400/0xe984082ccd725f99 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b27 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.695375:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143696.695379:0:21713:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.695423:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28498:x1830963592329088:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 159us (4585us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746143696.695429:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8323 00000100:00100000:3.0:1746143696.700970:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592327168:12345-192.168.202.48@tcp:3:cat.0 Request processed in 37841us (42245us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143696.700982:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3620 00002000:00100000:3.0:1746143696.700993:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880136919880 x1830963592327168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.701003:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919880 with x1830963592327168 ext(1048576->2097151) 00002000:00010000:3.0:1746143696.701009:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136919880 00000100:00100000:0.0:1746143696.709673:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.709747:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592329344 00000100:00100000:2.0:1746143696.709757:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592329344 00000100:00100000:0.0:1746143696.709772:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.709813:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3391 00000100:00100000:2.0:1746143696.709828:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:28503:x1830963592329344:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143696.709986:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592329600 00000100:00100000:0.0:1746143696.709990:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592329600 00000100:00100000:0.0:1746143696.710015:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3392 00000100:00100000:0.0:1746143696.710020:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28498:x1830963592329600:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1746143696.710063:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:28503:x1830963592329344:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 235us (401us total) trans 8589942431 rc 0/0 00000100:00100000:2.0:1746143696.710069:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3391 00000100:00100000:0.0:1746143696.710105:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28498:x1830963592329600:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 84us (332us total) trans 8589942432 rc 0/0 00000100:00100000:0.0:1746143696.710111:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3392 00000100:00100000:1.0:1746143696.711231:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593766656:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143696.711265:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e33600/0xe984082ccd7260e9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc1 expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.711279:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e33600/0xe984082ccd7260e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc1 expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.711300:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e33600, rc 0) 00000100:00100000:1.0:1746143696.712348:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592328832:12345-192.168.202.48@tcp:101:cat.0 Request processed in 20509us (21532us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143696.712356:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9789 00000100:00100000:0.0:1746143696.715372:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.715565:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592329728 00000100:00100000:1.0:1746143696.715576:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592329728 00000100:00100000:1.0:1746143696.716786:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9790 00000100:00100000:1.0:1746143696.716800:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28508:x1830963592329728:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143696.716834:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.716856:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1bc8 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.716892:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0619000/0xe984082ccd72603a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b66 expref: 28 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.716900:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e33200/0xe984082ccd7260e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bb3 expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.716906:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.716908:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.716911:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1585152->1847295] (req 1585152->1847295) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.716944:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093e33200/0xe984082ccd7260e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bb3 expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.716955:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093e33200/0xe984082ccd7260e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bb3 expref: 19 pid: 6929 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746143696.716967:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593766784:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143696.717078:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0619000/0xe984082ccd72603a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b66 expref: 28 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.717086:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0619000/0xe984082ccd72603a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b66 expref: 28 pid: 21542 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746143696.717098:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593766912:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143696.717118:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143696.720256:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.720669:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592329984 00000100:00100000:1.0:1746143696.720681:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592329984 00000100:00100000:1.0:1746143696.721034:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3393 00000100:00100000:1.0:1746143696.721043:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28498:x1830963592329984:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:1.0:1746143696.724956:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28498:x1830963592329984:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 3903us (4699us total) trans 8589942433 rc 0/0 00000100:00100000:1.0:1746143696.724969:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3393 00000100:00100000:1.0:1746143696.729551:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593766784:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143696.729563:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593766912:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143696.729595:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1585152->1847295] (req 1585152->1847295) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.729615:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e33c00, rc 0) 00000100:00100000:1.0:1746143696.729662:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28508:x1830963592329728:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 12866us (14300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.729670:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9790 00000100:00100000:0.0:1746143696.730976:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.731015:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.731089:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592330112 00000100:00100000:2.0:1746143696.731098:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592330112 00010000:00010000:2.0:1746143696.731129:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093e33200/0xe984082ccd7260e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bb3 expref: 19 pid: 6929 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746143696.731182:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592330240 00000100:00100000:2.0:1746143696.731184:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592330240 00010000:00010000:2.0:1746143696.731196:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0619000/0xe984082ccd72603a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b66 expref: 29 pid: 21542 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746143696.731211:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5045 00000100:00100000:2.0:1746143696.731217:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592330112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.731232:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.731258:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e33200/0xe984082ccd7260e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bb3 expref: 19 pid: 6929 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.731268:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e33200/0xe984082ccd7260e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bb3 expref: 19 pid: 6929 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.731290:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e33200/0xe984082ccd7260e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bb3 expref: 19 pid: 6929 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.731318:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.731347:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592330112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 129us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.731352:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5045 00000100:00100000:2.0:1746143696.731366:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5046 00000100:00100000:2.0:1746143696.731371:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592330240:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.731378:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.731386:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0619000/0xe984082ccd72603a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b66 expref: 29 pid: 21542 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.731395:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0619000/0xe984082ccd72603a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b66 expref: 29 pid: 21542 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.731406:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0619000/0xe984082ccd72603a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b66 expref: 29 pid: 21542 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.731415:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.731417:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.731424:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.731431:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.731462:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143696.731474:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593767040:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143696.731530:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143696.742860:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.742901:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.742926:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.742957:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.743046:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592331136 00000100:00100000:1.0:1746143696.743056:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592331136 00000100:00100000:1.0:1746143696.743104:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9791 00000100:00100000:1.0:1746143696.743111:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28501:x1830963592331136:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.743132:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.743175:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e32a00/0xe984082ccd7260f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1bcf expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.743204:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.743206:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.743214:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e32a00/0xe984082ccd7260f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bcf expref: 30 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.743229:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e32a00/0xe984082ccd7260f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bcf expref: 30 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.743239:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e32a00, rc 0) 00000100:00100000:1.0:1746143696.743287:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28501:x1830963592331136:12345-192.168.202.48@tcp:101:cat.0 Request processed in 177us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.743293:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9791 00000100:00100000:3.0:1746143696.743362:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592330496 00000100:00100000:3.0:1746143696.743366:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592330496 00002000:00100000:3.0:1746143696.743397:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008f0afb80 x1830963592330496/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.743406:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0afb80 with x1830963592330496 ext(0->1048575) 00002000:00010000:3.0:1746143696.743411:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0afb80 00000100:00100000:3.0:1746143696.743429:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592330752 00000100:00100000:3.0:1746143696.743431:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592330752 00002000:00100000:3.0:1746143696.743445:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008f0ace00 x1830963592330752/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.743452:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ace00 with x1830963592330752 ext(1048576->2097151) 00002000:00010000:3.0:1746143696.743455:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ace00 00000100:00100000:3.0:1746143696.743463:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592330880 00000100:00100000:3.0:1746143696.743465:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592330880 00002000:00100000:3.0:1746143696.743472:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88008f0aea00 x1830963592330880/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.743478:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0aea00 with x1830963592330880 ext(1048576->2097151) 00002000:00010000:3.0:1746143696.743481:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0aea00 00000100:00100000:3.0:1746143696.743489:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3622 00000100:00100000:3.0:1746143696.743494:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592330496:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143696.745232:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3623 00000100:00100000:2.0:1746143696.745246:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592330752:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143696.746591:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3624 00000100:00100000:2.0:1746143696.746600:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592330880:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143696.752315:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593767040:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143696.752340:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.755163:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592330240:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 23766us (24122us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.755177:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5046 00000100:00100000:1.0:1746143696.755408:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.755619:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592331392 00000100:00100000:2.0:1746143696.755627:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592331392 00002000:00100000:2.0:1746143696.755667:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1585152->1589247) req@ffff88009bfe1180 x1830963592331392/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.755676:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1180 with x1830963592331392 ext(1585152->1589247) 00002000:00010000:2.0:1746143696.755682:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1180 00000100:00100000:2.0:1746143696.755697:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3625 00000100:00100000:2.0:1746143696.755704:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592331392:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143696.756070:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592331392:12345-192.168.202.48@tcp:3:cat.0 Request processed in 365us (662us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143696.756077:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3625 00002000:00100000:2.0:1746143696.756082:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1585152->1589247) req@ffff88009bfe1180 x1830963592331392/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.756089:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1180 with x1830963592331392 ext(1585152->1589247) 00002000:00010000:2.0:1746143696.756091:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1180 00000100:00100000:2.0:1746143696.760726:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592330496:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17217us (17865us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143696.760740:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3622 00002000:00100000:2.0:1746143696.760754:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008f0afb80 x1830963592330496/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.760764:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0afb80 with x1830963592330496 ext(0->1048575) 00002000:00010000:2.0:1746143696.760770:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0afb80 00000100:00100000:0.0:1746143696.763041:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.763075:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.763092:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.763162:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.763170:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592331776 00000100:00100000:1.0:1746143696.763181:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592331776 00000100:00100000:2.0:1746143696.763545:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592330752:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18302us (20641us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143696.763556:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3623 00002000:00100000:2.0:1746143696.763567:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88008f0ace00 x1830963592330752/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.763576:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ace00 with x1830963592330752 ext(1048576->2097151) 00002000:00010000:2.0:1746143696.763582:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ace00 00000100:00100000:2.0:1746143696.763613:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592331904 00000100:00100000:2.0:1746143696.763616:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592331904 00002000:00100000:2.0:1746143696.763642:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f0adc00 x1830963592331904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.763649:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0adc00 with x1830963592331904 ext(3145728->4194303) 00002000:00010000:2.0:1746143696.763652:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0adc00 00000100:00100000:2.0:1746143696.763664:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592332288 00000100:00100000:2.0:1746143696.763666:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592332288 00002000:00100000:2.0:1746143696.763676:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3350528->4194303) req@ffff8800a63a2d80 x1830963592332288/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.763682:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2d80 with x1830963592332288 ext(3350528->4194303) 00002000:00010000:2.0:1746143696.763684:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a63a2d80 00000100:00100000:2.0:1746143696.763691:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592332160 00000100:00100000:2.0:1746143696.763692:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592332160 00002000:00100000:2.0:1746143696.763700:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3350527) req@ffff8800a63a2300 x1830963592332160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 504/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.763705:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2300 with x1830963592332160 ext(2097152->3350527) 00002000:00010000:2.0:1746143696.763707:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a63a2300 00000100:00100000:2.0:1746143696.763725:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3626 00000100:00100000:2.0:1746143696.763732:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963592331904:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143696.765065:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3627 00000100:00100000:2.0:1746143696.765074:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592332288:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:1.0:1746143696.766111:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f0ae300 x1830963592331776/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.766122:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae300 with x1830963592331776 ext(2097152->3145727) 00002000:00010000:1.0:1746143696.766127:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ae300 00000100:00100000:1.0:1746143696.766161:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3628 00000100:00100000:1.0:1746143696.766169:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592332160:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143696.767376:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3629 00000100:00100000:1.0:1746143696.767383:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592331776:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143696.779641:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592330880:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33029us (36700us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143696.779655:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3624 00002000:00100000:3.0:1746143696.779669:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88008f0aea00 x1830963592330880/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.779679:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0aea00 with x1830963592330880 ext(1048576->2097151) 00002000:00010000:3.0:1746143696.779685:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0aea00 00000100:00100000:0.0:1746143696.780229:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.781403:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592332672 00000100:00100000:3.0:1746143696.781415:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592332672 00002000:00100000:3.0:1746143696.781458:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff8800a63a3480 x1830963592332672/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 504/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.781468:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a3480 with x1830963592332672 ext(1048576->2097151) 00002000:00010000:3.0:1746143696.781473:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a3480 00000100:00100000:3.0:1746143696.781504:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3630 00000100:00100000:3.0:1746143696.781512:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592332672:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143696.789787:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592331904:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26048us (26703us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143696.789800:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3626 00002000:00100000:2.0:1746143696.789808:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f0adc00 x1830963592331904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.789824:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0adc00 with x1830963592331904 ext(3145728->4194303) 00002000:00010000:2.0:1746143696.789829:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0adc00 00000100:00100000:2.0:1746143696.795710:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592332160:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29530us (32535us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143696.795721:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3628 00002000:00100000:2.0:1746143696.795733:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3350527) req@ffff8800a63a2300 x1830963592332160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 504/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.795742:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2300 with x1830963592332160 ext(2097152->3350527) 00002000:00010000:2.0:1746143696.795749:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a63a2300 00000100:00100000:1.0:1746143696.798450:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592331776:12345-192.168.202.48@tcp:3:cat.0 Request processed in 31056us (35408us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143696.798464:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3629 00002000:00100000:1.0:1746143696.798477:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88008f0ae300 x1830963592331776/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.798487:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae300 with x1830963592331776 ext(2097152->3145727) 00002000:00010000:1.0:1746143696.798493:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ae300 00000100:00100000:3.0:1746143696.800037:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592332288:12345-192.168.202.48@tcp:3:cat.0 Request processed in 34957us (36936us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746143696.800047:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3627 00002000:00100000:3.0:1746143696.800055:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3350528->4194303) req@ffff8800a63a2d80 x1830963592332288/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.800069:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2d80 with x1830963592332288 ext(3350528->4194303) 00002000:00010000:3.0:1746143696.800074:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a63a2d80 00000100:00100000:3.0:1746143696.804677:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592332672:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23153us (24438us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746143696.804689:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3630 00002000:00100000:3.0:1746143696.804702:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff8800a63a3480 x1830963592332672/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 504/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.804710:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a3480 with x1830963592332672 ext(1048576->2097151) 00002000:00010000:3.0:1746143696.804716:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a3480 00000100:00100000:0.0:1746143696.813649:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.813734:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592332928 00000100:00100000:1.0:1746143696.813746:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592332928 00000100:00100000:1.0:1746143696.813811:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3394 00000100:00100000:1.0:1746143696.813829:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28508:x1830963592332928:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143696.814833:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28508:x1830963592332928:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 1002us (1193us total) trans 8589942434 rc 0/0 00000100:00100000:1.0:1746143696.814841:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3394 00000100:00100000:1.0:1746143696.816228:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.816292:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592333184 00000100:00100000:3.0:1746143696.816299:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592333184 00000100:00100000:1.0:1746143696.816313:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:3.0:1746143696.816339:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009bfe2d80 x1830963592333184/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.816349:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2d80 with x1830963592333184 ext(2097152->3145727) 00002000:00010000:3.0:1746143696.816354:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2d80 00000100:00100000:0.0:1746143696.816517:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592333312 00000100:00100000:0.0:1746143696.816522:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592333312 00000100:00100000:0.0:1746143696.816556:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9792 00000100:00100000:0.0:1746143696.816562:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592333312:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143696.816575:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143696.816592:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdc4800/0xe984082ccd7260fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1bd6 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.816602:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3631 00000100:00100000:3.0:1746143696.816609:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592333184:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143696.816641:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593767168:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143696.816706:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00002000:00010000:0.0:1746143696.822600:0:15784:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143695 -> 1746143696 00002000:00010000:0.0:1746143696.822609:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143695 -> 1746143696 00002000:00010000:0.0:1746143696.822611:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143695 -> 1746143696 00000100:00100000:0.0:1746143696.822636:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593767168:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143696.822668:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdc4800/0xe984082ccd7260fe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bd6 expref: 30 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.822688:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdc4800/0xe984082ccd7260fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bd6 expref: 30 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.822713:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdc4800, rc 0) 00000100:00100000:0.0:1746143696.822760:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592333312:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6196us (6444us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143696.822768:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9792 00000100:00100000:3.0:1746143696.826765:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592333184:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10141us (10527us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143696.826779:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3631 00002000:00100000:3.0:1746143696.826793:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009bfe2d80 x1830963592333184/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.826803:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2d80 with x1830963592333184 ext(2097152->3145727) 00002000:00010000:3.0:1746143696.826810:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2d80 00000100:00100000:0.0:1746143696.836427:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.836479:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.837109:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592333568 00000100:00100000:3.0:1746143696.837119:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592333568 00000100:00100000:2.0:1746143696.837165:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592333696 00000100:00100000:2.0:1746143696.837170:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592333696 00002000:00100000:3.0:1746143696.837194:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a63a0380 x1830963592333568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.837204:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a0380 with x1830963592333568 ext(4194304->4898815) 00002000:00010000:3.0:1746143696.837209:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a0380 00000100:00100000:2.0:1746143696.837217:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9793 00000100:00100000:3.0:1746143696.837222:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3632 00000100:00100000:2.0:1746143696.837225:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28506:x1830963592333696:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143696.837226:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592333568:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:2.0:1746143696.837240:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.837258:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb4c400/0xe984082ccd726105 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1bdd expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.837286:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2564095) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b89 expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.837293:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143696.837296:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143696.837299:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb4c400/0xe984082ccd726105 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bdd expref: 19 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.837328:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2564095) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b89 expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.837340:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2564095) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b89 expref: 26 pid: 6929 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.837353:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593767296:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.837430:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143696.844067:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593767296:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.844100:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb4c400/0xe984082ccd726105 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bdd expref: 19 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.844100:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143696.844118:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb4c400, rc 0) 00000100:00100000:2.0:1746143696.844195:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28506:x1830963592333696:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6970us (7777us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.844203:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9793 00000100:00100000:2.0:1746143696.844238:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592333824 00000100:00100000:2.0:1746143696.844245:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592333824 00002000:00100000:2.0:1746143696.844277:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2359296->2564095) req@ffff8800a63a1180 x1830963592333824/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.844285:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a1180 with x1830963592333824 ext(2359296->2564095) 00010000:00010000:2.0:1746143696.844291:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2564095) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b89 expref: 27 pid: 6929 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.844304:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2564095) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b89 expref: 27 pid: 6929 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746143696.844310:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a63a1180 00000100:00100000:2.0:1746143696.844339:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 887 00000100:00100000:2.0:1746143696.844346:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592333824:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143696.844441:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592333568:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7213us (7960us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143696.844448:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3632 00002000:00100000:3.0:1746143696.844455:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a63a0380 x1830963592333568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143696.844462:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a0380 with x1830963592333568 ext(4194304->4898815) 00002000:00010000:3.0:1746143696.844465:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a0380 00000100:00100000:0.0:1746143696.849504:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.849545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.850468:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592334080 00000100:00100000:3.0:1746143696.850478:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592334080 00000100:00100000:3.0:1746143696.850514:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592333952 00000100:00100000:3.0:1746143696.850515:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592333952 00000100:00100000:3.0:1746143696.850534:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9794 00000100:00100000:3.0:1746143696.850542:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592334080:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.850560:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.850577:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca77e00/0xe984082ccd72610c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1beb expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.850592:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9795 00000100:00100000:0.0:1746143696.850600:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592333952:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143696.850609:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143696.850620:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdc5c00/0xe984082ccd726113 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1be4 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.850634:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593767424:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143696.850650:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593767552:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143696.850725:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143696.850725:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143696.850787:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592333824:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6438us (6686us total) trans 21474839764 rc 0/0 00000100:00100000:2.0:1746143696.850797:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 887 00002000:00100000:2.0:1746143696.850806:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2359296->2564095) req@ffff8800a63a1180 x1830963592333824/t21474839764(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:92/0 lens 488/448 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.850832:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a1180 with x1830963592333824 ext(2359296->2564095) 00010000:00010000:2.0:1746143696.850838:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->2564095) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b89 expref: 31 pid: 6929 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.850851:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->2564095) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b89 expref: 31 pid: 6929 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746143696.850857:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a63a1180 00000100:00100000:3.0:1746143696.853905:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593767424:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143696.853917:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593767552:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143696.853942:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdc5c00/0xe984082ccd726113 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1be4 expref: 30 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.853943:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca77e00/0xe984082ccd72610c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1beb expref: 30 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.853955:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca77e00/0xe984082ccd72610c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1beb expref: 30 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.853955:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdc5c00/0xe984082ccd726113 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1be4 expref: 30 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.853981:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca77e00, rc 0) 00010000:00010000:1.0:1746143696.853982:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdc5c00, rc 0) 00000100:00100000:1.0:1746143696.854022:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592333952:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3423us (4476us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143696.854030:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9795 00000100:00100000:3.0:1746143696.854213:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592334080:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3671us (4718us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143696.854218:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9794 00000100:00100000:0.0:1746143696.860654:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.860994:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592334208 00000100:00100000:2.0:1746143696.861005:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592334208 00010000:00010000:2.0:1746143696.861050:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2359296->2564095) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b89 expref: 29 pid: 6929 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.861094:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5047 00000100:00100000:2.0:1746143696.861103:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592334208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.861121:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.861167:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->2564095) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b89 expref: 29 pid: 6929 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.861180:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->2564095) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b89 expref: 29 pid: 6929 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.861205:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e32600/0xe984082ccd72608e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2359296->2564095) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b89 expref: 29 pid: 6929 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.861242:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.861244:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.861253:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb4c400/0xe984082ccd726105 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bdd expref: 18 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.861261:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb4c400/0xe984082ccd726105 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bdd expref: 18 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.861295:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb4c400/0xe984082ccd726105 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bdd expref: 18 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143696.861308:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593767680:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143696.861403:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143696.864419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.868176:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.868602:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592334464 00000100:00100000:0.0:1746143696.868711:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592334336 00000100:00100000:0.0:1746143696.868722:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592334336 00000100:00100000:0.0:1746143696.868832:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8324 00000100:00100000:0.0:1746143696.868840:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28513:x1830963592334336:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:3.0:1746143696.868858:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592334464 00010000:00010000:0.0:1746143696.868867:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143696.868885:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5800/0xe984082ccd72611a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1bf2 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.868887:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9796 00000100:00100000:3.0:1746143696.868893:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592334464:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.868902:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.868912:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca77800/0xe984082ccd726121 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1bf9 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.868944:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5200/0xe984082ccd726128 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.868956:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5200/0xe984082ccd726128 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00000100:00100000:3.0:1746143696.868961:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593767808:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143696.868966:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5200/0xe984082ccd726128 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.868977:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5000/0xe984082ccd72612f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.868981:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5000/0xe984082ccd72612f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.868986:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5000/0xe984082ccd72612f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:3.0:1746143696.869044:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa99c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143696.869092:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc4e00/0xe984082ccd726136 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869098:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc4e00/0xe984082ccd726136 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869102:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc4e00/0xe984082ccd726136 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:0.0:1746143696.869129:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:0.0:1746143696.869133:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143696.869162:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc4e00/0xe984082ccd726136 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869170:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc4e00/0xe984082ccd726136 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869176:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5200/0xe984082ccd726128 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869181:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5200/0xe984082ccd726128 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869187:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5200/0xe984082ccd726128 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869192:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bdc5200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143696.869195:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5200/0xe984082ccd726128 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869200:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5200/0xe984082ccd726128 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869208:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143696.869210:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143696.869213:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5200/0xe984082ccd726128 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869217:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5200/0xe984082ccd726128 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869234:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5000/0xe984082ccd72612f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869237:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5000/0xe984082ccd72612f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869241:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5000/0xe984082ccd72612f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869246:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bdc5000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143696.869248:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5000/0xe984082ccd72612f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869252:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5000/0xe984082ccd72612f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869256:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094e98400) 00010000:00010000:0.0:1746143696.869257:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143696.869259:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5000/0xe984082ccd72612f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869262:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5000/0xe984082ccd72612f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.869284:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc5800/0xe984082ccd72611a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bf2 expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.869292:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc4e00/0xe984082ccd726136 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bf2 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.869296:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143696.869298:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143696.869300:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdc4e00, rc 0) 00000100:00100000:0.0:1746143696.869325:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28513:x1830963592334336:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 486us (4919us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.869331:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8324 00000100:00100000:2.0:1746143696.869417:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593767680:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143696.869431:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.869448:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592334208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8348us (8806us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.869455:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5047 00000100:00100000:2.0:1746143696.872157:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.872676:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593767808:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143696.872705:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca77800/0xe984082ccd726121 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bf9 expref: 30 pid: 15784 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143696.873239:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592334592 00000100:00100000:1.0:1746143696.873246:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592334592 00000100:00100000:1.0:1746143696.873296:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9797 00000100:00100000:1.0:1746143696.873303:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592334592:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.873320:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.873334:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e33400/0xe984082ccd72613d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c00 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.873354:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.873355:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.873363:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e33400/0xe984082ccd72613d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c00 expref: 29 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.873376:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e33400/0xe984082ccd72613d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c00 expref: 29 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.873384:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e33400, rc 0) 00000100:00100000:1.0:1746143696.873434:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592334592:12345-192.168.202.48@tcp:101:cat.0 Request processed in 131us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.873439:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9797 00010000:00010000:3.0:1746143696.873494:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca77800/0xe984082ccd726121 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bf9 expref: 30 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.873510:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca77800, rc 0) 00000100:00100000:3.0:1746143696.873531:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592334464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4638us (5364us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143696.873537:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9796 00000100:00100000:0.0:1746143696.878525:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.878562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.878586:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.878609:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.878624:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.878635:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.878652:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.878664:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.878677:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592334720 00000100:00100000:3.0:1746143696.878687:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592334720 00000100:00100000:0.0:1746143696.878696:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.878727:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592334848 00000100:00100000:3.0:1746143696.878729:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592334848 00000100:00100000:3.0:1746143696.878741:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592334976 00000100:00100000:3.0:1746143696.878743:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592334976 00000100:00100000:3.0:1746143696.878760:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592335360 00000100:00100000:3.0:1746143696.878762:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592335360 00000100:00100000:1.0:1746143696.878846:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592335488 00000100:00100000:1.0:1746143696.878850:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592335488 00000100:00100000:1.0:1746143696.878869:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592335616 00000100:00100000:1.0:1746143696.878871:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592335616 00000100:00100000:1.0:1746143696.878886:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9798 00000100:00100000:1.0:1746143696.878894:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592334720:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143696.878913:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.878930:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e32400/0xe984082ccd726144 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c07 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.878956:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.878958:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.878967:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e32400/0xe984082ccd726144 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c07 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.878983:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e32400/0xe984082ccd726144 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c07 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.878994:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e32400, rc 0) 00000100:00100000:1.0:1746143696.879074:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592334720:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 180us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.879080:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9798 00000100:00100000:1.0:1746143696.879109:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9799 00000100:00100000:1.0:1746143696.879114:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592334848:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143696.879121:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.879131:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e33e00/0xe984082ccd72614b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c0e expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.879169:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.879171:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.879175:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e33e00/0xe984082ccd72614b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c0e expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.879190:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e33e00/0xe984082ccd72614b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c0e expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.879197:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e33e00, rc 0) 00000100:00100000:1.0:1746143696.879214:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592334848:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 100us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.879218:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9799 00000100:00100000:1.0:1746143696.879229:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9800 00000100:00100000:1.0:1746143696.879233:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592334976:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143696.879239:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.879245:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e32e00/0xe984082ccd726152 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c15 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.879254:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.879255:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.879259:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e32e00/0xe984082ccd726152 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c15 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.879266:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e32e00/0xe984082ccd726152 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c15 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.879272:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e32e00, rc 0) 00000100:00100000:1.0:1746143696.879285:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592334976:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 52us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.879290:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9800 00000100:00100000:3.0:1746143696.879303:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9801 00000100:00100000:3.0:1746143696.879310:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592335360:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:1.0:1746143696.879312:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9802 00010000:00010000:3.0:1746143696.879317:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143696.879317:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592335488:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143696.879323:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.879325:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca76a00/0xe984082ccd726159 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c1c expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.879330:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e33800/0xe984082ccd726160 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c23 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.879339:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.879340:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.879344:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e33800/0xe984082ccd726160 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c23 expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.879352:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e33800/0xe984082ccd726160 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c23 expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143696.879353:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9803 00010000:00010000:1.0:1746143696.879358:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e33800, rc 0) 00000100:00100000:2.0:1746143696.879362:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592335616:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:3.0:1746143696.879366:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593767936:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143696.879369:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143696.879373:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1965:x1830963592335488:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 56us (749us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143696.879377:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a034ac00/0xe984082ccd726167 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c2a expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143696.879378:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9802 00010000:00010000:2.0:1746143696.879388:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.879390:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.879395:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034ac00/0xe984082ccd726167 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c2a expref: 12 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143696.879397:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592335232 00000100:00100000:1.0:1746143696.879400:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592335232 00010000:00010000:2.0:1746143696.879404:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a034ac00/0xe984082ccd726167 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c2a expref: 12 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.879410:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034ac00, rc 0) 00000100:00100000:3.0:1746143696.879423:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa99c0 going to sleep for 11 seconds 00002000:00100000:1.0:1746143696.879424:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880094304e00 x1830963592335232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143696.879429:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592335616:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 69us (792us total) trans 0 rc 0/0 00002000:00100000:1.0:1746143696.879432:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304e00 with x1830963592335232 ext(2097152->3145727) 00000100:00100000:2.0:1746143696.879434:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9803 00002000:00010000:1.0:1746143696.879436:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304e00 00000100:00100000:1.0:1746143696.879672:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592335872 00000100:00100000:3.0:1746143696.879673:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592336128 00000100:00100000:1.0:1746143696.879675:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592335872 00000100:00100000:3.0:1746143696.879677:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592336128 00002000:00100000:1.0:1746143696.879689:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880094304700 x1830963592335872/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.879696:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304700 with x1830963592335872 ext(3145728->4194303) 00002000:00100000:3.0:1746143696.879697:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880094305180 x1830963592336128/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746143696.879699:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304700 00002000:00100000:3.0:1746143696.879704:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305180 with x1830963592336128 ext(3145728->4194303) 00002000:00010000:3.0:1746143696.879707:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305180 00000100:00100000:1.0:1746143696.879715:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3633 00000100:00100000:1.0:1746143696.879720:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592335232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143696.879728:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3634 00000100:00100000:3.0:1746143696.879734:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592335872:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143696.879769:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3635 00000100:00100000:1.0:1746143696.879773:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592336128:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143696.885543:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593767936:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143696.885580:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca76a00/0xe984082ccd726159 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c1c expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.885597:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca76a00/0xe984082ccd726159 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c1c expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.885624:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca76a00, rc 0) 00000100:00100000:3.0:1746143696.885664:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592335360:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 6353us (7053us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143696.885673:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9801 00000100:00100000:2.0:1746143696.891599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.892130:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592336384 00000100:00100000:1.0:1746143696.892175:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592336384 00000100:00100000:1.0:1746143696.892237:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3395 00000100:00100000:1.0:1746143696.892246:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:28501:x1830963592336384:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1746143696.894537:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:28501:x1830963592336384:12345-192.168.202.48@tcp:35:cat.0 Request processed in 2284us (2949us total) trans 8589942435 rc 0/0 00000100:00100000:0.0:1746143696.894548:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3395 00000100:00100000:2.0:1746143696.899264:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.899328:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592336640 00000100:00100000:3.0:1746143696.899338:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592336640 00000100:00100000:3.0:1746143696.899395:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8325 00000100:00100000:3.0:1746143696.899404:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:28513:x1830963592336640:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143696.899425:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.899444:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76800/0xe984082ccd72616e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c31 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.899548:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.899562:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619600/0xe984082ccd726017 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b4a expref: 250 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.899570:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009465ca00/0xe984082ccd72609c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b90 expref: 14 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.899577:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc4e00/0xe984082ccd726136 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bf2 expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.899582:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.899615:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc4e00/0xe984082ccd726136 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bf2 expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.899627:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc4e00/0xe984082ccd726136 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bf2 expref: 12 pid: 16090 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.899639:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593768064:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.899742:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009465ca00/0xe984082ccd72609c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b90 expref: 14 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.899755:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009465ca00/0xe984082ccd72609c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b90 expref: 14 pid: 16090 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.899771:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593768192:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.899799:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619600/0xe984082ccd726017 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b4a expref: 250 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.899806:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619600/0xe984082ccd726017 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b4a expref: 250 pid: 21713 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.899824:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593768320:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.899861:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143696.902623:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592336128:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22836us (23913us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143696.902634:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3635 00002000:00100000:0.0:1746143696.902646:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880094305180 x1830963592336128/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143696.902655:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305180 with x1830963592336128 ext(3145728->4194303) 00002000:00010000:0.0:1746143696.902661:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305180 00000100:00100000:2.0:1746143696.903259:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592335872:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23523us (24592us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143696.903266:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3634 00002000:00100000:2.0:1746143696.903272:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880094304700 x1830963592335872/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.903279:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304700 with x1830963592335872 ext(3145728->4194303) 00002000:00010000:2.0:1746143696.903283:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304700 00000100:00100000:0.0:1746143696.906119:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.906559:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593768064:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.906572:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593768192:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.906580:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f185880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593768320:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.906613:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:2.0:1746143696.907748:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592336768 00000100:00100000:2.0:1746143696.907757:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592336768 00010000:00010000:2.0:1746143696.907799:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc4e00/0xe984082ccd726136 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bf2 expref: 13 pid: 16090 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.907840:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5048 00000100:00100000:2.0:1746143696.907847:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963592336768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143696.907865:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.907870:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc4e00/0xe984082ccd726136 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bf2 expref: 13 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.907880:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc4e00/0xe984082ccd726136 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bf2 expref: 13 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.907901:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bdc4e00/0xe984082ccd726136 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bf2 expref: 13 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.907931:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143696.907935:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.907943:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143696.907947:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.907994:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592336768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 148us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.908001:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5048 00000100:00100000:3.0:1746143696.908128:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.908251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.908266:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592336896 00000100:00100000:3.0:1746143696.908270:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592336896 00010000:00010000:3.0:1746143696.908284:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009465ca00/0xe984082ccd72609c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b90 expref: 15 pid: 16090 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.908296:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592337024 00000100:00100000:3.0:1746143696.908298:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592337024 00010000:00010000:3.0:1746143696.908306:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619600/0xe984082ccd726017 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b4a expref: 251 pid: 21713 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.908318:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5049 00000100:00100000:3.0:1746143696.908323:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592336896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.908330:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.908333:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009465ca00/0xe984082ccd72609c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b90 expref: 15 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.908340:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009465ca00/0xe984082ccd72609c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b90 expref: 15 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.908351:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009465ca00/0xe984082ccd72609c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b90 expref: 15 pid: 16090 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.908362:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143696.908365:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.908370:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.908374:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.908392:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592336896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 68us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.908396:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5049 00000100:00100000:3.0:1746143696.908420:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5050 00000100:00100000:3.0:1746143696.908424:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1963:x1830963592337024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.908431:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.908434:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619600/0xe984082ccd726017 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b4a expref: 251 pid: 21713 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.908441:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619600/0xe984082ccd726017 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b4a expref: 251 pid: 21713 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.908451:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0619600/0xe984082ccd726017 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b4a expref: 251 pid: 21713 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.908460:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143696.908463:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.908469:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.908476:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.908491:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.908505:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:1963:x1830963592337024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.908509:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5050 00010000:00010000:3.0:1746143696.908532:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.908537:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143696.908556:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143696.908698:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76800/0xe984082ccd72616e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c31 expref: 13 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.908716:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c31 expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.908722:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143696.908724:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143696.908726:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca76600, rc 0) 00000100:00100000:3.0:1746143696.908746:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28513:x1830963592336640:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 9344us (9495us total) trans 8589942436 rc 0/0 00000100:00100000:3.0:1746143696.908752:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8325 00000100:00100000:0.0:1746143696.909605:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592335232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29881us (30948us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143696.909612:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3633 00002000:00100000:0.0:1746143696.909620:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880094304e00 x1830963592335232/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143696.909628:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304e00 with x1830963592335232 ext(2097152->3145727) 00002000:00010000:0.0:1746143696.909633:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304e00 00000100:00100000:0.0:1746143696.910403:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.910794:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592337280 00000100:00100000:2.0:1746143696.910801:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592337280 00000100:00100000:3.0:1746143696.911773:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8326 00000100:00100000:3.0:1746143696.911784:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28513:x1830963592337280:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143696.911807:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.911810:0:21713:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143696.911848:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76600/0xe984082ccd726175 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c31 expref: 12 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.911873:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143696.911878:0:21713:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143696.911889:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76e00/0xe984082ccd726183 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c38 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.911977:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77600/0xe984082ccd72618a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.911989:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77600/0xe984082ccd72618a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143696.912001:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77600/0xe984082ccd72618a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143696.912011:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143696.912108:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76e00/0xe984082ccd726183 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c38 expref: 14 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.912121:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77600/0xe984082ccd72618a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c38 expref: 13 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.912127:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143696.912130:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143696.912132:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca77600, rc 0) 00000100:00100000:2.0:1746143696.912410:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28513:x1830963592337280:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 627us (2006us total) trans 8589942437 rc 0/0 00000100:00100000:2.0:1746143696.912417:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8326 00000100:00100000:0.0:1746143696.917832:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.917895:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592337408 00000100:00100000:2.0:1746143696.917907:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592337408 00000100:00100000:2.0:1746143696.917969:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8327 00000100:00100000:2.0:1746143696.917977:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28513:x1830963592337408:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143696.918004:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.918024:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5600/0xe984082ccd726198 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c3f expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.918085:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5600/0xe984082ccd726198 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c3f expref: 14 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.918099:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5600/0xe984082ccd726198 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c3f expref: 14 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.918117:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143696.918120:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143696.918124:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc5600, rc 0) 00000100:00100000:2.0:1746143696.918211:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:28513:x1830963592337408:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 234us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.918218:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8327 00000100:00100000:0.0:1746143696.921995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.922103:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592337664 00000100:00100000:2.0:1746143696.922112:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592337664 00002000:00100000:2.0:1746143696.922186:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094305c00 x1830963592337664/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.922196:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305c00 with x1830963592337664 ext(4194304->4898815) 00000100:00100000:0.0:1746143696.922197:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:2.0:1746143696.922202:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305c00 00000100:00100000:2.0:1746143696.922228:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3636 00000100:00100000:2.0:1746143696.922236:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592337664:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143696.922291:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592337792 00000100:00100000:3.0:1746143696.922296:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592337792 00000100:00100000:3.0:1746143696.922356:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9804 00000100:00100000:3.0:1746143696.922362:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592337792:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143696.922507:0:8496:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.922526:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c068600/0xe984082ccd72601e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b51 expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.922534:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e32400/0xe984082ccd726144 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c07 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.922541:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca76c00/0xe984082ccd7260a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b9e expref: 18 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.922548:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.922550:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.922552:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.922586:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca76c00/0xe984082ccd7260a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b9e expref: 18 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.922599:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca76c00/0xe984082ccd7260a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b9e expref: 18 pid: 8496 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.922613:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593768448:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143696.923839:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.923863:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592337920 00000100:00100000:0.0:1746143696.923867:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592337920 00000100:00100000:0.0:1746143696.923897:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9805 00000100:00100000:0.0:1746143696.923903:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592337920:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143696.923930:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.923943:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0586000/0xe984082ccd726033 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b58 expref: 28 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.923949:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e33e00/0xe984082ccd72614b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c0e expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.923956:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130638a00/0xe984082ccd7260db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ba5 expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.923961:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.923962:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.923965:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.923984:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130638a00/0xe984082ccd7260db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ba5 expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.923997:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130638a00/0xe984082ccd7260db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ba5 expref: 18 pid: 25369 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746143696.924007:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593768576:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143696.924042:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e33e00/0xe984082ccd72614b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c0e expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.924049:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e33e00/0xe984082ccd72614b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c0e expref: 12 pid: 8495 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746143696.924056:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593768704:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143696.924079:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0586000/0xe984082ccd726033 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b58 expref: 28 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.924087:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0586000/0xe984082ccd726033 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b58 expref: 28 pid: 9527 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746143696.924094:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593768832:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143696.924111:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143696.924220:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.924235:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592338048 00000100:00100000:0.0:1746143696.924237:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592338048 00000100:00100000:0.0:1746143696.924262:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9806 00000100:00100000:0.0:1746143696.924267:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1965:x1830963592338048:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143696.924284:0:12618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.924294:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c068800/0xe984082ccd726025 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b5f expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.924301:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e32e00/0xe984082ccd726152 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c15 expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.924307:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e33a00/0xe984082ccd7260cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bac expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.924311:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.924312:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.924315:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.924330:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e33a00/0xe984082ccd7260cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bac expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.924337:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e33a00/0xe984082ccd7260cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bac expref: 18 pid: 6929 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746143696.924344:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593768960:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143696.924383:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e32e00/0xe984082ccd726152 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c15 expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.924394:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e32e00/0xe984082ccd726152 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c15 expref: 13 pid: 8495 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746143696.924401:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593769088:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143696.924425:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c068800/0xe984082ccd726025 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b5f expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.924431:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c068800/0xe984082ccd726025 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b5f expref: 28 pid: 4582 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746143696.924438:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593769216:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143696.924453:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143696.924495:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093e32400/0xe984082ccd726144 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c07 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.924503:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093e32400/0xe984082ccd726144 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c07 expref: 11 pid: 8495 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.924512:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593769344:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.924546:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c068600/0xe984082ccd72601e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b51 expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.924553:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c068600/0xe984082ccd72601e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b51 expref: 28 pid: 4582 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.924566:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593769472:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.924577:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143696.926115:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.926198:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592338304 00000100:00100000:1.0:1746143696.926204:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.926205:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592338304 00000100:00100000:2.0:1746143696.926241:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9807 00000100:00100000:2.0:1746143696.926248:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592338304:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143696.926286:0:6929:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.926305:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e32800/0xe984082ccd7260d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bba expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.926314:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e33800/0xe984082ccd726160 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c23 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.926326:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e32a00/0xe984082ccd7260f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bcf expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.926333:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.926334:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.926337:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.926364:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093e32a00/0xe984082ccd7260f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bcf expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.926374:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093e32a00/0xe984082ccd7260f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bcf expref: 28 pid: 6929 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.926386:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593769600:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.926437:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093e33800/0xe984082ccd726160 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c23 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.926446:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093e33800/0xe984082ccd726160 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c23 expref: 12 pid: 8495 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746143696.926454:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593769728:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.926476:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093e32800/0xe984082ccd7260d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bba expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.926488:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093e32800/0xe984082ccd7260d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bba expref: 19 pid: 6929 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746143696.926496:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593769856:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.926508:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143696.926741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.927429:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592338176 00000100:00100000:2.0:1746143696.927434:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592338176 00000100:00100000:2.0:1746143696.927460:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592338432 00000100:00100000:2.0:1746143696.927462:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592338432 00000100:00100000:2.0:1746143696.927479:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9808 00000100:00100000:2.0:1746143696.927485:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1965:x1830963592338176:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143696.927509:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.927522:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.927528:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143696.927530:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143696.927531:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.927549:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.927557:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 19 pid: 6929 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.927566:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593769984:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.927605:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e323c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143696.927623:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9809 00000100:00100000:2.0:1746143696.927629:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1965:x1830963592338432:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143696.927650:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.927660:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb4c400/0xe984082ccd726105 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bdd expref: 18 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.927668:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a034ac00/0xe984082ccd726167 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c2a expref: 14 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.927674:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e33400/0xe984082ccd72613d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c00 expref: 28 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.927680:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.927682:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143696.927684:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.927701:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e33400/0xe984082ccd72613d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c00 expref: 28 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.927709:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e33400/0xe984082ccd72613d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c00 expref: 28 pid: 8495 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746143696.927718:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593770112:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.927745:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a034ac00/0xe984082ccd726167 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c2a expref: 14 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.927752:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a034ac00/0xe984082ccd726167 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c2a expref: 14 pid: 4582 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746143696.927759:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593770240:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.927781:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb4c400/0xe984082ccd726105 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bdd expref: 18 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.927789:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb4c400/0xe984082ccd726105 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bdd expref: 18 pid: 15784 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.927796:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593770368:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.927812:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143696.942764:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593768448:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.942765:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593768704:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.944577:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593768832:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143696.944665:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593769088:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143696.944678:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593769216:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.944717:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593768576:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.944748:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.944882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.944909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.944935:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592338560 00000100:00100000:3.0:1746143696.944942:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592338560 00010000:00010000:3.0:1746143696.944985:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e33e00/0xe984082ccd72614b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c0e expref: 15 pid: 8495 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.945010:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592338816 00000100:00100000:3.0:1746143696.945012:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592338816 00010000:00010000:3.0:1746143696.945021:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0586000/0xe984082ccd726033 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b58 expref: 29 pid: 9527 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.945036:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5051 00000100:00100000:3.0:1746143696.945043:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1963:x1830963592338560:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.945063:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143696.945065:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5052 00000100:00100000:0.0:1746143696.945074:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592338816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143696.945082:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.945090:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e33e00/0xe984082ccd72614b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c0e expref: 15 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746143696.945094:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0586000/0xe984082ccd726033 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b58 expref: 29 pid: 9527 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746143696.945105:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0586000/0xe984082ccd726033 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b58 expref: 29 pid: 9527 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.945114:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e33e00/0xe984082ccd72614b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c0e expref: 15 pid: 8495 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746143696.945201:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593769600:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.945211:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593769728:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.945232:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f185f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593769344:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.945241:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593769472:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.945260:0:8496:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143696.945363:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593768960:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143696.945383:0:12618:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.945577:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0586000/0xe984082ccd726033 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b58 expref: 29 pid: 9527 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746143696.945603:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143696.945750:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e33e00/0xe984082ccd72614b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c0e expref: 15 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.945764:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.945955:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1963:x1830963592338560:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 910us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.945962:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5051 00000100:00100000:1.0:1746143696.945962:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592338816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 889us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.945969:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5052 00000100:00100000:3.0:1746143696.946028:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.946087:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.946135:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592339072 00000100:00100000:1.0:1746143696.946155:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592339072 00010000:00010000:1.0:1746143696.946175:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130638a00/0xe984082ccd7260db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ba5 expref: 19 pid: 25369 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746143696.946191:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592338688 00000100:00100000:1.0:1746143696.946193:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592338688 00000100:00100000:3.0:1746143696.946202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143696.946203:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e32e00/0xe984082ccd726152 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c15 expref: 14 pid: 8495 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746143696.946226:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592339584 00000100:00100000:1.0:1746143696.946228:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592339584 00010000:00010000:1.0:1746143696.946237:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e33a00/0xe984082ccd7260cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bac expref: 20 pid: 6929 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.946428:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5053 00000100:00100000:3.0:1746143696.946434:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592339072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.946443:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.946457:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130638a00/0xe984082ccd7260db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ba5 expref: 20 pid: 25369 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.946465:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130638a00/0xe984082ccd7260db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ba5 expref: 20 pid: 25369 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.946478:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130638a00/0xe984082ccd7260db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ba5 expref: 20 pid: 25369 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.946491:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.946493:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.946497:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.946505:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.946525:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.946545:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592339072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 111us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.946550:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5053 00000100:00100000:3.0:1746143696.946587:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5054 00000100:00100000:3.0:1746143696.946591:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1964:x1830963592338688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.946597:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.946606:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e32e00/0xe984082ccd726152 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c15 expref: 14 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.946613:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e32e00/0xe984082ccd726152 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c15 expref: 14 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.946623:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e32e00/0xe984082ccd726152 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c15 expref: 14 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.946630:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.946641:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963592338688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 50us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.946646:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5054 00000100:00100000:3.0:1746143696.946652:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5055 00000100:00100000:3.0:1746143696.946656:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592339584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.946660:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.946665:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e33a00/0xe984082ccd7260cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bac expref: 18 pid: 6929 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.946671:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e33a00/0xe984082ccd7260cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bac expref: 18 pid: 6929 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.946680:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e33a00/0xe984082ccd7260cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bac expref: 18 pid: 6929 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.946686:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.946695:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592339584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 39us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.946699:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5055 00010000:00010000:3.0:1746143696.946713:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.946721:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.946743:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.946755:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.946761:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.946767:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bdc5600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143696.946770:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.946777:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.946784:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.946788:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5600/0xe984082ccd7261a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.946833:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592337920:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 22931us (23001us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.946839:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9805 00000100:00100000:3.0:1746143696.946867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.946877:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592339456 00000100:00100000:3.0:1746143696.946879:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592339456 00010000:00010000:3.0:1746143696.946890:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c068600/0xe984082ccd72601e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b51 expref: 29 pid: 4582 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.946900:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5056 00000100:00100000:3.0:1746143696.946904:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592339456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.946911:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.946926:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c068600/0xe984082ccd72601e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b51 expref: 29 pid: 4582 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.946934:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c068600/0xe984082ccd72601e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b51 expref: 29 pid: 4582 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.946946:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c068600/0xe984082ccd72601e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b51 expref: 29 pid: 4582 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.946954:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.946965:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592339456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 61us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.946970:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5056 00000100:00100000:3.0:1746143696.947002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.947010:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592338944 00000100:00100000:3.0:1746143696.947012:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592338944 00010000:00010000:3.0:1746143696.947021:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca76c00/0xe984082ccd7260a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b9e expref: 20 pid: 8496 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.947030:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5057 00000100:00100000:3.0:1746143696.947034:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592338944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.947039:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.947045:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca76c00/0xe984082ccd7260a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b9e expref: 20 pid: 8496 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.947054:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca76c00/0xe984082ccd7260a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b9e expref: 20 pid: 8496 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.947063:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca76c00/0xe984082ccd7260a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b9e expref: 20 pid: 8496 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.947070:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.947082:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592338944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.947086:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5057 00000100:00100000:3.0:1746143696.947117:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.947125:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592339200 00000100:00100000:3.0:1746143696.947127:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592339200 00010000:00010000:3.0:1746143696.947136:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093e32400/0xe984082ccd726144 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c07 expref: 14 pid: 8495 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.947172:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5058 00000100:00100000:3.0:1746143696.947177:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1965:x1830963592339200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.947183:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.947189:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e32400/0xe984082ccd726144 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c07 expref: 14 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.947197:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e32400/0xe984082ccd726144 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c07 expref: 14 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.947213:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e32400/0xe984082ccd726144 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c07 expref: 14 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.947220:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.947221:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.947224:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.947230:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.947243:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.947257:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1965:x1830963592339200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 80us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.947262:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5058 00010000:00010000:3.0:1746143696.947278:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.947285:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.947298:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.947304:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.947315:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.947319:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca77a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143696.947322:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.947327:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.947335:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.947340:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd72619f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.947373:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592337792:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 25011us (25175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.947378:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9804 00000100:00100000:3.0:1746143696.947415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.947425:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592339328 00000100:00100000:3.0:1746143696.947427:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592339328 00010000:00010000:3.0:1746143696.947437:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093e33800/0xe984082ccd726160 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c23 expref: 12 pid: 8495 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.947446:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5059 00000100:00100000:3.0:1746143696.947451:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592339328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.947455:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.947463:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e33800/0xe984082ccd726160 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c23 expref: 12 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.947470:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e33800/0xe984082ccd726160 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c23 expref: 12 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.947480:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e33800/0xe984082ccd726160 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c23 expref: 12 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.947488:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.947500:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592339328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.947505:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5059 00000100:00100000:3.0:1746143696.947539:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.947549:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592339712 00000100:00100000:3.0:1746143696.947552:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592339712 00010000:00010000:3.0:1746143696.947561:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c068800/0xe984082ccd726025 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b5f expref: 28 pid: 4582 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.947572:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5060 00000100:00100000:3.0:1746143696.947577:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592339712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.947582:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.947589:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c068800/0xe984082ccd726025 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b5f expref: 28 pid: 4582 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.947601:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c068800/0xe984082ccd726025 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b5f expref: 28 pid: 4582 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.947611:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c068800/0xe984082ccd726025 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1b5f expref: 28 pid: 4582 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.947618:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.947619:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.947622:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.947628:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.947639:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.947650:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592339712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 73us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.947654:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5060 00000100:00100000:3.0:1746143696.947709:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.947717:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592339840 00000100:00100000:3.0:1746143696.947719:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592339840 00010000:00010000:3.0:1746143696.947726:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093e32a00/0xe984082ccd7260f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bcf expref: 28 pid: 6929 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.947736:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5061 00000100:00100000:3.0:1746143696.947739:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592339840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.947746:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.947751:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e32a00/0xe984082ccd7260f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bcf expref: 28 pid: 6929 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.947758:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e32a00/0xe984082ccd7260f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bcf expref: 28 pid: 6929 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.947766:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e32a00/0xe984082ccd7260f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bcf expref: 28 pid: 6929 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.947772:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.947782:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592339840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 42us (72us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.947786:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5061 00000100:00100000:3.0:1746143696.947866:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593770112:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.947896:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593770240:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143696.947918:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593770368:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143696.947936:0:4582:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.948003:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.948016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.948022:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592340224 00000100:00100000:3.0:1746143696.948024:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592340224 00010000:00010000:3.0:1746143696.948033:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034ac00/0xe984082ccd726167 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c2a expref: 12 pid: 4582 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.948046:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5062 00000100:00100000:3.0:1746143696.948050:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592340224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.948054:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.948061:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a034ac00/0xe984082ccd726167 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c2a expref: 12 pid: 4582 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.948068:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a034ac00/0xe984082ccd726167 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c2a expref: 12 pid: 4582 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.948077:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a034ac00/0xe984082ccd726167 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c2a expref: 12 pid: 4582 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.948084:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.948094:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592340224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 44us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.948099:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5062 00000100:00100000:3.0:1746143696.948122:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.948132:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592340096 00000100:00100000:3.0:1746143696.948134:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592340096 00010000:00010000:3.0:1746143696.948168:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e33400/0xe984082ccd72613d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c00 expref: 27 pid: 8495 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746143696.948179:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5063 00000100:00100000:3.0:1746143696.948183:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592340096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.948190:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.948195:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e33400/0xe984082ccd72613d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c00 expref: 27 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.948202:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e33400/0xe984082ccd72613d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c00 expref: 27 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.948210:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e33400/0xe984082ccd72613d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c00 expref: 27 pid: 8495 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746143696.948216:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.948226:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592340096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 43us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.948230:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5063 00000100:00100000:3.0:1746143696.948297:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.948308:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592340352 00000100:00100000:3.0:1746143696.948311:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592340352 00010000:00010000:3.0:1746143696.948321:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb4c400/0xe984082ccd726105 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bdd expref: 17 pid: 15784 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746143696.948331:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5064 00000100:00100000:3.0:1746143696.948336:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592340352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143696.948341:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143696.948347:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb4c400/0xe984082ccd726105 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bdd expref: 17 pid: 15784 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.948358:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb4c400/0xe984082ccd726105 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bdd expref: 17 pid: 15784 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.948368:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb4c400/0xe984082ccd726105 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bdd expref: 17 pid: 15784 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746143696.948376:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.948377:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.948379:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.948385:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.948396:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143696.948406:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592340352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 71us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.948410:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5064 00010000:00010000:3.0:1746143696.948422:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.948428:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.948441:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.948451:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.948458:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.948463:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffc4000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143696.948466:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.948472:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.948480:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.948486:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc4000/0xe984082ccd7261c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.948516:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592338432:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 20888us (21775us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.948522:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9809 00010000:00010000:1.0:1746143696.949788:0:12618:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.949801:0:12618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143696.949829:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593769984:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143696.949838:0:12618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.949845:0:12618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.949847:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.949852:0:12618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.949863:0:12618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bdc5400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143696.949866:0:12618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.949872:0:12618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143696.949873:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593769856:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143696.949886:0:12618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.949887:0:6929:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.949892:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bdc5400/0xe984082ccd7261ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143696.949958:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592338048:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 25690us (25737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.949966:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9806 00000100:00100000:1.0:1746143696.949994:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592339968 00000100:00100000:1.0:1746143696.949998:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592339968 00002000:00100000:1.0:1746143696.950033:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1585152->1847295) req@ffff88012f185500 x1830963592339968/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.950042:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185500 with x1830963592339968 ext(1585152->1847295) 00010000:00010000:1.0:1746143696.950049:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 19 pid: 6929 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.950058:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 19 pid: 6929 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746143696.950065:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f185500 00000100:00100000:1.0:1746143696.950078:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 888 00000100:00100000:1.0:1746143696.950084:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592339968:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143696.951777:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592337664:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29533us (29784us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143696.951787:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3636 00002000:00100000:2.0:1746143696.951796:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094305c00 x1830963592337664/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/440 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.951805:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305c00 with x1830963592337664 ext(4194304->4898815) 00010000:00010000:2.0:1746143696.951831:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093e32800/0xe984082ccd7260d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bba expref: 19 pid: 6929 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746143696.951842:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093e32800/0xe984082ccd7260d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bba expref: 19 pid: 6929 timeout: 875 lvb_type: 1 00002000:00010000:2.0:1746143696.951853:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094305c00 00000100:00100000:0.0:1746143696.961072:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.961353:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592341376 00000100:00100000:2.0:1746143696.961362:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592341376 00000100:00100000:2.0:1746143696.961409:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8328 00000100:00100000:2.0:1746143696.961417:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:28516:x1830963592341376:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143696.961441:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143696.961461:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd7261c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c70 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.961564:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd7261d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.961577:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd7261d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.961588:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd7261d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.961601:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd7261d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.961605:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd7261d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.961609:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd7261d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.961714:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.961724:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77600/0xe984082ccd72618a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c38 expref: 13 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.961731:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.961761:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77600/0xe984082ccd72618a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c38 expref: 13 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.961771:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77600/0xe984082ccd72618a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c38 expref: 13 pid: 21713 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.961783:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593770496:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143696.961873:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143696.962510:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592339968:12345-192.168.202.48@tcp:4:cat.0 Request processed in 12423us (14503us total) trans 17179872500 rc 0/0 00000100:00100000:1.0:1746143696.962520:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 888 00002000:00100000:1.0:1746143696.962528:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34e:0x0] (1585152->1847295) req@ffff88012f185500 x1830963592339968/t17179872500(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/448 e 0 to 0 dl 1746143707 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.962536:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185500 with x1830963592339968 ext(1585152->1847295) 00010000:00010000:1.0:1746143696.962544:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 19 pid: 6929 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.962554:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 19 pid: 6929 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746143696.962560:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f185500 00000100:00100000:0.0:1746143696.967237:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.967268:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.967291:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.967303:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.967353:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592340480 00000100:00100000:1.0:1746143696.967363:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592340480 00000100:00100000:1.0:1746143696.967411:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9810 00000100:00100000:1.0:1746143696.967420:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592340480:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.967441:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.967463:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130639a00/0xe984082ccd7261e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c46 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.967470:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.967486:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592341504 00000100:00100000:0.0:1746143696.967489:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592341504 00002000:00010000:1.0:1746143696.967497:0:12618:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409cf, atime: 0x681409cf, ctime: 0x681409cf, blocks: 0x809 00010000:00010000:0.0:1746143696.967510:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77600/0xe984082ccd72618a lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c38 expref: 14 pid: 21713 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.967517:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.967519:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.967526:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130639a00/0xe984082ccd7261e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c46 expref: 20 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143696.967527:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5065 00000100:00100000:0.0:1746143696.967532:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1964:x1830963592341504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143696.967541:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143696.967543:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130639a00/0xe984082ccd7261e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c46 expref: 20 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.967546:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77600/0xe984082ccd72618a lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c38 expref: 14 pid: 21713 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746143696.967553:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130639a00, rc 0) 00010000:00010000:0.0:1746143696.967556:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77600/0xe984082ccd72618a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c38 expref: 14 pid: 21713 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.967572:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143696.967576:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.967583:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143696.967593:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 16090 initiator: MDT0 00000100:00100000:1.0:1746143696.967598:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592340480:12345-192.168.202.48@tcp:101:cat.0 Request processed in 179us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.967603:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9810 00010000:00010000:0.0:1746143696.967607:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143696.967617:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592340608 00000100:00100000:1.0:1746143696.967620:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592340608 00000100:00100000:0.0:1746143696.967621:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:1964:x1830963592341504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 89us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.967627:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5065 00000100:00100000:1.0:1746143696.967631:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592340736 00000100:00100000:1.0:1746143696.967633:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592340736 00000100:00100000:1.0:1746143696.967640:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592340992 00000100:00100000:1.0:1746143696.967642:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592340992 00000100:00100000:1.0:1746143696.967651:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9811 00000100:00100000:0.0:1746143696.967653:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.967655:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592340608:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.967662:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143696.967667:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592340864 00000100:00100000:0.0:1746143696.967670:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592340864 00010000:00010000:1.0:1746143696.967672:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130639400/0xe984082ccd7261ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c4d expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.967680:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9812 00000100:00100000:0.0:1746143696.967684:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592340736:12345-192.168.202.48@tcp:101:cat.0 00002000:00010000:1.0:1746143696.967686:0:12618:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34a:0x0] initial LVB size: 2097152, mtime: 0x681409cf, atime: 0x681409cf, ctime: 0x681409cf, blocks: 0x81f 00010000:00010000:0.0:1746143696.967690:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.967696:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.967697:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.967698:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a067f600/0xe984082ccd7261f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c54 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.967701:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130639400/0xe984082ccd7261ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c4d expref: 18 pid: 12618 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746143696.967709:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34b:0x0] initial LVB size: 2097152, mtime: 0x681409cf, atime: 0x681409cf, ctime: 0x681409cf, blocks: 0x821 00010000:00010000:1.0:1746143696.967710:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130639400/0xe984082ccd7261ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c4d expref: 18 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143696.967716:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130639400, rc 0) 00010000:00010000:0.0:1746143696.967717:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.967718:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.967723:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a067f600/0xe984082ccd7261f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c54 expref: 19 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143696.967729:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592340608:12345-192.168.202.48@tcp:101:cat.0 Request processed in 73us (460us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143696.967732:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a067f600/0xe984082ccd7261f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c54 expref: 19 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143696.967734:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9811 00010000:00010000:0.0:1746143696.967738:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a067f600, rc 0) 00000100:00100000:1.0:1746143696.967741:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9813 00000100:00100000:1.0:1746143696.967746:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592340992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.967750:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143696.967751:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592340736:12345-192.168.202.48@tcp:101:cat.0 Request processed in 66us (459us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143696.967756:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130638a00/0xe984082ccd7261fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c62 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.967756:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9812 00010000:00010000:1.0:1746143696.967763:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143696.967764:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9814 00000100:00100000:0.0:1746143696.967768:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592340864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.967769:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130638a00/0xe984082ccd7261fa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c62 expref: 22 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.967773:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.967776:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130638a00/0xe984082ccd7261fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c62 expref: 22 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143696.967779:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a067f800/0xe984082ccd726201 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c5b expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143696.967789:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130638a00, rc 0) 00000100:00100000:1.0:1746143696.967801:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592340992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 55us (497us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143696.967807:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9813 00000100:00100000:0.0:1746143696.967808:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593770624:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143696.967854:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143696.967861:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143696.967864:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592341120 00000100:00100000:1.0:1746143696.967867:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592341120 00000100:00100000:1.0:1746143696.967878:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9815 00000100:00100000:1.0:1746143696.967882:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592341120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143696.967887:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143696.967895:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130639200/0xe984082ccd726208 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c69 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143696.967906:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409d0, atime: 0x681409d0, ctime: 0x681409d0, blocks: 0x1029 00010000:00010000:1.0:1746143696.967913:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.967915:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143696.967919:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130639200/0xe984082ccd726208 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c69 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143696.967921:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143696.967927:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130639200/0xe984082ccd726208 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c69 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143696.967930:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592341632 00000100:00100000:0.0:1746143696.967932:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592341632 00010000:00010000:1.0:1746143696.967934:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130639200, rc 0) 00010000:00010000:0.0:1746143696.967942:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093e32800/0xe984082ccd7260d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bba expref: 22 pid: 6929 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746143696.967946:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592341120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 63us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143696.967951:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9815 00000100:00100000:0.0:1746143696.967954:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5066 00000100:00100000:0.0:1746143696.967958:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592341632:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143696.967964:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143696.967974:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e32800/0xe984082ccd7260d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bba expref: 22 pid: 6929 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746143696.967981:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e32800/0xe984082ccd7260d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bba expref: 22 pid: 6929 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746143696.967990:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e32800/0xe984082ccd7260d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bba expref: 22 pid: 6929 timeout: 875 lvb_type: 1 00010000:00010000:0.0:1746143696.968002:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.968004:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.968006:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.968012:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143696.968039:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143696.968562:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77600/0xe984082ccd72618a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c38 expref: 13 pid: 21713 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.968602:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963593770496:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143696.968620:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968627:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968633:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143696.968648:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143696.968751:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968757:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968764:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968770:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a034b600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143696.968773:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968779:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968788:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143696.968791:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143696.968793:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968797:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b600/0xe984082ccd7261de lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968822:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd7261d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968827:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd7261d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968832:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd7261d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968836:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a034ae00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143696.968838:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd7261d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968842:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd7261d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968853:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143696.968855:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143696.968858:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd7261d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968862:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd7261d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968871:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd7261d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968876:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd7261d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968880:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd7261d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968884:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a034b400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143696.968886:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd7261d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968890:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd7261d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968895:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9d000) 00010000:00010000:2.0:1746143696.968897:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143696.968899:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd7261d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968903:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd7261d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143696.968948:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd7261c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c70 expref: 252 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.968956:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd7261c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c70 expref: 252 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.968963:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034b000, rc 0) 00000100:00100000:2.0:1746143696.968990:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:28516:x1830963592341376:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7574us (7931us total) trans 8589942438 rc 301/301 00000100:00100000:2.0:1746143696.968997:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8328 00010000:00010000:0.0:1746143696.969404:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143696.969422:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592341632:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1462us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.969428:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5066 00010000:00010000:2.0:1746143696.969483:0:6929:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.969490:0:6929:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.969511:0:6929:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.969517:0:6929:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.969523:0:6929:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.969528:0:6929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffc5a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143696.969531:0:6929:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.969541:0:6929:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.969553:0:6929:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.969558:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc5a00/0xe984082ccd7261b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143696.969589:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592341760 00000100:00100000:0.0:1746143696.969593:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592341760 00010000:00010000:0.0:1746143696.969606:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 21 pid: 6929 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746143696.969631:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5067 00000100:00100000:0.0:1746143696.969637:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963592341760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143696.971402:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143696.971436:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 21 pid: 6929 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.971449:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 21 pid: 6929 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746143696.971477:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.971479:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143696.971483:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143696.971492:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143696.972023:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592338304:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 45770us (45913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143696.972032:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9807 00010000:00010000:0.0:1746143696.972827:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143696.972849:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963592341760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3211us (4809us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143696.972858:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5067 00010000:00010000:3.0:1746143696.973256:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.973268:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.973297:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.973304:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.973311:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.973317:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffc4600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143696.973322:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.973329:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.973344:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.973349:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc4600/0xe984082ccd7261bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143696.973392:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592338176:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 45907us (47187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.973401:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9808 00010000:00010000:2.0:1746143696.975202:0:8495:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff880094c0d880 x1830963593770624) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 20 pid: 6929 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746143696.975238:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e33c00/0xe984082ccd7260f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->1847295) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1bc8 expref: 20 pid: 6929 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746143696.975250:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593770624:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143696.975282:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a067f800/0xe984082ccd726201 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c5b expref: 19 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.975295:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a067f800/0xe984082ccd726201 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c5b expref: 19 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143696.975317:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a067f800, rc 0) 00000100:00100000:2.0:1746143696.975368:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592340864:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7597us (7712us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143696.975375:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9814 00000100:00100000:0.0:1746143696.976233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.976285:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592342016 00000100:00100000:2.0:1746143696.976293:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592342016 00000100:00100000:2.0:1746143696.976344:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8329 00000100:00100000:2.0:1746143696.976351:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28513:x1830963592342016:12345-192.168.202.48@tcp:36:mirror_io.0 00010000:00010000:2.0:1746143696.976395:0:16090:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143696.976417:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5600/0xe984082ccd726198 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c3f expref: 13 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143696.976431:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143696.976436:0:16090:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143696.976480:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28513:x1830963592342016:12345-192.168.202.48@tcp:36:mirror_io.0 Request processed in 129us (251us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746143696.976485:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8329 00000100:00100000:1.0:1746143696.977102:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.977187:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592342144 00000100:00100000:3.0:1746143696.977192:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592342144 00000100:00100000:3.0:1746143696.977566:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9816 00000100:00100000:3.0:1746143696.977572:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28506:x1830963592342144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.977584:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.977601:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd726216 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c77 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143696.977622:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 4897312, mtime: 0x681409d0, atime: 0x681409cf, ctime: 0x681409d0, blocks: 0x15a5 00010000:00010000:3.0:1746143696.977637:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.977639:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.977647:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd726216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c77 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.977659:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd726216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c77 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143696.977668:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca77a00, rc 0) 00000100:00100000:3.0:1746143696.977869:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28506:x1830963592342144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 296us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.977875:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9816 00000100:00100000:0.0:1746143696.980599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.980750:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592342400 00000100:00100000:1.0:1746143696.980761:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592342400 00000100:00100000:1.0:1746143696.980869:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3396 00000100:00100000:1.0:1746143696.980878:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ecc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:28513:x1830963592342400:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143696.983045:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ecc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28513:x1830963592342400:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 2160us (2449us total) trans 8589942439 rc 0/0 00000100:00100000:1.0:1746143696.983103:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3396 00000100:00100000:0.0:1746143696.987567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.988850:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592342656 00000100:00100000:1.0:1746143696.988861:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592342656 00000100:00100000:1.0:1746143696.988925:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3397 00000100:00100000:1.0:1746143696.988934:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:28513:x1830963592342656:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143696.989190:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:28513:x1830963592342656:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 257us (1632us total) trans 8589942440 rc 0/0 00000100:00100000:1.0:1746143696.989198:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3397 00000100:00100000:0.0:1746143696.989420:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143696.989487:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592342784 00000100:00100000:3.0:1746143696.989493:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592342784 00000100:00100000:3.0:1746143696.989518:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9817 00000100:00100000:3.0:1746143696.989523:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592342784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143696.989533:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143696.989552:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca76400/0xe984082ccd72621d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c7e expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143696.989579:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409d0, atime: 0x681409d0, ctime: 0x681409d0, blocks: 0x821 00010000:00010000:3.0:1746143696.989595:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.989597:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143696.989610:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca76400/0xe984082ccd72621d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c7e expref: 20 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.989625:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca76400/0xe984082ccd72621d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c7e expref: 20 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143696.989635:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca76400, rc 0) 00000100:00100000:3.0:1746143696.989656:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592342784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 133us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143696.989661:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9817 00000100:00100000:0.0:1746143696.995341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143696.995431:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592343040 00000100:00100000:1.0:1746143696.995441:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592343040 00002000:00100000:1.0:1746143696.995492:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff880094c0ce00 x1830963592343040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/0 e 0 to 0 dl 1746143707 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143696.995503:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ce00 with x1830963592343040 ext(4894720->4898815) 00002000:00010000:1.0:1746143696.995508:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0ce00 00000100:00100000:2.0:1746143696.996809:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3637 00000100:00100000:2.0:1746143696.996829:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592343040:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143696.997030:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592343040:12345-192.168.202.48@tcp:3:cat.0 Request processed in 205us (1700us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143696.997037:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3637 00002000:00100000:2.0:1746143696.997043:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4894720->4898815) req@ffff880094c0ce00 x1830963592343040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:92/0 lens 488/4536 e 0 to 0 dl 1746143707 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143696.997058:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ce00 with x1830963592343040 ext(4894720->4898815) 00002000:00010000:2.0:1746143696.997062:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0ce00 00000100:00100000:0.0:1746143696.999704:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143696.999898:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592343168 00000100:00100000:2.0:1746143696.999907:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592343168 00000100:00100000:2.0:1746143696.999967:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9818 00000100:00100000:2.0:1746143696.999974:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:28516:x1830963592343168:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143696.999995:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143697.000016:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c85 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.000049:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd726216 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c77 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.000057:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143697.000059:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143697.000062:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2633728->3031039] (req 2633728->3031039) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 28 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.000091:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd726216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c77 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.000102:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd726216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c77 expref: 19 pid: 8495 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746143697.000114:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593770752:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143697.000226:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e323c0 going to sleep for 10 seconds 00000100:00100000:0.0:1746143697.004071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.004178:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592343552 00000100:00100000:3.0:1746143697.004188:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592343552 00000100:00100000:0.0:1746143697.004192:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.004229:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3398 00000100:00100000:3.0:1746143697.004237:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28506:x1830963592343552:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143697.004289:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592343424 00000100:00100000:1.0:1746143697.004294:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592343424 00010000:00010000:1.0:1746143697.004320:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd726216 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c77 expref: 20 pid: 8495 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746143697.004322:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593770752:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143697.004345:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5068 00010000:00010000:2.0:1746143697.004347:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2633728->3031039] (req 2633728->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 28 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143697.004350:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592343424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143697.004364:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034b600, rc 0) 00010000:00010000:1.0:1746143697.004377:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143697.004401:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd726216 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c77 expref: 20 pid: 8495 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.004411:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd726216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c77 expref: 20 pid: 8495 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746143697.004417:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28516:x1830963592343168:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4443us (4724us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143697.004424:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9818 00010000:00010000:1.0:1746143697.004435:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca77a00/0xe984082ccd726216 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c77 expref: 20 pid: 8495 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746143697.004446:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28506:x1830963592343552:12345-192.168.202.48@tcp:35:cat.0 Request processed in 209us (386us total) trans 8589942441 rc 0/0 00010000:00010000:1.0:1746143697.004449:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.004451:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143697.004452:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3398 00010000:00010000:1.0:1746143697.004458:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.004466:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.004495:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143697.004508:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593770880:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143697.004565:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143697.006557:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.007479:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592343808 00000100:00100000:2.0:1746143697.007489:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592343808 00002000:00100000:2.0:1746143697.007536:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2633728->2637823) req@ffff880094c0ea00 x1830963592343808/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.007545:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ea00 with x1830963592343808 ext(2633728->2637823) 00002000:00010000:2.0:1746143697.007551:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0ea00 00000100:00100000:2.0:1746143697.007585:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3638 00000100:00100000:2.0:1746143697.007593:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592343808:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143697.007691:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593770880:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143697.007711:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143697.007751:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592343424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3400us (3558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143697.007761:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5068 00000100:00100000:2.0:1746143697.008220:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592343808:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 627us (1669us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143697.008226:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3638 00002000:00100000:2.0:1746143697.008232:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (2633728->2637823) req@ffff880094c0ea00 x1830963592343808/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.008239:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ea00 with x1830963592343808 ext(2633728->2637823) 00002000:00010000:2.0:1746143697.008241:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0ea00 00000100:00100000:0.0:1746143697.013002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.013079:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592344064 00000100:00100000:2.0:1746143697.013090:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592344064 00002000:00100000:2.0:1746143697.013134:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3026944->3031039) req@ffff880094c0d880 x1830963592344064/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.013264:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d880 with x1830963592344064 ext(3026944->3031039) 00002000:00010000:2.0:1746143697.013269:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0d880 00000100:00100000:2.0:1746143697.013297:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3639 00000100:00100000:2.0:1746143697.013304:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592344064:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143697.014037:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592344064:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 731us (1043us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143697.014043:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3639 00002000:00100000:2.0:1746143697.014049:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3026944->3031039) req@ffff880094c0d880 x1830963592344064/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.014056:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d880 with x1830963592344064 ext(3026944->3031039) 00002000:00010000:2.0:1746143697.014058:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0d880 00000100:00100000:0.0:1746143697.018500:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.018585:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592344320 00000100:00100000:3.0:1746143697.018598:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592344320 00000100:00100000:3.0:1746143697.018658:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3399 00000100:00100000:3.0:1746143697.018667:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:28516:x1830963592344320:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143697.018925:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:28516:x1830963592344320:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 258us (437us total) trans 8589942442 rc 0/0 00000100:00100000:3.0:1746143697.018933:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3399 00000100:00100000:0.0:1746143697.052935:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.053018:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592344576 00000100:00100000:2.0:1746143697.053029:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592344576 00000100:00100000:2.0:1746143697.053091:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8330 00000100:00100000:2.0:1746143697.053100:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28522:x1830963592344576:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143697.053128:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143697.053169:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd72622b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c8c expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.053279:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034bc00/0xe984082ccd726232 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053291:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034bc00/0xe984082ccd726232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053304:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034bc00/0xe984082ccd726232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053317:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726239 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053322:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053327:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053437:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034aa00/0xe984082ccd726240 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053444:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034aa00/0xe984082ccd726240 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053450:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034aa00/0xe984082ccd726240 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143697.053458:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143697.053537:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034bc00/0xe984082ccd726232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053543:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034bc00/0xe984082ccd726232 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053549:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034bc00/0xe984082ccd726232 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053554:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a034bc00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143697.053557:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034bc00/0xe984082ccd726232 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053564:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034bc00/0xe984082ccd726232 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053573:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143697.053576:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143697.053579:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034bc00/0xe984082ccd726232 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053584:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034bc00/0xe984082ccd726232 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053621:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053626:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726239 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053631:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726239 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053635:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a034a800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143697.053637:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726239 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053641:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726239 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053647:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9d800) 00010000:00010000:2.0:1746143697.053649:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143697.053651:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726239 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053656:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726239 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.053693:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd72622b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c8c expref: 18 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.053704:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034aa00/0xe984082ccd726240 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c8c expref: 17 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.053710:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143697.053712:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143697.053714:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034aa00, rc 0) 00000100:00100000:2.0:1746143697.053770:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28522:x1830963592344576:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 672us (848us total) trans 8589942443 rc 0/0 00000100:00100000:2.0:1746143697.053776:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8330 00000100:00100000:0.0:1746143697.142286:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.149016:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592344832 00000100:00100000:2.0:1746143697.149032:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592344832 00000100:00100000:2.0:1746143697.149116:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8331 00000100:00100000:2.0:1746143697.149126:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28529:x1830963592344832:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143697.149168:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143697.149189:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd72624e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c93 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.149287:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726255 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.149301:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726255 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.149312:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726255 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143697.149327:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143697.149433:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd72624e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c93 expref: 20 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.149470:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726255 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c93 expref: 19 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.149483:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143697.149486:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143697.149489:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034a800, rc 0) 00000100:00100000:2.0:1746143697.149558:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28529:x1830963592344832:12345-192.168.202.48@tcp:101:cat.0 Request processed in 434us (7281us total) trans 8589942444 rc 0/0 00000100:00100000:2.0:1746143697.149568:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8331 00000100:00100000:0.0:1746143697.162684:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.162733:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.164374:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592345088 00000100:00100000:2.0:1746143697.164387:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592345088 00000100:00100000:2.0:1746143697.164439:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8332 00000100:00100000:2.0:1746143697.164448:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:28530:x1830963592345088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143697.164482:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143697.164500:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b800/0xe984082ccd726263 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1c9a expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.164598:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ba00/0xe984082ccd72626a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164610:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ba00/0xe984082ccd72626a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164620:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ba00/0xe984082ccd72626a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164631:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd726271 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164635:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd726271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164639:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd726271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164732:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd726278 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164737:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd726278 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164742:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd726278 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143697.164749:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143697.164827:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ba00/0xe984082ccd72626a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164833:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ba00/0xe984082ccd72626a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164838:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ba00/0xe984082ccd72626a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164843:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a034ba00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143697.164846:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ba00/0xe984082ccd72626a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164851:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ba00/0xe984082ccd72626a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164861:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143697.164863:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143697.164866:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ba00/0xe984082ccd72626a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164871:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ba00/0xe984082ccd72626a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164897:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd726271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164901:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd726271 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164905:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd726271 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164908:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a034b400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143697.164910:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd726271 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164914:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd726271 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164919:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880131c9dd00) 00010000:00010000:2.0:1746143697.164921:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143697.164922:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd726271 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164926:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd726271 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143697.164958:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b800/0xe984082ccd726263 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c9a expref: 255 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.164969:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd726278 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c9a expref: 254 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.164974:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143697.164976:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143697.164978:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034b000, rc 0) 00000100:00100000:2.0:1746143697.165034:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:28530:x1830963592345088:12345-192.168.202.48@tcp:101:cat.0 Request processed in 586us (2361us total) trans 8589942445 rc 0/0 00000100:00100000:2.0:1746143697.165040:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8332 00000100:00100000:3.0:1746143697.167122:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592345216 00000100:00100000:3.0:1746143697.167133:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592345216 00000100:00100000:3.0:1746143697.167210:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9819 00000100:00100000:3.0:1746143697.167218:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592345216:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.167237:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.167252:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca76c00/0xe984082ccd726286 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ca1 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143697.167306:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593771008:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143697.167397:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143697.176232:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:3.0:1746143697.177033:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime: 1746143695 -> 1746143696 00000100:00100000:3.0:1746143697.177060:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f185c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593771008:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143697.177094:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca76c00/0xe984082ccd726286 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ca1 expref: 20 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.177110:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca76c00/0xe984082ccd726286 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ca1 expref: 20 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143697.177587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143697.177653:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca76c00, rc 0) 00000100:00100000:3.0:1746143697.177710:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592345216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 10491us (14975us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143697.177719:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9819 00000100:00100000:3.0:1746143697.178256:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592345472 00000100:00100000:3.0:1746143697.178264:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592345472 00000100:00100000:3.0:1746143697.178291:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592345600 00000100:00100000:3.0:1746143697.178293:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592345600 00000100:00100000:3.0:1746143697.178306:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9820 00000100:00100000:3.0:1746143697.178313:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592345472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.178328:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.178342:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca77200/0xe984082ccd72628d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1caf expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.178361:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.178362:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.178369:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca77200/0xe984082ccd72628d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1caf expref: 29 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.178383:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca77200/0xe984082ccd72628d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1caf expref: 29 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.178391:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca77200, rc 0) 00000100:00100000:3.0:1746143697.178413:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592345472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 102us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.178418:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9820 00000100:00100000:3.0:1746143697.178430:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9821 00000100:00100000:3.0:1746143697.178435:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963592345600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.178442:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.178451:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca77600/0xe984082ccd726294 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1cb6 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.178462:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.178464:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.178468:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca77600/0xe984082ccd726294 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cb6 expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.178481:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca77600/0xe984082ccd726294 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cb6 expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.178487:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca77600, rc 0) 00000100:00100000:3.0:1746143697.178503:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592345600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 67us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.178507:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9821 00000100:00100000:3.0:1746143697.178683:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.178697:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592345728 00000100:00100000:3.0:1746143697.178699:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592345728 00000100:00100000:3.0:1746143697.178728:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9822 00000100:00100000:3.0:1746143697.178734:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592345728:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.178740:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.178746:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca76600/0xe984082ccd72629b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1cbd expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.178756:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.178757:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.178762:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca76600/0xe984082ccd72629b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cbd expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.178771:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca76600/0xe984082ccd72629b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cbd expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.178777:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca76600, rc 0) 00000100:00100000:3.0:1746143697.178793:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592345728:12345-192.168.202.48@tcp:101:cat.0 Request processed in 59us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.178798:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9822 00000100:00100000:3.0:1746143697.178853:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.178866:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592345856 00000100:00100000:3.0:1746143697.178868:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592345856 00000100:00100000:3.0:1746143697.178882:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9823 00000100:00100000:3.0:1746143697.178886:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592345856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.178892:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.178898:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca77000/0xe984082ccd7262a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1cc4 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.178907:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.178909:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.178913:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca77000/0xe984082ccd7262a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cc4 expref: 30 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.178921:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca77000/0xe984082ccd7262a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cc4 expref: 30 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.178927:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca77000, rc 0) 00000100:00100000:3.0:1746143697.178940:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592345856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 54us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.178945:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9823 00000100:00100000:3.0:1746143697.178993:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.179004:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592345984 00000100:00100000:3.0:1746143697.179007:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592345984 00000100:00100000:3.0:1746143697.179020:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9824 00000100:00100000:3.0:1746143697.179025:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592345984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.179030:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.179036:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca76e00/0xe984082ccd7262a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ccb expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.179045:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.179046:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.179050:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca76e00/0xe984082ccd7262a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ccb expref: 29 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.179058:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca76e00/0xe984082ccd7262a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ccb expref: 29 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.179064:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca76e00, rc 0) 00000100:00100000:3.0:1746143697.179093:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592345984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 68us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.179098:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9824 00000100:00100000:0.0:1746143697.179820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.182755:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592346112 00000100:00100000:3.0:1746143697.182768:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592346112 00000100:00100000:3.0:1746143697.182831:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8333 00000100:00100000:3.0:1746143697.182838:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:28528:x1830963592346112:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143697.182871:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.182888:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77c00/0xe984082ccd7262b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ca8 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.182977:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.182993:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034aa00/0xe984082ccd726240 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c8c expref: 18 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.182999:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd726278 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c9a expref: 255 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.183004:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.183032:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd726278 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c9a expref: 255 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.183041:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd726278 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c9a expref: 255 pid: 16090 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746143697.183052:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593771136:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143697.183174:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034aa00/0xe984082ccd726240 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c8c expref: 18 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.183181:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034aa00/0xe984082ccd726240 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c8c expref: 18 pid: 21713 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746143697.183187:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593771264:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143697.183211:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143697.203117:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f185880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593771136:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143697.203128:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593771264:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143697.203181:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143697.210103:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.210163:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.210187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.210425:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592346368 00000100:00100000:2.0:1746143697.210435:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592346368 00000100:00100000:0.0:1746143697.210453:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592346624 00000100:00100000:0.0:1746143697.210456:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592346624 00002000:00100000:2.0:1746143697.210481:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880090764a80 x1830963592346368/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.210481:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880090767b80 x1830963592346624/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.210490:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764a80 with x1830963592346368 ext(0->1048575) 00002000:00100000:0.0:1746143697.210490:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767b80 with x1830963592346624 ext(1048576->2097151) 00002000:00010000:2.0:1746143697.210495:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090764a80 00002000:00010000:0.0:1746143697.210495:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767b80 00000100:00100000:2.0:1746143697.210515:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592346880 00000100:00100000:2.0:1746143697.210517:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592346880 00002000:00100000:2.0:1746143697.210526:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880090766a00 x1830963592346880/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.210532:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766a00 with x1830963592346880 ext(1048576->2097151) 00002000:00010000:2.0:1746143697.210534:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090766a00 00000100:00100000:0.0:1746143697.210548:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3640 00000100:00100000:2.0:1746143697.210553:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3641 00000100:00100000:0.0:1746143697.210556:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592346368:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143697.210558:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592346624:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143697.211074:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.211091:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592347136 00000100:00100000:1.0:1746143697.211093:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592347136 00002000:00100000:1.0:1746143697.211111:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009bfe0000 x1830963592347136/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.211117:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0000 with x1830963592347136 ext(1048576->2097151) 00002000:00010000:1.0:1746143697.211120:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0000 00000100:00100000:1.0:1746143697.211136:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3642 00000100:00100000:1.0:1746143697.211159:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592346880:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143697.212002:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.212338:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592347392 00000100:00100000:1.0:1746143697.212344:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592347392 00010000:00010000:1.0:1746143697.212368:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034aa00/0xe984082ccd726240 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c8c expref: 19 pid: 21713 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746143697.212393:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5069 00000100:00100000:1.0:1746143697.212399:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592347392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143697.212409:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143697.212414:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034aa00/0xe984082ccd726240 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c8c expref: 19 pid: 21713 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.212424:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034aa00/0xe984082ccd726240 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c8c expref: 19 pid: 21713 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.212446:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034aa00/0xe984082ccd726240 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c8c expref: 19 pid: 21713 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.212474:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143697.212479:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143697.212486:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143697.212492:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143697.212519:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592347392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 121us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143697.212525:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5069 00000100:00100000:1.0:1746143697.212558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.212570:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592347264 00000100:00100000:1.0:1746143697.212573:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592347264 00010000:00010000:1.0:1746143697.212584:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd726278 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c9a expref: 256 pid: 16090 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746143697.212597:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5070 00000100:00100000:1.0:1746143697.212601:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:1965:x1830963592347264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143697.212608:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143697.212611:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd726278 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c9a expref: 256 pid: 16090 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.212619:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd726278 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c9a expref: 256 pid: 16090 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.212631:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b000/0xe984082ccd726278 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c9a expref: 256 pid: 16090 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.212641:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143697.212644:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143697.212649:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143697.212655:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143697.212673:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143697.212688:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1965:x1830963592347264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 86us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143697.212692:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5070 00000100:00100000:1.0:1746143697.212744:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.212761:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592347648 00000100:00100000:1.0:1746143697.212764:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592347648 00002000:00100000:1.0:1746143697.212783:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009bfe1c00 x1830963592347648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.212791:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1c00 with x1830963592347648 ext(0->1048575) 00002000:00010000:1.0:1746143697.212795:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1c00 00000100:00100000:1.0:1746143697.212808:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3643 00000100:00100000:1.0:1746143697.212827:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592347136:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143697.217365:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3644 00000100:00100000:2.0:1746143697.217380:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592347648:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143697.221238:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143697.227465:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.227481:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143697.227504:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143697.227647:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca77c00/0xe984082ccd7262b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ca8 expref: 256 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.227679:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ca8 expref: 255 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.227686:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143697.227688:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143697.227691:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca76a00, rc 0) 00000100:00100000:3.0:1746143697.227727:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:28528:x1830963592346112:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 44888us (47916us total) trans 8589942446 rc 0/0 00000100:00100000:3.0:1746143697.227734:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8333 00000100:00100000:0.0:1746143697.228427:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.229122:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592347904 00000100:00100000:3.0:1746143697.229130:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592347904 00000100:00100000:0.0:1746143697.229155:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.229157:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592348160 00000100:00100000:3.0:1746143697.229159:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592348160 00002000:00100000:3.0:1746143697.229191:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880090764700 x1830963592348160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143697.229199:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764700 with x1830963592348160 ext(1048576->2097151) 00002000:00010000:3.0:1746143697.229204:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090764700 00000100:00100000:3.0:1746143697.229221:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592348416 00000100:00100000:3.0:1746143697.229223:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592348416 00002000:00100000:3.0:1746143697.229232:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880090766d80 x1830963592348416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143697.229232:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3645 00002000:00100000:3.0:1746143697.229238:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766d80 with x1830963592348416 ext(1048576->2097151) 00002000:00010000:3.0:1746143697.229240:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090766d80 00000100:00100000:0.0:1746143697.229241:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592348160:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143697.229246:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3646 00000100:00100000:3.0:1746143697.229250:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963592348416:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143697.230406:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592346368:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19847us (20310us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143697.230414:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3640 00002000:00100000:0.0:1746143697.230421:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880090764a80 x1830963592346368/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.230436:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764a80 with x1830963592346368 ext(0->1048575) 00002000:00010000:0.0:1746143697.230440:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090764a80 00002000:00100000:1.0:1746143697.231392:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880090764380 x1830963592347904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.231400:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764380 with x1830963592347904 ext(1048576->2097151) 00002000:00010000:1.0:1746143697.231404:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090764380 00000100:00100000:1.0:1746143697.231417:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3647 00000100:00100000:1.0:1746143697.231423:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592347904:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143697.239911:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592346880:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28741us (29711us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143697.239923:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3642 00002000:00100000:1.0:1746143697.239934:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880090766a00 x1830963592346880/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.239943:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766a00 with x1830963592346880 ext(1048576->2097151) 00002000:00010000:1.0:1746143697.239950:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090766a00 00000100:00100000:2.0:1746143697.251422:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592346624:12345-192.168.202.48@tcp:3:cat.0 Request processed in 40851us (41245us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143697.251434:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3641 00002000:00100000:2.0:1746143697.251445:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880090767b80 x1830963592346624/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.251456:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767b80 with x1830963592346624 ext(1048576->2097151) 00002000:00010000:2.0:1746143697.251462:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767b80 00000100:00100000:2.0:1746143697.262097:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963592347648:12345-192.168.202.48@tcp:3:cat.0 Request processed in 44710us (49341us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143697.262109:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3644 00002000:00100000:2.0:1746143697.262122:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88009bfe1c00 x1830963592347648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.262131:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1c00 with x1830963592347648 ext(0->1048575) 00002000:00010000:2.0:1746143697.262137:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1c00 00000100:00100000:0.0:1746143697.267417:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.270259:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592348544 00000100:00100000:2.0:1746143697.270275:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592348544 00000100:00100000:2.0:1746143697.270353:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9825 00000100:00100000:2.0:1746143697.270364:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28522:x1830963592348544:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143697.270385:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143697.270407:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1cd2 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.271471:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130639200/0xe984082ccd726208 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c69 expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.271483:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca76e00/0xe984082ccd7262a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ccb expref: 32 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.271490:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143697.271491:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143697.271494:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3493888->4194303] (req 3493888->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 20 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.271525:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca76e00/0xe984082ccd7262a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ccb expref: 32 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.271537:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca76e00/0xe984082ccd7262a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ccb expref: 32 pid: 15784 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746143697.271548:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593771392:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143697.271628:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592347136:12345-192.168.202.48@tcp:3:cat.0 Request processed in 58812us (60552us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143697.271637:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3643 00002000:00100000:1.0:1746143697.271646:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009bfe0000 x1830963592347136/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.271654:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0000 with x1830963592347136 ext(1048576->2097151) 00002000:00010000:1.0:1746143697.271659:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0000 00010000:00010000:2.0:1746143697.272003:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130639200/0xe984082ccd726208 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c69 expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.272012:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130639200/0xe984082ccd726208 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c69 expref: 20 pid: 25369 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746143697.272021:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593771520:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143697.272044:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143697.294734:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592348160:12345-192.168.202.48@tcp:3:cat.0 Request processed in 65483us (66297us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143697.294750:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3645 00002000:00100000:2.0:1746143697.294763:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880090764700 x1830963592348160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.294773:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764700 with x1830963592348160 ext(1048576->2097151) 00002000:00010000:2.0:1746143697.294779:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090764700 00000100:00100000:3.0:1746143697.306038:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592348416:12345-192.168.202.48@tcp:3:cat.0 Request processed in 76774us (76885us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143697.306048:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3646 00002000:00100000:3.0:1746143697.306062:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880090766d80 x1830963592348416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143697.306071:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766d80 with x1830963592348416 ext(1048576->2097151) 00002000:00010000:3.0:1746143697.306078:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090766d80 00000100:00100000:2.0:1746143697.310243:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.310260:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.310312:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592348800 00000100:00100000:2.0:1746143697.310321:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592348800 00010000:00010000:2.0:1746143697.310360:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130639200/0xe984082ccd726208 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c69 expref: 21 pid: 25369 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.310857:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593771392:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143697.310870:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593771520:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143697.310897:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3493888->4194303] (req 3493888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 21 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.310915:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94ce00, rc 0) 00000100:00100000:0.0:1746143697.310962:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28522:x1830963592348544:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 40599us (43553us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.310971:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9825 00000100:00100000:2.0:1746143697.311570:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592348672 00000100:00100000:2.0:1746143697.311573:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592348672 00010000:00010000:2.0:1746143697.311590:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca76e00/0xe984082ccd7262a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ccb expref: 31 pid: 15784 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746143697.312077:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5071 00000100:00100000:2.0:1746143697.312085:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592348800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143697.312099:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143697.312122:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130639200/0xe984082ccd726208 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c69 expref: 20 pid: 25369 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746143697.312496:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5072 00000100:00100000:3.0:1746143697.312506:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963592348672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143697.312514:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143697.312984:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592347904:12345-192.168.202.48@tcp:3:cat.0 Request processed in 81559us (91756us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143697.312994:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3647 00002000:00100000:1.0:1746143697.313005:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880090764380 x1830963592347904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.313014:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764380 with x1830963592347904 ext(1048576->2097151) 00002000:00010000:1.0:1746143697.313019:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090764380 00010000:00010000:2.0:1746143697.313337:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130639200/0xe984082ccd726208 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c69 expref: 20 pid: 25369 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.313620:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.313648:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.313663:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592348928 00000100:00100000:0.0:1746143697.313668:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592348928 00000100:00100000:0.0:1746143697.313693:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592349056 00000100:00100000:0.0:1746143697.313694:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592349056 00000100:00100000:0.0:1746143697.313706:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9826 00000100:00100000:0.0:1746143697.313711:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592348928:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143697.313725:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143697.313740:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009465d800/0xe984082ccd7262cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1cd9 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143697.313783:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593771648:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143697.313845:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f000 going to sleep for 11 seconds 00010000:00010000:3.0:1746143697.314720:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca76e00/0xe984082ccd7262a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ccb expref: 29 pid: 15784 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746143697.314734:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca76e00/0xe984082ccd7262a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ccb expref: 29 pid: 15784 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746143697.314758:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca76e00/0xe984082ccd7262a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ccb expref: 29 pid: 15784 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746143697.314777:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143697.314822:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9827 00000100:00100000:3.0:1746143697.314830:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592349056:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.314841:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.314848:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ffc5a00/0xe984082ccd7262d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ce0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.314863:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.314870:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc5a00/0xe984082ccd7262d3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ce0 expref: 22 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.314878:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc5a00/0xe984082ccd7262d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ce0 expref: 22 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.314885:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc5a00, rc 0) 00000100:00100000:3.0:1746143697.314911:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592349056:12345-192.168.202.48@tcp:101:cat.0 Request processed in 83us (1261us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143697.314917:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9827 00000100:00100000:3.0:1746143697.314947:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592348672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2443us (4685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.314953:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5072 00010000:00010000:2.0:1746143697.315067:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130639200/0xe984082ccd726208 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c69 expref: 20 pid: 25369 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746143697.315080:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143697.315081:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143697.315088:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 19 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.315095:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 19 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.315121:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 19 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143697.315131:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593771776:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143697.315588:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143697.329300:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:1.0:1746143697.329921:0:6929:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime: 1746143696 -> 1746143697 00000100:00100000:1.0:1746143697.329948:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593771648:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143697.329983:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009465d800/0xe984082ccd7262cc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd9 expref: 20 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.329998:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009465d800/0xe984082ccd7262cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd9 expref: 20 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.330415:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009465d800, rc 0) 00000100:00100000:2.0:1746143697.331684:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593771776:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143697.331703:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143697.331948:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592349184 00000100:00100000:3.0:1746143697.331957:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592349184 00000100:00100000:3.0:1746143697.332013:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8334 00000100:00100000:3.0:1746143697.332021:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+14:28531:x1830963592349184:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143697.332044:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.332061:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc4a00/0xe984082ccd7262da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ce7 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.332118:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd7262e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.332132:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd7262e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.332158:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd7262e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.332170:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc4000/0xe984082ccd7262e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.332175:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc4000/0xe984082ccd7262e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.332181:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc4000/0xe984082ccd7262e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.332291:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.332300:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ca8 expref: 254 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.332385:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.332422:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ca8 expref: 254 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.332433:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ca8 expref: 254 pid: 21713 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746143697.332446:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593771904:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143697.333615:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592348928:12345-192.168.202.48@tcp:101:cat.0 Request processed in 19893us (19985us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143697.333626:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9826 00000100:00100000:2.0:1746143697.333946:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592348800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 21859us (23712us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143697.333955:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5071 00000100:00100000:3.0:1746143697.334057:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143697.334071:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.334106:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592349440 00000100:00100000:0.0:1746143697.334112:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592349440 00002000:00100000:0.0:1746143697.334247:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3493888->3497983) req@ffff880130fd6a00 x1830963592349440/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.334257:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6a00 with x1830963592349440 ext(3493888->3497983) 00002000:00010000:0.0:1746143697.334262:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd6a00 00000100:00100000:1.0:1746143697.334492:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3648 00000100:00100000:1.0:1746143697.334501:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592349440:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143697.337371:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592349440:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 2857us (3285us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143697.337385:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3648 00002000:00100000:1.0:1746143697.337399:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3493888->3497983) req@ffff880130fd6a00 x1830963592349440/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.337409:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6a00 with x1830963592349440 ext(3493888->3497983) 00002000:00010000:1.0:1746143697.337415:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd6a00 00000100:00100000:0.0:1746143697.339221:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.339257:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592349696 00000100:00100000:1.0:1746143697.339266:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592349696 00002000:00100000:1.0:1746143697.339311:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880090765f80 x1830963592349696/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 504/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.339321:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765f80 with x1830963592349696 ext(2097152->3145727) 00002000:00010000:1.0:1746143697.339326:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090765f80 00000100:00100000:1.0:1746143697.339359:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3649 00000100:00100000:1.0:1746143697.339367:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963592349696:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143697.340342:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.340440:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592349824 00000100:00100000:0.0:1746143697.340448:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592349824 00000100:00100000:0.0:1746143697.340493:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9828 00000100:00100000:0.0:1746143697.340499:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28529:x1830963592349824:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143697.340516:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143697.340531:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1cee expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.340554:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 31 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.340561:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143697.340563:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143697.340566:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.340592:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 31 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.340605:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 31 pid: 9527 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746143697.340616:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593772032:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143697.340680:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143697.340802:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593771904:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143697.340838:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143697.341891:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.352407:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.352663:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592349952 00000100:00100000:2.0:1746143697.352674:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592349952 00010000:00010000:2.0:1746143697.352710:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ca8 expref: 255 pid: 21713 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746143697.352823:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593772032:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143697.352848:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.352862:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009465c800, rc 0) 00000100:00100000:2.0:1746143697.353462:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5073 00000100:00100000:2.0:1746143697.353471:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1965:x1830963592349952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143697.353483:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143697.353490:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ca8 expref: 255 pid: 21713 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746143697.353499:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ca8 expref: 255 pid: 21713 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746143697.353515:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca76a00/0xe984082ccd7262b7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ca8 expref: 255 pid: 21713 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746143697.353554:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143697.353559:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353566:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353572:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353587:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143697.353600:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353607:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143697.353644:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:2.0:1746143697.353648:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143697.353667:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353677:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353684:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd7262e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353689:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd7262e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353694:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd7262e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353698:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffc5800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143697.353702:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd7262e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353707:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd7262e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353714:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143697.353716:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143697.353719:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd7262e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353723:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd7262e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353734:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc4000/0xe984082ccd7262e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353739:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc4000/0xe984082ccd7262e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353743:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc4000/0xe984082ccd7262e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353747:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffc4000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143697.353749:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc4000/0xe984082ccd7262e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353754:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc4000/0xe984082ccd7262e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353760:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ba5a000) 00010000:00010000:2.0:1746143697.353761:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143697.353763:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc4000/0xe984082ccd7262e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.353767:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc4000/0xe984082ccd7262e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00000100:00100000:3.0:1746143697.353781:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592350080 00000100:00100000:3.0:1746143697.353789:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592350080 00010000:00010000:2.0:1746143697.353799:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc4a00/0xe984082ccd7262da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ce7 expref: 16 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.353809:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ce7 expref: 15 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.353824:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143697.353827:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143697.353828:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc5400, rc 0) 00002000:00100000:3.0:1746143697.353859:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2633728->3031039) req@ffff88009bfe0380 x1830963592350080/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143697.353869:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0380 with x1830963592350080 ext(2633728->3031039) 00010000:00010000:3.0:1746143697.353877:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 32 pid: 9527 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746143697.353891:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 32 pid: 9527 timeout: 876 lvb_type: 0 00002000:00010000:3.0:1746143697.353898:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe0380 00000100:00100000:3.0:1746143697.353922:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 889 00000100:00100000:3.0:1746143697.353930:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592350080:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143697.354252:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28529:x1830963592349824:12345-192.168.202.48@tcp:101:cat.0 Request processed in 13750us (13910us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.354259:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9828 00000100:00100000:1.0:1746143697.354683:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:1965:x1830963592349952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1210us (12792us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143697.354691:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5073 00000100:00100000:1.0:1746143697.354922:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963592349696:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15555us (15709us total) trans 0 rc 651264/651264 00000100:00100000:1.0:1746143697.354929:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3649 00002000:00100000:1.0:1746143697.354936:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880090765f80 x1830963592349696/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 504/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 651264/651264 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.354943:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765f80 with x1830963592349696 ext(2097152->3145727) 00010000:00010000:1.0:1746143697.354948:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 32 pid: 9527 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.354957:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 32 pid: 9527 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746143697.354963:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090765f80 00000100:00100000:2.0:1746143697.355638:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:28531:x1830963592349184:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 23614us (26345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143697.355646:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8334 00000100:00100000:0.0:1746143697.369310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.374954:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592350208 00000100:00100000:2.0:1746143697.374971:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592350208 00000100:00100000:2.0:1746143697.375041:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9829 00000100:00100000:2.0:1746143697.375050:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28522:x1830963592350208:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143697.375072:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143697.375094:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1cf5 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.375123:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143697.375126:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746143697.375363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143697.375706:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->4378623] (req 4194304->4378623) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.375722:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->4378623] (req 4194304->4378623) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.375734:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94dc00, rc 0) 00000100:00100000:2.0:1746143697.375801:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28522:x1830963592350208:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 752us (6503us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143697.375807:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9829 00000100:00100000:1.0:1746143697.377182:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.379249:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592350336 00000100:00100000:2.0:1746143697.379263:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592350336 00000100:00100000:2.0:1746143697.379301:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9830 00000100:00100000:2.0:1746143697.379311:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592350336:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143697.379328:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143697.379345:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c94d800/0xe984082ccd726304 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1cfc expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.379369:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143697.379371:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143697.379380:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94d800/0xe984082ccd726304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cfc expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.379394:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c94d800/0xe984082ccd726304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cfc expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.379404:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94d800, rc 0) 00000100:00100000:2.0:1746143697.379451:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592350336:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 142us (4089us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143697.379457:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9830 00000100:00100000:1.0:1746143697.382127:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.382170:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.382193:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.382216:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592350464 00000100:00100000:1.0:1746143697.382224:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592350464 00000100:00100000:1.0:1746143697.382264:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592350592 00000100:00100000:1.0:1746143697.382266:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592350592 00000100:00100000:1.0:1746143697.382277:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592350720 00000100:00100000:1.0:1746143697.382279:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592350720 00000100:00100000:1.0:1746143697.382289:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592350848 00000100:00100000:1.0:1746143697.382291:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592350848 00000100:00100000:1.0:1746143697.382319:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9831 00000100:00100000:1.0:1746143697.382326:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592350464:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143697.382344:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.382363:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e200/0xe984082ccd72630b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d03 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.382386:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.382387:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.382395:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e200/0xe984082ccd72630b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d03 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.382409:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e200/0xe984082ccd72630b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d03 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.382418:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae5e200, rc 0) 00000100:00100000:1.0:1746143697.382453:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592350464:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 128us (5277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143697.382460:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9831 00000100:00100000:1.0:1746143697.382472:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9832 00000100:00100000:1.0:1746143697.382476:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1963:x1830963592350592:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143697.382481:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.382485:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e400/0xe984082ccd726312 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d0a expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.382494:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.382495:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.382498:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e400/0xe984082ccd726312 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d0a expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.382505:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e400/0xe984082ccd726312 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d0a expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.382511:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae5e400, rc 0) 00000100:00100000:1.0:1746143697.382520:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592350592:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 44us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143697.382524:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9832 00000100:00100000:1.0:1746143697.382531:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9833 00000100:00100000:1.0:1746143697.382535:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592350720:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143697.382540:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.382548:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ae5e600/0xe984082ccd726319 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d11 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.382556:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.382557:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.382560:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae5e600/0xe984082ccd726319 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d11 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.382568:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ae5e600/0xe984082ccd726319 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d11 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.382574:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae5e600, rc 0) 00000100:00100000:1.0:1746143697.382582:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592350720:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 47us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143697.382586:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9833 00000100:00100000:1.0:1746143697.382591:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9834 00000100:00100000:1.0:1746143697.382594:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592350848:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143697.382598:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.382603:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ae5e800/0xe984082ccd726320 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d18 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143697.382638:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593772160:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143697.382692:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.382702:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592350976 00000100:00100000:1.0:1746143697.382704:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592350976 00000100:00100000:1.0:1746143697.382716:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9835 00000100:00100000:1.0:1746143697.382720:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592350976:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143697.382725:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.382730:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f000/0xe984082ccd726327 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d1f expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143697.382751:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593772288:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143697.382799:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.382825:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592351104 00000100:00100000:1.0:1746143697.382828:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592351104 00000100:00100000:1.0:1746143697.382845:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9836 00000100:00100000:1.0:1746143697.382849:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28530:x1830963592351104:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143697.382856:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.382862:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f800/0xe984082ccd72632e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d26 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.382879:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.382885:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143697.382886:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143697.382889:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f800/0xe984082ccd72632e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d26 expref: 29 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.382904:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.382914:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 18 pid: 9527 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746143697.382921:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593772416:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143697.384307:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592350080:12345-192.168.202.48@tcp:4:cat.0 Request processed in 30373us (31909us total) trans 17179872501 rc 0/0 00000100:00100000:1.0:1746143697.384316:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 889 00002000:00100000:1.0:1746143697.384325:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (2633728->3031039) req@ffff88009bfe0380 x1830963592350080/t17179872501(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/448 e 0 to 0 dl 1746143708 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.384333:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0380 with x1830963592350080 ext(2633728->3031039) 00010000:00010000:1.0:1746143697.384341:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 32 pid: 9527 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.384350:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 32 pid: 9527 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746143697.384355:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe0380 00000100:00100000:0.0:1746143697.390495:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.390590:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.391103:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143697.391172:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593772160:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143697.391202:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ae5e800/0xe984082ccd726320 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d18 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.391217:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae5e800/0xe984082ccd726320 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d18 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.391234:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae5e800, rc 0) 00000100:00100000:1.0:1746143697.391278:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592350848:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 8681us (9083us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143697.391286:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9834 00000100:00100000:1.0:1746143697.391321:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592351360 00000100:00100000:1.0:1746143697.391327:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592351360 00002000:00100000:1.0:1746143697.391358:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3493888->4194303) req@ffff8800930d0380 x1830963592351360/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.391374:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0380 with x1830963592351360 ext(3493888->4194303) 00010000:00010000:1.0:1746143697.391381:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 8/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 19 pid: 9527 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.391391:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 8/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 19 pid: 9527 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746143697.391398:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d0380 00000100:00100000:1.0:1746143697.391410:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 890 00000100:00100000:1.0:1746143697.391416:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592351360:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143697.392013:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592351232 00000100:00100000:1.0:1746143697.392017:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592351232 00010000:00010000:1.0:1746143697.392035:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 32 pid: 9527 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746143697.392054:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5074 00000100:00100000:1.0:1746143697.392058:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963592351232:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143697.392066:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143697.392076:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 32 pid: 9527 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.392085:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 32 pid: 9527 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.392103:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a034b600/0xe984082ccd726224 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2633728->3031039) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c85 expref: 32 pid: 9527 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.392117:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.392119:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.392127:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.392135:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.392165:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.392166:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.392169:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.392175:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.392201:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143697.392212:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593772544:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143697.392273:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143697.392280:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ad880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593772672:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143697.392293:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143697.394056:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7300 going to sleep for 11 seconds 00002000:00010000:2.0:1746143697.394099:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143696 -> 1746143697 00000100:00100000:2.0:1746143697.394123:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593772288:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143697.394183:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f000/0xe984082ccd726327 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d1f expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.394195:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f000/0xe984082ccd726327 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d1f expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.394216:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae5f000, rc 0) 00000100:00100000:2.0:1746143697.394277:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1963:x1830963592350976:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 11545us (11573us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143697.394285:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9835 00000100:00100000:2.0:1746143697.398698:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.398764:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593772544:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143697.398775:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ad880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593772672:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143697.398797:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143697.400136:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143697.400183:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593772416:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143697.400208:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f800/0xe984082ccd72632e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d26 expref: 29 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.400226:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae5f800, rc 0) 00000100:00100000:1.0:1746143697.402329:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28530:x1830963592351104:12345-192.168.202.48@tcp:101:cat.0 Request processed in 19466us (19517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143697.402341:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9836 00000100:00100000:2.0:1746143697.403536:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963592351232:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 11467us (13043us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143697.403549:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5074 00000100:00100000:2.0:1746143697.403626:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592351616 00000100:00100000:2.0:1746143697.403634:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592351616 00002000:00100000:2.0:1746143697.403678:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4374528->4378623) req@ffff880130fd6680 x1830963592351616/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.403687:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6680 with x1830963592351616 ext(4374528->4378623) 00002000:00010000:2.0:1746143697.403693:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd6680 00000100:00100000:2.0:1746143697.403714:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3650 00000100:00100000:2.0:1746143697.403721:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592351616:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143697.407041:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592351616:12345-192.168.202.48@tcp:3:cat.0 Request processed in 3306us (8339us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143697.407055:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3650 00002000:00100000:2.0:1746143697.407071:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4374528->4378623) req@ffff880130fd6680 x1830963592351616/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.407081:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6680 with x1830963592351616 ext(4374528->4378623) 00002000:00010000:2.0:1746143697.407089:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd6680 00000100:00100000:3.0:1746143697.408484:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.408870:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.408941:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592351872 00000100:00100000:2.0:1746143697.408951:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592351872 00000100:00100000:2.0:1746143697.408996:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8335 00000100:00100000:2.0:1746143697.409004:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:28531:x1830963592351872:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143697.409027:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143697.409045:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94cc00/0xe984082ccd726335 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d2d expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.409162:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0xe984082ccd72633c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.409176:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ce7 expref: 16 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.409183:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0xe984082ccd72633c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.409215:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ce7 expref: 16 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.409225:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ce7 expref: 16 pid: 21713 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746143697.409238:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593772800:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143697.412553:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592351360:12345-192.168.202.48@tcp:4:cat.0 Request processed in 21126us (21951us total) trans 21474839765 rc 0/0 00000100:00100000:1.0:1746143697.412566:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 890 00002000:00100000:1.0:1746143697.412580:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3493888->4194303) req@ffff8800930d0380 x1830963592351360/t21474839765(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/448 e 0 to 0 dl 1746143708 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.412589:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0380 with x1830963592351360 ext(3493888->4194303) 00010000:00010000:1.0:1746143697.412601:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 21 pid: 9527 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.412613:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 21 pid: 9527 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746143697.412619:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d0380 00000100:00100000:1.0:1746143697.412645:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592352128 00000100:00100000:1.0:1746143697.412652:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592352128 00002000:00100000:1.0:1746143697.412681:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88012f185880 x1830963592352128/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.412688:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185880 with x1830963592352128 ext(2097152->3145727) 00002000:00010000:1.0:1746143697.412692:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185880 00000100:00100000:1.0:1746143697.412718:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3651 00000100:00100000:1.0:1746143697.412724:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592352128:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143697.415959:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143697.417598:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.417625:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592352384 00000100:00100000:0.0:1746143697.417633:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592352384 00000100:00100000:0.0:1746143697.417678:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3400 00000100:00100000:0.0:1746143697.417686:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28522:x1830963592352384:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143697.417959:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28522:x1830963592352384:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 272us (368us total) trans 8589942447 rc 0/0 00000100:00100000:0.0:1746143697.417968:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3400 00000100:00100000:3.0:1746143697.418553:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593772800:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143697.418578:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0xe984082ccd72633c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143697.420315:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.420379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.420450:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592352512 00000100:00100000:3.0:1746143697.420457:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592352512 00010000:00010000:3.0:1746143697.420489:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ce7 expref: 17 pid: 21713 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746143697.420512:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592352640 00000100:00100000:3.0:1746143697.420513:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592352640 00010000:00010000:3.0:1746143697.420523:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 21 pid: 9527 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746143697.420537:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5075 00000100:00100000:3.0:1746143697.420543:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+17:1965:x1830963592352512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143697.420554:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143697.420559:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ce7 expref: 17 pid: 21713 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746143697.420568:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ce7 expref: 17 pid: 21713 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746143697.420587:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5400/0xe984082ccd7262ef lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ce7 expref: 17 pid: 21713 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746143697.420616:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143697.420621:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0xe984082ccd72633c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.420633:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0xe984082ccd72633c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.420640:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0xe984082ccd72633c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.420659:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143697.420696:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:1965:x1830963592352512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 152us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.420703:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5075 00000100:00100000:3.0:1746143697.420719:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5076 00000100:00100000:3.0:1746143697.420724:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592352640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143697.420732:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143697.420750:0:7151:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143696 -> 1746143697 00002000:00010000:3.0:1746143697.420752:0:7151:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143696 -> 1746143697 00010000:00010000:3.0:1746143697.420757:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 21 pid: 9527 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746143697.420765:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 21 pid: 9527 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746143697.420780:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c94ce00/0xe984082ccd7262c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cd2 expref: 21 pid: 9527 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746143697.420792:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.420794:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.420800:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f800/0xe984082ccd72632e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d26 expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.420808:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f800/0xe984082ccd72632e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d26 expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.420848:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f800/0xe984082ccd72632e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d26 expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143697.420860:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593772928:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143697.420908:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa90c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143697.420929:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0xe984082ccd72633c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.420935:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0xe984082ccd72633c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143697.420953:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143697.421083:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94cc00/0xe984082ccd726335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d2d expref: 17 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.421094:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0xe984082ccd72633c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d2d expref: 16 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.421100:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143697.421103:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143697.421105:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94d400, rc 0) 00000100:00100000:3.0:1746143697.421128:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:28531:x1830963592351872:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 12126us (12258us total) trans 8589942448 rc 0/0 00000100:00100000:3.0:1746143697.421134:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8335 00000100:00100000:2.0:1746143697.425945:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592352128:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13206us (17453us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143697.425957:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3651 00002000:00100000:2.0:1746143697.425972:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88012f185880 x1830963592352128/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.425983:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185880 with x1830963592352128 ext(2097152->3145727) 00002000:00010000:2.0:1746143697.425989:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185880 00000100:00100000:0.0:1746143697.428694:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.428797:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593772928:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143697.428825:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143697.428846:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592352896 00000100:00100000:2.0:1746143697.428854:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592352896 00002000:00100000:2.0:1746143697.428901:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800930d1880 x1830963592352896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143697.429758:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592352640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9029us (9373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.429769:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5076 00002000:00100000:2.0:1746143697.429873:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1880 with x1830963592352896 ext(2097152->3145727) 00002000:00010000:2.0:1746143697.429879:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1880 00000100:00100000:2.0:1746143697.429896:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3652 00000100:00100000:2.0:1746143697.429905:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592352896:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143697.441973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.442595:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592353152 00000100:00100000:3.0:1746143697.442605:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592353152 00000100:00100000:3.0:1746143697.442657:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8336 00000100:00100000:3.0:1746143697.442665:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:28531:x1830963592353152:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143697.442690:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.442694:0:16090:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143697.442722:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0xe984082ccd72633c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d2d expref: 16 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.442739:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143697.442743:0:16090:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143697.442755:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5e00/0xe984082ccd72634a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d34 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.442862:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd726351 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143697.442874:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd726351 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143697.442881:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd726351 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143697.442890:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd726351 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143697.442897:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd726351 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143697.442902:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd726351 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143697.442906:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffc5800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143697.442910:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd726351 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143697.442915:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd726351 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143697.442921:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143697.442923:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143697.442925:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd726351 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143697.442929:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5800/0xe984082ccd726351 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143697.442961:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5e00/0xe984082ccd72634a lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d34 expref: 16 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.442969:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc5e00/0xe984082ccd72634a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d34 expref: 16 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.442975:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc5e00, rc 0) 00000100:00100000:3.0:1746143697.443022:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:28531:x1830963592353152:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 358us (1061us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143697.443029:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8336 00000100:00100000:3.0:1746143697.446395:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.449597:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592353280 00000100:00100000:1.0:1746143697.449612:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592353280 00000100:00100000:1.0:1746143697.449675:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9837 00000100:00100000:1.0:1746143697.449684:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28529:x1830963592353280:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143697.449705:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.449727:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a652ac00/0xe984082ccd726358 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d3b expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.449758:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.449759:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.449768:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a652ac00/0xe984082ccd726358 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d3b expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.449783:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a652ac00/0xe984082ccd726358 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d3b expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.449794:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a652ac00, rc 0) 00000100:00100000:1.0:1746143697.449876:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28529:x1830963592353280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 192us (3489us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143697.449883:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9837 00000100:00100000:3.0:1746143697.459553:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.459670:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.459699:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592353664 00000100:00100000:3.0:1746143697.459707:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592353664 00000100:00100000:3.0:1746143697.459762:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3401 00000100:00100000:3.0:1746143697.459771:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:28531:x1830963592353664:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143697.460424:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592353408 00000100:00100000:1.0:1746143697.460429:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592353408 00000100:00100000:1.0:1746143697.460456:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9838 00000100:00100000:1.0:1746143697.460462:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:28528:x1830963592353408:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143697.460473:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.460490:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d42 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.460517:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.460525:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143697.460527:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143697.460531:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.460558:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.460569:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 20 pid: 6929 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746143697.460580:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593773056:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143697.460645:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143697.461076:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:28531:x1830963592353664:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 1305us (1405us total) trans 8589942449 rc 0/0 00000100:00100000:3.0:1746143697.461084:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3401 00000100:00100000:2.0:1746143697.461324:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592352896:12345-192.168.202.48@tcp:3:cat.0 Request processed in 31420us (32639us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143697.461332:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3652 00002000:00100000:2.0:1746143697.461341:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800930d1880 x1830963592352896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.461349:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1880 with x1830963592352896 ext(2097152->3145727) 00002000:00010000:2.0:1746143697.461354:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1880 00000100:00100000:1.0:1746143697.471976:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.471994:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.472058:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.472105:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592353920 00000100:00100000:1.0:1746143697.472112:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592353920 00002000:00100000:1.0:1746143697.472174:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f0ac000 x1830963592353920/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.472189:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ac000 with x1830963592353920 ext(2097152->3145727) 00002000:00010000:1.0:1746143697.472194:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ac000 00000100:00100000:1.0:1746143697.472208:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592354176 00000100:00100000:1.0:1746143697.472209:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592354176 00002000:00100000:1.0:1746143697.472217:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f0af800 x1830963592354176/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.472223:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0af800 with x1830963592354176 ext(3145728->4194303) 00002000:00010000:1.0:1746143697.472225:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0af800 00000100:00100000:1.0:1746143697.472233:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592354432 00000100:00100000:1.0:1746143697.472234:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592354432 00002000:00100000:1.0:1746143697.472244:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f0ad880 x1830963592354432/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.472250:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad880 with x1830963592354432 ext(3145728->4194303) 00010000:00010000:1.0:1746143697.472258:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 21 pid: 6929 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.472272:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 21 pid: 6929 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746143697.472279:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f0ad880 00000100:00100000:1.0:1746143697.472293:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 891 00000100:00100000:1.0:1746143697.472299:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592354432:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143697.474757:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3653 00000100:00100000:0.0:1746143697.476222:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592353920:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143697.477124:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3654 00000100:00100000:1.0:1746143697.477136:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592354176:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143697.479299:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.493767:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592354560 00000100:00100000:0.0:1746143697.493783:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592354560 00000100:00100000:0.0:1746143697.493851:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9839 00000100:00100000:0.0:1746143697.493859:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:28530:x1830963592354560:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143697.493878:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143697.493897:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009465d200/0xe984082ccd726366 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d49 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.493925:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.493928:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.493935:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009465d200/0xe984082ccd726366 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d49 expref: 34 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.493950:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009465d200/0xe984082ccd726366 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d49 expref: 34 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.493960:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009465d200, rc 0) 00000100:00100000:0.0:1746143697.494018:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:28530:x1830963592354560:12345-192.168.202.48@tcp:101:cat.0 Request processed in 159us (14728us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.494024:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9839 00000100:00100000:0.0:1746143697.494535:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593773056:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143697.494558:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.494569:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0559600, rc 0) 00000100:00100000:0.0:1746143697.494591:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:28528:x1830963592353408:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 34128us (35050us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.494597:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9838 00000100:00100000:1.0:1746143697.504868:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592354432:12345-192.168.202.48@tcp:3:cat.0 Request processed in 32557us (32797us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143697.504881:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 891 00002000:00100000:1.0:1746143697.504894:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f0ad880 x1830963592354432/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.504903:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad880 with x1830963592354432 ext(3145728->4194303) 00010000:00010000:1.0:1746143697.504914:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 21 pid: 6929 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.504929:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 21 pid: 6929 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746143697.504936:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f0ad880 00000100:00100000:1.0:1746143697.518930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.518955:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592354816 00000100:00100000:1.0:1746143697.518965:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592354816 00002000:00100000:1.0:1746143697.519011:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f0adf80 x1830963592354816/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.519021:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0adf80 with x1830963592354816 ext(3145728->4194303) 00002000:00010000:1.0:1746143697.519027:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0adf80 00000100:00100000:1.0:1746143697.519048:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3655 00000100:00100000:1.0:1746143697.519055:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963592354816:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143697.519304:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592354176:12345-192.168.202.48@tcp:3:cat.0 Request processed in 42169us (47306us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143697.519313:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3654 00002000:00100000:0.0:1746143697.519320:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f0af800 x1830963592354176/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.519328:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0af800 with x1830963592354176 ext(3145728->4194303) 00002000:00010000:0.0:1746143697.519332:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0af800 00000100:00100000:0.0:1746143697.519367:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.519433:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.519465:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592355072 00000100:00100000:0.0:1746143697.519469:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592355072 00002000:00100000:0.0:1746143697.519485:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800930d0e00 x1830963592355072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.519492:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0e00 with x1830963592355072 ext(3145728->4194303) 00002000:00010000:0.0:1746143697.519495:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d0e00 00000100:00100000:0.0:1746143697.519506:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3656 00000100:00100000:3.0:1746143697.519508:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592355200 00000100:00100000:3.0:1746143697.519512:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592355200 00000100:00100000:0.0:1746143697.519512:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592355072:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:3.0:1746143697.519537:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 21 pid: 6929 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746143697.519560:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5077 00000100:00100000:3.0:1746143697.519566:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592355200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143697.519577:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143697.519591:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 21 pid: 6929 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746143697.519603:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 21 pid: 6929 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746143697.519627:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009465c800/0xe984082ccd7262f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cee expref: 21 pid: 6929 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746143697.519649:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.519652:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.519660:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.519667:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.519700:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143697.519712:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593773184:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143697.519771:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143697.534670:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592353920:12345-192.168.202.48@tcp:3:cat.0 Request processed in 59397us (62693us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143697.534683:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3653 00002000:00100000:0.0:1746143697.534698:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f0ac000 x1830963592353920/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.534707:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ac000 with x1830963592353920 ext(2097152->3145727) 00002000:00010000:0.0:1746143697.534713:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ac000 00000100:00100000:0.0:1746143697.534912:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.534951:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593773184:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143697.534968:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143697.534992:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592355200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 15426us (15558us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.535000:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5077 00000100:00100000:0.0:1746143697.535035:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592355456 00000100:00100000:0.0:1746143697.535042:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592355456 00002000:00100000:0.0:1746143697.535071:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2805760->2809855) req@ffff8800930d3480 x1830963592355456/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.535078:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d3480 with x1830963592355456 ext(2805760->2809855) 00002000:00010000:0.0:1746143697.535082:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d3480 00000100:00100000:0.0:1746143697.535096:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3657 00000100:00100000:0.0:1746143697.535103:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963592355456:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143697.535252:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963592355456:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 149us (340us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143697.535258:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3657 00002000:00100000:0.0:1746143697.535263:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2805760->2809855) req@ffff8800930d3480 x1830963592355456/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.535270:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d3480 with x1830963592355456 ext(2805760->2809855) 00002000:00010000:0.0:1746143697.535272:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d3480 00000100:00100000:0.0:1746143697.546642:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.546669:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592355584 00000100:00100000:0.0:1746143697.546677:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592355584 00000100:00100000:0.0:1746143697.546718:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9840 00000100:00100000:0.0:1746143697.546726:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28529:x1830963592355584:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143697.546744:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143697.546762:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca77800/0xe984082ccd72636d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d50 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.546789:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.546791:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.546798:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca77800/0xe984082ccd72636d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d50 expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.546825:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca77800/0xe984082ccd72636d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d50 expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.546836:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca77800, rc 0) 00000100:00100000:0.0:1746143697.546880:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28529:x1830963592355584:12345-192.168.202.48@tcp:101:cat.0 Request processed in 154us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.546886:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9840 00000100:00100000:2.0:1746143697.546980:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592355072:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 27466us (27611us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143697.546988:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3656 00002000:00100000:2.0:1746143697.546998:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800930d0e00 x1830963592355072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.547012:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0e00 with x1830963592355072 ext(3145728->4194303) 00002000:00010000:2.0:1746143697.547017:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d0e00 00000100:00100000:1.0:1746143697.547262:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963592354816:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 28206us (28339us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143697.547272:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3655 00002000:00100000:1.0:1746143697.547278:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f0adf80 x1830963592354816/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.547285:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0adf80 with x1830963592354816 ext(3145728->4194303) 00002000:00010000:1.0:1746143697.547289:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0adf80 00000100:00100000:1.0:1746143697.559680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.559716:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.560167:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592356096 00000100:00100000:1.0:1746143697.560178:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592356096 00002000:00100000:1.0:1746143697.560228:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f533100 x1830963592356096/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.560238:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f533100 with x1830963592356096 ext(3145728->4194303) 00002000:00010000:1.0:1746143697.560244:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f533100 00000100:00100000:1.0:1746143697.560265:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3658 00000100:00100000:1.0:1746143697.560273:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592356096:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143697.569228:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592355840 00000100:00100000:3.0:1746143697.569243:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592355840 00000100:00100000:3.0:1746143697.569292:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8337 00000100:00100000:3.0:1746143697.569299:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28535:x1830963592355840:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143697.569323:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.569341:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ba00/0xe984082ccd726374 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d57 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.569443:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd72637b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.569456:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd72637b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.569467:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd72637b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.569478:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b800/0xe984082ccd726382 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.569483:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b800/0xe984082ccd726382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.569487:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b800/0xe984082ccd726382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570682:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd726389 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570695:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd726389 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570703:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd726389 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143697.570712:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143697.570791:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd72637b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570797:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd72637b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570803:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd72637b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570807:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a034b400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143697.570823:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd72637b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570829:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd72637b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570840:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143697.570843:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143697.570847:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd72637b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570851:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b400/0xe984082ccd72637b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570877:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b800/0xe984082ccd726382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570881:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b800/0xe984082ccd726382 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570885:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b800/0xe984082ccd726382 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570889:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a034b800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143697.570891:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b800/0xe984082ccd726382 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570895:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b800/0xe984082ccd726382 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570899:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d03c100) 00010000:00010000:3.0:1746143697.570901:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143697.570903:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b800/0xe984082ccd726382 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570907:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b800/0xe984082ccd726382 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.570950:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ba00/0xe984082ccd726374 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d57 expref: 22 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.570963:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd726389 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d57 expref: 21 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.570969:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143697.570970:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143697.570972:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034ac00, rc 0) 00000100:00100000:3.0:1746143697.571024:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28535:x1830963592355840:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1725us (11355us total) trans 8589942450 rc 0/0 00000100:00100000:3.0:1746143697.571031:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8337 00000100:00100000:1.0:1746143697.572061:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.572238:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592356224 00000100:00100000:1.0:1746143697.572247:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592356224 00000100:00100000:1.0:1746143697.572284:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9841 00000100:00100000:1.0:1746143697.572291:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28528:x1830963592356224:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143697.572307:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.572320:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d5e expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.572349:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f800/0xe984082ccd72632e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d26 expref: 30 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.572356:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a652ac00/0xe984082ccd726358 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d3b expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.572362:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.572364:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143697.572367:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2449407] (req 2097152->2449407) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.572395:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a652ac00/0xe984082ccd726358 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d3b expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.572406:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a652ac00/0xe984082ccd726358 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d3b expref: 20 pid: 4581 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746143697.572418:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593773312:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143697.572487:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f800/0xe984082ccd72632e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d26 expref: 30 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.572495:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f800/0xe984082ccd72632e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d26 expref: 30 pid: 4581 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746143697.572502:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593773440:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143697.572521:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143697.573417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.573476:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592356352 00000100:00100000:1.0:1746143697.573480:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592356352 00000100:00100000:1.0:1746143697.573508:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9842 00000100:00100000:1.0:1746143697.573513:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963592356352:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143697.573523:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.573533:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b103c00/0xe984082ccd72639e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d65 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143697.573564:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593773568:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143697.573594:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143697.593662:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593773312:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143697.593672:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593773440:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143697.593700:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->2449407] (req 2097152->2449407) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.593718:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a067e800, rc 0) 00000100:00100000:1.0:1746143697.593761:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:28528:x1830963592356224:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 21470us (21702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143697.593770:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9841 00000100:00100000:2.0:1746143697.593952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.594170:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592356096:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33897us (34452us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143697.594177:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3658 00002000:00100000:2.0:1746143697.594186:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f533100 x1830963592356096/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.594194:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f533100 with x1830963592356096 ext(3145728->4194303) 00002000:00010000:2.0:1746143697.594199:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f533100 00002000:00010000:2.0:1746143697.594226:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime: 1746143696 -> 1746143697 00002000:00010000:2.0:1746143697.594228:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime: 1746143696 -> 1746143697 00000100:00100000:2.0:1746143697.594241:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593773568:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143697.594261:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b103c00/0xe984082ccd72639e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d65 expref: 34 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.594271:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b103c00/0xe984082ccd72639e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d65 expref: 34 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.594278:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b103c00, rc 0) 00000100:00100000:2.0:1746143697.594292:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963592356352:12345-192.168.202.48@tcp:101:cat.0 Request processed in 20779us (20879us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143697.594296:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9842 00000100:00100000:0.0:1746143697.597697:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592356480 00000100:00100000:0.0:1746143697.597710:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592356480 00010000:00010000:0.0:1746143697.597759:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a652ac00/0xe984082ccd726358 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d3b expref: 21 pid: 4581 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746143697.597866:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5078 00000100:00100000:0.0:1746143697.597878:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592356480:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143697.597894:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143697.597923:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a652ac00/0xe984082ccd726358 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d3b expref: 21 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.597936:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a652ac00/0xe984082ccd726358 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d3b expref: 21 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.597960:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a652ac00/0xe984082ccd726358 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d3b expref: 21 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.597976:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143697.598043:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592356480:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 165us (4089us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.598050:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5078 00000100:00100000:0.0:1746143697.598159:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.598241:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592356608 00000100:00100000:0.0:1746143697.598246:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592356608 00010000:00010000:0.0:1746143697.598265:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f800/0xe984082ccd72632e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d26 expref: 30 pid: 4581 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746143697.598289:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5079 00000100:00100000:0.0:1746143697.598296:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592356608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143697.598306:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143697.598318:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f800/0xe984082ccd72632e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d26 expref: 30 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.598328:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f800/0xe984082ccd72632e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d26 expref: 30 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.598342:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae5f800/0xe984082ccd72632e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d26 expref: 30 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.598352:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.598354:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.598363:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.598372:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.598409:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143697.598423:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593773696:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143697.598506:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7600 going to sleep for 11 seconds 00010000:00010000:0.0:1746143697.598622:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143697.609004:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.609035:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.609115:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592356736 00000100:00100000:3.0:1746143697.609125:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592356736 00000100:00100000:3.0:1746143697.609178:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592356864 00000100:00100000:3.0:1746143697.609181:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592356864 00000100:00100000:3.0:1746143697.609198:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9843 00000100:00100000:3.0:1746143697.609206:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:28530:x1830963592356736:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.609224:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.609242:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a034b000/0xe984082ccd7263a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d6c expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.609269:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.609276:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143697.609278:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143697.609281:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a034b000/0xe984082ccd7263a5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d6c expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.609310:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.609321:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 20 pid: 6929 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746143697.609331:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593773824:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143697.609392:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143697.609407:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9844 00000100:00100000:3.0:1746143697.609411:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28529:x1830963592356864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.609418:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.609427:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd7263ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d73 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.609440:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.609445:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143697.609446:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143697.609448:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd7263ac lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d73 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.609461:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.609472:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 29 pid: 25369 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746143697.609479:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593773952:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143697.609494:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0736c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143697.613157:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593773696:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143697.613180:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143697.613235:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592356608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 14938us (15096us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.613247:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5079 00000100:00100000:1.0:1746143697.614527:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.614612:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592357120 00000100:00100000:0.0:1746143697.614620:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592357120 00002000:00100000:0.0:1746143697.614663:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2445312->2449407) req@ffff88008f532a00 x1830963592357120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.614673:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f532a00 with x1830963592357120 ext(2445312->2449407) 00010000:00010000:0.0:1746143697.614681:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 29 pid: 25369 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.614693:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 29 pid: 25369 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746143697.614699:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f532a00 00000100:00100000:0.0:1746143697.614726:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 892 00000100:00100000:0.0:1746143697.614734:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592357120:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143697.614941:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963592357120:12345-192.168.202.48@tcp:3:cat.0 Request processed in 207us (418us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143697.614947:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 892 00002000:00100000:0.0:1746143697.614952:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2445312->2449407) req@ffff88008f532a00 x1830963592357120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746143708 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.614959:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f532a00 with x1830963592357120 ext(2445312->2449407) 00010000:00010000:0.0:1746143697.614963:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 29 pid: 25369 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.614971:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 29 pid: 25369 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746143697.614977:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f532a00 00000100:00100000:3.0:1746143697.622912:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593773824:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143697.622952:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a034b000/0xe984082ccd7263a5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d6c expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.622973:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034b000, rc 0) 00000100:00100000:3.0:1746143697.623039:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:28530:x1830963592356736:12345-192.168.202.48@tcp:101:cat.0 Request processed in 13830us (14039us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.623049:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9843 00000100:00100000:3.0:1746143697.623287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.623334:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.623383:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.623421:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593773952:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143697.623441:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd7263ac lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d73 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.623453:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034ba00, rc 0) 00000100:00100000:3.0:1746143697.623485:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28529:x1830963592356864:12345-192.168.202.48@tcp:101:cat.0 Request processed in 14071us (14447us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.623495:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9844 00000100:00100000:1.0:1746143697.623707:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592357760 00000100:00100000:1.0:1746143697.623716:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592357760 00000100:00100000:1.0:1746143697.623763:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3402 00000100:00100000:1.0:1746143697.623772:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:28528:x1830963592357760:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143697.623972:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:28528:x1830963592357760:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 202us (639us total) trans 8589942451 rc 0/0 00000100:00100000:1.0:1746143697.623978:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3402 00000100:00100000:0.0:1746143697.624337:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592357248 00000100:00100000:0.0:1746143697.624341:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592357248 00002000:00100000:0.0:1746143697.624368:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4378623) req@ffff88012f184380 x1830963592357248/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.624377:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f184380 with x1830963592357248 ext(4194304->4378623) 00010000:00010000:0.0:1746143697.624384:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 21 pid: 6929 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.624395:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 21 pid: 6929 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746143697.624401:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f184380 00000100:00100000:0.0:1746143697.624413:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592357504 00000100:00100000:0.0:1746143697.624415:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592357504 00002000:00100000:0.0:1746143697.624427:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2449407) req@ffff88012f187480 x1830963592357504/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.624433:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187480 with x1830963592357504 ext(2097152->2449407) 00010000:00010000:0.0:1746143697.624437:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 29 pid: 25369 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.624444:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 29 pid: 25369 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746143697.624450:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f187480 00000100:00100000:0.0:1746143697.624460:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 893 00000100:00100000:0.0:1746143697.624465:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963592357248:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143697.624680:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 894 00000100:00100000:0.0:1746143697.624686:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963592357504:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143697.632540:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1962:x1830963592357248:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8063us (9245us total) trans 17179872502 rc 0/0 00000100:00100000:2.0:1746143697.632551:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 893 00002000:00100000:2.0:1746143697.632562:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4378623) req@ffff88012f184380 x1830963592357248/t17179872502(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/448 e 0 to 0 dl 1746143708 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.632571:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f184380 with x1830963592357248 ext(4194304->4378623) 00010000:00010000:2.0:1746143697.632582:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 23 pid: 6929 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746143697.632595:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 23 pid: 6929 timeout: 876 lvb_type: 0 00002000:00010000:2.0:1746143697.632602:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f184380 00000100:00100000:2.0:1746143697.637572:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.638042:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592357888 00000100:00100000:0.0:1746143697.638052:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592357888 00010000:00010000:0.0:1746143697.638088:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 23 pid: 6929 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746143697.639128:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5080 00000100:00100000:0.0:1746143697.639154:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963592357888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143697.639170:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143697.639193:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 23 pid: 6929 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.639204:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 23 pid: 6929 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.639226:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c94dc00/0xe984082ccd7262fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4378623) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cf5 expref: 23 pid: 6929 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.639247:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.639249:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.639257:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a034b000/0xe984082ccd7263a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d6c expref: 33 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.639265:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a034b000/0xe984082ccd7263a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d6c expref: 33 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.639300:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a034b000/0xe984082ccd7263a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d6c expref: 33 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143697.639311:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593774080:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143697.639387:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143697.648518:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963592357504:12345-192.168.202.48@tcp:4:cat.0 Request processed in 23820us (25124us total) trans 21474839766 rc 0/0 00000100:00100000:1.0:1746143697.648530:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 894 00002000:00100000:1.0:1746143697.648543:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->2449407) req@ffff88012f187480 x1830963592357504/t21474839766(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/448 e 0 to 0 dl 1746143708 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.648553:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187480 with x1830963592357504 ext(2097152->2449407) 00010000:00010000:1.0:1746143697.648563:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 31 pid: 25369 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.648577:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 31 pid: 25369 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746143697.648584:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f187480 00000100:00100000:0.0:1746143697.648945:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.648988:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593774080:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143697.649005:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143697.649025:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963592357888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9888us (11465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.649033:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5080 00000100:00100000:1.0:1746143697.650075:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592358144 00000100:00100000:1.0:1746143697.650081:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592358144 00002000:00100000:1.0:1746143697.650116:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800930d2a00 x1830963592358144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.650124:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d2a00 with x1830963592358144 ext(4194304->4898815) 00002000:00010000:1.0:1746143697.650127:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d2a00 00000100:00100000:1.0:1746143697.650870:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3659 00000100:00100000:1.0:1746143697.650878:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592358144:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143697.652475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.653170:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592358272 00000100:00100000:0.0:1746143697.653177:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592358272 00010000:00010000:0.0:1746143697.653209:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 31 pid: 25369 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746143697.653236:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5081 00000100:00100000:0.0:1746143697.653242:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592358272:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143697.653254:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143697.653276:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 31 pid: 25369 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.653288:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 31 pid: 25369 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.653309:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a067e800/0xe984082ccd726397 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d5e expref: 31 pid: 25369 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746143697.653325:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.653327:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.653334:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd7263ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d73 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.653342:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd7263ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d73 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.653374:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd7263ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d73 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143697.653387:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593774208:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143697.653452:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143697.660571:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963593774208:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143697.660595:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143697.660642:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592358272:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7398us (8171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.660653:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5081 00000100:00100000:0.0:1746143697.660980:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592358144:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10102us (12035us total) trans 0 rc 704512/704512 00000100:00100000:0.0:1746143697.660987:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3659 00002000:00100000:0.0:1746143697.660998:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800930d2a00 x1830963592358144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.661007:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d2a00 with x1830963592358144 ext(4194304->4898815) 00002000:00010000:0.0:1746143697.661012:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d2a00 00000100:00100000:0.0:1746143697.664197:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.664223:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592358528 00000100:00100000:0.0:1746143697.664231:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592358528 00002000:00100000:0.0:1746143697.664271:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800930d0700 x1830963592358528/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.664281:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0700 with x1830963592358528 ext(3145728->4194303) 00002000:00010000:0.0:1746143697.664286:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d0700 00000100:00100000:0.0:1746143697.664303:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3660 00000100:00100000:0.0:1746143697.664309:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592358528:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143697.670307:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.670632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.670676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.670950:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592358656 00000100:00100000:3.0:1746143697.670959:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592358656 00000100:00100000:3.0:1746143697.670992:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592358784 00000100:00100000:3.0:1746143697.670994:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592358784 00000100:00100000:3.0:1746143697.671005:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592358912 00000100:00100000:3.0:1746143697.671006:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592358912 00000100:00100000:3.0:1746143697.671295:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9845 00000100:00100000:3.0:1746143697.671304:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592358656:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.671324:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.671341:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a034b800/0xe984082ccd7263b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d7a expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.671372:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a034b800/0xe984082ccd7263b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d7a expref: 35 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.671381:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a034b800/0xe984082ccd7263b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d7a expref: 35 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.671389:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034b800, rc 0) 00000100:00100000:3.0:1746143697.671427:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963592358656:12345-192.168.202.48@tcp:101:cat.0 Request processed in 123us (1129us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143697.671433:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9845 00000100:00100000:3.0:1746143697.671453:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9846 00000100:00100000:3.0:1746143697.671457:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592358784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.671465:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.671475:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a034a200/0xe984082ccd7263ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d81 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.671491:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.671493:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.671500:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034a200/0xe984082ccd7263ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d81 expref: 31 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.671514:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a034a200/0xe984082ccd7263ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d81 expref: 31 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.671523:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034a200, rc 0) 00000100:00100000:3.0:1746143697.671536:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963592358784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 79us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.671541:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9846 00000100:00100000:3.0:1746143697.671551:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9847 00000100:00100000:3.0:1746143697.671559:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28535:x1830963592358912:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143697.671565:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.671571:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d88 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.671586:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130639400/0xe984082ccd7261ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c4d expref: 24 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.671594:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e200/0xe984082ccd72630b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d03 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.671605:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca77600/0xe984082ccd726294 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cb6 expref: 30 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.671611:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.671612:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143697.671615:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [1654784->2097151] (req 1654784->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.671640:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca77600/0xe984082ccd726294 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cb6 expref: 30 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.671652:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca77600/0xe984082ccd726294 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cb6 expref: 30 pid: 8495 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746143697.671664:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593774336:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143697.671713:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e200/0xe984082ccd72630b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d03 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.671721:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e200/0xe984082ccd72630b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d03 expref: 10 pid: 8495 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746143697.671728:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593774464:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143697.671750:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130639400/0xe984082ccd7261ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c4d expref: 24 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.671761:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130639400/0xe984082ccd7261ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c4d expref: 24 pid: 12618 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746143697.671768:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593774592:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143697.671784:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0736c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143697.684298:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.684315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.684328:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.684360:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592359168 00000100:00100000:0.0:1746143697.684370:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592359168 00010000:00010000:0.0:1746143697.684408:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca77600/0xe984082ccd726294 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cb6 expref: 31 pid: 8495 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.684434:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592359296 00000100:00100000:0.0:1746143697.684436:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592359296 00010000:00010000:0.0:1746143697.684447:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130639400/0xe984082ccd7261ec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c4d expref: 25 pid: 12618 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.684465:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592359040 00000100:00100000:0.0:1746143697.684467:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592359040 00010000:00010000:0.0:1746143697.684477:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e200/0xe984082ccd72630b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d03 expref: 11 pid: 8495 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.684491:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5082 00000100:00100000:0.0:1746143697.684499:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592359168:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143697.684513:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143697.684533:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:0.0:1746143697.684540:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca77600/0xe984082ccd726294 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cb6 expref: 31 pid: 8495 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746143697.684551:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca77600/0xe984082ccd726294 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cb6 expref: 31 pid: 8495 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746143697.684577:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143697.684620:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963592359168:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 121us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.684627:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5082 00000100:00100000:0.0:1746143697.684643:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5083 00000100:00100000:0.0:1746143697.684648:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963592359296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143697.684655:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143697.684662:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130639400/0xe984082ccd7261ec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c4d expref: 25 pid: 12618 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746143697.684665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143697.684674:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130639400/0xe984082ccd7261ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c4d expref: 25 pid: 12618 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746143697.684685:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143697.684699:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963592359296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.684705:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5083 00000100:00100000:0.0:1746143697.684714:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5084 00000100:00100000:0.0:1746143697.684719:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592359040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143697.684725:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143697.684733:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e200/0xe984082ccd72630b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d03 expref: 11 pid: 8495 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746143697.684742:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e200/0xe984082ccd72630b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d03 expref: 11 pid: 8495 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746143697.684753:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.684756:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.684763:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.684771:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.684801:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143697.684829:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593774720:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143697.684960:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143697.685162:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592359424 00000100:00100000:2.0:1746143697.685166:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592359424 00000100:00100000:2.0:1746143697.685186:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9848 00000100:00100000:2.0:1746143697.685191:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963592359424:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143697.685204:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143697.685215:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8d9000/0xe984082ccd7263c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d8f expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143697.685241:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593774848:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143697.685269:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143697.685322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.685375:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592359552 00000100:00100000:2.0:1746143697.685379:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592359552 00000100:00100000:2.0:1746143697.685398:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9849 00000100:00100000:2.0:1746143697.685403:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963592359552:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143697.685411:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143697.685421:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8d9a00/0xe984082ccd7263cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d96 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.685437:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8d9a00/0xe984082ccd7263cf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d96 expref: 35 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.685449:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8d9a00/0xe984082ccd7263cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d96 expref: 35 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.685459:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8d9a00, rc 0) 00000100:00100000:2.0:1746143697.685502:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963592359552:12345-192.168.202.48@tcp:101:cat.0 Request processed in 98us (180us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143697.685507:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9849 00000001:00080000:2.0:1746143697.687601:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839763 is committed 00000001:00080000:2.0:1746143697.687616:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839756 is committed 00000001:00080000:2.0:1746143697.687640:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839728 is committed 00000001:00080000:2.0:1746143697.687655:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839765 is committed 00000001:00080000:2.0:1746143697.687668:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839757 is committed 00000001:00080000:2.0:1746143697.687675:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839743 is committed 00000001:00080000:2.0:1746143697.687689:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839764 is committed 00000001:00080000:2.0:1746143697.687701:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839759 is committed 00010000:00010000:3.0:1746143697.687911:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca77600/0xe984082ccd726294 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cb6 expref: 20 pid: 8495 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746143697.687925:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593774336:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143697.687937:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e200/0xe984082ccd72630b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d03 expref: 8 pid: 8495 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746143697.687946:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593774464:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143697.687956:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130639400/0xe984082ccd7261ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c4d expref: 12 pid: 12618 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746143697.687963:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593774592:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143697.687988:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.688007:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034aa00, rc 0) 00000100:00100000:3.0:1746143697.688050:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28535:x1830963592358912:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 16492us (17372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.688057:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9847 00000100:00100000:3.0:1746143697.688567:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963592358528:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24257us (24378us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143697.688574:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3660 00002000:00100000:3.0:1746143697.688583:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800930d0700 x1830963592358528/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143697.688592:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0700 with x1830963592358528 ext(3145728->4194303) 00002000:00010000:3.0:1746143697.688597:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d0700 00000100:00100000:0.0:1746143697.688820:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593774720:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143697.688831:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143697.688854:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592359040:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4134us (4524us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.688863:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5084 00002000:00010000:0.0:1746143697.691276:0:15784:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime: 1746143695 -> 1746143697 00002000:00010000:0.0:1746143697.691284:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime: 1746143695 -> 1746143697 00002000:00010000:0.0:1746143697.691286:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime: 1746143695 -> 1746143697 00000100:00100000:0.0:1746143697.691309:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593774848:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143697.691342:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8d9000/0xe984082ccd7263c8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d8f expref: 19 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143697.691356:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8d9000/0xe984082ccd7263c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d8f expref: 19 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143697.691367:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8d9000, rc 0) 00000100:00100000:0.0:1746143697.691413:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963592359424:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6220us (6746us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143697.691421:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9848 00000100:00100000:1.0:1746143697.696879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.696911:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592359808 00000100:00100000:1.0:1746143697.696919:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592359808 00002000:00100000:1.0:1746143697.696967:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1654784->1658879) req@ffff88008f531180 x1830963592359808/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.696978:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f531180 with x1830963592359808 ext(1654784->1658879) 00002000:00010000:1.0:1746143697.696984:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f531180 00000100:00100000:1.0:1746143697.697005:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3661 00000100:00100000:1.0:1746143697.697012:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1962:x1830963592359808:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143697.697209:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1962:x1830963592359808:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 196us (338us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143697.697215:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3661 00002000:00100000:1.0:1746143697.697221:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1654784->1658879) req@ffff88008f531180 x1830963592359808/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.697228:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f531180 with x1830963592359808 ext(1654784->1658879) 00002000:00010000:1.0:1746143697.697231:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f531180 00000100:00100000:1.0:1746143697.699959:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.701353:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592359936 00000100:00100000:0.0:1746143697.701364:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592359936 00000100:00100000:0.0:1746143697.701431:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9850 00000100:00100000:0.0:1746143697.701438:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592359936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143697.701456:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143697.701473:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f5bcc00/0xe984082ccd7263d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1d9d expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.701504:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f5bcc00/0xe984082ccd7263d6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d9d expref: 23 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143697.701514:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f5bcc00/0xe984082ccd7263d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d9d expref: 23 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143697.701522:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bcc00, rc 0) 00000100:00100000:0.0:1746143697.701566:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592359936:12345-192.168.202.48@tcp:101:cat.0 Request processed in 129us (1617us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143697.701571:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9850 00000100:00100000:1.0:1746143697.701638:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.701781:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592360192 00000100:00100000:3.0:1746143697.701785:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592360192 00000100:00100000:3.0:1746143697.701819:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3403 00000100:00100000:3.0:1746143697.701825:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:28530:x1830963592360192:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143697.701976:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:28530:x1830963592360192:12345-192.168.202.48@tcp:35:cat.0 Request processed in 150us (337us total) trans 8589942452 rc 0/0 00000100:00100000:3.0:1746143697.701981:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3403 00000100:00100000:0.0:1746143697.704774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.704799:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592360320 00000100:00100000:0.0:1746143697.704817:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592360320 00000100:00100000:0.0:1746143697.704855:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9851 00000100:00100000:0.0:1746143697.704862:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28535:x1830963592360320:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143697.704880:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143697.704897:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1da4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.704926:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a067f600/0xe984082ccd7261f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c54 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143697.704938:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e400/0xe984082ccd726312 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d0a expref: 6 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143697.704945:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca76600/0xe984082ccd72629b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cbd expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143697.704950:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.704952:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.704955:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [1048576->1130495] (req 1048576->1130495) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 10 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.704984:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca76600/0xe984082ccd72629b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cbd expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143697.704994:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca76600/0xe984082ccd72629b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cbd expref: 17 pid: 15784 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.705006:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593774976:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143697.705079:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e400/0xe984082ccd726312 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d0a expref: 6 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143697.705087:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e400/0xe984082ccd726312 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d0a expref: 6 pid: 8495 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.705094:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593775104:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143697.705117:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a067f600/0xe984082ccd7261f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c54 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143697.705124:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a067f600/0xe984082ccd7261f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c54 expref: 10 pid: 8495 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.705131:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593775232:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143697.705176:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143697.711948:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.711996:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.712009:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.712082:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.712105:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592360576 00000100:00100000:0.0:1746143697.712113:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592360576 00010000:00010000:0.0:1746143697.712161:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e400/0xe984082ccd726312 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d0a expref: 7 pid: 8495 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.712185:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592360704 00000100:00100000:0.0:1746143697.712187:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592360704 00010000:00010000:0.0:1746143697.712194:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a067f600/0xe984082ccd7261f3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c54 expref: 11 pid: 8495 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.712204:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592360832 00000100:00100000:0.0:1746143697.712205:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592360832 00010000:00010000:0.0:1746143697.712212:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca76600/0xe984082ccd72629b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cbd expref: 18 pid: 15784 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.712222:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5085 00000100:00100000:0.0:1746143697.712230:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963592360576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143697.712244:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143697.712267:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e400/0xe984082ccd726312 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d0a expref: 7 pid: 8495 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746143697.712277:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e400/0xe984082ccd726312 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d0a expref: 7 pid: 8495 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746143697.712300:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143697.712338:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1963:x1830963592360576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 109us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.712343:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5085 00000100:00100000:0.0:1746143697.712356:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5086 00000100:00100000:0.0:1746143697.712360:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592360704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143697.712365:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143697.712370:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a067f600/0xe984082ccd7261f3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c54 expref: 11 pid: 8495 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746143697.712377:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a067f600/0xe984082ccd7261f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c54 expref: 11 pid: 8495 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746143697.712386:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143697.712394:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1963:x1830963592360704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 34us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.712398:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5086 00000100:00100000:0.0:1746143697.712403:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5087 00000100:00100000:0.0:1746143697.712407:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592360832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143697.712412:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143697.712416:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca76600/0xe984082ccd72629b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cbd expref: 18 pid: 15784 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746143697.712423:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca76600/0xe984082ccd72629b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cbd expref: 18 pid: 15784 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746143697.712431:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.712433:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.712439:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 10 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.712447:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 10 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.712476:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 10 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143697.712486:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593775360:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143697.712525:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143697.712554:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592360448 00000100:00100000:0.0:1746143697.712557:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592360448 00000100:00100000:0.0:1746143697.712574:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9852 00000100:00100000:0.0:1746143697.712578:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28529:x1830963592360448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143697.712591:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143697.712603:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc400/0xe984082ccd7263e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1dab expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.712616:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.712617:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143697.712621:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc400/0xe984082ccd7263e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dab expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.712630:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc400/0xe984082ccd7263e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dab expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.712636:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bc400, rc 0) 00000100:00100000:0.0:1746143697.712650:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28529:x1830963592360448:12345-192.168.202.48@tcp:101:cat.0 Request processed in 72us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.712654:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9852 00010000:00010000:0.0:1746143697.712737:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca76600/0xe984082ccd72629b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cbd expref: 18 pid: 15784 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.712748:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593774976:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143697.712756:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae5e400/0xe984082ccd726312 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d0a expref: 6 pid: 8495 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.712763:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593775104:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143697.712769:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a067f600/0xe984082ccd7261f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c54 expref: 10 pid: 8495 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746143697.712777:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593775232:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143697.712795:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 9 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.712802:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bce00, rc 0) 00000100:00100000:0.0:1746143697.712830:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28535:x1830963592360320:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7969us (8063us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.712835:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9851 00000100:00100000:0.0:1746143697.714336:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593775360:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143697.714349:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143697.714374:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963592360832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1964us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143697.714382:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5087 00000100:00100000:0.0:1746143697.717727:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.717753:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.719301:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592361216 00000100:00100000:2.0:1746143697.719314:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592361216 00002000:00100000:2.0:1746143697.719365:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094c10a80 x1830963592361216/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.719380:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10a80 with x1830963592361216 ext(4194304->4898815) 00002000:00010000:2.0:1746143697.719386:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10a80 00000100:00100000:2.0:1746143697.719404:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592361344 00000100:00100000:2.0:1746143697.719406:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592361344 00002000:00100000:2.0:1746143697.719418:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1126400->1130495) req@ffff880094c12680 x1830963592361344/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.719423:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12680 with x1830963592361344 ext(1126400->1130495) 00002000:00010000:2.0:1746143697.719426:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c12680 00000100:00100000:2.0:1746143697.719438:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3662 00000100:00100000:2.0:1746143697.719445:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592361216:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143697.721204:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3663 00000100:00100000:2.0:1746143697.721217:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963592361344:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143697.721347:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963592361344:12345-192.168.202.48@tcp:3:cat.0 Request processed in 133us (3591us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143697.721353:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3663 00002000:00100000:2.0:1746143697.721360:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1126400->1130495) req@ffff880094c12680 x1830963592361344/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.721368:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12680 with x1830963592361344 ext(1126400->1130495) 00002000:00010000:2.0:1746143697.721372:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c12680 00000100:00100000:0.0:1746143697.728259:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592361216:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8802us (10528us total) trans 0 rc 704512/704512 00000100:00100000:0.0:1746143697.728272:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3662 00002000:00100000:0.0:1746143697.728285:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880094c10a80 x1830963592361216/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143697.728295:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10a80 with x1830963592361216 ext(4194304->4898815) 00002000:00010000:0.0:1746143697.728302:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10a80 00000100:00100000:0.0:1746143697.742662:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.744540:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.745444:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592361472 00000100:00100000:1.0:1746143697.745455:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592361472 00000100:00100000:1.0:1746143697.745503:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9853 00000100:00100000:1.0:1746143697.745511:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592361472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143697.745533:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.745551:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009133d800/0xe984082ccd7263eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1db2 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.745590:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009133d800/0xe984082ccd7263eb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1db2 expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.745601:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009133d800/0xe984082ccd7263eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1db2 expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.745610:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133d800, rc 0) 00000100:00100000:1.0:1746143697.745663:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592361472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 153us (3011us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143697.745670:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9853 00000100:00100000:3.0:1746143697.747031:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592361728 00000100:00100000:3.0:1746143697.747039:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592361728 00000100:00100000:3.0:1746143697.747077:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3404 00000100:00100000:3.0:1746143697.747083:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28535:x1830963592361728:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143697.747348:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28535:x1830963592361728:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 264us (2815us total) trans 8589942453 rc 0/0 00000100:00100000:3.0:1746143697.747355:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3404 00000100:00100000:1.0:1746143697.752512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.755892:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592361856 00000100:00100000:2.0:1746143697.755904:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592361856 00000100:00100000:2.0:1746143697.759792:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9854 00000100:00100000:2.0:1746143697.759803:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1962:x1830963592361856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143697.759833:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143697.759852:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8d8000/0xe984082ccd7263f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1db9 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.759887:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8d8000/0xe984082ccd7263f2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1db9 expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.759896:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8d8000/0xe984082ccd7263f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1db9 expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.759906:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8d8000, rc 0) 00000100:00100000:2.0:1746143697.759965:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1962:x1830963592361856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 163us (7459us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143697.759971:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9854 00000001:00080000:2.0:1746143697.816498:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872491 is committed 00000001:00080000:2.0:1746143697.816609:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872442 is committed 00000001:00080000:2.0:1746143697.816632:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872501 is committed 00000001:00080000:2.0:1746143697.816637:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872500 is committed 00000001:00080000:2.0:1746143697.816643:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872494 is committed 00000001:00080000:2.0:1746143697.816651:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872477 is committed 00000001:00080000:2.0:1746143697.816671:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872502 is committed 00000001:00080000:2.0:1746143697.816689:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872495 is committed 00000100:00100000:0.0:1746143697.864664:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.864859:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592362112 00000100:00100000:3.0:1746143697.864870:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592362112 00000100:00100000:3.0:1746143697.864923:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8338 00000100:00100000:3.0:1746143697.864932:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:28541:x1830963592362112:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143697.864960:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.864980:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d1000/0xe984082ccd7263f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1dc0 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.865089:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd726400 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865102:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd726400 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865112:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd726400 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865124:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0200/0xe984082ccd726407 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865130:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0200/0xe984082ccd726407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865135:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0200/0xe984082ccd726407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865274:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd72640e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865282:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd72640e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865289:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd72640e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143697.865297:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143697.865375:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd726400 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865381:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd726400 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865387:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd726400 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865392:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800950d0400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143697.865396:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd726400 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865402:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd726400 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865413:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143697.865415:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143697.865419:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd726400 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865424:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0400/0xe984082ccd726400 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865466:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0200/0xe984082ccd726407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865471:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0200/0xe984082ccd726407 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865479:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0200/0xe984082ccd726407 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865483:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800950d0200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143697.865485:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0200/0xe984082ccd726407 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865490:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0200/0xe984082ccd726407 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865497:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f0f2500) 00010000:00010000:3.0:1746143697.865499:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143697.865501:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0200/0xe984082ccd726407 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865505:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d0200/0xe984082ccd726407 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.865540:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800950d1000/0xe984082ccd7263f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc0 expref: 259 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.865552:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd72640e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc0 expref: 258 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.865557:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143697.865559:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143697.865561:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f4000, rc 0) 00000100:00100000:3.0:1746143697.865617:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:28541:x1830963592362112:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 686us (963us total) trans 8589942454 rc 0/0 00000100:00100000:3.0:1746143697.865623:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8338 00000100:00100000:0.0:1746143697.873345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.873414:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592362240 00000100:00100000:2.0:1746143697.873425:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592362240 00000100:00100000:2.0:1746143697.873489:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9855 00000100:00100000:2.0:1746143697.873497:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28541:x1830963592362240:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143697.873518:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143697.873537:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b75ca00/0xe984082ccd72641c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1dc7 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.873568:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009465d200/0xe984082ccd726366 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d49 expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.873577:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca77800/0xe984082ccd72636d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d50 expref: 8 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.873582:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143697.873585:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143697.873587:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b75ca00/0xe984082ccd72641c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3665920->3751935] (req 3665920->3751935) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc7 expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.873618:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca77800/0xe984082ccd72636d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d50 expref: 8 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.873630:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca77800/0xe984082ccd72636d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d50 expref: 8 pid: 8495 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746143697.873643:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593775488:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143697.873746:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009465d200/0xe984082ccd726366 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d49 expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.873753:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009465d200/0xe984082ccd726366 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d49 expref: 23 pid: 4581 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746143697.873760:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593775616:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143697.873778:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143697.882046:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.882213:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593775488:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143697.882226:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593775616:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143697.882261:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b75ca00/0xe984082ccd72641c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3665920->3751935] (req 3665920->3751935) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc7 expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.882281:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b75ca00, rc 0) 00000100:00100000:2.0:1746143697.882333:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28541:x1830963592362240:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8836us (9000us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143697.882342:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9855 00000100:00100000:3.0:1746143697.882434:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592362368 00000100:00100000:3.0:1746143697.882441:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592362368 00010000:00010000:3.0:1746143697.882473:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009465d200/0xe984082ccd726366 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d49 expref: 23 pid: 4581 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746143697.882508:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5088 00000100:00100000:3.0:1746143697.882515:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592362368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143697.882530:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143697.882553:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009465d200/0xe984082ccd726366 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d49 expref: 23 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746143697.882561:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009465d200/0xe984082ccd726366 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d49 expref: 23 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746143697.882583:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009465d200/0xe984082ccd726366 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d49 expref: 23 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746143697.882597:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143697.882615:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592362368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 101us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.882621:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5088 00000100:00100000:1.0:1746143697.883443:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.883856:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592362496 00000100:00100000:2.0:1746143697.883860:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592362496 00010000:00010000:2.0:1746143697.883880:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca77800/0xe984082ccd72636d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d50 expref: 9 pid: 8495 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746143697.884033:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5089 00000100:00100000:2.0:1746143697.884041:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963592362496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143697.884052:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143697.884069:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca77800/0xe984082ccd72636d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d50 expref: 9 pid: 8495 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746143697.884079:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca77800/0xe984082ccd72636d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d50 expref: 9 pid: 8495 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746143697.884094:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca77800/0xe984082ccd72636d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d50 expref: 9 pid: 8495 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746143697.884124:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143697.884126:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143697.884133:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b75ca00/0xe984082ccd72641c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [3665920->4194303] (req 3665920->3751935) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc7 expref: 21 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.884163:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b75ca00/0xe984082ccd72641c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [3665920->4194303] (req 3665920->3751935) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc7 expref: 21 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.884194:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b75ca00/0xe984082ccd72641c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [3665920->4194303] (req 3665920->3751935) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc7 expref: 21 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143697.884205:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593775744:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143697.884275:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e323c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143697.885692:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593775744:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143697.885713:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143697.885823:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1964:x1830963592362496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1781us (2380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143697.885833:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5089 00000100:00100000:0.0:1746143697.890533:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.891707:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592362752 00000100:00100000:2.0:1746143697.891720:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592362752 00002000:00100000:2.0:1746143697.891776:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3665920->3670015) req@ffff880094c12a00 x1830963592362752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.891786:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12a00 with x1830963592362752 ext(3665920->3670015) 00002000:00010000:2.0:1746143697.891792:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c12a00 00000100:00100000:2.0:1746143697.891837:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3664 00000100:00100000:2.0:1746143697.891850:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592362752:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143697.892061:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592362752:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 211us (1538us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143697.892070:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3664 00002000:00100000:2.0:1746143697.892076:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3665920->3670015) req@ffff880094c12a00 x1830963592362752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143697.892082:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12a00 with x1830963592362752 ext(3665920->3670015) 00002000:00010000:2.0:1746143697.892085:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c12a00 00000100:00100000:0.0:1746143697.896706:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.896823:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592363008 00000100:00100000:1.0:1746143697.896833:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592363008 00002000:00100000:1.0:1746143697.896886:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3747840->3751935) req@ffff880094c11c00 x1830963592363008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.896897:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11c00 with x1830963592363008 ext(3747840->3751935) 00002000:00010000:1.0:1746143697.896902:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11c00 00000100:00100000:1.0:1746143697.897076:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3665 00000100:00100000:1.0:1746143697.897085:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592363008:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143697.897420:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592363008:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 335us (724us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143697.897427:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3665 00002000:00100000:1.0:1746143697.897433:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3747840->3751935) req@ffff880094c11c00 x1830963592363008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/4536 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.897442:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11c00 with x1830963592363008 ext(3747840->3751935) 00002000:00010000:1.0:1746143697.897444:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11c00 00000100:00100000:0.0:1746143697.902244:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.902371:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592363264 00000100:00100000:2.0:1746143697.902380:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592363264 00000100:00100000:2.0:1746143697.902488:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3405 00000100:00100000:2.0:1746143697.902497:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:28541:x1830963592363264:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143697.903484:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:28541:x1830963592363264:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 986us (1249us total) trans 8589942455 rc 0/0 00000100:00100000:2.0:1746143697.903492:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3405 00000100:00100000:0.0:1746143697.927669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.927813:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592363520 00000100:00100000:3.0:1746143697.927823:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592363520 00000100:00100000:3.0:1746143697.927876:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8339 00000100:00100000:3.0:1746143697.927884:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:28545:x1830963592363520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.927909:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.927927:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5e00/0xe984082ccd726423 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1dce expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.928015:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5400/0xe984082ccd72642a lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.928029:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5400/0xe984082ccd72642a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.928039:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5400/0xe984082ccd72642a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143697.928048:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143697.928219:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5e00/0xe984082ccd726423 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dce expref: 262 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.928260:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5400/0xe984082ccd72642a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dce expref: 261 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.928268:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143697.928271:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143697.928274:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f5400, rc 0) 00000100:00100000:3.0:1746143697.928317:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:28545:x1830963592363520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 434us (660us total) trans 8589942456 rc 0/0 00000100:00100000:3.0:1746143697.928323:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8339 00000100:00100000:0.0:1746143697.930998:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.931670:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.931836:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592363648 00000100:00100000:2.0:1746143697.931846:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592363648 00000100:00100000:1.0:1746143697.931885:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592363776 00000100:00100000:1.0:1746143697.931889:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592363776 00000100:00100000:1.0:1746143697.931926:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9856 00000100:00100000:1.0:1746143697.931932:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963592363776:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143697.931950:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.931969:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009133c600/0xe984082ccd726438 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ddc expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143697.932028:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593775872:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143697.932034:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9857 00000100:00100000:3.0:1746143697.932040:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592363648:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.932047:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.932055:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4600/0xe984082ccd72643f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1dd5 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143697.932083:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593776000:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143697.932104:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143697.932108:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143697.933725:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.933786:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592363904 00000100:00100000:2.0:1746143697.933791:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592363904 00000100:00100000:2.0:1746143697.933835:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9858 00000100:00100000:2.0:1746143697.933841:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592363904:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143697.933852:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143697.933864:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b75c800/0xe984082ccd726446 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1de3 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.933891:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b75c800/0xe984082ccd726446 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1de3 expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.933901:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b75c800/0xe984082ccd726446 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1de3 expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143697.933915:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b75c800, rc 0) 00000100:00100000:2.0:1746143697.933945:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592363904:12345-192.168.202.48@tcp:101:cat.0 Request processed in 104us (226us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143697.933951:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9858 00002000:00010000:1.0:1746143697.935123:0:15784:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime: 1746143695 -> 1746143697 00002000:00010000:1.0:1746143697.935128:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime: 1746143695 -> 1746143697 00002000:00010000:1.0:1746143697.935130:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime: 1746143695 -> 1746143697 00000100:00100000:1.0:1746143697.935183:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593775872:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143697.935208:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009133c600/0xe984082ccd726438 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ddc expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.935219:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009133c600/0xe984082ccd726438 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ddc expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143697.935230:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133c600, rc 0) 00000100:00100000:1.0:1746143697.935255:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592363776:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3323us (3586us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143697.935263:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9856 00000100:00100000:3.0:1746143697.935351:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593776000:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143697.935366:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4600/0xe984082ccd72643f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dd5 expref: 18 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.935375:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4600/0xe984082ccd72643f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dd5 expref: 18 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143697.935381:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f4600, rc 0) 00000100:00100000:3.0:1746143697.935396:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963592363648:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3357us (4409us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143697.935401:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9857 00000100:00100000:0.0:1746143697.940761:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143697.940874:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592364032 00000100:00100000:3.0:1746143697.940884:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592364032 00000100:00100000:3.0:1746143697.941624:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9859 00000100:00100000:3.0:1746143697.941634:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:28545:x1830963592364032:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143697.941655:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.941673:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72644d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1dea expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.941705:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 8 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.941717:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143697.941719:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143697.941722:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72644d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dea expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.941752:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 8 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.941764:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 8 pid: 4581 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746143697.941775:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593776128:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143697.943296:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143697.945620:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593776128:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143697.945650:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72644d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dea expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.945669:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f5800, rc 0) 00000100:00100000:3.0:1746143697.945723:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:28545:x1830963592364032:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4089us (4972us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.945731:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9859 00000100:00100000:0.0:1746143697.946605:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.947114:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592364160 00000100:00100000:1.0:1746143697.947122:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592364160 00002000:00100000:1.0:1746143697.947200:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1654784->2097151) req@ffff880094c10000 x1830963592364160/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.947211:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10000 with x1830963592364160 ext(1654784->2097151) 00010000:00010000:1.0:1746143697.947219:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 9 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.947232:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 9 pid: 4581 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746143697.947238:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c10000 00000100:00100000:1.0:1746143697.947943:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 895 00000100:00100000:1.0:1746143697.947952:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1964:x1830963592364160:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143697.956833:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592364160:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8870us (10217us total) trans 21474839767 rc 0/0 00000100:00100000:1.0:1746143697.956846:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 895 00002000:00100000:1.0:1746143697.956859:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1654784->2097151) req@ffff880094c10000 x1830963592364160/t21474839767(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:93/0 lens 488/448 e 0 to 0 dl 1746143708 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.956871:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10000 with x1830963592364160 ext(1654784->2097151) 00010000:00010000:1.0:1746143697.956881:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 11 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746143697.956905:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 11 pid: 4581 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746143697.956912:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c10000 00000100:00100000:0.0:1746143697.960941:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143697.961372:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592364288 00000100:00100000:2.0:1746143697.961382:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592364288 00010000:00010000:2.0:1746143697.961422:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 11 pid: 4581 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746143697.961457:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5090 00000100:00100000:2.0:1746143697.961464:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1965:x1830963592364288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143697.961477:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143697.961500:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 11 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746143697.961513:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 11 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746143697.961535:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a034aa00/0xe984082ccd7263c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d88 expref: 11 pid: 4581 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746143697.961557:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143697.961560:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143697.961567:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72644d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dea expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.961576:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72644d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dea expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143697.961607:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72644d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dea expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143697.961618:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593776256:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143697.961693:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e323c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143697.968592:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593776256:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143697.968616:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143697.968669:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1965:x1830963592364288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7204us (7737us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143697.968680:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5090 00000100:00100000:0.0:1746143697.975837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.978379:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592364544 00000100:00100000:1.0:1746143697.978393:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592364544 00002000:00100000:1.0:1746143697.978445:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880094c11f80 x1830963592364544/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/0 e 0 to 0 dl 1746143708 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143697.978456:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11f80 with x1830963592364544 ext(1048576->2097151) 00002000:00010000:1.0:1746143697.978462:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c11f80 00000100:00100000:1.0:1746143697.983556:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3666 00000100:00100000:1.0:1746143697.983577:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592364544:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143697.986216:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.986910:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592364672 00000100:00100000:1.0:1746143697.986921:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592364672 00000100:00100000:1.0:1746143697.986985:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8340 00000100:00100000:1.0:1746143697.986993:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+16:28548:x1830963592364672:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143697.987019:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.987039:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144e00/0xe984082ccd726454 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1df1 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.987100:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c600/0xe984082ccd72645b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.987114:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c600/0xe984082ccd72645b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.987129:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c600/0xe984082ccd72645b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.989770:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7800/0xe984082ccd726462 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.989791:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7800/0xe984082ccd726462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.989802:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7800/0xe984082ccd726462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.989936:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd726469 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.989944:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd726469 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.989950:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd726469 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143697.989982:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:1.0:1746143697.989986:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143697.990000:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd726469 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990009:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd726469 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990016:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c600/0xe984082ccd72645b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990021:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c600/0xe984082ccd72645b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990030:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c600/0xe984082ccd72645b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990036:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009133c600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143697.990039:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c600/0xe984082ccd72645b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990045:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c600/0xe984082ccd72645b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990055:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143697.990058:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143697.990062:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c600/0xe984082ccd72645b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990066:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c600/0xe984082ccd72645b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990095:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7800/0xe984082ccd726462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990101:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7800/0xe984082ccd726462 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990105:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7800/0xe984082ccd726462 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990108:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbc7800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143697.990110:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7800/0xe984082ccd726462 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990114:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7800/0xe984082ccd726462 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143697.990120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143697.990124:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5e400) 00010000:00010000:1.0:1746143697.990125:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143697.990127:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7800/0xe984082ccd726462 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990131:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7800/0xe984082ccd726462 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.990178:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b144e00/0xe984082ccd726454 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df1 expref: 18 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.990190:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd726469 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df1 expref: 17 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.990196:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143697.990198:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143697.990200:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc7000, rc 0) 00000100:00100000:1.0:1746143697.990259:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+17:28548:x1830963592364672:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3265us (4052us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143697.990262:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592364928 00000100:00100000:1.0:1746143697.990267:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8340 00000100:00100000:3.0:1746143697.990269:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592364928 00000100:00100000:3.0:1746143697.990299:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8341 00000100:00100000:3.0:1746143697.990306:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28547:x1830963592364928:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143697.990331:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143697.990339:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd726470 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1df8 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.990396:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.990404:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd726389 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d57 expref: 23 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.990412:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd72640e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc0 expref: 260 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.990418:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd726469 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df1 expref: 16 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.990424:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143697.990452:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd726469 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df1 expref: 16 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.990462:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd726469 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df1 expref: 16 pid: 16090 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143697.990474:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593776384:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143697.991442:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd72640e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc0 expref: 260 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.991455:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd72640e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc0 expref: 260 pid: 21713 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143697.991463:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593776512:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143697.991491:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd726389 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d57 expref: 23 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143697.991499:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd726389 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d57 expref: 23 pid: 21713 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143697.991505:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593776640:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143697.991519:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143697.998575:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143697.998605:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592365696 00000100:00100000:1.0:1746143697.998614:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592365696 00000100:00100000:1.0:1746143697.998982:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8342 00000100:00100000:1.0:1746143697.998990:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28551:x1830963592365696:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143697.999004:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143697.999013:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143697.999031:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd72647e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e06 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.999175:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd726485 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.999189:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd726485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.999202:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd726485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.999214:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd72648c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.999220:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd72648c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143697.999225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143697.999226:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd72648c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143697.999240:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.999254:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592365312 00000100:00100000:0.0:1746143697.999257:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592365312 00000100:00100000:0.0:1746143697.999275:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8343 00000100:00100000:0.0:1746143697.999280:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+17:28548:x1830963592365312:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143697.999287:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143697.999293:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc200/0xe984082ccd726493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1dff expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143697.999323:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143697.999331:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd7264a1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143697.999331:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143697.999338:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143697.999345:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd7264a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.999350:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd7264a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143697.999353:0:14763:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143697.999357:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143697.999361:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143697.999394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143697.999409:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592365056 00000100:00100000:0.0:1746143697.999412:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592365056 00010000:00010000:0.0:1746143697.999427:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd72640e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc0 expref: 261 pid: 21713 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143697.999441:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd726485 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143697.999441:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592365184 00000100:00100000:0.0:1746143697.999443:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592365184 00010000:00010000:1.0:1746143697.999447:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd726485 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143697.999449:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd726389 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d57 expref: 27 pid: 21713 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143697.999457:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd726485 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143697.999459:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592365440 00000100:00100000:0.0:1746143697.999461:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592365440 00010000:00010000:1.0:1746143697.999463:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbc6000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143697.999466:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd726485 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143697.999467:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd726469 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df1 expref: 19 pid: 16090 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143697.999472:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd726485 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143697.999477:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5091 00000100:00100000:0.0:1746143697.999481:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:1962:x1830963592365056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143697.999482:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143697.999484:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143697.999488:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd726485 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143697.999489:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143697.999492:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd726485 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143697.999493:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd72640e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc0 expref: 261 pid: 21713 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143697.999502:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd72640e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc0 expref: 261 pid: 21713 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143697.999503:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd72648c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.999507:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd72648c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.999511:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd72648c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143697.999513:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143697.999514:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbc6400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143697.999516:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd72648c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143697.999516:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143697.999521:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd72648c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143697.999522:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143697.999527:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143697.999530:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5ec00) 00010000:00010000:0.0:1746143697.999531:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143697.999532:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143697.999534:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd72648c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143697.999536:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143697.999537:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd72648c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143697.999564:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd72647e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e06 expref: 28 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.999578:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd7264a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e06 expref: 27 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143697.999583:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143697.999585:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143697.999586:0:16090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143697.999590:0:16090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143697.999595:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc6a00, rc 0) 00000100:00100000:2.0:1746143697.999609:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5092 00000100:00100000:2.0:1746143697.999616:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1962:x1830963592365184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143697.999623:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143697.999626:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd726389 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d57 expref: 27 pid: 21713 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143697.999637:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd726389 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d57 expref: 27 pid: 21713 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143697.999645:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143697.999647:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.999651:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143697.999655:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143697.999659:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143697.999662:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143698.001090:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5093 00000100:00100000:3.0:1746143698.001113:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+19:1963:x1830963592365440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143698.001124:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143698.001131:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd726469 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df1 expref: 19 pid: 16090 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.001164:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd726469 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df1 expref: 19 pid: 16090 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.001178:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143698.001181:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143698.001189:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143698.001196:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290400000020 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143698.001202:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143698.001207:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143698.001211:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143698.001223:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143698.001831:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+27:28551:x1830963592365696:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2839us (3264us total) trans 8589942457 rc 0/0 00000100:00100000:1.0:1746143698.001840:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8342 00000100:00100000:2.0:1746143698.001849:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1962:x1830963592365184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2233us (2623us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.001856:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5092 00000100:00100000:3.0:1746143698.002051:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+19:1963:x1830963592365440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 952us (2655us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.002056:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5093 00000100:00080000:3.0:1746143698.002073:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746143698.002109:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd726469 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df1 expref: 18 pid: 16090 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.002317:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592364544:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18749us (26491us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143698.002324:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3666 00002000:00100000:1.0:1746143698.002334:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880094c11f80 x1830963592364544/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:93/0 lens 488/440 e 0 to 0 dl 1746143708 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.002343:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11f80 with x1830963592364544 ext(1048576->2097151) 00002000:00010000:1.0:1746143698.002348:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c11f80 00000100:00100000:3.0:1746143698.002400:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593776384:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143698.002417:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd72640e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc0 expref: 261 pid: 21713 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143698.002439:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593776512:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143698.002450:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd726389 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d57 expref: 25 pid: 21713 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143698.002459:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593776640:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143698.002479:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143698.002486:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143698.002492:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143698.002508:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143698.002621:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd726470 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df8 expref: 26 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.002635:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df8 expref: 25 pid: 21713 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.002641:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df8 expref: 25 pid: 21713 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.002647:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b51fd600, rc 0) 00000100:00100000:3.0:1746143698.002666:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28547:x1830963592364928:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 12361us (12551us total) trans 8589942458 rc 0/0 00000100:00100000:3.0:1746143698.002672:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8341 00000100:00100000:0.0:1746143698.002942:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:1962:x1830963592365056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3457us (3935us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143698.002948:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5091 00000100:00100000:0.0:1746143698.007299:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.007334:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.007400:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592365824 00000100:00100000:2.0:1746143698.007410:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592365824 00010000:00010000:2.0:1746143698.007461:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df8 expref: 25 pid: 21713 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.007498:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5094 00000100:00100000:2.0:1746143698.007505:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592365824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.007519:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.007525:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df8 expref: 25 pid: 21713 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.007540:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df8 expref: 25 pid: 21713 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.007562:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd726477 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1df8 expref: 25 pid: 21713 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.007599:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143698.007604:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143698.007613:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143698.007620:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143698.007637:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.007682:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1965:x1830963592365824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 177us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.007688:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5094 00010000:00010000:0.0:1746143698.009896:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.009909:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143698.009956:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:0.0:1746143698.009960:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143698.009978:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.009989:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.010019:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc200/0xe984082ccd726493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dff expref: 18 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.010058:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dff expref: 17 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.010065:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143698.010068:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143698.010071:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bc800, rc 0) 00000100:00100000:0.0:1746143698.010121:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+17:28548:x1830963592365312:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 10839us (10878us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143698.010128:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8343 00000100:00080000:0.0:1746143698.010190:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143698.010319:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592366080 00000100:00100000:3.0:1746143698.010325:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592366080 00000100:00100000:3.0:1746143698.010362:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3406 00000100:00100000:3.0:1746143698.010369:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+24:28551:x1830963592366080:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143698.010521:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28551:x1830963592366080:12345-192.168.202.48@tcp:35:cat.0 Request processed in 147us (3180us total) trans 8589942459 rc 0/0 00000100:00100000:3.0:1746143698.010530:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3406 00000100:00100000:0.0:1746143698.016664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.017328:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.017422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.017429:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592366208 00000100:00100000:3.0:1746143698.017438:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592366208 00000100:00100000:3.0:1746143698.017502:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592366336 00000100:00100000:3.0:1746143698.017505:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592366336 00000100:00100000:3.0:1746143698.017519:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592366464 00000100:00100000:3.0:1746143698.017521:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592366464 00000100:00100000:3.0:1746143698.017539:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9860 00000100:00100000:3.0:1746143698.017547:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:28545:x1830963592366208:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143698.017556:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9861 00000100:00100000:1.0:1746143698.017562:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1964:x1830963592366336:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143698.017567:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.017568:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.017584:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd7264bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e0d expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.017584:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7000/0xe984082ccd7264b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e14 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.017605:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.017607:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.017609:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 10 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.017614:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7000/0xe984082ccd7264b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e14 expref: 7 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.017616:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143698.017618:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143698.017621:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd7264bd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e0d expref: 19 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.017630:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7000/0xe984082ccd7264b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e14 expref: 7 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.017639:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc7000, rc 0) 00010000:00010000:3.0:1746143698.017645:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 10 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.017655:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 10 pid: 15784 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143698.017665:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593776768:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143698.017677:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592366336:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 116us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143698.017682:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9861 00000100:00100000:1.0:1746143698.017708:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9862 00000100:00100000:1.0:1746143698.017713:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592366464:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143698.017716:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143698.017721:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.017726:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7e00/0xe984082ccd7264c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e1b expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.017737:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.017738:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.017742:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7e00/0xe984082ccd7264c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e1b expref: 11 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.017751:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7e00/0xe984082ccd7264c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e1b expref: 11 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.017757:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc7e00, rc 0) 00000100:00080000:2.0:1746143698.017769:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143698.017772:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592366464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 59us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143698.017777:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9862 00000100:00100000:0.0:1746143698.017951:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.018072:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592366592 00000100:00100000:2.0:1746143698.018076:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592366592 00000100:00100000:2.0:1746143698.018109:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9863 00000100:00100000:2.0:1746143698.018115:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1965:x1830963592366592:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.018123:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.018133:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b75d200/0xe984082ccd7264cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e22 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.018172:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b75d200/0xe984082ccd7264cb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e22 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.018182:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b75d200/0xe984082ccd7264cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e22 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.018202:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b75d200, rc 0) 00000100:00100000:2.0:1746143698.018222:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1965:x1830963592366592:12345-192.168.202.48@tcp:101:cat.0 Request processed in 108us (272us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143698.018227:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9863 00000100:00100000:0.0:1746143698.018935:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.018955:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.018987:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.019001:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592366720 00000100:00100000:1.0:1746143698.019004:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592366720 00000100:00100000:1.0:1746143698.019021:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592366848 00000100:00100000:1.0:1746143698.019023:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592366848 00000100:00100000:1.0:1746143698.019033:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592366976 00000100:00100000:1.0:1746143698.019035:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592366976 00000100:00100000:1.0:1746143698.019047:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9864 00000100:00100000:1.0:1746143698.019052:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592366720:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143698.019058:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.019065:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7800/0xe984082ccd7264d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e29 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143698.019099:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593776896:192.168.202.48@tcp:106: 00000100:00080000:3.0:1746143698.019164:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143698.019233:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143698.019340:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9865 00000100:00100000:1.0:1746143698.019347:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592366848:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143698.019354:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.019361:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b145800/0xe984082ccd7264d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e30 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.019377:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b145800/0xe984082ccd7264d9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e30 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.019384:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b145800/0xe984082ccd7264d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e30 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.019395:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b145800, rc 0) 00000100:00100000:1.0:1746143698.019425:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592366848:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 78us (467us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143698.019430:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9865 00000100:00100000:1.0:1746143698.019441:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9866 00000100:00100000:1.0:1746143698.019446:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592366976:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143698.019452:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.019458:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6000/0xe984082ccd7264e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e37 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.019472:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.019474:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.019480:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6000/0xe984082ccd7264e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e37 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.019491:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6000/0xe984082ccd7264e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e37 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.019498:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc6000, rc 0) 00000100:00100000:1.0:1746143698.019515:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592366976:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 68us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143698.019520:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9866 00000100:00100000:0.0:1746143698.022749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.022813:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592367104 00000100:00100000:1.0:1746143698.022822:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592367104 00000100:00100000:1.0:1746143698.022886:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963593776896:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143698.022917:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7800/0xe984082ccd7264d2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e29 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.022932:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7800/0xe984082ccd7264d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e29 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.022944:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc7800, rc 0) 00000100:00100000:3.0:1746143698.022959:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593776768:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143698.022976:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd7264bd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e0d expref: 19 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143698.022986:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592366720:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3934us (4051us total) trans 0 rc 301/301 00010000:00010000:3.0:1746143698.022987:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744a00, rc 0) 00000100:00100000:1.0:1746143698.022994:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9864 00000100:00100000:3.0:1746143698.023002:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:28545:x1830963592366208:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5457us (6349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.023007:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9860 00002000:00100000:1.0:1746143698.023047:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1130495) req@ffff88008f3c8a80 x1830963592367104/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.023056:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8a80 with x1830963592367104 ext(1048576->1130495) 00010000:00010000:1.0:1746143698.023063:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 11 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.023075:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 11 pid: 15784 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746143698.023081:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3c8a80 00000100:00100000:1.0:1746143698.023108:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 896 00000100:00100000:1.0:1746143698.023115:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592367104:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143698.030949:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.031103:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592367360 00000100:00100000:2.0:1746143698.031113:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592367360 00002000:00100000:2.0:1746143698.031187:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800949f0380 x1830963592367360/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.031198:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0380 with x1830963592367360 ext(1048576->2097151) 00002000:00010000:2.0:1746143698.031204:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f0380 00000100:00100000:2.0:1746143698.031224:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3667 00000100:00100000:2.0:1746143698.031231:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592367360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143698.033860:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963592367104:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10737us (11112us total) trans 21474839768 rc 0/0 00000100:00100000:1.0:1746143698.033872:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 896 00002000:00100000:1.0:1746143698.033882:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1130495) req@ffff88008f3c8a80 x1830963592367104/t21474839768(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/448 e 0 to 0 dl 1746143709 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.033891:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8a80 with x1830963592367104 ext(1048576->1130495) 00010000:00010000:1.0:1746143698.033900:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 15 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.033914:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 15 pid: 15784 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746143698.033920:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3c8a80 00000100:00100000:0.0:1746143698.036341:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.036371:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592367616 00000100:00100000:0.0:1746143698.036379:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592367616 00000100:00100000:0.0:1746143698.036438:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8344 00000100:00100000:0.0:1746143698.036446:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+17:28548:x1830963592367616:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143698.036468:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143698.036487:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bdc00/0xe984082ccd7264e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e3e expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.036591:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bca00/0xe984082ccd7264ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036605:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bca00/0xe984082ccd7264ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036615:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bca00/0xe984082ccd7264ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036627:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc200/0xe984082ccd7264f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036633:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc200/0xe984082ccd7264f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036638:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc200/0xe984082ccd7264f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036740:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bd000/0xe984082ccd7264fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036748:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bd000/0xe984082ccd7264fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036754:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bd000/0xe984082ccd7264fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143698.036762:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143698.036849:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bca00/0xe984082ccd7264ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036856:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bca00/0xe984082ccd7264ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036861:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bca00/0xe984082ccd7264ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036867:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f5bca00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143698.036870:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bca00/0xe984082ccd7264ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036876:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bca00/0xe984082ccd7264ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036887:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143698.036889:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143698.036893:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bca00/0xe984082ccd7264ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036898:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bca00/0xe984082ccd7264ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036912:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc200/0xe984082ccd7264f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036916:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc200/0xe984082ccd7264f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036921:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc200/0xe984082ccd7264f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036925:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f5bc200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143698.036927:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc200/0xe984082ccd7264f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036934:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc200/0xe984082ccd7264f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036939:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f442900) 00010000:00010000:0.0:1746143698.036941:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143698.036942:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc200/0xe984082ccd7264f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036947:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc200/0xe984082ccd7264f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143698.036980:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bdc00/0xe984082ccd7264e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e3e expref: 20 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.036991:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bd000/0xe984082ccd7264fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e3e expref: 19 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.036997:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143698.036998:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143698.037000:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bd000, rc 0) 00000100:00100000:0.0:1746143698.037025:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+19:28548:x1830963592367616:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 580us (693us total) trans 8589942460 rc 0/0 00000100:00100000:0.0:1746143698.037031:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8344 00000100:00100000:0.0:1746143698.044723:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.044776:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592367744 00000100:00100000:2.0:1746143698.044785:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592367744 00010000:00010000:2.0:1746143698.044837:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 15 pid: 15784 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.044873:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5095 00000100:00100000:2.0:1746143698.044881:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963592367744:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.044897:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.044919:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 15 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.044932:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 15 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.044954:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f5bce00/0xe984082ccd7263dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1da4 expref: 15 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.044979:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.044981:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.044990:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd7264bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e0d expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.044999:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd7264bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e0d expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.045040:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd7264bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e0d expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.045052:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593777024:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143698.045150:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e323c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143698.053462:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592367360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22215us (22508us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143698.053476:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3667 00002000:00100000:2.0:1746143698.053491:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff8800949f0380 x1830963592367360/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.053501:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0380 with x1830963592367360 ext(1048576->2097151) 00002000:00010000:2.0:1746143698.053507:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f0380 00000100:00100000:3.0:1746143698.053814:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593777024:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143698.053837:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143698.053883:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592367744:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9003us (9172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.053892:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5095 00000100:00100000:0.0:1746143698.054090:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.054171:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.054202:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.054244:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592367872 00000100:00100000:3.0:1746143698.054251:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592367872 00000100:00100000:1.0:1746143698.054471:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592368000 00000100:00100000:1.0:1746143698.054476:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592368000 00000100:00100000:3.0:1746143698.054494:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 573 00000100:00100000:3.0:1746143698.054501:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+19:1964:x1830963592367872:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143698.054509:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592368128 00000100:00100000:1.0:1746143698.054511:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592368128 00010000:00010000:3.0:1746143698.054516:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143698.054527:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9867 00000100:00100000:1.0:1746143698.054532:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592368000:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143698.054543:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bd000/0xe984082ccd7264fc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e3e expref: 19 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.054549:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.054563:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f5bda00/0xe984082ccd72650a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e45 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.054572:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143698.054576:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143698.054580:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.054582:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.054591:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5bda00/0xe984082ccd72650a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e45 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143698.054596:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+18:1964:x1830963592367872:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 95us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.054601:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 573 00010000:00010000:1.0:1746143698.054605:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f5bda00/0xe984082ccd72650a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e45 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.054615:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bda00, rc 0) 00000100:00100000:1.0:1746143698.054631:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592368000:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 99us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.054632:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9868 00000100:00100000:1.0:1746143698.054636:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9867 00000100:00100000:3.0:1746143698.054637:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592368128:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143698.054645:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.054655:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090745e00/0xe984082ccd726511 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e4c expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.054671:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090745e00/0xe984082ccd726511 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e4c expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.054679:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090745e00/0xe984082ccd726511 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e4c expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.054686:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090745e00, rc 0) 00000100:00100000:3.0:1746143698.054702:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592368128:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 65us (499us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143698.054706:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9868 00000100:00100000:0.0:1746143698.060746:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.060849:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.060943:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592368640 00000100:00100000:1.0:1746143698.060943:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592368384 00000100:00100000:3.0:1746143698.060952:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592368640 00000100:00100000:1.0:1746143698.060952:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592368384 00002000:00100000:3.0:1746143698.060999:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800949f0700 x1830963592368640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143698.061004:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8345 00002000:00100000:3.0:1746143698.061009:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0700 with x1830963592368640 ext(1048576->2097151) 00000100:00100000:1.0:1746143698.061011:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+18:28548:x1830963592368384:12345-192.168.202.48@tcp:101:lfs.0 00002000:00010000:3.0:1746143698.061014:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f0700 00000100:00100000:3.0:1746143698.061032:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3668 00010000:00010000:1.0:1746143698.061035:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143698.061037:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592368640:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143698.061058:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bd600/0xe984082ccd726518 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e53 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.061172:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc600/0xe984082ccd72651f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.061186:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc600/0xe984082ccd72651f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.061196:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc600/0xe984082ccd72651f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.061206:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc600/0xe984082ccd72651f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.061211:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc600/0xe984082ccd72651f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.061216:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc600/0xe984082ccd72651f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.061222:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f5bc600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143698.061226:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc600/0xe984082ccd72651f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.061231:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc600/0xe984082ccd72651f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.061242:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143698.061245:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143698.061249:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc600/0xe984082ccd72651f lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.061254:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc600/0xe984082ccd72651f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.061290:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bd600/0xe984082ccd726518 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e53 expref: 19 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.061297:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bd600/0xe984082ccd726518 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e53 expref: 19 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.061304:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bd600, rc 0) 00000100:00100000:1.0:1746143698.061346:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+18:28548:x1830963592368384:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 335us (496us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143698.061352:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8345 00000100:00100000:2.0:1746143698.069128:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.069189:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.069279:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592368768 00000100:00100000:0.0:1746143698.069289:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592368768 00000100:00100000:0.0:1746143698.069344:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9869 00000100:00100000:0.0:1746143698.069353:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28551:x1830963592368768:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143698.069375:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143698.069395:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd726526 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e5a expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.069422:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143698.069423:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143698.069432:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd726526 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e5a expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.069448:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd726526 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e5a expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.069458:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800950d1000, rc 0) 00000100:00100000:0.0:1746143698.069516:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28551:x1830963592368768:12345-192.168.202.48@tcp:101:cat.0 Request processed in 164us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143698.069522:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9869 00000100:00100000:1.0:1746143698.070737:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592369024 00000100:00100000:1.0:1746143698.070745:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592369024 00000100:00100000:1.0:1746143698.071329:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3407 00000100:00100000:1.0:1746143698.071336:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+18:28548:x1830963592369024:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:1.0:1746143698.071533:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+19:28548:x1830963592369024:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 197us (2343us total) trans 8589942461 rc 0/0 00000100:00100000:1.0:1746143698.071540:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3407 00000100:00100000:3.0:1746143698.076898:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592368640:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15847us (16150us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143698.076912:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3668 00002000:00100000:3.0:1746143698.076924:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800949f0700 x1830963592368640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.076934:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0700 with x1830963592368640 ext(1048576->2097151) 00002000:00010000:3.0:1746143698.076940:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f0700 00000100:00100000:0.0:1746143698.084183:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.084260:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592369280 00000100:00100000:3.0:1746143698.084270:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592369280 00002000:00100000:3.0:1746143698.084312:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800949f1c00 x1830963592369280/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.084324:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1c00 with x1830963592369280 ext(1048576->2097151) 00002000:00010000:3.0:1746143698.084330:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1c00 00000100:00100000:3.0:1746143698.084355:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3669 00000100:00100000:3.0:1746143698.084362:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592369280:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143698.089094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.089197:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592369408 00000100:00100000:3.0:1746143698.089207:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592369408 00000100:00100000:3.0:1746143698.089269:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9870 00000100:00100000:3.0:1746143698.089277:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28545:x1830963592369408:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143698.089298:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.089316:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090745a00/0xe984082ccd72652d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e61 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.089348:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.089357:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143698.089359:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143698.089362:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090745a00/0xe984082ccd72652d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e61 expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.089396:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.089408:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 23 pid: 25369 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143698.089422:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593777152:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143698.089510:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f429c0 going to sleep for 11 seconds 00000100:00080000:3.0:1746143698.089527:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143698.096330:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592369280:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11956us (12146us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143698.096343:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3669 00002000:00100000:3.0:1746143698.096355:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800949f1c00 x1830963592369280/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.096364:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1c00 with x1830963592369280 ext(1048576->2097151) 00002000:00010000:3.0:1746143698.096371:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1c00 00000100:00100000:2.0:1746143698.096827:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593777152:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143698.096857:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090745a00/0xe984082ccd72652d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e61 expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.096873:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090745a00, rc 0) 00000100:00100000:2.0:1746143698.096900:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28545:x1830963592369408:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7624us (7818us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.096906:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9870 00000100:00100000:2.0:1746143698.097202:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.097472:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592369536 00000100:00100000:3.0:1746143698.097480:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592369536 00002000:00100000:3.0:1746143698.097514:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2805760->3751935) req@ffff880130fd4700 x1830963592369536/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 504/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.097526:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4700 with x1830963592369536 ext(2805760->3751935) 00010000:00010000:3.0:1746143698.097537:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 23 pid: 25369 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.097548:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 23 pid: 25369 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746143698.097554:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130fd4700 00000100:00100000:3.0:1746143698.097580:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 897 00000100:00100000:3.0:1746143698.097587:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592369536:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143698.103586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.105198:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592369664 00000100:00100000:2.0:1746143698.105211:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592369664 00000100:00100000:1.0:1746143698.106791:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9871 00000100:00100000:1.0:1746143698.106812:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28547:x1830963592369664:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143698.106833:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.106853:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e68 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.106884:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd7264bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e0d expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.106893:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd726526 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e5a expref: 14 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.106900:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f5bda00/0xe984082ccd72650a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e45 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.106906:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.106908:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.106912:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [1716224->2097151] (req 1716224->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 14 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.106943:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f5bda00/0xe984082ccd72650a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e45 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.106954:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f5bda00/0xe984082ccd72650a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e45 expref: 8 pid: 4581 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746143698.106965:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593777280:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.107071:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd726526 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e5a expref: 14 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.107078:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd726526 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e5a expref: 14 pid: 6929 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.107085:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593777408:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.107109:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd7264bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e0d expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.107115:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd7264bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e0d expref: 18 pid: 9527 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.107122:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094458a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593777536:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143698.107149:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.111230:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.111379:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592369792 00000100:00100000:2.0:1746143698.111389:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592369792 00000100:00100000:1.0:1746143698.111413:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.111430:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592370048 00000100:00100000:1.0:1746143698.111433:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592370048 00000100:00100000:2.0:1746143698.111437:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9872 00000100:00100000:2.0:1746143698.111445:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28551:x1830963592369792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143698.111457:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd726526 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e5a expref: 15 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.111463:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.111480:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b75da00/0xe984082ccd72653b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e6f expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143698.111486:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5096 00000100:00100000:1.0:1746143698.111491:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592370048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143698.111499:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.111508:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143698.111513:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b75da00/0xe984082ccd72653b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e6f expref: 9 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.111521:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd726526 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e5a expref: 15 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.111524:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b75da00/0xe984082ccd72653b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e6f expref: 9 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.111531:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd726526 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e5a expref: 15 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.111533:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b75da00, rc 0) 00010000:00010000:1.0:1746143698.111548:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.111582:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28551:x1830963592369792:12345-192.168.202.48@tcp:101:cat.0 Request processed in 137us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.111588:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9872 00000100:00100000:0.0:1746143698.111666:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593777280:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143698.111678:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800950d1000/0xe984082ccd726526 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e5a expref: 15 pid: 6929 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746143698.111698:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593777408:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143698.111707:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094458a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593777536:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143698.111731:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1716224->2097151] (req 1716224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 14 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.111739:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336be00, rc 0) 00000100:00100000:1.0:1746143698.111786:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592370048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 294us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143698.111786:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28547:x1830963592369664:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4985us (8210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143698.111791:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9871 00000100:00100000:1.0:1746143698.111795:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5096 00000100:00100000:1.0:1746143698.111828:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.111840:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592369920 00000100:00100000:1.0:1746143698.111842:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592369920 00010000:00010000:1.0:1746143698.111852:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5bda00/0xe984082ccd72650a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e45 expref: 9 pid: 4581 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746143698.112595:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5097 00000100:00100000:3.0:1746143698.112604:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592369920:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143698.112612:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143698.112625:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f5bda00/0xe984082ccd72650a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e45 expref: 9 pid: 4581 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746143698.112633:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f5bda00/0xe984082ccd72650a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e45 expref: 9 pid: 4581 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746143698.112646:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f5bda00/0xe984082ccd72650a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e45 expref: 9 pid: 4581 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746143698.112659:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143698.112676:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1963:x1830963592369920:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 75us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.112682:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5097 00000100:00100000:3.0:1746143698.113988:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592369536:12345-192.168.202.48@tcp:4:cat.0 Request processed in 16399us (16784us total) trans 17179872503 rc 0/0 00000100:00100000:3.0:1746143698.113997:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 897 00002000:00100000:3.0:1746143698.114006:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2805760->3751935) req@ffff880130fd4700 x1830963592369536/t17179872503(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 504/448 e 0 to 0 dl 1746143709 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.114016:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4700 with x1830963592369536 ext(2805760->3751935) 00010000:00010000:3.0:1746143698.114027:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 25 pid: 25369 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.114037:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 25 pid: 25369 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746143698.114043:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130fd4700 00000100:00100000:1.0:1746143698.114857:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.114912:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592370176 00000100:00100000:0.0:1746143698.114919:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592370176 00010000:00010000:0.0:1746143698.114941:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd7264bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e0d expref: 19 pid: 9527 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746143698.115498:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5098 00000100:00100000:0.0:1746143698.115505:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963592370176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143698.115517:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143698.115535:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd7264bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e0d expref: 19 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.115544:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd7264bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e0d expref: 19 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.115562:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090744a00/0xe984082ccd7264bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e0d expref: 19 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.115575:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143698.115577:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143698.115583:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 12 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.115591:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 12 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.115619:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 12 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143698.115629:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593777664:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143698.115687:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.118895:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593777664:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143698.118918:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143698.118966:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963592370176:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3458us (4109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143698.118976:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5098 00000100:00100000:1.0:1746143698.118984:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.119110:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592370304 00000100:00100000:0.0:1746143698.119116:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592370304 00010000:00010000:0.0:1746143698.119164:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 25 pid: 25369 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746143698.119182:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5099 00000100:00100000:0.0:1746143698.119188:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592370304:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143698.119202:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143698.120605:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 25 pid: 25369 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.120639:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 25 pid: 25369 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.120670:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0559600/0xe984082ccd72635f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d42 expref: 25 pid: 25369 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.120687:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143698.120689:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143698.120695:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090745a00/0xe984082ccd72652d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e61 expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.120703:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090745a00/0xe984082ccd72652d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e61 expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.120710:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143698.120710:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143698.120713:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b75da00/0xe984082ccd72653b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e6f expref: 8 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.120719:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b75da00/0xe984082ccd72653b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e6f expref: 8 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.120755:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b75da00/0xe984082ccd72653b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e6f expref: 8 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143698.120772:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593777792:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143698.120874:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090745a00/0xe984082ccd72652d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e61 expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143698.120881:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593777920:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143698.120897:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.122104:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.122182:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592370560 00000100:00100000:3.0:1746143698.122190:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592370560 00002000:00100000:3.0:1746143698.122229:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1716224->1720319) req@ffff8800949f1500 x1830963592370560/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.122238:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1500 with x1830963592370560 ext(1716224->1720319) 00002000:00010000:3.0:1746143698.122243:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1500 00000100:00100000:3.0:1746143698.122259:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3670 00000100:00100000:3.0:1746143698.122265:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592370560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143698.122727:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1962:x1830963592370560:12345-192.168.202.48@tcp:3:cat.0 Request processed in 459us (627us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143698.122738:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3670 00002000:00100000:3.0:1746143698.122745:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1716224->1720319) req@ffff8800949f1500 x1830963592370560/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/4536 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.122751:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1500 with x1830963592370560 ext(1716224->1720319) 00002000:00010000:3.0:1746143698.122754:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1500 00000100:00100000:2.0:1746143698.123458:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593777792:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143698.123469:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593777920:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143698.123487:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.123525:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592370304:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4336us (4541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.123534:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5099 00000100:00100000:2.0:1746143698.128520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.128921:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592370688 00000100:00100000:1.0:1746143698.128931:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592370688 00000100:00100000:1.0:1746143698.128983:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9873 00000100:00100000:1.0:1746143698.128992:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28547:x1830963592370688:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143698.129011:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.129030:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e76 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.129062:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca76400/0xe984082ccd72621d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c7e expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.129071:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ae5e600/0xe984082ccd726319 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d11 expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.129078:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca77000/0xe984082ccd7262a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cc4 expref: 23 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.129084:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.129087:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.129090:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1048576->1306623] (req 1048576->1306623) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 10 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.129122:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca77000/0xe984082ccd7262a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cc4 expref: 23 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.129134:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca77000/0xe984082ccd7262a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cc4 expref: 23 pid: 8496 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746143698.129178:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094458a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593778048:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.129278:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ae5e600/0xe984082ccd726319 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d11 expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.129285:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ae5e600/0xe984082ccd726319 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d11 expref: 7 pid: 8495 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746143698.129293:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593778176:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.129315:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca76400/0xe984082ccd72621d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c7e expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.129322:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca76400/0xe984082ccd72621d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c7e expref: 10 pid: 8495 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746143698.130658:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593778304:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143698.130718:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143698.132103:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094458a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593778048:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143698.132115:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593778176:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143698.135792:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.135837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.135857:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592371200 00000100:00100000:1.0:1746143698.135866:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592371200 00000100:00100000:0.0:1746143698.135872:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.135892:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.135912:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592371328 00000100:00100000:0.0:1746143698.135915:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592371328 00000100:00100000:1.0:1746143698.135925:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8346 00000100:00100000:1.0:1746143698.135933:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:28556:x1830963592371200:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143698.135937:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca77000/0xe984082ccd7262a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cc4 expref: 24 pid: 8496 timeout: 877 lvb_type: 1 00000100:00100000:0.0:1746143698.135954:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592371456 00010000:00010000:1.0:1746143698.135956:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143698.135956:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592371456 00010000:00010000:0.0:1746143698.135964:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae5e600/0xe984082ccd726319 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d11 expref: 8 pid: 8495 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746143698.135973:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4dae000/0xe984082ccd726549 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e7d expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143698.135975:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5100 00000100:00100000:0.0:1746143698.135979:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592371328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143698.135991:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143698.136015:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca77000/0xe984082ccd7262a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cc4 expref: 24 pid: 8496 timeout: 877 lvb_type: 1 00010000:00010000:0.0:1746143698.136026:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca77000/0xe984082ccd7262a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cc4 expref: 24 pid: 8496 timeout: 877 lvb_type: 1 00010000:00010000:0.0:1746143698.136044:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca77000/0xe984082ccd7262a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cc4 expref: 24 pid: 8496 timeout: 877 lvb_type: 1 00010000:00010000:0.0:1746143698.136062:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143698.136071:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daf800/0xe984082ccd726550 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.136082:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daf800/0xe984082ccd726550 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.136091:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daf800/0xe984082ccd726550 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143698.136099:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592371328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 119us (262us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143698.136102:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4dae600/0xe984082ccd726557 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143698.136105:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5100 00010000:00010000:1.0:1746143698.136107:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4dae600/0xe984082ccd726557 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.136111:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4dae600/0xe984082ccd726557 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143698.136118:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5101 00000100:00100000:0.0:1746143698.136122:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592371456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143698.136129:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143698.136135:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ae5e600/0xe984082ccd726319 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d11 expref: 8 pid: 8495 timeout: 877 lvb_type: 1 00010000:00010000:0.0:1746143698.136166:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ae5e600/0xe984082ccd726319 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d11 expref: 8 pid: 8495 timeout: 877 lvb_type: 1 00010000:00010000:0.0:1746143698.136176:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae5e600/0xe984082ccd726319 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d11 expref: 8 pid: 8495 timeout: 877 lvb_type: 1 00010000:00010000:0.0:1746143698.136182:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143698.136196:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963592371456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 73us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143698.136203:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5101 00010000:00010000:1.0:1746143698.136237:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daea00/0xe984082ccd72655e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.136245:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daea00/0xe984082ccd72655e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.136252:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daea00/0xe984082ccd72655e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143698.136261:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000100:00100000:0.0:1746143698.136278:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.136328:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592371584 00000100:00100000:0.0:1746143698.136330:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592371584 00010000:00010000:1.0:1746143698.136342:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daf800/0xe984082ccd726550 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.136348:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daf800/0xe984082ccd726550 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00002000:00100000:0.0:1746143698.136351:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009c3fbb80 x1830963592371584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746143698.136353:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daf800/0xe984082ccd726550 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.136358:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4daf800 already unused, calling callback (ffffffffa1387690) 00002000:00100000:0.0:1746143698.136360:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830963592371584 ext(2097152->3145727) 00010000:00010000:1.0:1746143698.136362:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daf800/0xe984082ccd726550 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00002000:00010000:0.0:1746143698.136363:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fbb80 00010000:00010000:1.0:1746143698.136368:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daf800/0xe984082ccd726550 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.136376:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00000100:00100000:0.0:1746143698.136377:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592371712 00010000:00010000:1.0:1746143698.136378:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746143698.136380:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592371712 00010000:00010000:1.0:1746143698.136382:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daf800/0xe984082ccd726550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.136387:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daf800/0xe984082ccd726550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00002000:00100000:0.0:1746143698.136391:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009c3fb800 x1830963592371712/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746143698.136397:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4dae600/0xe984082ccd726557 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00002000:00100000:0.0:1746143698.136397:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb800 with x1830963592371712 ext(2097152->3145727) 00002000:00010000:0.0:1746143698.136400:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fb800 00010000:00010000:1.0:1746143698.136402:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4dae600/0xe984082ccd726557 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143698.136409:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3671 00010000:00010000:1.0:1746143698.136410:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4dae600/0xe984082ccd726557 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143698.136413:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592371584:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143698.136414:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4dae600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143698.136416:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4dae600/0xe984082ccd726557 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.136420:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4dae600/0xe984082ccd726557 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.136425:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129f5e000) 00010000:00010000:1.0:1746143698.136427:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143698.136429:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4dae600/0xe984082ccd726557 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.136432:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4dae600/0xe984082ccd726557 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143698.136463:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4dae000/0xe984082ccd726549 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e7d expref: 263 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.136471:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daea00/0xe984082ccd72655e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e7d expref: 262 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.136477:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143698.136478:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143698.136480:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4daea00, rc 0) 00000100:00100000:1.0:1746143698.136502:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:28556:x1830963592371200:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 571us (721us total) trans 8589942462 rc 0/0 00000100:00100000:1.0:1746143698.136508:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8346 00000100:00100000:1.0:1746143698.137522:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3672 00000100:00100000:1.0:1746143698.137531:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963592371712:12345-192.168.202.48@tcp:3:cat.0 00000100:00080000:3.0:1746143698.138857:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143698.149179:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.151339:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.151391:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.151416:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592372480 00000100:00100000:2.0:1746143698.151425:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592372480 00000100:00100000:2.0:1746143698.151471:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9874 00000100:00100000:2.0:1746143698.151480:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28556:x1830963592372480:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143698.151502:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.151521:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e84 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.151556:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 12 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.151563:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143698.151565:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143698.151568:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1196032->1245183] (req 1196032->1245183) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 21 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.151600:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 12 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.151611:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 12 pid: 6929 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.151624:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593778432:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143698.151701:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143698.151760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.151782:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592372352 00000100:00100000:2.0:1746143698.151785:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592372352 00010000:00010000:2.0:1746143698.151813:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca76400/0xe984082ccd72621d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c7e expref: 11 pid: 8495 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746143698.151833:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5102 00000100:00100000:2.0:1746143698.151838:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592372352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.151848:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.151872:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca76400/0xe984082ccd72621d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c7e expref: 11 pid: 8495 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746143698.151881:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca76400/0xe984082ccd72621d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c7e expref: 11 pid: 8495 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746143698.151899:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.151901:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.151908:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 11 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.151915:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 11 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.151937:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 11 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.151946:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593778560:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143698.151967:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143698.152349:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592372096 00000100:00100000:3.0:1746143698.152355:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592372096 00002000:00100000:3.0:1746143698.152384:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094459500 x1830963592372096/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.152393:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459500 with x1830963592372096 ext(2097152->3145727) 00002000:00010000:3.0:1746143698.152397:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094459500 00000100:00100000:3.0:1746143698.152408:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592372224 00000100:00100000:3.0:1746143698.152410:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592372224 00002000:00100000:3.0:1746143698.152421:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880130fd5f80 x1830963592372224/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.152427:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5f80 with x1830963592372224 ext(2097152->3145727) 00002000:00010000:3.0:1746143698.152431:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd5f80 00000100:00100000:3.0:1746143698.152442:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3673 00000100:00100000:3.0:1746143698.152447:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592372096:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143698.153745:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3674 00000100:00100000:3.0:1746143698.153753:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592372224:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143698.153795:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca76400/0xe984082ccd72621d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c7e expref: 13 pid: 8495 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746143698.153823:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593778304:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.153852:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 12 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.153861:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336a600, rc 0) 00000100:00100000:1.0:1746143698.153883:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28547:x1830963592370688:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 24893us (25374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143698.153890:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9873 00000100:00100000:0.0:1746143698.155444:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592371584:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19017us (19558us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143698.155457:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3671 00002000:00100000:0.0:1746143698.155467:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009c3fbb80 x1830963592371584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143698.155475:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830963592371584 ext(2097152->3145727) 00002000:00010000:0.0:1746143698.155480:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fbb80 00000100:00100000:2.0:1746143698.163818:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593778560:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143698.163845:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.163914:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592372352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12072us (12151us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.163925:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5102 00000100:00100000:2.0:1746143698.167401:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593778432:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143698.167439:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1196032->1245183] (req 1196032->1245183) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 21 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.167465:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b75cc00, rc 0) 00000100:00100000:2.0:1746143698.167542:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28556:x1830963592372480:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 16062us (16148us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.167552:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9874 00000100:00100000:1.0:1746143698.168453:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.168506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.168717:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592371712:12345-192.168.202.48@tcp:3:cat.0 Request processed in 31187us (32437us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143698.168725:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3672 00002000:00100000:2.0:1746143698.168735:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009c3fb800 x1830963592371712/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.168743:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb800 with x1830963592371712 ext(2097152->3145727) 00002000:00010000:2.0:1746143698.168749:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fb800 00000100:00100000:2.0:1746143698.168765:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592372736 00000100:00100000:2.0:1746143698.168771:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592372736 00002000:00100000:2.0:1746143698.168812:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1302528->1306623) req@ffff880094459880 x1830963592372736/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.168820:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459880 with x1830963592372736 ext(1302528->1306623) 00002000:00010000:2.0:1746143698.168824:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094459880 00000100:00100000:2.0:1746143698.168836:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592372864 00000100:00100000:2.0:1746143698.168839:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592372864 00002000:00100000:2.0:1746143698.168852:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1716224->2097151) req@ffff880094459f80 x1830963592372864/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.168859:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459f80 with x1830963592372864 ext(1716224->2097151) 00010000:00010000:2.0:1746143698.168865:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 15 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.168879:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 15 pid: 6929 timeout: 877 lvb_type: 0 00002000:00010000:2.0:1746143698.168885:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094459f80 00000100:00100000:1.0:1746143698.168889:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3675 00000100:00100000:1.0:1746143698.168897:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592372736:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143698.169081:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592372736:12345-192.168.202.48@tcp:3:cat.0 Request processed in 185us (630us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143698.169544:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592372096:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17095us (20375us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143698.169590:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 898 00000100:00100000:2.0:1746143698.169596:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1962:x1830963592372864:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143698.170234:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3675 00000100:00100000:3.0:1746143698.170238:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3673 00002000:00100000:1.0:1746143698.170242:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34e:0x0] (1302528->1306623) req@ffff880094459880 x1830963592372736/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/4536 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.170243:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094459500 x1830963592372096/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.170250:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459500 with x1830963592372096 ext(2097152->3145727) 00002000:00100000:1.0:1746143698.170250:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459880 with x1830963592372736 ext(1302528->1306623) 00002000:00010000:3.0:1746143698.170254:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094459500 00002000:00010000:1.0:1746143698.170254:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094459880 00000100:00100000:1.0:1746143698.173358:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746143698.173380:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593778688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746143698.173444:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143698.173567:0:8498:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593778688 00000100:00100000:2.0:1746143698.173575:0:8498:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593778688 00000100:00100000:2.0:1746143698.173635:0:8498:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1746143698.173642:0:8498:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1830963593778688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746143698.173666:0:8498:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 373489664 pending 6815744 free 3852468224 avail 3837788160 00000100:00100000:2.0:1746143698.173702:0:8498:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1830963593778688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.173708:0:8498:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:3.0:1746143698.173757:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143698.173822:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839759 gen 2 00000004:00080000:1.0:1746143698.173828:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3ca300, transno 21474839711 00000004:00080000:1.0:1746143698.173835:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c9180, transno 21474839712 00000004:00080000:1.0:1746143698.173838:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3cad80, transno 21474839713 00000004:00080000:1.0:1746143698.173840:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c9500, transno 21474839714 00000004:00080000:1.0:1746143698.173842:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3ca680, transno 21474839715 00000004:00080000:1.0:1746143698.173844:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3cb100, transno 21474839716 00000004:00080000:1.0:1746143698.173846:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3caa00, transno 21474839717 00000004:00080000:1.0:1746143698.173848:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79c380, transno 21474839718 00000004:00080000:1.0:1746143698.173850:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093806d80, transno 21474839719 00000004:00080000:1.0:1746143698.173853:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093804e00, transno 21474839720 00000004:00080000:1.0:1746143698.173855:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093806a00, transno 21474839721 00000004:00080000:1.0:1746143698.173857:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093805f80, transno 21474839722 00000004:00080000:1.0:1746143698.173859:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093804380, transno 21474839723 00000004:00080000:1.0:1746143698.173861:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d2680, transno 21474839724 00000004:00080000:1.0:1746143698.173863:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093805c00, transno 21474839725 00000004:00080000:1.0:1746143698.173866:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e0a80, transno 21474839726 00000004:00080000:1.0:1746143698.173868:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ee680, transno 21474839733 00000004:00080000:1.0:1746143698.173871:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ec700, transno 21474839734 00000004:00080000:1.0:1746143698.173874:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ef100, transno 21474839735 00000004:00080000:1.0:1746143698.173876:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1edf80, transno 21474839736 00000004:00080000:1.0:1746143698.173879:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1edc00, transno 21474839737 00000004:00080000:1.0:1746143698.173882:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ef800, transno 21474839738 00000004:00080000:1.0:1746143698.173884:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1eed80, transno 21474839739 00000004:00080000:1.0:1746143698.173887:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ec000, transno 21474839740 00000004:00080000:1.0:1746143698.173890:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1eca80, transno 21474839744 00000004:00080000:1.0:1746143698.173892:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ece00, transno 21474839745 00000004:00080000:1.0:1746143698.173895:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ed880, transno 21474839746 00000004:00080000:1.0:1746143698.173897:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1efb80, transno 21474839747 00000004:00080000:1.0:1746143698.173900:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ed180, transno 21474839748 00000004:00080000:1.0:1746143698.173902:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ec380, transno 21474839749 00000004:00080000:1.0:1746143698.173904:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ed500, transno 21474839750 00000004:00080000:1.0:1746143698.173906:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ef480, transno 21474839751 00000004:00080000:1.0:1746143698.173908:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c21f80, transno 21474839752 00000004:00080000:1.0:1746143698.173911:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c23480, transno 21474839753 00000004:00080000:1.0:1746143698.173913:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c20000, transno 21474839754 00000004:00080000:1.0:1746143698.173915:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c20e00, transno 21474839755 00000004:00080000:1.0:1746143698.173917:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c23800, transno 21474839756 00000004:00080000:1.0:1746143698.173919:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c21880, transno 21474839757 00000004:00080000:1.0:1746143698.173921:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dd500, transno 21474839758 00000004:00080000:1.0:1746143698.173924:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c21c00, transno 21474839759 00000100:00100000:1.0:1746143698.173933:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593778688:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1746143698.174348:0:14800:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 40 done 00000100:00100000:0.0:1746143698.176583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.178631:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592372992 00000100:00100000:2.0:1746143698.178643:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592372992 00000100:00100000:2.0:1746143698.178698:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9875 00000100:00100000:2.0:1746143698.178706:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28545:x1830963592372992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.178727:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.178746:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b75c200/0xe984082ccd726573 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e8b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.178776:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b75ca00/0xe984082ccd72641c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3665920->4194303] (req 3665920->3751935) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc7 expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.178785:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143698.178786:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143698.178789:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b75c200/0xe984082ccd726573 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e8b expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.178830:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b75ca00/0xe984082ccd72641c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3665920->4194303] (req 3665920->3751935) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc7 expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.178842:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b75ca00/0xe984082ccd72641c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3665920->4194303] (req 3665920->3751935) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc7 expref: 24 pid: 9527 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.178854:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593778816:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143698.179531:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143698.184111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.184136:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592373248 00000100:00100000:3.0:1746143698.184169:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592373248 00000100:00100000:3.0:1746143698.184213:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3408 00000100:00100000:3.0:1746143698.184220:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+25:28547:x1830963592373248:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143698.184430:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+26:28547:x1830963592373248:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 209us (328us total) trans 8589942463 rc 0/0 00000100:00100000:3.0:1746143698.184435:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3408 00000100:00100000:3.0:1746143698.184569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.184615:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593778816:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143698.184642:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b75c200/0xe984082ccd726573 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e8b expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.184658:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b75c200, rc 0) 00000100:00100000:3.0:1746143698.184678:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28545:x1830963592372992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5973us (8106us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.184684:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9875 00000100:00100000:2.0:1746143698.187366:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592372864:12345-192.168.202.48@tcp:4:cat.0 Request processed in 17760us (18849us total) trans 21474839769 rc 0/0 00000100:00100000:2.0:1746143698.187377:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 898 00002000:00100000:2.0:1746143698.187388:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1716224->2097151) req@ffff880094459f80 x1830963592372864/t21474839769(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/448 e 0 to 0 dl 1746143709 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.187397:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459f80 with x1830963592372864 ext(1716224->2097151) 00010000:00010000:2.0:1746143698.187407:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 17 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.187420:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 17 pid: 6929 timeout: 877 lvb_type: 0 00002000:00010000:2.0:1746143698.187432:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094459f80 00000100:00100000:2.0:1746143698.187463:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592373376 00000100:00100000:2.0:1746143698.187469:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592373376 00010000:00010000:2.0:1746143698.187492:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b75ca00/0xe984082ccd72641c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3665920->4194303] (req 3665920->3751935) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc7 expref: 24 pid: 9527 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.187523:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5103 00000100:00100000:2.0:1746143698.187529:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592373376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.187540:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.187559:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b75ca00/0xe984082ccd72641c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [3665920->4194303] (req 3665920->3751935) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc7 expref: 24 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.187709:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b75ca00/0xe984082ccd72641c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [3665920->4194303] (req 3665920->3751935) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc7 expref: 24 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.187731:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b75ca00/0xe984082ccd72641c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [3665920->4194303] (req 3665920->3751935) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dc7 expref: 24 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.187750:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.187752:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.187760:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b75c200/0xe984082ccd726573 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e8b expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.187769:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b75c200/0xe984082ccd726573 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e8b expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.187815:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b75c200/0xe984082ccd726573 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e8b expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.187828:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593778944:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143698.187994:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143698.188656:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592372224:12345-192.168.202.48@tcp:3:cat.0 Request processed in 34901us (37323us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143698.188663:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3674 00002000:00100000:2.0:1746143698.188670:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880130fd5f80 x1830963592372224/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.188924:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5f80 with x1830963592372224 ext(2097152->3145727) 00002000:00010000:2.0:1746143698.188930:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd5f80 00000100:00100000:1.0:1746143698.189332:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1830963593779200:0@lo:400:kworker.0 00000100:00100000:0.0:1746143698.189341:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593779456:0@lo:400:kworker.0 00000100:00100000:1.0:1746143698.189373:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143698.189373:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143698.189397:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746143698.189399:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143698.189401:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1830963593779328:0@lo:400:kworker.0 00000100:00100000:1.0:1746143698.189403:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b20e2be-dc58-49ff-81b7-9c0574412294:3293:1830963593779072:0@lo:400:kworker.0 00000100:00100000:0.0:1746143698.189426:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143698.189428:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143698.189446:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593779200 00000100:00100000:1.0:1746143698.189451:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830963593779584:0@lo:400:kworker.0 00000100:00100000:0.0:1746143698.189451:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593779200 00000100:00100000:1.0:1746143698.189467:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143698.189484:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593779328 00000100:00100000:1.0:1746143698.189485:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593779584 00000100:00100000:0.0:1746143698.189486:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593779328 00000100:00100000:1.0:1746143698.189487:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593779584 00000100:00100000:0.0:1746143698.189501:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1746143698.189504:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1746143698.189507:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1830963593779200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143698.189508:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830963593779328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143698.189536:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830963593779328:12345-0@lo:400:kworker.0 Request processed in 27us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143698.189538:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1830963593779200:12345-0@lo:400:kworker.0 Request processed in 32us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143698.189541:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1746143698.189543:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1746143698.189551:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1746143698.189555:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963593779584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143698.189572:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963593779584:12345-0@lo:400:kworker.0 Request processed in 17us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143698.189576:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1746143698.189578:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3295:1830963593779328:0@lo:400:kworker.0 00000100:00100000:1.0:1746143698.189591:0:14761:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593779072 00000100:00100000:1.0:1746143698.189594:0:14761:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593779072 00000100:00100000:0.0:1746143698.189600:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830963593779584:0@lo:400:kworker.0 00000100:00100000:0.0:1746143698.189607:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3293:1830963593779200:0@lo:400:kworker.0 00000100:00100000:1.0:1746143698.189609:0:14761:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1746143698.189613:0:14761:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c23f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3293:x1830963593779072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143698.189634:0:14761:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c23f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3293:x1830963593779072:12345-0@lo:400:kworker.0 Request processed in 20us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143698.189639:0:14761:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1746143698.189641:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b20e2be-dc58-49ff-81b7-9c0574412294:3293:1830963593779072:0@lo:400:kworker.0 00000100:00100000:0.0:1746143698.191474:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:3.0:1746143698.191608:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143698.191627:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593779456 00000100:00100000:3.0:1746143698.191632:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593779456 00000100:00100000:1.0:1746143698.191637:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592373504 00000100:00100000:1.0:1746143698.191641:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592373504 00000100:00080000:3.0:1746143698.191651:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746143698.191669:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 15 pid: 6929 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143698.191687:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1746143698.191694:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3295:x1830963593779456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143698.191752:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3295:x1830963593779456:12345-0@lo:400:kworker.0 Request processed in 59us (2379us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.191758:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1746143698.191776:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872495 gen 2 00000004:00080000:0.0:1746143698.191782:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79df80, transno 17179872443 00000004:00080000:0.0:1746143698.191832:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79d500, transno 17179872444 00000004:00080000:0.0:1746143698.191835:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79d180, transno 17179872445 00000004:00080000:0.0:1746143698.191837:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79fb80, transno 17179872446 00000004:00080000:0.0:1746143698.191839:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79ca80, transno 17179872447 00000004:00080000:0.0:1746143698.191842:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79d880, transno 17179872448 00000004:00080000:0.0:1746143698.191845:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009509b800, transno 17179872449 00000100:00100000:2.0:1746143698.191847:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593778944:192.168.202.48@tcp:105: 00000004:00080000:0.0:1746143698.191848:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79ed80, transno 17179872450 00000004:00080000:0.0:1746143698.191851:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79f100, transno 17179872451 00000004:00080000:0.0:1746143698.191853:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f9f80, transno 17179872452 00000004:00080000:0.0:1746143698.191855:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3fb100, transno 17179872453 00000004:00080000:0.0:1746143698.191857:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3fa680, transno 17179872454 00000004:00080000:0.0:1746143698.191859:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e63d180, transno 17179872455 00010000:00010000:2.0:1746143698.191861:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1746143698.191861:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3fad80, transno 17179872456 00000004:00080000:0.0:1746143698.191863:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f8a80, transno 17179872457 00000004:00080000:0.0:1746143698.191866:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f9180, transno 17179872458 00000004:00080000:0.0:1746143698.191867:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f8380, transno 17179872459 00000004:00080000:0.0:1746143698.191869:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949f1f80, transno 17179872460 00000004:00080000:0.0:1746143698.191871:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0878a80, transno 17179872466 00000004:00080000:0.0:1746143698.191873:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0879f80, transno 17179872467 00000004:00080000:0.0:1746143698.191875:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0879180, transno 17179872468 00000004:00080000:0.0:1746143698.191877:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0878000, transno 17179872469 00000004:00080000:0.0:1746143698.191879:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0879880, transno 17179872470 00000004:00080000:0.0:1746143698.191882:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0878380, transno 17179872471 00000004:00080000:0.0:1746143698.191884:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a087b100, transno 17179872472 00000004:00080000:0.0:1746143698.191886:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0878700, transno 17179872473 00000004:00080000:0.0:1746143698.191888:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0878e00, transno 17179872474 00000004:00080000:0.0:1746143698.191890:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e1880, transno 17179872478 00000100:00100000:2.0:1746143698.191892:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592373376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4363us (7323us total) trans 0 rc 0/0 00000004:00080000:0.0:1746143698.191892:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e3800, transno 17179872479 00000004:00080000:0.0:1746143698.191894:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e0000, transno 17179872480 00000004:00080000:0.0:1746143698.191896:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009445b800, transno 17179872481 00000100:00100000:2.0:1746143698.191897:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5103 00000004:00080000:0.0:1746143698.191898:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e1500, transno 17179872482 00000004:00080000:0.0:1746143698.191900:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e3100, transno 17179872483 00000004:00080000:0.0:1746143698.191902:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e1f80, transno 17179872484 00000004:00080000:0.0:1746143698.191904:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009445ad80, transno 17179872485 00000004:00080000:0.0:1746143698.191907:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009445b480, transno 17179872486 00000004:00080000:0.0:1746143698.191909:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79f480, transno 17179872487 00000004:00080000:0.0:1746143698.191911:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79f800, transno 17179872488 00000100:00100000:2.0:1746143698.191912:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5104 00000004:00080000:0.0:1746143698.191914:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f01f80, transno 17179872489 00000100:00100000:2.0:1746143698.191916:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1962:x1830963592373504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000004:00080000:0.0:1746143698.191916:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f00e00, transno 17179872490 00000004:00080000:0.0:1746143698.191918:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f02300, transno 17179872491 00000004:00080000:0.0:1746143698.191920:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f03b80, transno 17179872492 00000004:00080000:0.0:1746143698.191923:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a087a300, transno 17179872493 00010000:00010000:2.0:1746143698.191924:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:0.0:1746143698.191925:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79e680, transno 17179872494 00000004:00080000:0.0:1746143698.191928:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f00a80, transno 17179872495 00000100:00100000:0.0:1746143698.191933:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593779456:0@lo:400:kworker.0 00010000:00010000:2.0:1746143698.191946:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 15 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.191960:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 15 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.191980:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009336be00/0xe984082ccd726534 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e68 expref: 15 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.191993:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.191995:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.192002:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.192009:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.192036:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.192046:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593779712:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143698.192081:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32240 going to sleep for 11 seconds 00000004:00080000:3.0:1746143698.192497:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 45 done 00000100:00100000:1.0:1746143698.198877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.198944:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.199001:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593779712:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143698.199026:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143698.199112:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.199114:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592373504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7194us (7645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.199124:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5104 00000100:00100000:1.0:1746143698.199157:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592373888 00000100:00100000:1.0:1746143698.199165:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592373888 00000100:00100000:2.0:1746143698.199176:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592374144 00000100:00100000:2.0:1746143698.199180:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592374144 00002000:00100000:2.0:1746143698.199206:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009445b800 x1830963592374144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.199206:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880094458000 x1830963592373888/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.199215:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445b800 with x1830963592374144 ext(3145728->4194303) 00002000:00010000:2.0:1746143698.199220:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445b800 00002000:00100000:1.0:1746143698.199221:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094458000 with x1830963592373888 ext(3145728->4194303) 00002000:00010000:1.0:1746143698.199224:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094458000 00000100:00100000:2.0:1746143698.199235:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3676 00000100:00100000:2.0:1746143698.199242:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592374144:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143698.199245:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3677 00000100:00100000:1.0:1746143698.199251:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592373888:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143698.199965:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592373632 00000100:00100000:3.0:1746143698.199970:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592373632 00000100:00100000:3.0:1746143698.199998:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9876 00000100:00100000:3.0:1746143698.200003:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28551:x1830963592373632:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143698.200013:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.200030:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd72657a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e92 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.200050:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.200052:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.200058:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd72657a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e92 expref: 10 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.200072:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd72657a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e92 expref: 10 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.200081:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2d600, rc 0) 00000100:00100000:3.0:1746143698.200103:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28551:x1830963592373632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 100us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.200112:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9876 00000100:00100000:0.0:1746143698.201845:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.203022:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592374400 00000100:00100000:1.0:1746143698.203033:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592374400 00002000:00100000:1.0:1746143698.203083:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1196032->1200127) req@ffff88009c3fb480 x1830963592374400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.203095:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb480 with x1830963592374400 ext(1196032->1200127) 00002000:00010000:1.0:1746143698.203102:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fb480 00000100:00100000:1.0:1746143698.203131:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3678 00000100:00100000:1.0:1746143698.203151:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592374400:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143698.203274:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592374400:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 137us (1439us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143698.203280:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3678 00002000:00100000:1.0:1746143698.203285:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1196032->1200127) req@ffff88009c3fb480 x1830963592374400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/4536 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.203292:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb480 with x1830963592374400 ext(1196032->1200127) 00002000:00010000:1.0:1746143698.203295:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fb480 00000100:00100000:0.0:1746143698.206300:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593779840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143698.206364:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143698.206419:0:8499:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593779840 00000100:00100000:1.0:1746143698.206426:0:8499:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593779840 00000100:00100000:1.0:1746143698.206480:0:8499:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1746143698.206488:0:8499:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1830963593779840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746143698.206511:0:8499:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 388562944 pending 3407872 free 3849322496 avail 3833593856 00000100:00100000:1.0:1746143698.206549:0:8499:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1830963593779840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143698.206555:0:8499:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1746143698.206581:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593779840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143698.211201:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.211541:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592374656 00000100:00100000:3.0:1746143698.211551:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592374656 00002000:00100000:3.0:1746143698.211599:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009c3f9500 x1830963592374656/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.211610:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9500 with x1830963592374656 ext(3145728->4194303) 00002000:00010000:3.0:1746143698.211615:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9500 00000100:00100000:3.0:1746143698.211635:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3679 00000100:00100000:3.0:1746143698.211643:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592374656:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143698.214841:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592373888:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 15576us (15883us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143698.214855:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3677 00002000:00100000:0.0:1746143698.214866:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff880094458000 x1830963592373888/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143698.214875:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094458000 with x1830963592373888 ext(3145728->4194303) 00002000:00010000:0.0:1746143698.214880:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094458000 00000100:00100000:1.0:1746143698.215019:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.215038:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592374912 00000100:00100000:0.0:1746143698.215045:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592374912 00000100:00100000:3.0:1746143698.215751:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592374144:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 16508us (16637us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143698.215758:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3676 00002000:00100000:3.0:1746143698.215764:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009445b800 x1830963592374144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.215772:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445b800 with x1830963592374144 ext(3145728->4194303) 00002000:00010000:3.0:1746143698.215775:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445b800 00002000:00100000:0.0:1746143698.215944:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34b:0x0] (1241088->1245183) req@ffff88009445ad80 x1830963592374912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143698.215952:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445ad80 with x1830963592374912 ext(1241088->1245183) 00002000:00010000:0.0:1746143698.215956:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445ad80 00000100:00100000:3.0:1746143698.216285:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3680 00000100:00100000:3.0:1746143698.216295:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592374912:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143698.216438:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592374912:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 144us (1419us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143698.216443:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3680 00002000:00100000:3.0:1746143698.216449:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1241088->1245183) req@ffff88009445ad80 x1830963592374912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/4536 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.216463:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445ad80 with x1830963592374912 ext(1241088->1245183) 00002000:00010000:3.0:1746143698.216466:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445ad80 00000100:00100000:0.0:1746143698.227251:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.227975:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592375040 00000100:00100000:2.0:1746143698.227986:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592375040 00000100:00100000:2.0:1746143698.228037:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9877 00000100:00100000:2.0:1746143698.228050:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592375040:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143698.228054:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143698.228071:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.228090:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012caa8c00/0xe984082ccd726581 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1e99 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.228163:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593779968:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143698.228240:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.228704:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592375296 00000100:00100000:0.0:1746143698.228708:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592375296 00000100:00100000:0.0:1746143698.228905:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3409 00000100:00100000:0.0:1746143698.228912:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:28556:x1830963592375296:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143698.229101:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1964:x1830963592374656:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17457us (17910us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143698.229110:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3679 00002000:00100000:3.0:1746143698.229120:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009c3f9500 x1830963592374656/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.229130:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9500 with x1830963592374656 ext(3145728->4194303) 00002000:00010000:3.0:1746143698.229134:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9500 00000100:00100000:0.0:1746143698.229385:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+263:28556:x1830963592375296:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 474us (1331us total) trans 8589942464 rc 0/0 00000100:00100000:0.0:1746143698.229391:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3409 00002000:00010000:2.0:1746143698.230783:0:6929:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143696 -> 1746143697 00002000:00010000:2.0:1746143698.230788:0:6929:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143696 -> 1746143697 00002000:00010000:2.0:1746143698.230790:0:6929:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143696 -> 1746143697 00000100:00100000:2.0:1746143698.230819:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593779968:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143698.230849:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012caa8c00/0xe984082ccd726581 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e99 expref: 24 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.230863:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012caa8c00/0xe984082ccd726581 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e99 expref: 24 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.230889:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa8c00, rc 0) 00000100:00100000:2.0:1746143698.230927:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592375040:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2883us (3686us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143698.230934:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9877 00000100:00100000:1.0:1746143698.234060:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.234135:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592375424 00000100:00100000:2.0:1746143698.234161:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592375424 00000100:00100000:2.0:1746143698.234211:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9878 00000100:00100000:2.0:1746143698.234219:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592375424:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.234239:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.234256:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012caa9200/0xe984082ccd726588 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ea0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.234309:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593780096:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143698.234379:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143698.236324:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593780096:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143698.236357:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012caa9200/0xe984082ccd726588 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ea0 expref: 24 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.236371:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012caa9200/0xe984082ccd726588 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ea0 expref: 24 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.236398:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa9200, rc 0) 00000100:00100000:2.0:1746143698.236965:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592375424:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2743us (2912us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143698.236980:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9878 00000100:00100000:0.0:1746143698.238733:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.238904:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592375552 00000100:00100000:2.0:1746143698.238913:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592375552 00000100:00100000:2.0:1746143698.239000:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9879 00000100:00100000:2.0:1746143698.239008:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592375552:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.239027:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.239044:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012caa8200/0xe984082ccd72658f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ea7 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.239094:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593780224:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143698.239514:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.240473:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.240606:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592375680 00000100:00100000:3.0:1746143698.240612:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592375680 00000100:00100000:3.0:1746143698.241365:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9880 00000100:00100000:3.0:1746143698.241374:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592375680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143698.241392:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.241407:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c2c400/0xe984082ccd726596 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1eae expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143698.241452:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593780352:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143698.241522:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f423c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143698.241930:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593780224:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143698.241954:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012caa8200/0xe984082ccd72658f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ea7 expref: 15 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.241965:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caa8200/0xe984082ccd72658f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ea7 expref: 15 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.241978:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa8200, rc 0) 00000100:00100000:3.0:1746143698.242003:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592375552:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2996us (3279us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143698.242009:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9879 00000100:00100000:3.0:1746143698.243833:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593780352:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143698.243862:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c2c400/0xe984082ccd726596 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eae expref: 24 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.243873:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c2c400/0xe984082ccd726596 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eae expref: 24 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.243883:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2c400, rc 0) 00000100:00100000:3.0:1746143698.244345:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592375680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2970us (3873us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143698.244354:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9880 00000100:00100000:0.0:1746143698.244656:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.244912:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592375808 00000100:00100000:3.0:1746143698.244919:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592375808 00000100:00100000:2.0:1746143698.245211:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9881 00000100:00100000:2.0:1746143698.245220:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592375808:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.245237:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.245253:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012caa9800/0xe984082ccd72659d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1eb5 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.245300:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593780480:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143698.245360:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143698.246371:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593780480:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143698.246395:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012caa9800/0xe984082ccd72659d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eb5 expref: 15 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.246406:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caa9800/0xe984082ccd72659d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eb5 expref: 15 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.246418:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa9800, rc 0) 00000100:00100000:2.0:1746143698.246702:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592375808:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1484us (2046us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143698.246709:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9881 00000100:00100000:0.0:1746143698.249799:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.250329:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592375936 00000100:00100000:2.0:1746143698.250339:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592375936 00000100:00100000:2.0:1746143698.250440:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9882 00000100:00100000:2.0:1746143698.250449:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592375936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.250470:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.250488:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012caa8000/0xe984082ccd7265a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ebc expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.250543:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593780608:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143698.250621:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e320c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746143698.252491:0:4582:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime: 1746143697 -> 1746143698 00000100:00100000:2.0:1746143698.252519:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593780608:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143698.252543:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012caa8000/0xe984082ccd7265a4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ebc expref: 15 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.252557:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caa8000/0xe984082ccd7265a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ebc expref: 15 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.252566:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa8000, rc 0) 00000100:00100000:2.0:1746143698.252608:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592375936:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2161us (2818us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143698.252616:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9882 00000100:00100000:0.0:1746143698.320717:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.321577:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592376192 00000100:00100000:3.0:1746143698.321589:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592376192 00000100:00100000:3.0:1746143698.321645:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8347 00000100:00100000:3.0:1746143698.321654:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+26:28562:x1830963592376192:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143698.321678:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.321697:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093369400/0xe984082ccd7265ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ec3 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.321816:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd7265b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.321829:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd7265b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.321841:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd7265b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.321854:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d400/0xe984082ccd7265b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.321860:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d400/0xe984082ccd7265b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.321865:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d400/0xe984082ccd7265b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.321964:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef3fa00/0xe984082ccd7265c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.321971:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef3fa00/0xe984082ccd7265c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.321977:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef3fa00/0xe984082ccd7265c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143698.321984:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143698.322057:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd7265b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.322064:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd7265b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.322073:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd7265b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.322079:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c2c400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143698.322083:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd7265b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.322089:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd7265b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.322098:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143698.322101:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143698.322105:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd7265b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.322110:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c400/0xe984082ccd7265b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.323905:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d400/0xe984082ccd7265b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.323916:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d400/0xe984082ccd7265b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.323923:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d400/0xe984082ccd7265b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.323927:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c2d400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143698.323929:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d400/0xe984082ccd7265b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.323934:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d400/0xe984082ccd7265b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.323949:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009322f600) 00010000:00010000:3.0:1746143698.323951:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143698.323953:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d400/0xe984082ccd7265b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.323958:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d400/0xe984082ccd7265b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.324018:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093369400/0xe984082ccd7265ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ec3 expref: 29 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.324030:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef3fa00/0xe984082ccd7265c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ec3 expref: 28 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.324036:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143698.324038:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143698.324040:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef3fa00, rc 0) 00000100:00100000:3.0:1746143698.324107:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+28:28562:x1830963592376192:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2454us (3403us total) trans 8589942465 rc 0/0 00000100:00100000:3.0:1746143698.324115:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8347 00000100:00100000:0.0:1746143698.372063:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.372213:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592376320 00000100:00100000:2.0:1746143698.372225:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592376320 00000100:00100000:2.0:1746143698.372308:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9883 00000100:00100000:2.0:1746143698.372320:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592376320:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.372345:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.372367:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012caa9800/0xe984082ccd7265ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1eca expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.372433:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593780736:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143698.372586:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e320c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746143698.376296:0:4582:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime: 1746143697 -> 1746143698 00000100:00100000:2.0:1746143698.376328:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593780736:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143698.376361:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012caa9800/0xe984082ccd7265ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eca expref: 24 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.376374:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012caa9800/0xe984082ccd7265ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eca expref: 24 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.376395:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa9800, rc 0) 00000100:00100000:2.0:1746143698.376445:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592376320:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4127us (4396us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143698.376453:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9883 00000100:00100000:0.0:1746143698.384489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.386004:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592376448 00000100:00100000:2.0:1746143698.386017:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592376448 00000100:00100000:2.0:1746143698.386083:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9884 00000100:00100000:2.0:1746143698.386091:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592376448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.386113:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.386131:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012caa9200/0xe984082ccd7265d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ed1 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.386203:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593780864:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143698.386865:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.390391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.390552:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592376704 00000100:00100000:3.0:1746143698.390561:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592376704 00002000:00100000:3.0:1746143698.390606:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800949f1f80 x1830963592376704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 504/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.390618:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1f80 with x1830963592376704 ext(1048576->2097151) 00002000:00010000:3.0:1746143698.390624:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1f80 00000100:00100000:3.0:1746143698.390643:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3681 00000100:00100000:3.0:1746143698.390651:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963592376704:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143698.398612:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963592376704:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7948us (8219us total) trans 0 rc 999424/999424 00000100:00100000:2.0:1746143698.398626:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3681 00002000:00100000:2.0:1746143698.398640:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800949f1f80 x1830963592376704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 504/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.398650:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1f80 with x1830963592376704 ext(1048576->2097151) 00002000:00010000:2.0:1746143698.398657:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1f80 00000100:00100000:3.0:1746143698.399266:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593780864:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143698.399300:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012caa9200/0xe984082ccd7265d5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed1 expref: 15 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.399316:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caa9200/0xe984082ccd7265d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed1 expref: 15 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.399341:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa9200, rc 0) 00000100:00100000:3.0:1746143698.399615:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592376448:12345-192.168.202.48@tcp:101:cat.0 Request processed in 13523us (15134us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143698.399621:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9884 00000100:00100000:0.0:1746143698.404347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.404478:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592376832 00000100:00100000:3.0:1746143698.404489:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592376832 00000100:00100000:3.0:1746143698.404537:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9885 00000100:00100000:3.0:1746143698.404545:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28566:x1830963592376832:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143698.404567:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.404587:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd7265dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ed8 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.404620:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.404628:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143698.404629:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143698.404632:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd7265dc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed8 expref: 24 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.404666:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.404677:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 9 pid: 6929 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143698.404689:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593780992:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143698.406779:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.412942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.413445:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592376960 00000100:00100000:2.0:1746143698.413456:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592376960 00000100:00100000:2.0:1746143698.413512:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9886 00000100:00100000:2.0:1746143698.413521:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28568:x1830963592376960:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.413542:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.413559:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012caa8c00/0xe984082ccd7265e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1edf expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.413590:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.413596:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143698.413599:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143698.413602:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012caa8c00/0xe984082ccd7265e3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1edf expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.413630:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.413641:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 18 pid: 9527 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.413652:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593781120:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143698.414388:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593780992:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143698.414414:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd7265dc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed8 expref: 24 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.414426:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef3e800, rc 0) 00000100:00100000:3.0:1746143698.414450:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28566:x1830963592376832:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9906us (10115us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.414457:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9885 00000100:00100000:2.0:1746143698.414567:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.416348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.416500:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592377088 00000100:00100000:3.0:1746143698.416507:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592377088 00002000:00100000:3.0:1746143698.416549:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1306623) req@ffff8800a5d80e00 x1830963592377088/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.416560:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80e00 with x1830963592377088 ext(1048576->1306623) 00010000:00010000:3.0:1746143698.416568:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 10 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.416586:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 10 pid: 6929 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746143698.416593:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d80e00 00000100:00100000:3.0:1746143698.416608:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 899 00000100:00100000:3.0:1746143698.416614:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1962:x1830963592377088:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143698.416991:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593781120:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143698.417017:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012caa8c00/0xe984082ccd7265e3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1edf expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.417031:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012caa8c00, rc 0) 00000100:00100000:2.0:1746143698.420001:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28568:x1830963592376960:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6467us (7058us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.420014:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9886 00000100:00100000:1.0:1746143698.420422:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.420571:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592377216 00000100:00100000:0.0:1746143698.420579:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592377216 00002000:00100000:0.0:1746143698.420619:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1196032->1245183) req@ffff88012b79d500 x1830963592377216/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143698.420634:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79d500 with x1830963592377216 ext(1196032->1245183) 00010000:00010000:0.0:1746143698.420643:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 19 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.420655:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 19 pid: 9527 timeout: 877 lvb_type: 0 00002000:00010000:0.0:1746143698.420662:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b79d500 00000100:00100000:0.0:1746143698.420677:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 900 00000100:00100000:0.0:1746143698.420683:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592377216:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143698.426852:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592377216:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6155us (6418us total) trans 21474839770 rc 0/0 00000100:00100000:1.0:1746143698.426865:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 900 00002000:00100000:1.0:1746143698.426878:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1196032->1245183) req@ffff88012b79d500 x1830963592377216/t21474839770(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/448 e 0 to 0 dl 1746143709 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.426888:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79d500 with x1830963592377216 ext(1196032->1245183) 00010000:00010000:1.0:1746143698.426899:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 21 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.426912:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 21 pid: 9527 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746143698.426919:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b79d500 00000100:00100000:3.0:1746143698.432577:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592377088:12345-192.168.202.48@tcp:4:cat.0 Request processed in 15949us (16224us total) trans 17179872504 rc 0/0 00000100:00100000:3.0:1746143698.432591:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 899 00002000:00100000:3.0:1746143698.432604:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1306623) req@ffff8800a5d80e00 x1830963592377088/t17179872504(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/448 e 0 to 0 dl 1746143709 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.432613:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80e00 with x1830963592377088 ext(1048576->1306623) 00010000:00010000:3.0:1746143698.432624:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 12 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.432637:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 12 pid: 6929 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746143698.432644:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d80e00 00000100:00100000:0.0:1746143698.434925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.435017:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592377344 00000100:00100000:2.0:1746143698.435026:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592377344 00010000:00010000:2.0:1746143698.435064:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 12 pid: 6929 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.435094:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5105 00000100:00100000:2.0:1746143698.435101:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592377344:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.435116:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.435137:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 12 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.435172:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 12 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.435197:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009336a600/0xe984082ccd726542 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e76 expref: 12 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.435228:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.435230:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.435237:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd7265dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed8 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.435245:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd7265dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed8 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.435280:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd7265dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed8 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.435293:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593781248:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143698.435377:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.438736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.438885:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592377472 00000100:00100000:2.0:1746143698.438895:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592377472 00010000:00010000:2.0:1746143698.438934:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 21 pid: 9527 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.438979:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5106 00000100:00100000:2.0:1746143698.438987:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592377472:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.439003:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.439027:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 21 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.439039:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 21 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.439060:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b75cc00/0xe984082ccd72656c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1245183) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e84 expref: 21 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.439092:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.439094:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.439102:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012caa8c00/0xe984082ccd7265e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1edf expref: 14 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.439109:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012caa8c00/0xe984082ccd7265e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1edf expref: 14 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.439163:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012caa8c00/0xe984082ccd7265e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1edf expref: 14 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.439174:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593781376:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143698.439251:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143698.440058:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593781248:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143698.440075:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143698.440102:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592377344:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5001us (5189us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.440113:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5105 00000100:00100000:2.0:1746143698.441777:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963593781376:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143698.441795:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.441853:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592377472:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2865us (3126us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.441862:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5106 00000100:00100000:0.0:1746143698.450406:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.450458:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.452729:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592377856 00000100:00100000:1.0:1746143698.452743:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592377856 00002000:00100000:1.0:1746143698.452810:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a5d81c00 x1830963592377856/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.452820:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81c00 with x1830963592377856 ext(1048576->2097151) 00002000:00010000:1.0:1746143698.452828:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d81c00 00000100:00100000:1.0:1746143698.452860:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592377984 00000100:00100000:1.0:1746143698.452863:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592377984 00002000:00100000:1.0:1746143698.452878:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff8800a5d82d80 x1830963592377984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.452884:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830963592377984 ext(1048576->2097151) 00002000:00010000:1.0:1746143698.452888:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82d80 00000100:00100000:1.0:1746143698.452911:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3682 00000100:00100000:1.0:1746143698.452920:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963592377856:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143698.454343:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3683 00000100:00100000:1.0:1746143698.454353:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592377984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143698.480294:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963592377856:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27363us (29888us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143698.480308:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3682 00002000:00100000:0.0:1746143698.480321:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a5d81c00 x1830963592377856/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143698.480330:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81c00 with x1830963592377856 ext(1048576->2097151) 00002000:00010000:0.0:1746143698.480337:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d81c00 00000100:00100000:0.0:1746143698.480430:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.485908:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592378240 00000100:00100000:1.0:1746143698.485924:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592378240 00000100:00100000:1.0:1746143698.485984:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8348 00000100:00100000:1.0:1746143698.485993:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+263:28570:x1830963592378240:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143698.486018:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.486039:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792000/0xe984082ccd7265ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ee6 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.486161:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.486177:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dff expref: 18 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.486183:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daea00/0xe984082ccd72655e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e7d expref: 264 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.486191:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef3fa00/0xe984082ccd7265c0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ec3 expref: 27 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.486197:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.486230:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef3fa00/0xe984082ccd7265c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ec3 expref: 27 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.486242:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef3fa00/0xe984082ccd7265c0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ec3 expref: 27 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.486255:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593781504:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.490463:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daea00/0xe984082ccd72655e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e7d expref: 264 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.490481:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daea00/0xe984082ccd72655e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e7d expref: 264 pid: 14763 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.490497:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593781632:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.490618:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dff expref: 18 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.490626:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dff expref: 18 pid: 14763 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.490634:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593781760:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143698.490656:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143698.496351:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592377984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 41987us (45878us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143698.496364:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3683 00002000:00100000:1.0:1746143698.496377:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff8800a5d82d80 x1830963592377984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.496386:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830963592377984 ext(1048576->2097151) 00002000:00010000:1.0:1746143698.496392:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82d80 00000100:00100000:0.0:1746143698.496727:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.496917:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593781504:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143698.497841:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.498929:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.498995:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593781632:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143698.499005:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593781760:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143698.499042:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:2.0:1746143698.501734:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592378368 00000100:00100000:2.0:1746143698.501748:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592378368 00010000:00010000:2.0:1746143698.501808:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef3fa00/0xe984082ccd7265c0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ec3 expref: 28 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.501844:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592378496 00000100:00100000:2.0:1746143698.501847:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592378496 00010000:00010000:2.0:1746143698.501860:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daea00/0xe984082ccd72655e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e7d expref: 265 pid: 14763 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.501875:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592378624 00000100:00100000:2.0:1746143698.501878:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592378624 00010000:00010000:2.0:1746143698.501889:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dff expref: 19 pid: 14763 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.501902:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5107 00000100:00100000:2.0:1746143698.501910:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+28:1964:x1830963592378368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.501924:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.501929:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef3fa00/0xe984082ccd7265c0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ec3 expref: 28 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.501938:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef3fa00/0xe984082ccd7265c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ec3 expref: 28 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.501962:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef3fa00/0xe984082ccd7265c0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ec3 expref: 28 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.501993:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143698.501998:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.502006:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.502011:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.502065:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+27:1964:x1830963592378368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 156us (5339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.502072:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5107 00000100:00100000:2.0:1746143698.502089:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5108 00000100:00100000:2.0:1746143698.502094:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:1964:x1830963592378496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.502100:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.502104:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daea00/0xe984082ccd72655e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e7d expref: 265 pid: 14763 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.502111:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daea00/0xe984082ccd72655e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e7d expref: 265 pid: 14763 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.502124:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4daea00/0xe984082ccd72655e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e7d expref: 265 pid: 14763 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.502132:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143698.502134:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.502157:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.502161:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.502177:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:1964:x1830963592378496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 83us (4338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.502183:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5108 00000100:00100000:2.0:1746143698.502221:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5109 00000100:00100000:2.0:1746143698.502225:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+19:1965:x1830963592378624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.502231:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.502234:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dff expref: 19 pid: 14763 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.502241:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dff expref: 19 pid: 14763 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.502251:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc800/0xe984082ccd72649a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dff expref: 19 pid: 14763 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.502259:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143698.502262:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.502267:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.502274:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.502293:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.502306:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+18:1965:x1830963592378624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 81us (3379us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.502312:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5109 00010000:00010000:2.0:1746143698.503322:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.503340:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143698.503363:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143698.503517:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792000/0xe984082ccd7265ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ee6 expref: 265 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.503539:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ee6 expref: 264 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.503546:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143698.503548:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143698.503550:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5792600, rc 0) 00000100:00100000:2.0:1746143698.504041:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:28570:x1830963592378240:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 18047us (23609us total) trans 8589942466 rc 0/0 00000100:00100000:2.0:1746143698.504052:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8348 00000100:00100000:0.0:1746143698.508693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.508733:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.508754:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.508787:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.509122:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592378752 00000100:00100000:2.0:1746143698.509131:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592378752 00000100:00100000:2.0:1746143698.509199:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592378880 00000100:00100000:2.0:1746143698.509202:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592378880 00000100:00100000:2.0:1746143698.509223:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592379008 00000100:00100000:2.0:1746143698.509224:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592379008 00000100:00100000:2.0:1746143698.509236:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592379136 00000100:00100000:2.0:1746143698.509238:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592379136 00000100:00100000:2.0:1746143698.509254:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9887 00000100:00100000:2.0:1746143698.509262:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592378752:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.509283:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.509303:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c2c400/0xe984082ccd7265ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1eed expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509328:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.509330:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.509339:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2c400/0xe984082ccd7265ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eed expref: 21 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.509355:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c2c400/0xe984082ccd7265ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eed expref: 21 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.509365:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2c400, rc 0) 00000100:00100000:2.0:1746143698.509410:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592378752:12345-192.168.202.48@tcp:101:cat.0 Request processed in 150us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.509416:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9887 00000100:00100000:2.0:1746143698.509439:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9888 00000100:00100000:2.0:1746143698.509445:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28568:x1830963592378880:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.509452:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.509462:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ef4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509474:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.509475:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.509479:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ef4 expref: 12 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509487:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ef4 expref: 12 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509493:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095135200, rc 0) 00000100:00100000:2.0:1746143698.509508:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28568:x1830963592378880:12345-192.168.202.48@tcp:101:cat.0 Request processed in 63us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.509513:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9888 00000100:00100000:2.0:1746143698.509522:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9889 00000100:00100000:2.0:1746143698.509527:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28562:x1830963592379008:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143698.509533:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.509538:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1efb expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509550:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012caa8c00/0xe984082ccd7265e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1edf expref: 16 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509556:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c2c400/0xe984082ccd7265ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eed expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.509562:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.509564:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.509566:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1634304->2097151] (req 1634304->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 16 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509590:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c2c400/0xe984082ccd7265ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eed expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.509601:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c2c400/0xe984082ccd7265ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eed expref: 20 pid: 15784 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746143698.509611:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593781888:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143698.509664:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012caa8c00/0xe984082ccd7265e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1edf expref: 16 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509671:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012caa8c00/0xe984082ccd7265e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1edf expref: 16 pid: 9527 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.509679:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593782016:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143698.509696:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143698.509716:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9890 00000100:00100000:2.0:1746143698.509721:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28570:x1830963592379136:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143698.509728:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.509733:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f02 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509746:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd7265dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed8 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509753:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ef4 expref: 11 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509757:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.509758:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.509761:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1556480->1683455] (req 1556480->1683455) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509774:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ef4 expref: 11 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509781:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ef4 expref: 11 pid: 15784 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.509788:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593782144:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143698.509826:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd7265dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed8 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.509834:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd7265dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed8 expref: 25 pid: 4582 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.509841:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593782272:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143698.509858:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e323c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143698.517979:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593781888:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143698.517993:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593782016:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143698.518025:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1634304->2097151] (req 1634304->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 16 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.518043:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095614000, rc 0) 00000100:00100000:2.0:1746143698.518094:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28562:x1830963592379008:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8565us (9337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.518102:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9889 00000100:00100000:1.0:1746143698.518510:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.518528:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592379264 00000100:00100000:1.0:1746143698.518534:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592379264 00010000:00010000:1.0:1746143698.518562:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012caa8c00/0xe984082ccd7265e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1edf expref: 16 pid: 9527 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.518580:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5110 00000100:00100000:1.0:1746143698.518585:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592379264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143698.518597:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143698.518618:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012caa8c00/0xe984082ccd7265e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1edf expref: 16 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.518627:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012caa8c00/0xe984082ccd7265e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1edf expref: 16 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.518648:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caa8c00/0xe984082ccd7265e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1edf expref: 16 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.518678:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143698.518692:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592379264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 107us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143698.518697:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5110 00000100:00100000:1.0:1746143698.518728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.518738:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.518761:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.518768:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592379392 00000100:00100000:1.0:1746143698.518770:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592379392 00010000:00010000:1.0:1746143698.518779:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2c400/0xe984082ccd7265ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eed expref: 21 pid: 15784 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746143698.518790:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5111 00000100:00100000:1.0:1746143698.518794:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963592379392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143698.518799:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143698.518814:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c2c400/0xe984082ccd7265ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eed expref: 21 pid: 15784 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746143698.518822:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c2c400/0xe984082ccd7265ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eed expref: 21 pid: 15784 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746143698.518832:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c2c400/0xe984082ccd7265ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1eed expref: 21 pid: 15784 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746143698.518839:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.518841:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.518848:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 14 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.518855:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 14 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.518879:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 14 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143698.518889:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593782400:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143698.518934:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143698.518964:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592379520 00000100:00100000:1.0:1746143698.518967:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592379520 00000100:00100000:1.0:1746143698.518979:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592379648 00000100:00100000:1.0:1746143698.518981:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592379648 00000100:00100000:1.0:1746143698.518992:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9891 00000100:00100000:1.0:1746143698.518995:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592379520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143698.519006:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.519015:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd72661b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f09 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143698.519037:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593782528:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143698.519054:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f039c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143698.519065:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9892 00000100:00100000:1.0:1746143698.519069:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592379648:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143698.519075:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.519084:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136489800/0xe984082ccd726622 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f10 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.519093:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.519098:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136489800/0xe984082ccd726622 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f10 expref: 27 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.519105:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136489800/0xe984082ccd726622 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f10 expref: 27 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.519111:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136489800, rc 0) 00000100:00100000:1.0:1746143698.519122:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592379648:12345-192.168.202.48@tcp:101:cat.0 Request processed in 53us (383us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143698.519126:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9892 00000100:00100000:1.0:1746143698.519168:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593782144:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143698.519176:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963593782272:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.519188:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1556480->1683455] (req 1556480->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.519194:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f596e00, rc 0) 00000100:00100000:1.0:1746143698.519205:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28570:x1830963592379136:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 9485us (10418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143698.519209:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9890 00000100:00100000:0.0:1746143698.521352:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.521483:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.522465:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593782400:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143698.522488:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.522542:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592379392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3745us (3778us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.522553:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5111 00000100:00100000:2.0:1746143698.522582:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592380032 00000100:00100000:2.0:1746143698.522588:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592380032 00010000:00010000:2.0:1746143698.522616:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd7265dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed8 expref: 25 pid: 4582 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.522638:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5112 00000100:00100000:2.0:1746143698.522645:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592380032:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.522657:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.522679:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd7265dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed8 expref: 25 pid: 4582 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.522692:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd7265dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed8 expref: 25 pid: 4582 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.522714:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd7265dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ed8 expref: 25 pid: 4582 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.524012:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593782528:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143698.524037:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd72661b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f09 expref: 21 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.524056:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd72661b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f09 expref: 21 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.524065:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136489600, rc 0) 00010000:00010000:2.0:1746143698.524915:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143698.525519:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592379520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6335us (6602us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143698.525519:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.525528:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9891 00000100:00100000:0.0:1746143698.525544:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592379904 00000100:00100000:0.0:1746143698.525550:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592379904 00000100:00100000:1.0:1746143698.525558:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592380288 00000100:00100000:1.0:1746143698.525561:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592380288 00002000:00100000:1.0:1746143698.525587:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1634304->1638399) req@ffff8800a5d82680 x1830963592380288/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143698.525587:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff8800a5d80380 x1830963592379904/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.525596:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82680 with x1830963592380288 ext(1634304->1638399) 00002000:00100000:0.0:1746143698.525596:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80380 with x1830963592379904 ext(1048576->2097151) 00002000:00010000:1.0:1746143698.525600:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d82680 00010000:00010000:0.0:1746143698.525603:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ef4 expref: 12 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.525616:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ef4 expref: 12 pid: 15784 timeout: 877 lvb_type: 0 00002000:00010000:0.0:1746143698.525622:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d80380 00000100:00100000:1.0:1746143698.525624:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3684 00000100:00100000:1.0:1746143698.525631:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963592380288:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143698.525636:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 901 00000100:00100000:0.0:1746143698.525641:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592379904:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143698.525773:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963592380288:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 143us (261us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143698.525779:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3684 00002000:00100000:1.0:1746143698.525784:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1634304->1638399) req@ffff8800a5d82680 x1830963592380288/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/4536 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.525791:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82680 with x1830963592380288 ext(1634304->1638399) 00002000:00010000:1.0:1746143698.525794:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d82680 00000100:00100000:2.0:1746143698.525951:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963592380032:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3304us (4466us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.525959:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5112 00000100:00100000:1.0:1746143698.533431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.533502:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592380416 00000100:00100000:0.0:1746143698.533513:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592380416 00000100:00100000:0.0:1746143698.533577:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9893 00000100:00100000:0.0:1746143698.533586:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963592380416:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143698.533610:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143698.533629:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd17c00/0xe984082ccd726629 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f17 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143698.533690:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593782656:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143698.533768:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143698.534598:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.534742:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592380544 00000100:00100000:0.0:1746143698.534748:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592380544 00000100:00100000:0.0:1746143698.534776:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9894 00000100:00100000:0.0:1746143698.534782:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963592380544:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143698.534795:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143698.534820:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd16a00/0xe984082ccd726630 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f1e expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.534862:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143698.534874:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd16a00/0xe984082ccd726630 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f1e expref: 25 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143698.534883:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd16a00/0xe984082ccd726630 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f1e expref: 25 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143698.534905:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd16a00, rc 0) 00000100:00100000:0.0:1746143698.534947:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963592380544:12345-192.168.202.48@tcp:101:cat.0 Request processed in 165us (351us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143698.534954:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9894 00002000:00010000:2.0:1746143698.545941:0:8496:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime: 1746143697 -> 1746143698 00002000:00010000:2.0:1746143698.545948:0:8496:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime: 1746143697 -> 1746143698 00000100:00100000:2.0:1746143698.545971:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593782656:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143698.545999:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd17c00/0xe984082ccd726629 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f17 expref: 21 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.546012:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd17c00/0xe984082ccd726629 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f17 expref: 21 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.546032:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd17c00, rc 0) 00000100:00100000:2.0:1746143698.546102:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963592380416:12345-192.168.202.48@tcp:101:cat.0 Request processed in 12517us (12682us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143698.546110:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9893 00000100:00100000:0.0:1746143698.547004:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592379904:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 21354us (25653us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143698.547018:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 901 00002000:00100000:0.0:1746143698.547030:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff8800a5d80380 x1830963592379904/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143698.547039:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80380 with x1830963592379904 ext(1048576->2097151) 00010000:00010000:0.0:1746143698.547050:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ef4 expref: 12 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.547064:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ef4 expref: 12 pid: 15784 timeout: 877 lvb_type: 0 00002000:00010000:0.0:1746143698.547070:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d80380 00000100:00100000:0.0:1746143698.568230:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.568693:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592380672 00000100:00100000:2.0:1746143698.568705:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592380672 00010000:00010000:2.0:1746143698.568747:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ef4 expref: 12 pid: 15784 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.568791:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5113 00000100:00100000:2.0:1746143698.568808:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592380672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.568826:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.568851:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ef4 expref: 12 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.568863:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ef4 expref: 12 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.568886:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095135200/0xe984082ccd726606 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ef4 expref: 12 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.568926:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.568928:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.568936:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.568944:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.568978:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.568991:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593782784:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143698.569077:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143698.569715:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.569858:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592380800 00000100:00100000:3.0:1746143698.569862:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592380800 00000100:00100000:3.0:1746143698.569887:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9895 00000100:00100000:3.0:1746143698.569894:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28562:x1830963592380800:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143698.569910:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.569924:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f25 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.569942:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.569949:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143698.569950:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143698.569953:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->1306623] (req 1048576->1306623) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 13 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.569972:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.569982:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 23 pid: 8495 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143698.569991:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593782912:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143698.570036:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143698.576586:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.576994:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592380928 00000100:00100000:0.0:1746143698.577004:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592380928 00000100:00100000:2.0:1746143698.577361:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9896 00000100:00100000:2.0:1746143698.577372:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592380928:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.577391:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.577411:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f597400/0xe984082ccd72663e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f2c expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.577472:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593783040:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143698.577566:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143698.577862:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.577928:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593782912:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.577949:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [1048576->1306623] (req 1048576->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 15 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.577960:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef3e800, rc 0) 00000100:00100000:1.0:1746143698.577984:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28562:x1830963592380800:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8091us (8272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143698.577991:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9895 00000100:00100000:2.0:1746143698.578472:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593782784:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143698.578482:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143698.578494:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592381184 00000100:00100000:0.0:1746143698.578498:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592381184 00000100:00100000:2.0:1746143698.578505:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592380672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9707us (10288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.578512:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5113 00002000:00100000:0.0:1746143698.578527:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1556480->1560575) req@ffff88012b79f800 x1830963592381184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143698.578535:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79f800 with x1830963592381184 ext(1556480->1560575) 00010000:00010000:0.0:1746143698.578736:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 24 pid: 8495 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.578751:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 24 pid: 8495 timeout: 877 lvb_type: 0 00002000:00010000:0.0:1746143698.578758:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b79f800 00000100:00100000:3.0:1746143698.579054:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 902 00000100:00100000:3.0:1746143698.579064:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592381184:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143698.579270:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592381184:12345-192.168.202.48@tcp:3:cat.0 Request processed in 207us (1408us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143698.579276:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 902 00002000:00100000:3.0:1746143698.579282:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1556480->1560575) req@ffff88012b79f800 x1830963592381184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/4536 e 0 to 0 dl 1746143709 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.579289:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79f800 with x1830963592381184 ext(1556480->1560575) 00010000:00010000:3.0:1746143698.579295:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 24 pid: 8495 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.579304:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 24 pid: 8495 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746143698.579310:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b79f800 00002000:00010000:2.0:1746143698.579867:0:15784:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime: 1746143697 -> 1746143698 00002000:00010000:2.0:1746143698.579870:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime: 1746143697 -> 1746143698 00000100:00100000:2.0:1746143698.579881:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593783040:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143698.579898:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f597400/0xe984082ccd72663e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f2c expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.579907:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f597400/0xe984082ccd72663e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f2c expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.579927:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f597400, rc 0) 00000100:00100000:2.0:1746143698.579949:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1962:x1830963592380928:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2580us (3374us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143698.579957:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9896 00000100:00100000:0.0:1746143698.581996:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.582049:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592381440 00000100:00100000:3.0:1746143698.582057:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592381440 00002000:00100000:3.0:1746143698.582103:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1679360->1683455) req@ffff8800a5d80700 x1830963592381440/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.582112:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80700 with x1830963592381440 ext(1679360->1683455) 00010000:00010000:3.0:1746143698.582121:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 24 pid: 8495 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.582133:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 24 pid: 8495 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746143698.582268:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d80700 00000100:00100000:3.0:1746143698.582302:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 903 00000100:00100000:3.0:1746143698.582310:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592381440:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143698.582502:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592381440:12345-192.168.202.48@tcp:3:cat.0 Request processed in 192us (513us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143698.582509:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 903 00002000:00100000:3.0:1746143698.582514:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1679360->1683455) req@ffff8800a5d80700 x1830963592381440/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/4536 e 0 to 0 dl 1746143709 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.582520:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80700 with x1830963592381440 ext(1679360->1683455) 00010000:00010000:3.0:1746143698.582525:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 24 pid: 8495 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.582534:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 24 pid: 8495 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746143698.582539:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d80700 00000100:00100000:0.0:1746143698.582715:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.583057:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592381568 00000100:00100000:3.0:1746143698.583061:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592381568 00000100:00100000:3.0:1746143698.583094:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9897 00000100:00100000:3.0:1746143698.583099:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592381568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143698.583110:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.583123:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c2d400/0xe984082ccd726645 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f33 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143698.583645:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593783168:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143698.584133:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.586742:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.586855:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592381824 00000100:00100000:2.0:1746143698.586864:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592381824 00002000:00100000:2.0:1746143698.586910:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1556480->1683455) req@ffff8800a5d83480 x1830963592381824/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.586918:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83480 with x1830963592381824 ext(1556480->1683455) 00010000:00010000:2.0:1746143698.586927:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 24 pid: 8495 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.586938:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 24 pid: 8495 timeout: 877 lvb_type: 0 00002000:00010000:2.0:1746143698.586944:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d83480 00000100:00100000:2.0:1746143698.586972:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 904 00000100:00100000:2.0:1746143698.586979:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963592381824:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143698.590257:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593783168:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143698.590294:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c2d400/0xe984082ccd726645 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f33 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.590307:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c2d400/0xe984082ccd726645 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f33 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.590322:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2d400, rc 0) 00000100:00100000:3.0:1746143698.590846:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592381568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7744us (8129us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143698.590846:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963592381824:12345-192.168.202.48@tcp:4:cat.0 Request processed in 3865us (4110us total) trans 17179872505 rc 0/0 00000100:00100000:2.0:1746143698.590855:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 904 00000100:00100000:3.0:1746143698.590856:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9897 00002000:00100000:2.0:1746143698.590865:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1556480->1683455) req@ffff8800a5d83480 x1830963592381824/t17179872505(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/448 e 0 to 0 dl 1746143709 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.590874:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83480 with x1830963592381824 ext(1556480->1683455) 00010000:00010000:2.0:1746143698.590881:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 26 pid: 8495 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.590897:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 26 pid: 8495 timeout: 877 lvb_type: 0 00002000:00010000:2.0:1746143698.590903:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d83480 00000100:00100000:0.0:1746143698.594012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.594207:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592381952 00000100:00100000:2.0:1746143698.594217:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592381952 00010000:00010000:2.0:1746143698.594260:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 26 pid: 8495 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.594287:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5114 00000100:00100000:2.0:1746143698.594295:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592381952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.594309:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.594408:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 26 pid: 8495 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.594421:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 26 pid: 8495 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.594445:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f596e00/0xe984082ccd726614 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->1683455) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f02 expref: 26 pid: 8495 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.594480:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.594482:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.594489:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 11 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.594503:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 11 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.594539:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 11 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.594552:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593783296:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143698.595524:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e323c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143698.595630:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.596937:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592382208 00000100:00100000:2.0:1746143698.596946:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592382208 00000100:00100000:2.0:1746143698.596988:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9898 00000100:00100000:2.0:1746143698.596994:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592382208:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.597015:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.597032:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72664c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f3a expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.597089:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593783424:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143698.597176:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143698.597927:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593783296:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143698.597944:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.598124:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592381952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3827us (4119us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.598134:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5114 00000100:00100000:2.0:1746143698.599608:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593783424:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143698.600077:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72664c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f3a expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.600093:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72664c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f3a expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.600116:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938baa00, rc 0) 00000100:00100000:2.0:1746143698.600186:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592382208:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3190us (4556us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143698.600194:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9898 00000100:00100000:0.0:1746143698.600527:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.600858:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592382464 00000100:00100000:3.0:1746143698.600866:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592382464 00002000:00100000:3.0:1746143698.600902:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1302528->1306623) req@ffff880093502300 x1830963592382464/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.600910:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502300 with x1830963592382464 ext(1302528->1306623) 00002000:00010000:3.0:1746143698.600915:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093502300 00000100:00100000:3.0:1746143698.600932:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3685 00000100:00100000:3.0:1746143698.600939:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592382464:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143698.601099:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592382464:12345-192.168.202.48@tcp:3:cat.0 Request processed in 160us (573us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143698.601106:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3685 00002000:00100000:3.0:1746143698.601110:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1302528->1306623) req@ffff880093502300 x1830963592382464/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/4536 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.601117:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502300 with x1830963592382464 ext(1302528->1306623) 00002000:00010000:3.0:1746143698.601119:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093502300 00010000:00010000:3.0:1746143698.601971:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143698.602634:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.603456:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592382720 00000100:00100000:2.0:1746143698.603465:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592382720 00000100:00100000:2.0:1746143698.603497:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3410 00000100:00100000:2.0:1746143698.603503:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+27:28562:x1830963592382720:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143698.603723:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+28:28562:x1830963592382720:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 218us (1096us total) trans 8589942467 rc 0/0 00000100:00100000:2.0:1746143698.603729:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3410 00000100:00100000:0.0:1746143698.693060:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.693211:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592382848 00000100:00100000:2.0:1746143698.693222:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592382848 00000100:00100000:2.0:1746143698.693293:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8349 00000100:00100000:2.0:1746143698.693300:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+18:28577:x1830963592382848:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143698.693319:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.693335:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bac00/0xe984082ccd726653 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f41 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.693387:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72665a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.693398:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72665a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.693407:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72665a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.693420:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd726661 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.693424:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd726661 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.693428:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd726661 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.693529:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.693537:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ee6 expref: 263 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.693542:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.693571:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ee6 expref: 263 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.693585:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ee6 expref: 263 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.693598:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593783552:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143698.693699:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.701492:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.701921:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593783552:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143698.701945:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143698.703993:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592383104 00000100:00100000:1.0:1746143698.704006:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592383104 00000100:00100000:1.0:1746143698.704065:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3411 00000100:00100000:1.0:1746143698.704073:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:15421:x1830963592383104:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143698.704335:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:15421:x1830963592383104:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 262us (2852us total) trans 8589942468 rc 0/0 00000100:00100000:1.0:1746143698.704343:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3411 00000100:00100000:2.0:1746143698.711349:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.711546:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592383232 00000100:00100000:0.0:1746143698.711557:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592383232 00010000:00010000:0.0:1746143698.711596:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ee6 expref: 265 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746143698.711635:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5115 00000100:00100000:0.0:1746143698.711643:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:1963:x1830963592383232:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143698.711659:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143698.711664:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ee6 expref: 265 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.711676:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ee6 expref: 265 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.711697:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5792600/0xe984082ccd7265f1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ee6 expref: 265 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.711726:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143698.711731:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143698.711744:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143698.711751:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143698.711779:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143698.711834:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:1963:x1830963592383232:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 191us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143698.711840:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5115 00010000:00010000:2.0:1746143698.711891:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.711898:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143698.711941:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:2.0:1746143698.711945:0:14764:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143698.711961:0:14764:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.711970:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.711978:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72665a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.711984:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72665a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.711989:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72665a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.711995:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938bb200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143698.711999:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72665a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.712105:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72665a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.712119:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143698.712121:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143698.712125:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72665a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.712130:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72665a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.712160:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd726661 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.712165:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd726661 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.712169:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd726661 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.712173:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938bb400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143698.712175:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd726661 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.712180:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd726661 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.712186:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5691f00) 00010000:00010000:2.0:1746143698.712188:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143698.712325:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd726661 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.712330:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd726661 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.712367:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bac00/0xe984082ccd726653 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f41 expref: 20 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.712380:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f41 expref: 19 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.712386:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143698.712388:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143698.712390:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938bb800, rc 0) 00000100:00100000:2.0:1746143698.712426:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+19:28577:x1830963592382848:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 19127us (19375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.712433:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8349 00000100:00100000:0.0:1746143698.717368:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.717395:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.717426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.717446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.717452:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592383360 00000100:00100000:0.0:1746143698.717462:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592383360 00000100:00100000:1.0:1746143698.717468:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592383616 00000100:00100000:1.0:1746143698.717471:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592383616 00000100:00100000:0.0:1746143698.717501:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592383488 00000100:00100000:0.0:1746143698.717503:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592383488 00000100:00100000:3.0:1746143698.717535:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9899 00000100:00100000:3.0:1746143698.717543:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592383360:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143698.717566:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.717583:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57aee00/0xe984082ccd72666f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f48 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.717626:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592383872 00000100:00100000:2.0:1746143698.717629:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592383872 00000100:00100000:2.0:1746143698.717654:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8350 00000100:00100000:2.0:1746143698.717658:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:28579:x1830963592383872:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143698.717670:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.717680:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba200/0xe984082ccd726676 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f5d expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143698.717807:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593783680:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143698.717873:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143698.718421:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9900 00000100:00100000:1.0:1746143698.718433:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592383616:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:0.0:1746143698.718436:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9901 00010000:00010000:1.0:1746143698.718442:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143698.718442:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592383488:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143698.718447:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.718453:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a2120c00/0xe984082ccd72667d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f56 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.718453:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd17400/0xe984082ccd726684 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f4f expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.718466:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.718468:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.718478:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2120c00/0xe984082ccd72667d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f56 expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143698.718480:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593783808:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143698.718491:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a2120c00/0xe984082ccd72667d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f56 expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.718500:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2120c00, rc 0) 00000100:00100000:0.0:1746143698.718509:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143698.718521:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963592383616:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 91us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143698.718526:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9900 00010000:00010000:2.0:1746143698.718625:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938baa00/0xe984082ccd72668b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718637:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938baa00/0xe984082ccd72668b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718647:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938baa00/0xe984082ccd72668b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718659:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd726692 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718667:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd726692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718671:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd726692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718784:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f596e00/0xe984082ccd726699 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718793:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f596e00/0xe984082ccd726699 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718813:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f596e00/0xe984082ccd726699 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143698.718822:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143698.718908:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938baa00/0xe984082ccd72668b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718915:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938baa00/0xe984082ccd72668b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718920:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938baa00/0xe984082ccd72668b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718926:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938baa00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143698.718929:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938baa00/0xe984082ccd72668b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718936:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938baa00/0xe984082ccd72668b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718945:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143698.718949:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143698.718952:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938baa00/0xe984082ccd72668b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718957:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938baa00/0xe984082ccd72668b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718968:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd726692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718972:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd726692 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718976:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd726692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718980:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938bb600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143698.718982:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd726692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.718986:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd726692 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.719876:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5691e00) 00010000:00010000:2.0:1746143698.719880:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143698.719884:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd726692 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.719890:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd726692 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.719952:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba200/0xe984082ccd726676 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f5d expref: 267 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.719969:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f596e00/0xe984082ccd726699 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f5d expref: 266 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.719975:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143698.719977:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143698.719980:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f596e00, rc 0) 00000100:00100000:2.0:1746143698.720039:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:28579:x1830963592383872:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2379us (2682us total) trans 8589942469 rc 0/0 00000100:00100000:2.0:1746143698.720047:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8350 00000100:00100000:3.0:1746143698.720813:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593783680:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143698.720838:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57aee00/0xe984082ccd72666f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f48 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.720848:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57aee00/0xe984082ccd72666f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f48 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.720860:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57aee00, rc 0) 00000100:00100000:3.0:1746143698.720891:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592383360:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3349us (3496us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143698.720899:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9899 00000100:00100000:2.0:1746143698.723980:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963593783808:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143698.724018:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd17400/0xe984082ccd726684 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f4f expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.724033:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd17400/0xe984082ccd726684 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f4f expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.724057:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd17400, rc 0) 00000100:00100000:2.0:1746143698.724115:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592383488:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5671us (6666us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143698.724124:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9901 00000100:00100000:0.0:1746143698.724922:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.724961:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.725055:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592384000 00000100:00100000:2.0:1746143698.725062:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592384000 00000100:00100000:2.0:1746143698.725094:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592384128 00000100:00100000:2.0:1746143698.725096:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592384128 00000100:00100000:2.0:1746143698.725434:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9902 00000100:00100000:2.0:1746143698.725442:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592384000:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.725459:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.725474:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd7266a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f64 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.725521:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593783936:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143698.725573:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143698.725808:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9903 00000100:00100000:3.0:1746143698.725816:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592384128:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143698.725824:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.725832:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57af800/0xe984082ccd7266ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f6b expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143698.725855:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593784064:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143698.725877:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.727270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.727469:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592384384 00000100:00100000:3.0:1746143698.727475:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592384384 00000100:00100000:3.0:1746143698.727512:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8351 00000100:00100000:3.0:1746143698.727519:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+19:28577:x1830963592384384:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143698.727534:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.727549:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57ae600/0xe984082ccd7266b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f72 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.727644:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.727658:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f41 expref: 20 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.727665:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f596e00/0xe984082ccd726699 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f5d expref: 265 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.727671:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143698.727697:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f596e00/0xe984082ccd726699 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f5d expref: 265 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.727707:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f596e00/0xe984082ccd726699 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f5d expref: 265 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143698.727718:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593784192:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143698.727788:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f41 expref: 20 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.727794:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f41 expref: 20 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143698.727812:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593784320:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143698.727832:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.744543:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.744579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.744866:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592384640 00000100:00100000:1.0:1746143698.744876:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592384640 00010000:00010000:1.0:1746143698.744915:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f596e00/0xe984082ccd726699 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f5d expref: 266 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.744942:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592384512 00000100:00100000:1.0:1746143698.744945:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592384512 00010000:00010000:1.0:1746143698.744953:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f41 expref: 21 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.744954:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593783936:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143698.744976:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5116 00000100:00100000:1.0:1746143698.744983:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:1962:x1830963592384640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.744989:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd7266a7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f64 expref: 21 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.744996:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.744999:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd7266a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f64 expref: 21 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.745001:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f596e00/0xe984082ccd726699 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f5d expref: 266 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.745011:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f596e00/0xe984082ccd726699 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f5d expref: 266 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.745014:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938ba200, rc 0) 00010000:00010000:1.0:1746143698.745029:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143698.745034:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00000100:00100000:2.0:1746143698.745038:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5117 00010000:00010000:1.0:1746143698.745042:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00000100:00100000:2.0:1746143698.745043:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+21:1962:x1830963592384512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143698.745048:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143698.745050:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.745053:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f41 expref: 21 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.745060:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f41 expref: 21 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.745069:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143698.745071:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.745079:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143698.745082:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:1962:x1830963592384640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 99us (552us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143698.745085:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143698.745088:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5116 00010000:00010000:2.0:1746143698.745098:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.745112:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+21:1962:x1830963592384512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 69us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.745117:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5117 00000100:00100000:2.0:1746143698.745134:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592384000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 19693us (20215us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143698.745158:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9902 00010000:00010000:1.0:1746143698.745173:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f596e00/0xe984082ccd726699 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f5d expref: 265 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.745186:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593784192:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.745196:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd726668 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f41 expref: 20 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.745204:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593784320:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.745218:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.745225:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.745234:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143698.745253:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143698.745401:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57ae600/0xe984082ccd7266b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f72 expref: 21 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.745426:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f72 expref: 20 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.745432:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143698.745434:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143698.745435:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5643600, rc 0) 00000100:00100000:1.0:1746143698.745456:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+20:28577:x1830963592384384:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 17938us (18193us total) trans 8589942470 rc 0/0 00000100:00100000:1.0:1746143698.745462:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8351 00000100:00100000:3.0:1746143698.745825:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593784064:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143698.745843:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57af800/0xe984082ccd7266ae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f6b expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.745852:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57af800/0xe984082ccd7266ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f6b expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.745874:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57af800, rc 0) 00000100:00100000:3.0:1746143698.745902:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592384128:12345-192.168.202.48@tcp:101:cat.0 Request processed in 20087us (20940us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143698.745911:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9903 00000100:00100000:0.0:1746143698.749720:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.751917:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592384768 00000100:00100000:1.0:1746143698.751935:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592384768 00000100:00100000:1.0:1746143698.752013:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8352 00000100:00100000:1.0:1746143698.752025:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+20:28577:x1830963592384768:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143698.752058:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.752083:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120000/0xe984082ccd7266ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f79 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.752204:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.752222:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f72 expref: 21 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.752231:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.752272:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f72 expref: 21 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.752285:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f72 expref: 21 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.752299:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593784448:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143698.752424:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143698.752924:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.752992:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.753023:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.753043:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592385152 00000100:00100000:3.0:1746143698.753048:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592385152 00002000:00100000:3.0:1746143698.753080:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1634303) req@ffff880094c0f480 x1830963592385152/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.753089:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0f480 with x1830963592385152 ext(1048576->1634303) 00002000:00010000:3.0:1746143698.753093:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0f480 00000100:00100000:3.0:1746143698.753105:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592385408 00000100:00100000:3.0:1746143698.753107:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592385408 00002000:00100000:3.0:1746143698.753118:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1306624->2097151) req@ffff880094c0ca80 x1830963592385408/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.753124:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ca80 with x1830963592385408 ext(1306624->2097151) 00000100:00100000:2.0:1746143698.753125:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592384896 00002000:00010000:3.0:1746143698.753127:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0ca80 00000100:00100000:2.0:1746143698.753130:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592384896 00000100:00100000:3.0:1746143698.753137:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3686 00000100:00100000:3.0:1746143698.753163:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963592385152:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143698.753182:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9904 00000100:00100000:2.0:1746143698.753188:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28581:x1830963592384896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.753196:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.753209:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd7266d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f80 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.753231:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 15 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.753238:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143698.753239:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143698.753242:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd7266d8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f80 expref: 21 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.753263:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 15 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.753271:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 15 pid: 15784 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.753280:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593784576:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143698.753314:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.753716:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3687 00000100:00100000:0.0:1746143698.753724:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592385408:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143698.763363:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.763441:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.764001:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592385408:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10276us (10974us total) trans 0 rc 790528/790528 00000100:00100000:0.0:1746143698.764013:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3687 00002000:00100000:0.0:1746143698.764025:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1306624->2097151) req@ffff880094c0ca80 x1830963592385408/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 790528/790528 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143698.764034:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ca80 with x1830963592385408 ext(1306624->2097151) 00002000:00010000:0.0:1746143698.764041:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0ca80 00000100:00100000:0.0:1746143698.764077:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592385664 00000100:00100000:0.0:1746143698.764085:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592385664 00002000:00100000:0.0:1746143698.764118:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1634304->2097151) req@ffff880093501c00 x1830963592385664/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143698.764126:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501c00 with x1830963592385664 ext(1634304->2097151) 00010000:00010000:0.0:1746143698.764134:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 17 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.764170:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 17 pid: 15784 timeout: 877 lvb_type: 0 00002000:00010000:0.0:1746143698.764177:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093501c00 00000100:00100000:0.0:1746143698.764195:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 905 00000100:00100000:0.0:1746143698.764203:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592385664:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143698.764780:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592385536 00000100:00100000:2.0:1746143698.764786:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592385536 00010000:00010000:2.0:1746143698.764820:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f72 expref: 22 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.764843:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5118 00000100:00100000:2.0:1746143698.764849:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+22:1964:x1830963592385536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.764861:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.764866:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f72 expref: 22 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.764875:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f72 expref: 22 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.764897:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143698.764902:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.764915:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.764921:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143698.764936:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.764960:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+22:1964:x1830963592385536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 111us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.764965:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5118 00000100:00100000:2.0:1746143698.765021:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593784576:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143698.765043:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd7266d8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f80 expref: 21 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.765057:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938baa00, rc 0) 00000100:00100000:2.0:1746143698.765077:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28581:x1830963592384896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 11890us (12156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.765083:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9904 00000100:00100000:3.0:1746143698.765464:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592385152:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12300us (12469us total) trans 0 rc 585728/585728 00000100:00100000:3.0:1746143698.765470:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3686 00002000:00100000:3.0:1746143698.765477:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->1634303) req@ffff880094c0f480 x1830963592385152/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.765485:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0f480 with x1830963592385152 ext(1048576->1634303) 00010000:00010000:3.0:1746143698.765492:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 17 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.765504:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 17 pid: 15784 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746143698.765510:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c0f480 00010000:00010000:1.0:1746143698.765768:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5643600/0xe984082ccd7266bc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f72 expref: 21 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.765790:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593784448:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.765815:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.765834:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.765839:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143698.765882:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:1.0:1746143698.765886:0:14764:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143698.765901:0:14764:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.765932:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120000/0xe984082ccd7266ca lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f79 expref: 21 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.765943:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f79 expref: 20 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.765949:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143698.765952:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143698.765954:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2121600, rc 0) 00000100:00100000:1.0:1746143698.765980:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+20:28577:x1830963592384768:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 13958us (16275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143698.765987:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8352 00000100:00100000:2.0:1746143698.776048:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.776110:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.776152:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592385920 00000100:00100000:3.0:1746143698.776164:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592385920 00000100:00100000:2.0:1746143698.776173:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592385792 00000100:00100000:2.0:1746143698.776180:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592385792 00000100:00100000:2.0:1746143698.778381:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9905 00000100:00100000:2.0:1746143698.778399:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592385920:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143698.778421:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.778443:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938bac00/0xe984082ccd7266df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f8e expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.778508:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593784704:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143698.778597:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143698.778645:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9906 00000100:00100000:1.0:1746143698.778657:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592385792:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143698.778667:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.778678:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2121a00/0xe984082ccd7266e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f87 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143698.778706:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593784832:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143698.778731:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143698.780829:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593784704:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143698.780863:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938bac00/0xe984082ccd7266df lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f8e expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.780875:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938bac00/0xe984082ccd7266df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f8e expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.780897:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938bac00, rc 0) 00000100:00100000:3.0:1746143698.780936:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592385920:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2544us (4894us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143698.780943:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9905 00000100:00100000:1.0:1746143698.781049:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593784832:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143698.781067:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2121a00/0xe984082ccd7266e6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f87 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.781076:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2121a00/0xe984082ccd7266e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f87 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.781101:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2121a00, rc 0) 00000100:00100000:1.0:1746143698.781126:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592385792:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2472us (5015us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143698.781131:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9906 00000100:00100000:0.0:1746143698.783101:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592385664:12345-192.168.202.48@tcp:4:cat.0 Request processed in 18890us (19651us total) trans 21474839771 rc 0/0 00000100:00100000:0.0:1746143698.783111:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 905 00002000:00100000:0.0:1746143698.783122:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1634304->2097151) req@ffff880093501c00 x1830963592385664/t21474839771(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/448 e 0 to 0 dl 1746143709 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143698.783131:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501c00 with x1830963592385664 ext(1634304->2097151) 00010000:00010000:0.0:1746143698.783158:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 17 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.783171:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 17 pid: 15784 timeout: 877 lvb_type: 0 00002000:00010000:0.0:1746143698.783177:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093501c00 00000100:00100000:1.0:1746143698.783295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.783544:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.783781:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592386304 00000100:00100000:1.0:1746143698.783789:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592386304 00000100:00100000:1.0:1746143698.783835:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8353 00000100:00100000:1.0:1746143698.783843:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+20:28577:x1830963592386304:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143698.783862:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.783879:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121e00/0xe984082ccd7266ed lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f9c expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.783967:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120200/0xe984082ccd7266f4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.783982:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120200/0xe984082ccd7266f4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.783992:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120200/0xe984082ccd7266f4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.784003:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120200/0xe984082ccd7266f4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.784009:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120200/0xe984082ccd7266f4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.784015:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120200/0xe984082ccd7266f4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.784021:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a2120200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143698.784024:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120200/0xe984082ccd7266f4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.784030:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120200/0xe984082ccd7266f4 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.784040:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143698.784042:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143698.784046:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120200/0xe984082ccd7266f4 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.784050:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2120200/0xe984082ccd7266f4 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143698.784076:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121e00/0xe984082ccd7266ed lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f9c expref: 21 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.784083:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121e00/0xe984082ccd7266ed lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f9c expref: 21 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.784090:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2121e00, rc 0) 00000100:00100000:1.0:1746143698.784129:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+20:28577:x1830963592386304:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 287us (585us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143698.784135:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8353 00000100:00100000:0.0:1746143698.784214:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592386048 00000100:00100000:0.0:1746143698.784218:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592386048 00000100:00100000:0.0:1746143698.784239:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9907 00000100:00100000:0.0:1746143698.784244:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592386048:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143698.784252:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143698.784261:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff92e00/0xe984082ccd7266fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1f95 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143698.784302:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593784960:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143698.784360:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.790860:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.791007:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592386560 00000100:00100000:3.0:1746143698.791015:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592386560 00000100:00100000:2.0:1746143698.791057:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963593784960:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143698.791078:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3412 00000100:00100000:3.0:1746143698.791085:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+20:28577:x1830963592386560:12345-192.168.202.48@tcp:35:lfs.0 00010000:00010000:2.0:1746143698.791098:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff92e00/0xe984082ccd7266fb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f95 expref: 18 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.791111:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff92e00/0xe984082ccd7266fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f95 expref: 18 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.791126:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff92e00, rc 0) 00000100:00100000:2.0:1746143698.791199:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592386048:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6953us (7902us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143698.791206:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9907 00000100:00100000:3.0:1746143698.791298:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+21:28577:x1830963592386560:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 212us (450us total) trans 8589942471 rc 0/0 00000100:00100000:3.0:1746143698.791307:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3412 00000100:00100000:0.0:1746143698.797057:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.797713:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592386688 00000100:00100000:2.0:1746143698.797723:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592386688 00010000:00010000:2.0:1746143698.797768:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 17 pid: 15784 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.797809:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5119 00000100:00100000:2.0:1746143698.797818:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592386688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.797833:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.797857:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 17 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.797875:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 17 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.797897:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095614000/0xe984082ccd72660d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1efb expref: 17 pid: 15784 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.798433:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.798436:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.798787:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd7266d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f80 expref: 20 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.798806:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd7266d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f80 expref: 20 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.798846:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd7266d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f80 expref: 20 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143698.798859:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593785088:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143698.799544:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.800000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.800162:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592386816 00000100:00100000:3.0:1746143698.800169:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592386816 00000100:00100000:3.0:1746143698.800216:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9908 00000100:00100000:3.0:1746143698.800223:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592386816:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143698.800241:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.800255:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009465dc00/0xe984082ccd726702 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1fa3 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.800275:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.800277:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.800282:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009465dc00/0xe984082ccd726702 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fa3 expref: 18 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.800295:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009465dc00/0xe984082ccd726702 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fa3 expref: 18 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.800303:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009465dc00, rc 0) 00000100:00100000:3.0:1746143698.800343:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592386816:12345-192.168.202.48@tcp:101:cat.0 Request processed in 121us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.800348:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9908 00000100:00100000:0.0:1746143698.809135:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.809259:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592387072 00000100:00100000:1.0:1746143698.809270:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592387072 00002000:00100000:1.0:1746143698.809319:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880093500380 x1830963592387072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.809337:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500380 with x1830963592387072 ext(1048576->2097151) 00002000:00010000:1.0:1746143698.809343:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093500380 00000100:00100000:1.0:1746143698.809374:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3688 00000100:00100000:1.0:1746143698.809382:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592387072:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143698.810092:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593785088:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143698.810113:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.810205:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592386688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12387us (13159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.810215:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5119 00000100:00100000:1.0:1746143698.824010:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592387072:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14615us (14875us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143698.824024:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3688 00002000:00100000:1.0:1746143698.824037:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880093500380 x1830963592387072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.824046:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500380 with x1830963592387072 ext(1048576->2097151) 00002000:00010000:1.0:1746143698.824052:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093500380 00000100:00100000:0.0:1746143698.838286:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.839063:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592387200 00000100:00100000:2.0:1746143698.839075:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592387200 00000100:00100000:2.0:1746143698.839126:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9909 00000100:00100000:2.0:1746143698.839135:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28581:x1830963592387200:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143698.839171:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.839191:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930c5c00/0xe984082ccd726709 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1faa expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.839223:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 11 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.839231:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143698.839233:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143698.839237:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930c5c00/0xe984082ccd726709 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1faa expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.839270:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 11 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.839283:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 11 pid: 8496 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.839295:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593785216:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143698.839396:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.843447:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.843477:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592387456 00000100:00100000:0.0:1746143698.843486:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592387456 00000100:00100000:0.0:1746143698.843534:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8354 00000100:00100000:0.0:1746143698.843543:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+28:28587:x1830963592387456:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143698.843567:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143698.843586:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92400/0xe984082ccd726710 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1fb1 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.843687:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143698.843702:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f79 expref: 20 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.843709:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143698.843740:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f79 expref: 20 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143698.843752:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f79 expref: 20 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746143698.843764:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593785344:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143698.843959:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593785216:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143698.843990:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930c5c00/0xe984082ccd726709 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1faa expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.844013:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930c5c00, rc 0) 00000100:00100000:2.0:1746143698.844195:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28581:x1830963592387200:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5058us (5915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.844204:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9909 00000100:00100000:0.0:1746143698.845531:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143698.845673:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.845941:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592387584 00000100:00100000:0.0:1746143698.845949:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592387584 00002000:00100000:0.0:1746143698.845997:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1306623) req@ffff88012b79f480 x1830963592387584/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143698.846007:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79f480 with x1830963592387584 ext(1048576->1306623) 00010000:00010000:0.0:1746143698.846016:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 12 pid: 8496 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746143698.846027:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 12 pid: 8496 timeout: 877 lvb_type: 0 00002000:00010000:0.0:1746143698.846033:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b79f480 00000100:00100000:0.0:1746143698.846077:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 906 00000100:00100000:0.0:1746143698.846086:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592387584:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143698.850702:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593785344:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.850733:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143698.851336:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.851967:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592387712 00000100:00100000:2.0:1746143698.851975:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592387712 00010000:00010000:2.0:1746143698.852012:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f79 expref: 21 pid: 14764 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.852040:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5120 00000100:00100000:2.0:1746143698.852048:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+21:1962:x1830963592387712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.852062:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.852069:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f79 expref: 21 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.852080:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f79 expref: 21 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.852102:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a2121600/0xe984082ccd7266d1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f79 expref: 21 pid: 14764 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746143698.852132:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143698.852155:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143698.852166:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143698.852173:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143698.852200:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.852243:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+20:1962:x1830963592387712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 195us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.852250:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5120 00010000:00010000:1.0:1746143698.852521:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143698.852530:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143698.852547:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143698.852659:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff92400/0xe984082ccd726710 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb1 expref: 31 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.852691:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb1 expref: 30 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.852697:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143698.852699:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143698.852701:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff93400, rc 0) 00000100:00100000:1.0:1746143698.852725:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+30:28587:x1830963592387456:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 9184us (9289us total) trans 8589942472 rc 0/0 00000100:00100000:1.0:1746143698.852731:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8354 00000100:00100000:1.0:1746143698.855039:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592387584:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8943us (9360us total) trans 17179872506 rc 0/0 00000100:00100000:1.0:1746143698.855052:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 906 00002000:00100000:1.0:1746143698.855062:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->1306623) req@ffff88012b79f480 x1830963592387584/t17179872506(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/448 e 0 to 0 dl 1746143709 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.855071:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79f480 with x1830963592387584 ext(1048576->1306623) 00010000:00010000:1.0:1746143698.855081:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 14 pid: 8496 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.855096:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 14 pid: 8496 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746143698.855103:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b79f480 00000100:00100000:0.0:1746143698.857013:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.858439:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592387840 00000100:00100000:2.0:1746143698.858452:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592387840 00000100:00100000:2.0:1746143698.858508:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9910 00000100:00100000:2.0:1746143698.858516:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28587:x1830963592387840:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143698.858535:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143698.858555:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1fb8 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.858585:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd7263ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d73 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.858593:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6000/0xe984082ccd7264e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e37 expref: 7 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.858600:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a034a200/0xe984082ccd7263ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d81 expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.858606:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.858608:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143698.858611:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [3489792->3551231] (req 3489792->3551231) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.858643:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a034a200/0xe984082ccd7263ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d81 expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.858654:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a034a200/0xe984082ccd7263ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d81 expref: 20 pid: 4581 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746143698.858666:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593785472:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143698.858768:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6000/0xe984082ccd7264e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e37 expref: 7 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143698.858775:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6000/0xe984082ccd7264e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e37 expref: 7 pid: 25369 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746143698.858782:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593785600:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143698.858819:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd7263ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d73 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143698.858826:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd7263ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d73 expref: 18 pid: 4581 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.858833:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593785728:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143698.858851:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.864183:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.864228:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.864629:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592387968 00000100:00100000:1.0:1746143698.864639:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592387968 00010000:00010000:1.0:1746143698.864680:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 14 pid: 8496 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.864705:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592388096 00000100:00100000:1.0:1746143698.864707:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592388096 00010000:00010000:1.0:1746143698.864717:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6000/0xe984082ccd7264e0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e37 expref: 8 pid: 25369 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746143698.864731:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5121 00000100:00100000:1.0:1746143698.864738:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592387968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143698.864753:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143698.864776:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 14 pid: 8496 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.864786:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 14 pid: 8496 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.864818:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ef3e800/0xe984082ccd726637 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f25 expref: 14 pid: 8496 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.864838:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.864840:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.864847:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930c5c00/0xe984082ccd726709 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1faa expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.864855:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930c5c00/0xe984082ccd726709 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1faa expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.864888:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800930c5c00/0xe984082ccd726709 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1faa expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143698.864901:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593785856:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143698.864976:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143698.865057:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5122 00000100:00100000:2.0:1746143698.865065:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592388096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.865074:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.865090:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6000/0xe984082ccd7264e0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e37 expref: 8 pid: 25369 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746143698.865098:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6000/0xe984082ccd7264e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e37 expref: 8 pid: 25369 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746143698.865111:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143698.865131:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592388096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 69us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.865157:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5122 00000100:00100000:3.0:1746143698.865740:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593785472:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143698.865753:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6000/0xe984082ccd7264e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e37 expref: 7 pid: 25369 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746143698.865777:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593785600:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143698.865789:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593785728:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143698.865826:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3489792->3551231] (req 3489792->3551231) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.865835:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930c4e00, rc 0) 00000100:00100000:3.0:1746143698.865869:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28587:x1830963592387840:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7354us (8863us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.865875:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9910 00000100:00100000:0.0:1746143698.866528:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.866750:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.867722:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592388224 00000100:00100000:2.0:1746143698.867729:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592388224 00010000:00010000:2.0:1746143698.867759:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034a200/0xe984082ccd7263ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d81 expref: 21 pid: 4581 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746143698.867779:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592388352 00000100:00100000:2.0:1746143698.867781:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592388352 00010000:00010000:2.0:1746143698.867789:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd7263ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d73 expref: 18 pid: 4581 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746143698.867814:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5123 00000100:00100000:2.0:1746143698.867820:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963592388224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143698.867834:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143698.867852:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a034a200/0xe984082ccd7263ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d81 expref: 21 pid: 4581 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746143698.867866:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a034a200/0xe984082ccd7263ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d81 expref: 21 pid: 4581 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746143698.867888:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a034a200/0xe984082ccd7263ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d81 expref: 21 pid: 4581 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746143698.867904:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143698.869453:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5124 00000100:00100000:2.0:1746143698.869647:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963592388224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1824us (3116us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143698.869655:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5123 00000100:00100000:0.0:1746143698.869993:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963593785856:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143698.870012:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143698.870040:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592387968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5302us (5869us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143698.870046:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5121 00000100:00100000:3.0:1746143698.870134:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592388352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143698.870183:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143698.870206:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd7263ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d73 expref: 18 pid: 4581 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.870223:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd7263ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d73 expref: 18 pid: 4581 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.870252:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd7263ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d73 expref: 18 pid: 4581 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.870264:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.870266:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.870273:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.870287:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.870328:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143698.870349:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593785984:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143698.870440:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.871621:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.871692:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592388608 00000100:00100000:1.0:1746143698.871699:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592388608 00002000:00100000:1.0:1746143698.871737:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009b851500 x1830963592388608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.871747:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b851500 with x1830963592388608 ext(1048576->2097151) 00002000:00010000:1.0:1746143698.871751:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b851500 00000100:00100000:1.0:1746143698.871846:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3689 00000100:00100000:1.0:1746143698.871853:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592388608:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143698.878277:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.878477:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593785984:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143698.878497:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143698.879187:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592388352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9722us (12434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.879199:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5124 00000100:00100000:3.0:1746143698.879635:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592388864 00000100:00100000:3.0:1746143698.879642:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592388864 00002000:00100000:3.0:1746143698.879682:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3547136->3551231) req@ffff88009b850a80 x1830963592388864/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.879692:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850a80 with x1830963592388864 ext(3547136->3551231) 00002000:00010000:3.0:1746143698.879696:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b850a80 00000100:00100000:3.0:1746143698.879748:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3690 00000100:00100000:3.0:1746143698.879756:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592388864:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143698.879948:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592388864:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 192us (1681us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143698.879954:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3690 00002000:00100000:3.0:1746143698.879959:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3547136->3551231) req@ffff88009b850a80 x1830963592388864/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/4536 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.879972:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850a80 with x1830963592388864 ext(3547136->3551231) 00002000:00010000:3.0:1746143698.879975:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b850a80 00000100:00100000:1.0:1746143698.883731:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592388608:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11867us (12104us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143698.883744:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3689 00002000:00100000:1.0:1746143698.883755:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff88009b851500 x1830963592388608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.883764:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b851500 with x1830963592388608 ext(1048576->2097151) 00002000:00010000:1.0:1746143698.883769:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b851500 00000100:00100000:0.0:1746143698.890950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.891038:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592388992 00000100:00100000:3.0:1746143698.891049:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592388992 00000100:00100000:3.0:1746143698.891252:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9911 00000100:00100000:3.0:1746143698.891261:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28581:x1830963592388992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143698.891284:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.891303:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009465d800/0xe984082ccd72672c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1fbf expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.891334:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.891341:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143698.891343:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143698.891347:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009465d800/0xe984082ccd72672c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fbf expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.891380:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.891391:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 16 pid: 6929 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143698.891403:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593786112:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143698.891541:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143698.893884:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593786112:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143698.893915:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009465d800/0xe984082ccd72672c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fbf expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.893932:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009465d800, rc 0) 00000100:00100000:3.0:1746143698.893985:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28581:x1830963592388992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2723us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.893993:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9911 00000100:00100000:0.0:1746143698.898122:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.898276:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592389120 00000100:00100000:1.0:1746143698.898286:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592389120 00002000:00100000:1.0:1746143698.898330:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3489792->3551231) req@ffff88009b850e00 x1830963592389120/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.898340:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850e00 with x1830963592389120 ext(3489792->3551231) 00010000:00010000:1.0:1746143698.898349:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 17 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.898365:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 17 pid: 6929 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746143698.898372:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b850e00 00000100:00100000:1.0:1746143698.898392:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 907 00000100:00100000:1.0:1746143698.898399:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592389120:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143698.902855:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592389120:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 4446us (4733us total) trans 21474839772 rc 0/0 00000100:00100000:1.0:1746143698.902867:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 907 00002000:00100000:1.0:1746143698.902878:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3489792->3551231) req@ffff88009b850e00 x1830963592389120/t21474839772(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/448 e 0 to 0 dl 1746143709 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.902887:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850e00 with x1830963592389120 ext(3489792->3551231) 00010000:00010000:1.0:1746143698.902897:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 19 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.902912:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 19 pid: 6929 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746143698.902919:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b850e00 00000100:00100000:0.0:1746143698.904993:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.906550:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592389248 00000100:00100000:3.0:1746143698.906561:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592389248 00010000:00010000:3.0:1746143698.906609:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 19 pid: 6929 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143698.906654:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5125 00000100:00100000:3.0:1746143698.906664:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592389248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143698.906679:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143698.906699:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143697 -> 1746143698 00002000:00010000:3.0:1746143698.906702:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143697 -> 1746143698 00010000:00010000:3.0:1746143698.906707:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 19 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.906722:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 19 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.906744:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930c4e00/0xe984082ccd726725 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3489792->3551231) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb8 expref: 19 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.906781:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.906784:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.906792:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009465d800/0xe984082ccd72672c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fbf expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.906809:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009465d800/0xe984082ccd72672c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fbf expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.906849:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009465d800/0xe984082ccd72672c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fbf expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143698.906861:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593786240:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143698.906951:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143698.914263:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593786240:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143698.914286:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143698.914334:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592389248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7669us (9345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.914346:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5125 00000100:00100000:0.0:1746143698.916434:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.916474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.916542:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592389632 00000100:00100000:2.0:1746143698.916552:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592389632 00002000:00100000:2.0:1746143698.916598:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009b851180 x1830963592389632/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.916608:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b851180 with x1830963592389632 ext(3145728->4194303) 00002000:00010000:2.0:1746143698.916613:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b851180 00000100:00100000:2.0:1746143698.916643:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592389504 00000100:00100000:2.0:1746143698.916645:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592389504 00002000:00100000:2.0:1746143698.916657:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009b850380 x1830963592389504/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.916664:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850380 with x1830963592389504 ext(2097152->3145727) 00002000:00010000:2.0:1746143698.916666:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b850380 00000100:00100000:3.0:1746143698.916673:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3691 00000100:00100000:3.0:1746143698.916684:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592389632:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143698.916689:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3692 00000100:00100000:2.0:1746143698.916694:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963592389504:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143698.933943:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592389504:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17236us (17455us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143698.933955:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3692 00002000:00100000:2.0:1746143698.933968:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009b850380 x1830963592389504/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.933978:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850380 with x1830963592389504 ext(2097152->3145727) 00002000:00010000:2.0:1746143698.933984:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b850380 00000100:00100000:3.0:1746143698.939920:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963592389632:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23229us (23485us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143698.939931:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3691 00002000:00100000:3.0:1746143698.939941:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009b851180 x1830963592389632/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.939950:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b851180 with x1830963592389632 ext(3145728->4194303) 00002000:00010000:3.0:1746143698.939955:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b851180 00000100:00100000:0.0:1746143698.942245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.942783:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.942822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.944749:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592389888 00000100:00100000:3.0:1746143698.944759:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592389888 00000100:00100000:3.0:1746143698.944813:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592390016 00000100:00100000:3.0:1746143698.944815:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592390016 00000100:00100000:3.0:1746143698.944830:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592390144 00000100:00100000:3.0:1746143698.944832:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592390144 00000100:00100000:3.0:1746143698.944848:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9912 00000100:00100000:3.0:1746143698.944855:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28579:x1830963592389888:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143698.944869:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.944883:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1fc6 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.944912:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009465d800/0xe984082ccd72672c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fbf expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143698.944917:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9913 00010000:00010000:3.0:1746143698.944919:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.944920:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.944923:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3063808->3145727] (req 3063808->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143698.944925:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592390016:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143698.944933:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.944944:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a2121a00/0xe984082ccd72673a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1fcd expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.944949:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009465d800/0xe984082ccd72672c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fbf expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.944958:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.944960:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009465d800/0xe984082ccd72672c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fbf expref: 22 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746143698.944960:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.944966:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2121a00/0xe984082ccd72673a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fcd expref: 14 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143698.944975:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593786368:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.944978:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a2121a00/0xe984082ccd72673a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fcd expref: 14 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.944987:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2121a00, rc 0) 00000100:00100000:3.0:1746143698.945047:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143698.945065:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9914 00000100:00100000:3.0:1746143698.945071:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592390144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143698.945078:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143698.945083:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009465c600/0xe984082ccd726741 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1fd4 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.945097:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.945103:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009465c600/0xe984082ccd726741 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fd4 expref: 19 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.945109:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009465c600/0xe984082ccd726741 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fd4 expref: 19 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143698.945203:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009465c600, rc 0) 00000100:00100000:1.0:1746143698.945560:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592390016:12345-192.168.202.48@tcp:101:cat.0 Request processed in 635us (2776us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.945564:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592390144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 492us (2740us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143698.945567:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9913 00000100:00100000:3.0:1746143698.945570:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9914 00000100:00100000:3.0:1746143698.952426:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593786368:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143698.952542:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3063808->3145727] (req 3063808->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.952566:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009465da00, rc 0) 00000100:00100000:3.0:1746143698.953944:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28579:x1830963592389888:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 9084us (11700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.953953:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9912 00000100:00100000:0.0:1746143698.957389:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143698.957449:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592390272 00000100:00100000:3.0:1746143698.957457:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592390272 00010000:00010000:3.0:1746143698.957486:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009465d800/0xe984082ccd72672c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fbf expref: 22 pid: 6929 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143698.957522:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5126 00000100:00100000:3.0:1746143698.957529:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592390272:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143698.957539:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143698.957558:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009465d800/0xe984082ccd72672c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fbf expref: 22 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.957569:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009465d800/0xe984082ccd72672c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fbf expref: 22 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.957585:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009465d800/0xe984082ccd72672c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fbf expref: 22 pid: 6929 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143698.958242:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.958245:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143698.958253:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.958261:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143698.958295:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143698.958306:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593786496:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143698.958383:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143698.962369:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143698.962602:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592390528 00000100:00100000:2.0:1746143698.962609:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592390528 00002000:00100000:2.0:1746143698.962646:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3063808->3067903) req@ffff880093501f80 x1830963592390528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.962655:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501f80 with x1830963592390528 ext(3063808->3067903) 00002000:00010000:2.0:1746143698.962659:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093501f80 00000100:00100000:2.0:1746143698.962678:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3693 00000100:00100000:2.0:1746143698.962684:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592390528:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143698.962860:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592390528:12345-192.168.202.48@tcp:3:cat.0 Request processed in 176us (498us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143698.962866:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3693 00002000:00100000:2.0:1746143698.962873:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3063808->3067903) req@ffff880093501f80 x1830963592390528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:94/0 lens 488/4536 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143698.962884:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501f80 with x1830963592390528 ext(3063808->3067903) 00002000:00010000:2.0:1746143698.962887:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093501f80 00000100:00100000:3.0:1746143698.964343:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593786496:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143698.964358:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143698.964610:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143698.964627:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592390784 00000100:00100000:0.0:1746143698.964634:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592390784 00002000:00100000:0.0:1746143698.964659:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a5d82a00 x1830963592390784/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143698.964666:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830963592390784 ext(1048576->2097151) 00002000:00010000:0.0:1746143698.964670:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d82a00 00000100:00100000:0.0:1746143698.964690:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3694 00000100:00100000:0.0:1746143698.964701:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592390784:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143698.964871:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592390272:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6915us (7060us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143698.964889:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5126 00000100:00100000:1.0:1746143698.971622:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.971679:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143698.971708:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592391168 00000100:00100000:1.0:1746143698.971715:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592391168 00000100:00100000:1.0:1746143698.971751:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9915 00000100:00100000:1.0:1746143698.971758:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28579:x1830963592391168:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143698.971772:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143698.971786:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1fdb expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.971821:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b75c200/0xe984082ccd726573 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e8b expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.971829:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a2120c00/0xe984082ccd72667d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f56 expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.971837:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd72657a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e92 expref: 13 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.971844:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.971845:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143698.971848:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [3145728->4055039] (req 3145728->4055039) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.971874:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd72657a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e92 expref: 13 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.971884:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd72657a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e92 expref: 13 pid: 9527 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.971894:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593786624:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143698.972228:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592391040 00000100:00100000:3.0:1746143698.972232:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592391040 00002000:00100000:3.0:1746143698.972254:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880093f00e00 x1830963592391040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/0 e 0 to 0 dl 1746143709 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143698.972261:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00e00 with x1830963592391040 ext(1048576->2097151) 00002000:00010000:3.0:1746143698.972265:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f00e00 00000100:00100000:3.0:1746143698.972279:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3695 00000100:00100000:3.0:1746143698.972284:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592391040:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143698.973823:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a2120c00/0xe984082ccd72667d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f56 expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143698.973835:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a2120c00/0xe984082ccd72667d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f56 expref: 7 pid: 4581 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746143698.973846:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593786752:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143698.976227:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b75c200/0xe984082ccd726573 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e8b expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143698.976245:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b75c200/0xe984082ccd726573 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e8b expref: 27 pid: 9527 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143698.976256:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593786880:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143698.976311:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143698.988775:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592390784:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24069us (24155us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143698.988785:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3694 00002000:00100000:1.0:1746143698.988794:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff8800a5d82a00 x1830963592390784/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143698.988813:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830963592390784 ext(1048576->2097151) 00002000:00010000:1.0:1746143698.988819:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d82a00 00000100:00100000:0.0:1746143699.007283:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.007297:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593786880:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143699.007360:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.007385:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592391296 00000100:00100000:0.0:1746143699.007393:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592391296 00000100:00100000:3.0:1746143699.007404:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592391424 00000100:00100000:3.0:1746143699.007411:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592391424 00010000:00010000:0.0:1746143699.007433:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b75c200/0xe984082ccd726573 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e8b expref: 28 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143699.007437:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2120c00/0xe984082ccd72667d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f56 expref: 8 pid: 4581 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746143699.007471:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5127 00000100:00100000:3.0:1746143699.007478:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592391424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143699.007488:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143699.007505:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800a2120c00/0xe984082ccd72667d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f56 expref: 8 pid: 4581 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746143699.007514:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a2120c00/0xe984082ccd72667d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f56 expref: 8 pid: 4581 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746143699.007535:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.007577:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592391424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.007583:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5127 00000100:00100000:3.0:1746143699.007606:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5128 00000100:00100000:3.0:1746143699.007611:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592391296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143699.007617:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143699.007625:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009b75c200/0xe984082ccd726573 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e8b expref: 28 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143699.007633:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b75c200/0xe984082ccd726573 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e8b expref: 28 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143699.007645:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b75c200/0xe984082ccd726573 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e8b expref: 28 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143699.007660:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.007681:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592391296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 70us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.007686:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5128 00000100:00100000:0.0:1746143699.007712:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.007806:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592391552 00000100:00100000:3.0:1746143699.007810:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592391552 00010000:00010000:3.0:1746143699.007821:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd72657a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e92 expref: 16 pid: 9527 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746143699.007841:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5129 00000100:00100000:3.0:1746143699.007845:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592391552:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143699.007851:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143699.007859:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd72657a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e92 expref: 16 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143699.007867:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd72657a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e92 expref: 16 pid: 9527 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746143699.007878:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.007879:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.007885:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.007891:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.007915:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143699.007925:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593787008:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143699.008436:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143699.008767:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1962:x1830963592391040:12345-192.168.202.48@tcp:3:cat.0 Request processed in 36481us (37150us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143699.008775:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3695 00002000:00100000:2.0:1746143699.008783:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880093f00e00 x1830963592391040/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:94/0 lens 488/440 e 0 to 0 dl 1746143709 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.008791:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00e00 with x1830963592391040 ext(1048576->2097151) 00002000:00010000:2.0:1746143699.008803:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f00e00 00010000:00010000:1.0:1746143699.009231:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd72657a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e92 expref: 14 pid: 9527 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746143699.009241:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593786624:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.009252:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a2120c00/0xe984082ccd72667d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f56 expref: 7 pid: 4581 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746143699.009258:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593786752:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.009281:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.009290:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6298600, rc 0) 00000100:00100000:1.0:1746143699.009309:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28579:x1830963592391168:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 37552us (37629us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.009315:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9915 00000100:00100000:3.0:1746143699.016476:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593787008:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143699.016494:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.016532:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592391552:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8684us (8819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.016541:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5129 00000100:00100000:0.0:1746143699.033621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.034485:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592391808 00000100:00100000:2.0:1746143699.034494:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592391808 00002000:00100000:2.0:1746143699.034531:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (4050944->4055039) req@ffff880094c10e00 x1830963592391808/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.034540:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10e00 with x1830963592391808 ext(4050944->4055039) 00002000:00010000:2.0:1746143699.034545:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10e00 00000100:00100000:2.0:1746143699.035564:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3696 00000100:00100000:2.0:1746143699.035574:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592391808:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143699.035739:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592391808:12345-192.168.202.48@tcp:3:cat.0 Request processed in 166us (2125us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143699.035745:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3696 00002000:00100000:2.0:1746143699.035750:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (4050944->4055039) req@ffff880094c10e00 x1830963592391808/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.035757:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10e00 with x1830963592391808 ext(4050944->4055039) 00002000:00010000:2.0:1746143699.035760:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10e00 00000100:00100000:0.0:1746143699.037523:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.037589:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592391936 00000100:00100000:1.0:1746143699.037599:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592391936 00000100:00100000:1.0:1746143699.037646:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9916 00000100:00100000:1.0:1746143699.037653:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+18:28591:x1830963592391936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143699.037665:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.037680:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72674f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1fe2 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.037701:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.037706:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143699.037708:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143699.037711:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72674f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe2 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.037733:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.037742:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 20 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.037755:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593787136:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143699.037855:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.040778:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.040870:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592392192 00000100:00100000:1.0:1746143699.040880:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592392192 00000100:00100000:1.0:1746143699.040952:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3413 00000100:00100000:1.0:1746143699.040960:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:28579:x1830963592392192:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143699.041442:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:28579:x1830963592392192:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 480us (673us total) trans 8589942473 rc 0/0 00000100:00100000:1.0:1746143699.041448:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3413 00000100:00100000:1.0:1746143699.041949:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593787136:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.041981:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72674f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe2 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.041999:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095611e00, rc 0) 00000100:00100000:1.0:1746143699.042031:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28591:x1830963592391936:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4378us (4518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.042039:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9916 00000100:00100000:2.0:1746143699.042733:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.043729:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592392320 00000100:00100000:0.0:1746143699.043737:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592392320 00002000:00100000:0.0:1746143699.043779:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3063808->3145727) req@ffff880130fd5880 x1830963592392320/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.043788:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5880 with x1830963592392320 ext(3063808->3145727) 00010000:00010000:0.0:1746143699.043805:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 21 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.043818:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 21 pid: 6929 timeout: 878 lvb_type: 0 00002000:00010000:0.0:1746143699.043825:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130fd5880 00000100:00100000:0.0:1746143699.043852:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 908 00000100:00100000:0.0:1746143699.043859:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963592392320:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143699.052523:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592392320:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8652us (9779us total) trans 21474839773 rc 0/0 00000100:00100000:2.0:1746143699.052538:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 908 00002000:00100000:2.0:1746143699.052551:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3063808->3145727) req@ffff880130fd5880 x1830963592392320/t21474839773(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/448 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.052561:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5880 with x1830963592392320 ext(3063808->3145727) 00010000:00010000:2.0:1746143699.052573:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 23 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.052590:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 23 pid: 6929 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746143699.052597:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130fd5880 00000100:00100000:0.0:1746143699.059812:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.060768:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592392448 00000100:00100000:3.0:1746143699.060779:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592392448 00010000:00010000:3.0:1746143699.060828:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 23 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746143699.060868:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5130 00000100:00100000:3.0:1746143699.060876:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592392448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143699.060891:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143699.060915:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 23 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.060928:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 23 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.060953:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009465da00/0xe984082ccd726733 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fc6 expref: 23 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.060980:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.060983:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.060990:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72674f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe2 expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.061004:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72674f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe2 expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.061038:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72674f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe2 expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143699.061049:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593787264:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143699.061168:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143699.068700:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593787264:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143699.068725:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.068812:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592392448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7934us (9021us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.068823:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5130 00000100:00100000:0.0:1746143699.070398:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.070685:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592392704 00000100:00100000:2.0:1746143699.070694:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592392704 00002000:00100000:2.0:1746143699.070741:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880094c13480 x1830963592392704/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.070751:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13480 with x1830963592392704 ext(2097152->3145727) 00002000:00010000:2.0:1746143699.070756:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c13480 00000100:00100000:2.0:1746143699.071393:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3697 00000100:00100000:2.0:1746143699.071402:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592392704:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143699.086541:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592392704:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15129us (16139us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143699.086553:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3697 00002000:00100000:2.0:1746143699.086564:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff880094c13480 x1830963592392704/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.086579:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13480 with x1830963592392704 ext(2097152->3145727) 00002000:00010000:2.0:1746143699.086584:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c13480 00000100:00100000:0.0:1746143699.094105:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.094183:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592392832 00000100:00100000:1.0:1746143699.094193:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592392832 00000100:00100000:1.0:1746143699.094258:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9917 00000100:00100000:1.0:1746143699.094267:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28591:x1830963592392832:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143699.094290:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.094310:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd726756 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1fe9 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.094343:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.094351:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143699.094353:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143699.094356:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd726756 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe9 expref: 14 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.094388:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.094399:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 25 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.094412:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593787392:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143699.094515:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143699.098498:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593787392:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.098536:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd726756 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe9 expref: 14 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.098557:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095610400, rc 0) 00000100:00100000:1.0:1746143699.098653:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28591:x1830963592392832:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4385us (4558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.098662:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9917 00000100:00100000:0.0:1746143699.102577:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.102644:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592392960 00000100:00100000:2.0:1746143699.102654:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592392960 00000100:00100000:0.0:1746143699.102690:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:2.0:1746143699.103107:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4055039) req@ffff880094c13100 x1830963592392960/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.103118:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13100 with x1830963592392960 ext(3145728->4055039) 00010000:00010000:2.0:1746143699.103128:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 26 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.103179:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592393088 00010000:00010000:2.0:1746143699.103180:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 26 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.103183:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592393088 00002000:00010000:2.0:1746143699.103188:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c13100 00000100:00100000:2.0:1746143699.103209:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 909 00000100:00100000:1.0:1746143699.103209:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9918 00000100:00100000:2.0:1746143699.103215:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592392960:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143699.103215:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+19:28594:x1830963592393088:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143699.103230:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.103246:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ff0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.103270:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72674f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe2 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.103277:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.103278:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.103282:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2306048->2863103] (req 2306048->2863103) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.103311:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72674f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe2 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.103321:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72674f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe2 expref: 20 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.103332:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593787520:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143699.103418:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143699.108714:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593787520:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143699.108751:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2306048->2863103] (req 2306048->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.108772:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095611000, rc 0) 00000100:00100000:2.0:1746143699.111459:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+20:28594:x1830963592393088:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8229us (8754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.111472:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9918 00000100:00100000:0.0:1746143699.111848:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.111895:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592393216 00000100:00100000:2.0:1746143699.111904:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592393216 00010000:00010000:2.0:1746143699.112718:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72674f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe2 expref: 20 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746143699.112754:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5131 00000100:00100000:2.0:1746143699.112762:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592393216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143699.112774:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143699.112806:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72674f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe2 expref: 20 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.112817:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72674f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe2 expref: 20 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.112840:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72674f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe2 expref: 20 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.112859:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.112861:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.112868:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.112876:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.112907:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143699.112925:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593787648:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143699.112992:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143699.121693:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.121823:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592393472 00000100:00100000:0.0:1746143699.121832:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592393472 00002000:00100000:0.0:1746143699.121878:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2306048->2310143) req@ffff880130fd4e00 x1830963592393472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.121887:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4e00 with x1830963592393472 ext(2306048->2310143) 00002000:00010000:0.0:1746143699.121892:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd4e00 00000100:00100000:0.0:1746143699.121917:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3698 00000100:00100000:0.0:1746143699.121927:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592393472:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143699.122101:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592393472:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 176us (419us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143699.122108:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3698 00002000:00100000:0.0:1746143699.122114:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2306048->2310143) req@ffff880130fd4e00 x1830963592393472/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.122120:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4e00 with x1830963592393472 ext(2306048->2310143) 00002000:00010000:0.0:1746143699.122123:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd4e00 00000100:00100000:3.0:1746143699.123100:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963593787648:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143699.123121:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.123173:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592393216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10412us (11326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.123182:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5131 00000100:00100000:0.0:1746143699.133958:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.134060:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592393728 00000100:00100000:1.0:1746143699.134068:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592393728 00002000:00100000:1.0:1746143699.134104:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2859008->2863103) req@ffff8800930d1500 x1830963592393728/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.134117:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1500 with x1830963592393728 ext(2859008->2863103) 00002000:00010000:1.0:1746143699.134121:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1500 00000100:00100000:1.0:1746143699.135068:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3699 00000100:00100000:1.0:1746143699.135077:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592393728:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143699.135236:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592393728:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 160us (1284us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143699.135242:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3699 00002000:00100000:1.0:1746143699.135248:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (2859008->2863103) req@ffff8800930d1500 x1830963592393728/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.135255:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1500 with x1830963592393728 ext(2859008->2863103) 00002000:00010000:1.0:1746143699.135259:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1500 00000100:00100000:3.0:1746143699.138532:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592392960:12345-192.168.202.48@tcp:4:cat.0 Request processed in 35304us (35955us total) trans 17179872507 rc 0/0 00000100:00100000:3.0:1746143699.138545:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 909 00002000:00100000:3.0:1746143699.138557:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4055039) req@ffff880094c13100 x1830963592392960/t17179872507(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/448 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.138573:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13100 with x1830963592392960 ext(3145728->4055039) 00010000:00010000:3.0:1746143699.138584:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 28 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.138600:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 28 pid: 6929 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746143699.138608:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c13100 00000100:00100000:0.0:1746143699.144321:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.146945:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592393856 00000100:00100000:3.0:1746143699.146959:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592393856 00010000:00010000:3.0:1746143699.147010:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 28 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746143699.147068:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5132 00000100:00100000:3.0:1746143699.147076:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592393856:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143699.147092:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143699.147112:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143697 -> 1746143698 00002000:00010000:3.0:1746143699.147115:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143697 -> 1746143698 00010000:00010000:3.0:1746143699.147120:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 28 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.147133:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 28 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.147189:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6298600/0xe984082ccd726748 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4055039) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fdb expref: 28 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.147230:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.147232:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.147240:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd726756 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe9 expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.147248:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd726756 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe9 expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.147285:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd726756 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe9 expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143699.147297:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593787776:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143699.147397:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143699.152917:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593787776:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143699.152944:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.153001:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592393856:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5924us (8689us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.153013:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5132 00000100:00100000:0.0:1746143699.155529:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.157906:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592394112 00000100:00100000:3.0:1746143699.157921:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592394112 00002000:00100000:3.0:1746143699.157972:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800930d0a80 x1830963592394112/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.157982:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0a80 with x1830963592394112 ext(3145728->4194303) 00002000:00010000:3.0:1746143699.157988:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d0a80 00000100:00100000:3.0:1746143699.158011:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3700 00000100:00100000:3.0:1746143699.158019:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592394112:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143699.159592:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.159721:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592394368 00000100:00100000:0.0:1746143699.159728:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592394368 00002000:00100000:0.0:1746143699.159765:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880130fd4a80 x1830963592394368/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.159774:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4a80 with x1830963592394368 ext(3145728->4194303) 00002000:00010000:0.0:1746143699.159779:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd4a80 00000100:00100000:0.0:1746143699.159952:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3701 00000100:00100000:0.0:1746143699.159960:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592394368:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143699.170115:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592394112:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12088us (14588us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143699.170126:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3700 00002000:00100000:3.0:1746143699.170156:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800930d0a80 x1830963592394112/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.170165:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0a80 with x1830963592394112 ext(3145728->4194303) 00002000:00010000:3.0:1746143699.170170:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d0a80 00000100:00100000:2.0:1746143699.177547:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592394368:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 17579us (17954us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143699.177557:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3701 00002000:00100000:2.0:1746143699.177566:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880130fd4a80 x1830963592394368/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.177575:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4a80 with x1830963592394368 ext(3145728->4194303) 00002000:00010000:2.0:1746143699.177579:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd4a80 00000100:00100000:0.0:1746143699.179617:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.179704:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592394624 00000100:00100000:1.0:1746143699.179713:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592394624 00000100:00100000:1.0:1746143699.179775:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8355 00000100:00100000:1.0:1746143699.179783:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:28600:x1830963592394624:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143699.179821:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.179840:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176800/0xe984082ccd726764 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ff7 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.179948:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd72676b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.179961:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd72676b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.179973:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd72676b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.179985:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd726772 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.179990:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd726772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.179995:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd726772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180099:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd726779 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180108:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd726779 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180114:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd726779 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143699.180121:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143699.180239:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd72676b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180245:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd72676b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180250:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd72676b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180256:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c177e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143699.180259:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd72676b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180265:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd72676b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180275:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143699.180278:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143699.180282:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd72676b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180286:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd72676b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180310:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd726772 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180315:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd726772 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180319:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd726772 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180323:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c176a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143699.180325:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd726772 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180329:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd726772 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180335:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f442100) 00010000:00010000:1.0:1746143699.180336:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143699.180339:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd726772 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180343:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176a00/0xe984082ccd726772 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.180378:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176800/0xe984082ccd726764 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff7 expref: 269 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.180390:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd726779 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff7 expref: 268 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.180396:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143699.180398:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143699.180400:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c177600, rc 0) 00000100:00100000:1.0:1746143699.180448:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:28600:x1830963592394624:12345-192.168.202.48@tcp:101:cat.0 Request processed in 666us (841us total) trans 8589942474 rc 0/0 00000100:00100000:1.0:1746143699.180454:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8355 00000100:00100000:1.0:1746143699.189866:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.189932:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592394880 00000100:00100000:0.0:1746143699.189942:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592394880 00000100:00100000:0.0:1746143699.189993:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3414 00000100:00100000:0.0:1746143699.190001:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a8e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:28600:x1830963592394880:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1746143699.190213:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a8e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+269:28600:x1830963592394880:12345-192.168.202.48@tcp:35:cat.0 Request processed in 212us (359us total) trans 8589942475 rc 0/0 00000100:00100000:0.0:1746143699.190220:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3414 00000100:00100000:0.0:1746143699.194253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.194350:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.194400:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592395008 00000100:00100000:1.0:1746143699.194410:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592395008 00000100:00100000:3.0:1746143699.194423:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592395136 00000100:00100000:3.0:1746143699.194427:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592395136 00000100:00100000:1.0:1746143699.194467:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9919 00000100:00100000:1.0:1746143699.194475:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592395008:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143699.194479:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9920 00000100:00100000:3.0:1746143699.194485:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592395136:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143699.194495:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.194495:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.194513:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c177e00/0xe984082ccd726787 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a1ffe expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.194537:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.194539:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.194548:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c177e00/0xe984082ccd726787 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ffe expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.194562:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c177e00/0xe984082ccd726787 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ffe expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.194579:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c177e00, rc 0) 00000100:00100000:1.0:1746143699.194623:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592395008:12345-192.168.202.48@tcp:101:cat.0 Request processed in 148us (379us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143699.194625:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd72678e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2005 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143699.194628:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9919 00000100:00100000:3.0:1746143699.194672:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593787904:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143699.194752:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42000 going to sleep for 11 seconds 00002000:00010000:3.0:1746143699.195626:0:6929:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143697 -> 1746143698 00000100:00100000:3.0:1746143699.195646:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593787904:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143699.195665:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd72678e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2005 expref: 23 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143699.195671:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd72678e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2005 expref: 23 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143699.195691:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930c4000, rc 0) 00000100:00100000:3.0:1746143699.195711:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592395136:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1226us (1361us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143699.195715:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9920 00000100:00100000:0.0:1746143699.203239:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.203420:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592395264 00000100:00100000:3.0:1746143699.203430:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592395264 00000100:00100000:3.0:1746143699.203480:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9921 00000100:00100000:3.0:1746143699.203487:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28600:x1830963592395264:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143699.203505:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143699.203522:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bc9800/0xe984082ccd726795 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a200c expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.203551:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.203558:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143699.203560:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143699.203563:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bc9800/0xe984082ccd726795 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a200c expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.203594:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.203605:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 18 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746143699.203624:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593788032:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143699.203715:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143699.205746:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593788032:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143699.205779:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bc9800/0xe984082ccd726795 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a200c expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.205803:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bc9800, rc 0) 00000100:00100000:3.0:1746143699.206321:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:28600:x1830963592395264:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2831us (3089us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.206329:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9921 00000100:00100000:1.0:1746143699.207054:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.207368:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592395392 00000100:00100000:2.0:1746143699.207376:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592395392 00002000:00100000:2.0:1746143699.207419:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2306048->2863103) req@ffff880093f02300 x1830963592395392/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.207427:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02300 with x1830963592395392 ext(2306048->2863103) 00010000:00010000:2.0:1746143699.207436:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 19 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.207448:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 19 pid: 6929 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746143699.207455:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f02300 00000100:00100000:2.0:1746143699.207480:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 910 00000100:00100000:2.0:1746143699.207487:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592395392:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143699.211824:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.212533:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592395520 00000100:00100000:3.0:1746143699.212544:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592395520 00000100:00100000:3.0:1746143699.212608:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8356 00000100:00100000:3.0:1746143699.212616:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+20:28602:x1830963592395520:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143699.212648:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143699.212667:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930c4600/0xe984082ccd72679c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2013 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.212729:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd7267a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.212742:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd7267a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.212752:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd7267a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.212769:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804600/0xe984082ccd7267aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.212775:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804600/0xe984082ccd7267aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.212780:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804600/0xe984082ccd7267aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.212897:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.212908:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb1 expref: 29 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.212914:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.212947:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb1 expref: 29 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.212959:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb1 expref: 29 pid: 20509 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746143699.212971:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593788160:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143699.213059:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143699.214775:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593788160:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143699.214813:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:0.0:1746143699.215212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.215276:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592395776 00000100:00100000:2.0:1746143699.215281:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592395776 00000100:00100000:2.0:1746143699.215324:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3415 00000100:00100000:2.0:1746143699.215332:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+30:15421:x1830963592395776:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143699.215530:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+31:15421:x1830963592395776:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 199us (319us total) trans 8589942476 rc 0/0 00000100:00100000:2.0:1746143699.215537:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3415 00000100:00100000:0.0:1746143699.218240:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.218352:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592395392:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10862us (11314us total) trans 21474839774 rc 0/0 00000100:00100000:3.0:1746143699.218363:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 910 00002000:00100000:3.0:1746143699.218375:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2306048->2863103) req@ffff880093f02300 x1830963592395392/t21474839774(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/448 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.218385:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02300 with x1830963592395392 ext(2306048->2863103) 00010000:00010000:3.0:1746143699.218395:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 21 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.218408:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 21 pid: 6929 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746143699.218415:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f02300 00000100:00100000:2.0:1746143699.218720:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592395904 00000100:00100000:2.0:1746143699.218728:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592395904 00010000:00010000:2.0:1746143699.218758:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb1 expref: 31 pid: 20509 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746143699.218778:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5133 00000100:00100000:2.0:1746143699.218785:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1965:x1830963592395904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143699.218807:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143699.218813:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb1 expref: 31 pid: 20509 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.218822:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb1 expref: 31 pid: 20509 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.218848:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff93400/0xe984082ccd726717 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fb1 expref: 31 pid: 20509 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.218864:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143699.218868:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.218877:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.218883:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.218905:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143699.218925:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1965:x1830963592395904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 140us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.218932:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5133 00010000:00010000:2.0:1746143699.218949:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.218956:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143699.218994:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:2.0:1746143699.218999:0:14764:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143699.219014:0:14764:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219022:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219034:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd7267a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219040:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd7267a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219045:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd7267a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219050:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bc9a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143699.219054:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd7267a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219059:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd7267a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219066:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143699.219069:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143699.219072:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd7267a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219076:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd7267a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219095:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804600/0xe984082ccd7267aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219100:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804600/0xe984082ccd7267aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219104:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804600/0xe984082ccd7267aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219107:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5804600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143699.219111:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804600/0xe984082ccd7267aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219115:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804600/0xe984082ccd7267aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219121:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009322f600) 00010000:00010000:2.0:1746143699.219123:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143699.219133:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804600/0xe984082ccd7267aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219157:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5804600/0xe984082ccd7267aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.219192:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930c4600/0xe984082ccd72679c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2013 expref: 22 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.219206:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2013 expref: 21 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.219212:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143699.219214:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143699.219216:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095614000, rc 0) 00000100:00100000:2.0:1746143699.219254:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+21:28602:x1830963592395520:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 6639us (7460us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.219260:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8356 00000100:00100000:0.0:1746143699.222051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.222088:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.222111:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.222169:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592396032 00000100:00100000:0.0:1746143699.222178:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592396032 00000100:00100000:0.0:1746143699.222227:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9922 00000100:00100000:0.0:1746143699.222235:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1962:x1830963592396032:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143699.222254:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143699.222336:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592396160 00000100:00100000:3.0:1746143699.222342:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592396160 00000100:00100000:3.0:1746143699.222360:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592396288 00000100:00100000:3.0:1746143699.222361:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592396288 00000100:00100000:3.0:1746143699.222372:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9923 00000100:00100000:3.0:1746143699.222376:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592396160:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143699.222383:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143699.222394:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd7267bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2021 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143699.222554:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9924 00000100:00100000:2.0:1746143699.222562:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592396288:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143699.222568:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.222575:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd7267c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2028 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.222601:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.222603:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.222612:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd7267c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2028 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143699.222730:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.222731:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.222736:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd7267bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2021 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143699.222749:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd7267bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2021 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143699.222761:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c1c000, rc 0) 00010000:00010000:0.0:1746143699.223251:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e91800/0xe984082ccd7267b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a201a expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.223266:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.223268:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.223275:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e91800/0xe984082ccd7267b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a201a expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143699.223285:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e91800/0xe984082ccd7267b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a201a expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143699.223292:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91800, rc 0) 00000100:00100000:3.0:1746143699.223348:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963592396160:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 970us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.223355:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9923 00010000:00010000:2.0:1746143699.223425:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd7267c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2028 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.223432:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d8a00, rc 0) 00000100:00100000:0.0:1746143699.223500:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592396032:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1266us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.223506:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9922 00000100:00100000:3.0:1746143699.223638:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.223668:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.223786:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592396544 00000100:00100000:1.0:1746143699.223791:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592396544 00010000:00010000:1.0:1746143699.223821:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 21 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.223843:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5134 00000100:00100000:1.0:1746143699.223848:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592396544:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143699.223858:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143699.223880:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 21 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.223891:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 21 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.223909:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095611000/0xe984082ccd72675d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2306048->2863103) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff0 expref: 21 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.223924:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143699.223925:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592396288:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1364us (1811us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143699.223925:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143699.223930:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9924 00010000:00010000:1.0:1746143699.223931:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bc9800/0xe984082ccd726795 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a200c expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.223940:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bc9800/0xe984082ccd726795 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a200c expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143699.223943:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592396416 00000100:00100000:2.0:1746143699.223945:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592396416 00000100:00100000:2.0:1746143699.223959:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9925 00000100:00100000:2.0:1746143699.223963:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1962:x1830963592396416:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143699.223970:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bc9800/0xe984082ccd726795 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a200c expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.223971:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.223977:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9200/0xe984082ccd7267cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a202f expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143699.223981:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593788288:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143699.223986:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.223988:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.223992:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9200/0xe984082ccd7267cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a202f expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.224000:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9200/0xe984082ccd7267cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a202f expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.224011:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d9200, rc 0) 00000100:00100000:2.0:1746143699.224027:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1962:x1830963592396416:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 64us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.224031:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9925 00000100:00100000:1.0:1746143699.224035:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.228768:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.228839:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593788288:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143699.228867:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143699.228955:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592396544:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5093us (5272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.228967:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5134 00000100:00100000:2.0:1746143699.229250:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592396800 00000100:00100000:2.0:1746143699.229257:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592396800 00000100:00100000:2.0:1746143699.229311:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8357 00000100:00100000:2.0:1746143699.229319:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+21:28602:x1830963592396800:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143699.229340:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.229357:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8000/0xe984082ccd7267d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2036 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.229450:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.229466:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2013 expref: 22 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.229473:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.229502:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2013 expref: 22 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.229513:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2013 expref: 22 pid: 14764 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746143699.229530:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593788416:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143699.229597:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.232354:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.232957:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593788416:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143699.232982:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143699.233561:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592396928 00000100:00100000:1.0:1746143699.233570:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592396928 00010000:00010000:1.0:1746143699.233609:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2013 expref: 23 pid: 14764 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.233901:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5135 00000100:00100000:1.0:1746143699.233911:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+23:1964:x1830963592396928:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143699.233927:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143699.233933:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2013 expref: 23 pid: 14764 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.233944:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2013 expref: 23 pid: 14764 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.233969:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095614000/0xe984082ccd7267b1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2013 expref: 23 pid: 14764 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.234058:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143699.234063:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143699.234073:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143699.234079:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143699.234243:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143699.234324:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.234332:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143699.234354:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143699.234496:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8000/0xe984082ccd7267d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2036 expref: 24 pid: 14764 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143699.234598:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+23:1964:x1830963592396928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 688us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.234605:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5135 00010000:00010000:2.0:1746143699.235188:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2036 expref: 22 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.235195:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143699.235197:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143699.235200:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d8400, rc 0) 00000100:00100000:2.0:1746143699.235229:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+22:28602:x1830963592396800:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5911us (6472us total) trans 8589942477 rc 0/0 00000100:00100000:2.0:1746143699.235236:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8357 00000100:00100000:0.0:1746143699.237563:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.237643:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.237723:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592397440 00000100:00100000:3.0:1746143699.237732:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592397440 00002000:00100000:3.0:1746143699.237782:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f3cb100 x1830963592397440/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.237791:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb100 with x1830963592397440 ext(2097152->3145727) 00002000:00010000:3.0:1746143699.237807:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cb100 00000100:00100000:3.0:1746143699.237829:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3702 00000100:00100000:3.0:1746143699.237837:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592397440:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143699.238305:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592397312 00000100:00100000:2.0:1746143699.238310:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592397312 00000100:00100000:2.0:1746143699.238350:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8358 00000100:00100000:2.0:1746143699.238355:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+22:28602:x1830963592397312:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143699.238372:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.238389:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd7267e9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a203d expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.238461:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd7267f0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.238476:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2036 expref: 23 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.238482:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd7267f0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.238518:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2036 expref: 23 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.238529:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2036 expref: 23 pid: 14764 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746143699.238540:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593788544:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143699.238613:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.238633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.238650:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592397568 00000100:00100000:1.0:1746143699.238655:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592397568 00002000:00100000:1.0:1746143699.238673:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f3caa00 x1830963592397568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.238680:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3caa00 with x1830963592397568 ext(3145728->4194303) 00002000:00010000:1.0:1746143699.238683:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3caa00 00000100:00100000:1.0:1746143699.238703:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3703 00000100:00100000:1.0:1746143699.238708:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592397568:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143699.238708:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.239035:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592397824 00000100:00100000:0.0:1746143699.239039:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592397824 00002000:00100000:0.0:1746143699.239062:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f3cbb80 x1830963592397824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.239070:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cbb80 with x1830963592397824 ext(3145728->4194303) 00002000:00010000:0.0:1746143699.239073:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3cbb80 00000100:00100000:0.0:1746143699.239087:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3704 00000100:00100000:0.0:1746143699.239092:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592397824:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143699.242368:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593788544:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143699.242402:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd7267f0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:0.0:1746143699.242626:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.242677:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592397952 00000100:00100000:1.0:1746143699.242684:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592397952 00010000:00010000:1.0:1746143699.242715:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2036 expref: 24 pid: 14764 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.242737:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5136 00000100:00100000:1.0:1746143699.242744:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+24:1965:x1830963592397952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143699.242757:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143699.242763:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2036 expref: 24 pid: 14764 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.242774:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2036 expref: 24 pid: 14764 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.242811:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd7267db lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2036 expref: 24 pid: 14764 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.242836:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143699.242841:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd7267f0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143699.242852:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd7267f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143699.242858:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd7267f0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143699.242874:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143699.242898:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+23:1965:x1830963592397952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 154us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.242904:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5136 00010000:00010000:2.0:1746143699.244280:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd7267f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.244295:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd7267f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143699.244339:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:2.0:1746143699.244343:0:14764:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143699.244359:0:14764:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd7267f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.244394:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd7267e9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a203d expref: 23 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.244410:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd7267f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a203d expref: 22 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.244417:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143699.244420:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143699.244422:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d9c00, rc 0) 00000100:00100000:2.0:1746143699.244469:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+22:28602:x1830963592397312:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 6113us (6916us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.244477:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8358 00000100:00100000:3.0:1746143699.252868:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592397440:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15017us (15211us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143699.252881:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3702 00002000:00100000:3.0:1746143699.252895:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88008f3cb100 x1830963592397440/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.252905:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb100 with x1830963592397440 ext(2097152->3145727) 00002000:00010000:3.0:1746143699.252911:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cb100 00000100:00100000:2.0:1746143699.261402:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592397824:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22292us (22677us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143699.261417:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3704 00002000:00100000:2.0:1746143699.261429:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f3cbb80 x1830963592397824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.261438:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cbb80 with x1830963592397824 ext(3145728->4194303) 00002000:00010000:2.0:1746143699.261444:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3cbb80 00000100:00100000:1.0:1746143699.262984:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592397568:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24266us (24342us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143699.262993:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3703 00002000:00100000:1.0:1746143699.263001:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88008f3caa00 x1830963592397568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.263008:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3caa00 with x1830963592397568 ext(3145728->4194303) 00002000:00010000:1.0:1746143699.263012:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3caa00 00000100:00100000:0.0:1746143699.266078:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.266167:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592398208 00000100:00100000:2.0:1746143699.266177:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592398208 00000100:00100000:2.0:1746143699.266234:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8359 00000100:00100000:2.0:1746143699.266244:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+22:28602:x1830963592398208:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143699.266487:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.266508:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd7267f7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2044 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.266602:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd7267fe lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.266615:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd7267fe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143699.266625:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd7267fe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:2.0:1746143699.266636:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143699.267420:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd7267f7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2044 expref: 25 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.267459:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd7267fe lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2044 expref: 24 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.267468:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143699.267471:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143699.267474:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d8200, rc 0) 00000100:00100000:2.0:1746143699.268006:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+24:28602:x1830963592398208:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1762us (1936us total) trans 8589942478 rc 0/0 00000100:00100000:2.0:1746143699.268014:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8359 00000100:00100000:0.0:1746143699.274533:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.278340:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592398336 00000100:00100000:2.0:1746143699.278357:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592398336 00000100:00100000:2.0:1746143699.278415:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9926 00000100:00100000:2.0:1746143699.278423:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592398336:12345-192.168.202.48@tcp:1:lfs.0 00000100:00100000:1.0:1746143699.278451:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.278472:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592398464 00010000:00010000:2.0:1746143699.278474:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143699.278476:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592398464 00010000:00010000:2.0:1746143699.278493:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130639a00/0xe984082ccd7261e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c46 expref: 13 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143699.278496:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9927 00000100:00100000:1.0:1746143699.278501:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592398464:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143699.278502:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c94d800/0xe984082ccd726304 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cfc expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.278509:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca77200/0xe984082ccd72628d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1caf expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.278515:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.278517:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.278520:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.278522:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.278534:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72644d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dea expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.278541:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7e00/0xe984082ccd7264c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e1b expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.278546:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7000/0xe984082ccd7264b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e14 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.278550:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.278552:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.278553:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca77200/0xe984082ccd72628d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1caf expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.278554:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.278565:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca77200/0xe984082ccd72628d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1caf expref: 27 pid: 8495 timeout: 878 lvb_type: 1 00010000:00010000:1.0:1746143699.278576:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7000/0xe984082ccd7264b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e14 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143699.278579:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593788672:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.278583:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7000/0xe984082ccd7264b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e14 expref: 9 pid: 6929 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.278592:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593788800:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143699.278678:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c94d800/0xe984082ccd726304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cfc expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.278683:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7e00/0xe984082ccd7264c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e1b expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.278687:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c94d800/0xe984082ccd726304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cfc expref: 9 pid: 6929 timeout: 878 lvb_type: 1 00010000:00010000:1.0:1746143699.278690:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7e00/0xe984082ccd7264c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e1b expref: 19 pid: 6929 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746143699.278696:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593788928:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143699.278698:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593789056:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.278718:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72644d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dea expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.278724:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72644d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dea expref: 22 pid: 9527 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.278727:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130639a00/0xe984082ccd7261e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c46 expref: 13 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143699.278730:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593789184:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143699.278736:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130639a00/0xe984082ccd7261e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c46 expref: 13 pid: 12618 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.278743:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143699.278744:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593789312:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143699.278763:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143699.279428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.279455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.279472:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.279484:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592398592 00000100:00100000:1.0:1746143699.279487:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592398592 00000100:00100000:1.0:1746143699.279509:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592398720 00000100:00100000:1.0:1746143699.279511:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592398720 00000100:00100000:1.0:1746143699.279520:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592398848 00000100:00100000:1.0:1746143699.279521:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592398848 00000100:00100000:1.0:1746143699.279532:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9928 00000100:00100000:1.0:1746143699.279536:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592398592:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143699.279552:0:8495:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.279563:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd7266d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f80 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.279569:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e91800/0xe984082ccd7267b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a201a expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.279575:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009465dc00/0xe984082ccd726702 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fa3 expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.279580:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.279582:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.279584:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.279599:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009465dc00/0xe984082ccd726702 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fa3 expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.279610:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009465dc00/0xe984082ccd726702 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fa3 expref: 19 pid: 4582 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.279618:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593789440:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.279667:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e91800/0xe984082ccd7267b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a201a expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.279675:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e91800/0xe984082ccd7267b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a201a expref: 10 pid: 4581 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.279682:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593789568:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.279705:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd7266d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f80 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.279711:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd7266d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f80 expref: 22 pid: 8496 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.279717:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593789696:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143699.279731:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143699.279765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.279781:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592398976 00000100:00100000:1.0:1746143699.279784:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592398976 00000100:00100000:1.0:1746143699.279814:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9929 00000100:00100000:1.0:1746143699.279818:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592398720:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143699.279835:0:8497:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.279846:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930c5c00/0xe984082ccd726709 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1faa expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.279852:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd7267bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2021 expref: 11 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.279858:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a2121a00/0xe984082ccd72673a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fcd expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.279864:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.279865:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.279867:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.279881:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a2121a00/0xe984082ccd72673a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fcd expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.279888:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a2121a00/0xe984082ccd72673a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fcd expref: 13 pid: 8495 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.279895:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593789824:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.279918:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd7267bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2021 expref: 11 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.279929:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd7267bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2021 expref: 11 pid: 6929 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.279936:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593789952:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.279959:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930c5c00/0xe984082ccd726709 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1faa expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.279966:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930c5c00/0xe984082ccd726709 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1faa expref: 27 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.279973:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593790080:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143699.279988:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143699.280005:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9930 00000100:00100000:1.0:1746143699.280010:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592398848:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143699.280026:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.280036:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd726756 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe9 expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.280042:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd7267c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2028 expref: 11 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.280048:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c177e00/0xe984082ccd726787 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ffe expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.280054:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090745a00/0xe984082ccd72652d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e61 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.280060:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b75da00/0xe984082ccd72653b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e6f expref: 13 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.280067:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a034b000/0xe984082ccd7263a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d6c expref: 27 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.280072:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc400/0xe984082ccd7263e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dab expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.280077:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 4 00010000:00010000:1.0:1746143699.280078:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 4 00010000:00010000:1.0:1746143699.280080:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 10/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.280094:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc400/0xe984082ccd7263e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dab expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.280102:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc400/0xe984082ccd7263e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dab expref: 13 pid: 4581 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.280108:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790208:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.280132:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a034b000/0xe984082ccd7263a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d6c expref: 27 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.280167:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a034b000/0xe984082ccd7263a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d6c expref: 27 pid: 8495 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.280174:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790336:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.280213:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b75da00/0xe984082ccd72653b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e6f expref: 13 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.280224:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b75da00/0xe984082ccd72653b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e6f expref: 13 pid: 4582 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.280231:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790464:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.280250:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090745a00/0xe984082ccd72652d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e61 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.280256:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090745a00/0xe984082ccd72652d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e61 expref: 27 pid: 9527 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.280263:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790592:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.280277:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c177e00/0xe984082ccd726787 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ffe expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.280283:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c177e00/0xe984082ccd726787 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ffe expref: 27 pid: 4582 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.280295:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790720:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.280308:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd7267c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2028 expref: 11 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.280314:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd7267c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2028 expref: 11 pid: 8496 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.280320:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790848:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.280335:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd726756 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe9 expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.280341:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd726756 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe9 expref: 13 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.280347:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790976:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143699.280355:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.280525:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9931 00000100:00100000:0.0:1746143699.280532:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592398976:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143699.280549:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.280559:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bc9800/0xe984082ccd726795 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a200c expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.280565:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9200/0xe984082ccd7267cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a202f expref: 11 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143699.280570:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.280571:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.280573:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 5/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.280585:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9200/0xe984082ccd7267cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a202f expref: 11 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143699.280591:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9200/0xe984082ccd7267cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a202f expref: 11 pid: 8496 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746143699.280597:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593791104:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143699.280622:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bc9800/0xe984082ccd726795 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a200c expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.280632:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bc9800/0xe984082ccd726795 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a200c expref: 22 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746143699.280638:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593791232:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143699.280648:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.301028:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.301053:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.301064:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.301087:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592399872 00000100:00100000:0.0:1746143699.301095:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592399872 00010000:00010000:0.0:1746143699.301132:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd7267bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2021 expref: 12 pid: 6929 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746143699.301186:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592400640 00000100:00100000:0.0:1746143699.301189:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592400640 00010000:00010000:0.0:1746143699.301198:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd7267c6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2028 expref: 13 pid: 8496 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746143699.301209:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592400896 00000100:00100000:0.0:1746143699.301211:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592400896 00010000:00010000:0.0:1746143699.301220:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130639a00/0xe984082ccd7261e5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c46 expref: 14 pid: 12618 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746143699.301233:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5137 00000100:00100000:0.0:1746143699.301240:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1965:x1830963592399872:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.301253:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.301277:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd7267bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2021 expref: 13 pid: 6929 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.301288:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd7267bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2021 expref: 13 pid: 6929 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.301313:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.301357:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1965:x1830963592399872:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 117us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.301363:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5137 00000100:00100000:0.0:1746143699.301378:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5138 00000100:00100000:0.0:1746143699.301383:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592400640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.301390:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.301400:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd7267c6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2028 expref: 12 pid: 8496 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.301408:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd7267c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2028 expref: 12 pid: 8496 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.301418:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.301431:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592400640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.301436:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5138 00000100:00100000:0.0:1746143699.301446:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5139 00000100:00100000:0.0:1746143699.301449:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592400896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.301456:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.301466:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130639a00/0xe984082ccd7261e5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c46 expref: 14 pid: 12618 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.301473:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130639a00/0xe984082ccd7261e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c46 expref: 14 pid: 12618 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.301485:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.301499:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592400896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.301503:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5139 00000100:00100000:0.0:1746143699.301531:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.301543:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592400512 00000100:00100000:0.0:1746143699.301546:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592400512 00010000:00010000:0.0:1746143699.301556:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930c5c00/0xe984082ccd726709 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1faa expref: 28 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746143699.301565:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5140 00000100:00100000:0.0:1746143699.301569:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592400512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.301575:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.301580:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930c5c00/0xe984082ccd726709 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1faa expref: 28 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.301588:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930c5c00/0xe984082ccd726709 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1faa expref: 28 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.301598:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.301611:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592400512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 41us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.301618:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5140 00000100:00100000:0.0:1746143699.301668:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.301678:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592400768 00000100:00100000:0.0:1746143699.301680:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592400768 00010000:00010000:0.0:1746143699.301691:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd726756 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe9 expref: 14 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746143699.301701:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5141 00000100:00100000:0.0:1746143699.301705:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592400768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.301710:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.301716:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd726756 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe9 expref: 14 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.301724:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd726756 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe9 expref: 14 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.301733:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.301746:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592400768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 40us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.301750:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5141 00000100:00100000:0.0:1746143699.301775:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.301783:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592401024 00000100:00100000:0.0:1746143699.301785:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592401024 00010000:00010000:0.0:1746143699.301801:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b75da00/0xe984082ccd72653b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e6f expref: 14 pid: 4582 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746143699.301811:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5142 00000100:00100000:0.0:1746143699.301815:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592401024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.301820:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.301825:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b75da00/0xe984082ccd72653b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e6f expref: 14 pid: 4582 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.301832:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b75da00/0xe984082ccd72653b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e6f expref: 14 pid: 4582 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.301839:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.301849:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592401024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 34us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.301853:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5142 00000100:00100000:0.0:1746143699.301879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.301886:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592401152 00000100:00100000:0.0:1746143699.301888:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592401152 00010000:00010000:0.0:1746143699.301897:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009465dc00/0xe984082ccd726702 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fa3 expref: 20 pid: 4582 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746143699.301906:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5143 00000100:00100000:0.0:1746143699.301909:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592401152:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.301915:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.301927:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009465dc00/0xe984082ccd726702 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fa3 expref: 20 pid: 4582 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.301935:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009465dc00/0xe984082ccd726702 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fa3 expref: 20 pid: 4582 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.301950:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.301961:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592401152:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.301966:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5143 00000100:00100000:0.0:1746143699.302015:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.302023:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592399104 00000100:00100000:0.0:1746143699.302025:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592399104 00010000:00010000:0.0:1746143699.302033:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca77200/0xe984082ccd72628d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1caf expref: 28 pid: 8495 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746143699.302041:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5144 00000100:00100000:0.0:1746143699.302045:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592399104:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.302049:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.302054:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca77200/0xe984082ccd72628d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1caf expref: 28 pid: 8495 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.302060:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca77200/0xe984082ccd72628d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1caf expref: 28 pid: 8495 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.302067:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.302076:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592399104:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 31us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.302080:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5144 00000100:00100000:0.0:1746143699.302102:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.302109:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592399360 00000100:00100000:0.0:1746143699.302111:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592399360 00010000:00010000:0.0:1746143699.302118:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7e00/0xe984082ccd7264c4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e1b expref: 20 pid: 6929 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746143699.302126:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5145 00000100:00100000:0.0:1746143699.302129:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592399360:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.302133:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.302160:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7e00/0xe984082ccd7264c4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e1b expref: 20 pid: 6929 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.302167:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7e00/0xe984082ccd7264c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e1b expref: 20 pid: 6929 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.302175:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.302184:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592399360:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 54us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.302188:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5145 00000100:00100000:0.0:1746143699.302209:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.302215:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592399616 00000100:00100000:0.0:1746143699.302217:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592399616 00010000:00010000:0.0:1746143699.302225:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e91800/0xe984082ccd7267b8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a201a expref: 12 pid: 4581 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746143699.302233:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5146 00000100:00100000:0.0:1746143699.302237:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592399616:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.302240:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.302245:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e91800/0xe984082ccd7267b8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a201a expref: 12 pid: 4581 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.302253:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e91800/0xe984082ccd7267b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a201a expref: 12 pid: 4581 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.302260:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.302268:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592399616:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 31us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.302272:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5146 00000100:00100000:0.0:1746143699.302288:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.302294:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592400000 00000100:00100000:0.0:1746143699.302296:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592400000 00010000:00010000:0.0:1746143699.302302:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd7266d8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f80 expref: 23 pid: 8496 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746143699.302311:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5147 00000100:00100000:0.0:1746143699.302314:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592400000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.302318:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.302322:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd7266d8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f80 expref: 23 pid: 8496 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.302329:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd7266d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f80 expref: 23 pid: 8496 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.302338:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.302340:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.302345:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.302357:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.302372:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.302382:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592400000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 67us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.302385:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5147 00000100:00100000:0.0:1746143699.302406:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.302413:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592400256 00000100:00100000:0.0:1746143699.302415:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592400256 00010000:00010000:0.0:1746143699.302421:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a034b000/0xe984082ccd7263a5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d6c expref: 28 pid: 8495 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746143699.302430:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5148 00000100:00100000:0.0:1746143699.302433:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592400256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.302437:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.302442:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a034b000/0xe984082ccd7263a5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d6c expref: 28 pid: 8495 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.302449:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a034b000/0xe984082ccd7263a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d6c expref: 28 pid: 8495 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.302456:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.302469:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592400256:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 30us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.302476:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5148 00000100:00100000:0.0:1746143699.302495:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.302503:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592401280 00000100:00100000:0.0:1746143699.302506:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592401280 00010000:00010000:0.0:1746143699.302514:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2121a00/0xe984082ccd72673a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fcd expref: 14 pid: 8495 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746143699.302523:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5149 00000100:00100000:0.0:1746143699.302527:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592401280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.302532:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.302537:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a2121a00/0xe984082ccd72673a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fcd expref: 14 pid: 8495 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.302543:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a2121a00/0xe984082ccd72673a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fcd expref: 14 pid: 8495 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.302552:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.302553:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.302556:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.302561:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.302569:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.302580:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592401280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 52us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.302587:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5149 00000100:00100000:0.0:1746143699.302611:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.302618:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592399232 00000100:00100000:0.0:1746143699.302620:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592399232 00010000:00010000:0.0:1746143699.302627:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7000/0xe984082ccd7264b6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e14 expref: 12 pid: 6929 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746143699.302635:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5150 00000100:00100000:0.0:1746143699.302639:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592399232:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.302644:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.302650:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7000/0xe984082ccd7264b6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e14 expref: 12 pid: 6929 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.302657:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7000/0xe984082ccd7264b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e14 expref: 12 pid: 6929 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.302666:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.302682:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592399232:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 38us (65us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.302687:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5150 00000100:00100000:0.0:1746143699.302717:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.302725:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592399488 00000100:00100000:0.0:1746143699.302727:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592399488 00010000:00010000:0.0:1746143699.302735:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94d800/0xe984082ccd726304 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cfc expref: 12 pid: 6929 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746143699.302746:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5151 00000100:00100000:0.0:1746143699.302750:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592399488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.302754:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.302760:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c94d800/0xe984082ccd726304 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cfc expref: 12 pid: 6929 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.302767:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c94d800/0xe984082ccd726304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cfc expref: 12 pid: 6929 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.302775:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.302777:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.302780:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.302785:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.302802:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.302814:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592399488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 64us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.302819:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5151 00000100:00100000:0.0:1746143699.302848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.302857:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592399744 00000100:00100000:0.0:1746143699.302859:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592399744 00010000:00010000:0.0:1746143699.302868:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72644d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dea expref: 23 pid: 9527 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746143699.302879:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5152 00000100:00100000:0.0:1746143699.302882:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592399744:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.302888:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.302894:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72644d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dea expref: 23 pid: 9527 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.302903:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72644d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dea expref: 23 pid: 9527 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.302912:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.302913:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.302916:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.302921:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.302929:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.302941:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963592399744:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 58us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.302946:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5152 00000100:00100000:0.0:1746143699.302965:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.302973:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592400128 00000100:00100000:0.0:1746143699.302975:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592400128 00010000:00010000:0.0:1746143699.302983:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc400/0xe984082ccd7263e4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dab expref: 14 pid: 4581 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746143699.302992:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5153 00000100:00100000:0.0:1746143699.302996:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592400128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.303004:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.303010:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc400/0xe984082ccd7263e4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dab expref: 14 pid: 4581 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.303017:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc400/0xe984082ccd7263e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dab expref: 14 pid: 4581 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.303025:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.303037:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592400128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 41us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.303041:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5153 00000100:00100000:0.0:1746143699.303061:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.303069:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592400384 00000100:00100000:0.0:1746143699.303072:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592400384 00010000:00010000:0.0:1746143699.303079:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090745a00/0xe984082ccd72652d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e61 expref: 28 pid: 9527 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746143699.303088:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5154 00000100:00100000:0.0:1746143699.303092:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592400384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.303098:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.303104:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090745a00/0xe984082ccd72652d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e61 expref: 28 pid: 9527 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.303111:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090745a00/0xe984082ccd72652d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e61 expref: 28 pid: 9527 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.303120:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.303130:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592400384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 37us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.303134:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5154 00000100:00100000:0.0:1746143699.303215:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593791104:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143699.303242:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593791232:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143699.303259:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143699.303279:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.303288:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592401408 00000100:00100000:0.0:1746143699.303290:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592401408 00010000:00010000:0.0:1746143699.303300:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9200/0xe984082ccd7267cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a202f expref: 12 pid: 8496 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746143699.303310:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5155 00000100:00100000:0.0:1746143699.303313:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592401408:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.303319:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.303327:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9200/0xe984082ccd7267cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a202f expref: 12 pid: 8496 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.303334:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9200/0xe984082ccd7267cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a202f expref: 12 pid: 8496 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.303344:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9200/0xe984082ccd7267cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a202f expref: 12 pid: 8496 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.303365:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.303375:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592401408:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 61us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.303379:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5155 00000100:00100000:0.0:1746143699.303427:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.303436:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592401664 00000100:00100000:0.0:1746143699.303438:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592401664 00010000:00010000:0.0:1746143699.303447:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c177e00/0xe984082ccd726787 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ffe expref: 28 pid: 4582 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746143699.303457:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5156 00000100:00100000:0.0:1746143699.303461:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592401664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.303467:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.303473:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c177e00/0xe984082ccd726787 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ffe expref: 28 pid: 4582 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.303480:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c177e00/0xe984082ccd726787 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ffe expref: 28 pid: 4582 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746143699.303489:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.303490:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.303492:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.303498:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.303512:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.303521:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592401664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 60us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.303527:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5156 00000100:00100000:0.0:1746143699.303575:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.303585:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592401536 00000100:00100000:0.0:1746143699.303588:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592401536 00010000:00010000:0.0:1746143699.303597:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bc9800/0xe984082ccd726795 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a200c expref: 23 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746143699.303607:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5157 00000100:00100000:0.0:1746143699.303612:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592401536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143699.303617:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143699.303624:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bc9800/0xe984082ccd726795 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a200c expref: 23 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.303632:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5bc9800/0xe984082ccd726795 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a200c expref: 23 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.303642:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bc9800/0xe984082ccd726795 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a200c expref: 23 pid: 6929 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.303651:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.303653:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.303655:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.303666:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.303678:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.303688:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592401536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 76us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.303694:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5157 00010000:00010000:0.0:1746143699.303715:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.303722:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.303744:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.303750:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.303758:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.303765:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e90c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143699.303769:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.303782:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.303966:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca77200/0xe984082ccd72628d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1caf expref: 27 pid: 8495 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746143699.303980:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593788672:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143699.303994:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c94d800/0xe984082ccd726304 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1cfc expref: 11 pid: 6929 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746143699.304002:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593788928:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143699.304014:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130639a00/0xe984082ccd7261e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c46 expref: 13 pid: 12618 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746143699.304027:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593789312:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143699.304046:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.304053:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.304059:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.304073:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.304079:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.304085:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.304090:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63d9600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143699.304092:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.304097:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.304110:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.304116:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72680c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143699.304173:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592398336:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 25752us (29652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.304180:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9926 00010000:00010000:1.0:1746143699.304398:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7000/0xe984082ccd7264b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e14 expref: 10 pid: 6929 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.304416:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593788800:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.304427:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc7e00/0xe984082ccd7264c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e1b expref: 19 pid: 6929 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.304438:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593789056:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.304449:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72644d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dea expref: 21 pid: 9527 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.304455:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593789184:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.304471:0:15784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304477:0:15784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304482:0:15784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304496:0:15784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304502:0:15784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304507:0:15784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304512:0:15784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c176000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143699.304515:0:15784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304520:0:15784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304529:0:15784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304535:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c176000/0xe984082ccd726813 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143699.304564:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592398464:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 26062us (26114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.304569:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9927 00010000:00010000:1.0:1746143699.304600:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a2121a00/0xe984082ccd72673a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fcd expref: 12 pid: 8495 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.304609:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593789824:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.304620:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd7267bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2021 expref: 9 pid: 6929 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.304626:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593789952:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.304636:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930c5c00/0xe984082ccd726709 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1faa expref: 26 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.304644:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593790080:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.304662:0:8497:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304667:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304672:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304685:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304690:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304695:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304700:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5548200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143699.304702:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304708:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304717:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304727:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5548200/0xe984082ccd726821 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143699.304754:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592398720:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 24936us (25299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.304759:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9929 00010000:00010000:1.0:1746143699.304785:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009465dc00/0xe984082ccd726702 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fa3 expref: 18 pid: 4582 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.304819:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593789440:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.304831:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e91800/0xe984082ccd7267b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a201a expref: 8 pid: 4581 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.304838:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593789568:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.304847:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd7266d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1f80 expref: 20 pid: 8496 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.304853:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593789696:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.304866:0:8495:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304872:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304886:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304900:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304905:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304911:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304916:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e3ae00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143699.304919:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304924:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304932:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.304937:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3ae00/0xe984082ccd72681a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143699.304962:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963592398592:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 25425us (25535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.304968:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9928 00010000:00010000:1.0:1746143699.304998:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc400/0xe984082ccd7263e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 9 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dab expref: 11 pid: 4581 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.305006:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790208:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143699.305013:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.305016:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a034b000/0xe984082ccd7263a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1d6c expref: 25 pid: 8495 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.305022:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e90c00/0xe984082ccd72682f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143699.308135:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790336:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.308189:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b75da00/0xe984082ccd72653b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e6f expref: 10 pid: 4582 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.308204:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790464:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.308216:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090745a00/0xe984082ccd72652d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e61 expref: 24 pid: 9527 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.308225:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790592:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.308236:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c177e00/0xe984082ccd726787 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ffe expref: 23 pid: 4582 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.308244:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790720:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.308255:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a63d8a00/0xe984082ccd7267c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2028 expref: 7 pid: 8496 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746143699.308268:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790848:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.308280:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd726756 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1fe9 expref: 9 pid: 6929 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.308288:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963593790976:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.308321:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.308331:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.308337:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.308367:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.308375:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.308382:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.308389:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7f6800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143699.308392:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.308401:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.308419:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.308424:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd726828 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143699.308494:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1965:x1830963592398848:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 28482us (29018us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.308502:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9930 00000100:00100000:1.0:1746143699.312312:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1964:x1830963592398976:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 31769us (32534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.312322:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9931 00000100:00100000:2.0:1746143699.312387:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.312630:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592401920 00000100:00100000:0.0:1746143699.312638:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592401920 00000100:00100000:0.0:1746143699.312673:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8360 00000100:00100000:0.0:1746143699.312678:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+269:28604:x1830963592401920:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143699.312703:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143699.312722:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91c00/0xe984082ccd726836 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a204b expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.312844:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90a00/0xe984082ccd72683d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143699.312855:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90a00/0xe984082ccd72683d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143699.312864:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90a00/0xe984082ccd72683d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143699.312872:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90800/0xe984082ccd726844 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143699.312878:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90800/0xe984082ccd726844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143699.312881:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90800/0xe984082ccd726844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143699.312966:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143699.312974:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd7267fe lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2044 expref: 23 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.312978:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143699.313004:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd7267fe lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2044 expref: 23 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.313013:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd7267fe lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2044 expref: 23 pid: 14764 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746143699.313022:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593791360:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143699.313109:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.315774:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.315929:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593791360:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143699.315957:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:1.0:1746143699.316762:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592402176 00000100:00100000:1.0:1746143699.316770:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592402176 00000100:00100000:1.0:1746143699.316830:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8361 00000100:00100000:1.0:1746143699.316839:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+24:28602:x1830963592402176:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:1.0:1746143699.316890:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143699.316914:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd7267f0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a203d expref: 24 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.316928:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143699.316933:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143699.316941:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143699.317009:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+23:28602:x1830963592402176:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 171us (1243us total) trans 0 rc -16/-16 00000100:00100000:1.0:1746143699.317016:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8361 00000100:00100000:0.0:1746143699.317609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.317902:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592402304 00000100:00100000:1.0:1746143699.317906:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592402304 00010000:00010000:1.0:1746143699.317925:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd7267fe lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2044 expref: 23 pid: 14764 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.318463:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5158 00000100:00100000:1.0:1746143699.318470:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+23:1965:x1830963592402304:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143699.318481:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143699.318485:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd7267fe lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2044 expref: 23 pid: 14764 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.318495:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd7267fe lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2044 expref: 23 pid: 14764 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.318509:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd7267fe lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2044 expref: 23 pid: 14764 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.318520:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143699.318523:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143699.318532:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143699.318541:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143699.318598:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143699.318747:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318755:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143699.318770:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143699.318884:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318891:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318896:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318901:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e91a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143699.318904:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318909:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318916:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143699.318919:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143699.318921:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318925:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91a00/0xe984082ccd72684b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318943:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90a00/0xe984082ccd72683d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318948:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90a00/0xe984082ccd72683d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318952:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90a00/0xe984082ccd72683d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318956:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e90a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143699.318959:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90a00/0xe984082ccd72683d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318964:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90a00/0xe984082ccd72683d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318970:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143699.318972:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143699.318974:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90a00/0xe984082ccd72683d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318978:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90a00/0xe984082ccd72683d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318985:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90800/0xe984082ccd726844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318990:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90800/0xe984082ccd726844 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318995:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90800/0xe984082ccd726844 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.318999:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e90800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143699.319000:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90800/0xe984082ccd726844 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.319005:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90800/0xe984082ccd726844 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.319011:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d03c900) 00010000:00010000:3.0:1746143699.319012:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143699.319014:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90800/0xe984082ccd726844 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.319019:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90800/0xe984082ccd726844 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.319059:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91c00/0xe984082ccd726836 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a204b expref: 271 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.319066:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91c00/0xe984082ccd726836 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a204b expref: 271 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.319072:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91c00, rc 0) 00000100:00100000:1.0:1746143699.319105:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+22:1965:x1830963592402304:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 635us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.319111:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5158 00000100:00100000:3.0:1746143699.320254:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+270:28604:x1830963592401920:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7567us (7861us total) trans 8589942479 rc 301/301 00000100:00100000:3.0:1746143699.320262:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8360 00000100:00100000:2.0:1746143699.321681:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.321704:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.321929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.322000:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592402432 00000100:00100000:1.0:1746143699.322009:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592402432 00000100:00100000:2.0:1746143699.322011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.322023:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592402560 00000100:00100000:1.0:1746143699.322024:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592402560 00000100:00100000:2.0:1746143699.322034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.322053:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592402688 00000100:00100000:1.0:1746143699.322054:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592402688 00000100:00100000:2.0:1746143699.322063:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592402816 00000100:00100000:1.0:1746143699.322064:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592402944 00000100:00100000:2.0:1746143699.322066:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592402816 00000100:00100000:1.0:1746143699.322066:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592402944 00000100:00100000:1.0:1746143699.322081:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9932 00000100:00100000:1.0:1746143699.322125:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1964:x1830963592402560:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143699.322160:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.322179:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2c00/0xe984082ccd726859 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2059 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143699.322205:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34a:0x0] initial LVB size: 2097152, mtime: 0x681409d1, atime: 0x681409cf, ctime: 0x681409d1, blocks: 0x821 00010000:00010000:1.0:1746143699.322224:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.322226:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.322236:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2c00/0xe984082ccd726859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2059 expref: 20 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143699.322287:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9933 00000100:00100000:2.0:1746143699.322294:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592402688:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143699.322297:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9934 00010000:00010000:2.0:1746143699.322301:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143699.322305:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1964:x1830963592402944:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143699.322310:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd726860 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2060 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.322312:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143699.322324:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5a00/0xe984082ccd726867 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a206e expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143699.322329:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34b:0x0] initial LVB size: 2097152, mtime: 0x681409d2, atime: 0x681409d2, ctime: 0x681409d2, blocks: 0x821 00010000:00010000:2.0:1746143699.322337:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.322338:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746143699.322340:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 4897312, mtime: 0x681409d2, atime: 0x681409d1, ctime: 0x681409d2, blocks: 0x15a5 00010000:00010000:2.0:1746143699.322343:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd726860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2060 expref: 21 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143699.322349:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.322350:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.322355:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5a00/0xe984082ccd726867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a206e expref: 12 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.322357:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd726860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2060 expref: 21 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143699.322365:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5a00/0xe984082ccd726867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a206e expref: 12 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.322367:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930c4000, rc 0) 00010000:00010000:3.0:1746143699.322372:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f5a00, rc 0) 00000100:00100000:2.0:1746143699.322401:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592402688:12345-192.168.202.48@tcp:101:cat.0 Request processed in 108us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.322407:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9933 00000100:00100000:2.0:1746143699.322418:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9935 00000100:00100000:2.0:1746143699.322423:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592402816:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143699.322428:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.322435:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930c4600/0xe984082ccd72686e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2067 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143699.322446:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409d2, atime: 0x681409d2, ctime: 0x681409d2, blocks: 0x81f 00010000:00010000:2.0:1746143699.322452:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.322453:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.322457:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930c4600/0xe984082ccd72686e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2067 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.322470:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930c4600/0xe984082ccd72686e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2067 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.322476:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930c4600, rc 0) 00000100:00100000:3.0:1746143699.322574:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592402944:12345-192.168.202.48@tcp:101:cat.0 Request processed in 270us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.322578:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.322580:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9934 00000100:00100000:0.0:1746143699.322589:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592403072 00000100:00100000:0.0:1746143699.322592:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592403072 00000100:00100000:0.0:1746143699.322608:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9936 00000100:00100000:0.0:1746143699.322613:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592403072:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143699.322619:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143699.322627:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726875 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2075 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143699.322638:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409d2, atime: 0x681409d2, ctime: 0x681409d2, blocks: 0x1029 00010000:00010000:0.0:1746143699.322645:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.322646:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.322650:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726875 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2075 expref: 22 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143699.322659:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726875 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2075 expref: 22 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143699.322665:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91e00, rc 0) 00000100:00100000:0.0:1746143699.322678:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592403072:12345-192.168.202.48@tcp:101:cat.0 Request processed in 66us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.322683:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9936 00010000:00010000:1.0:1746143699.322694:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2c00/0xe984082ccd726859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2059 expref: 21 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.322707:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e2c00, rc 0) 00000100:00100000:1.0:1746143699.322726:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1964:x1830963592402560:12345-192.168.202.48@tcp:101:cat.0 Request processed in 603us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.322732:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9932 00000100:00100000:0.0:1746143699.322764:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.322776:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9937 00000100:00100000:1.0:1746143699.322780:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592402432:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143699.322782:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592403328 00000100:00100000:0.0:1746143699.322785:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592403328 00010000:00010000:1.0:1746143699.322786:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.322807:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72687c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2052 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143699.322817:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3416 00002000:00010000:1.0:1746143699.322820:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409cf, atime: 0x681409cf, ctime: 0x681409cf, blocks: 0x807 00000100:00100000:0.0:1746143699.322822:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+22:28602:x1830963592403328:12345-192.168.202.48@tcp:35:lfs.0 00010000:00010000:1.0:1746143699.322827:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.322829:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.322833:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72687c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2052 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.322842:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72687c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2052 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.322848:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e2400, rc 0) 00000100:00100000:1.0:1746143699.322865:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592402432:12345-192.168.202.48@tcp:101:cat.0 Request processed in 84us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.322870:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9937 00000100:00100000:2.0:1746143699.322935:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592402816:12345-192.168.202.48@tcp:101:cat.0 Request processed in 510us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.322940:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9935 00000100:00100000:0.0:1746143699.323051:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+23:28602:x1830963592403328:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 228us (286us total) trans 8589942480 rc 0/0 00000100:00100000:0.0:1746143699.323056:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3416 00000100:00100000:0.0:1746143699.326522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.326789:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592403584 00000100:00100000:2.0:1746143699.326808:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592403584 00000100:00100000:2.0:1746143699.326852:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3417 00000100:00100000:2.0:1746143699.326860:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+23:28602:x1830963592403584:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1746143699.327089:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+24:28602:x1830963592403584:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 228us (575us total) trans 8589942481 rc 0/0 00000100:00100000:2.0:1746143699.327096:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3417 00000100:00100000:0.0:1746143699.339878:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.339913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.339932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.339963:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.340036:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592403968 00000100:00100000:3.0:1746143699.340046:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592403968 00002000:00100000:3.0:1746143699.340090:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008f3c8000 x1830963592403968/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.340099:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8000 with x1830963592403968 ext(0->1048575) 00002000:00010000:3.0:1746143699.340105:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c8000 00000100:00100000:3.0:1746143699.340121:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592404096 00000100:00100000:3.0:1746143699.340123:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592404096 00002000:00100000:3.0:1746143699.340133:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880090765880 x1830963592404096/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.340169:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765880 with x1830963592404096 ext(1048576->2097151) 00002000:00010000:3.0:1746143699.340176:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090765880 00000100:00100000:3.0:1746143699.340186:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592404480 00000100:00100000:3.0:1746143699.340189:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592404480 00002000:00100000:3.0:1746143699.340202:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880090767800 x1830963592404480/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.340209:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767800 with x1830963592404480 ext(1048576->2097151) 00002000:00010000:3.0:1746143699.340212:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767800 00000100:00100000:3.0:1746143699.340233:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592404352 00000100:00100000:3.0:1746143699.340235:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592404352 00002000:00100000:3.0:1746143699.340248:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880090766300 x1830963592404352/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.340255:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766300 with x1830963592404352 ext(1048576->2097151) 00002000:00010000:3.0:1746143699.340258:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090766300 00000100:00100000:3.0:1746143699.340272:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3705 00000100:00100000:3.0:1746143699.340279:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592403968:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143699.342656:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3706 00000100:00100000:2.0:1746143699.342676:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592404096:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143699.343177:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3707 00000100:00100000:1.0:1746143699.343189:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963592404480:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143699.343636:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3708 00000100:00100000:0.0:1746143699.343647:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963592404352:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143699.363415:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963592404352:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19759us (23439us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143699.363428:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3708 00002000:00100000:2.0:1746143699.363447:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880090766300 x1830963592404352/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.363457:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766300 with x1830963592404352 ext(1048576->2097151) 00002000:00010000:2.0:1746143699.363475:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090766300 00000100:00100000:0.0:1746143699.367331:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.367498:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592404864 00000100:00100000:3.0:1746143699.367508:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592404864 00000100:00100000:3.0:1746143699.368578:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8362 00000100:00100000:3.0:1746143699.368590:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+30:28612:x1830963592404864:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143699.368618:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143699.368638:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb800/0xe984082ccd726883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a207c expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.368734:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72688a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.368748:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72688a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143699.368759:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72688a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:3.0:1746143699.368767:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143699.368886:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfb800/0xe984082ccd726883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a207c expref: 33 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.368921:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72688a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a207c expref: 32 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.368928:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143699.368932:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143699.368937:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bfa800, rc 0) 00000100:00100000:3.0:1746143699.368991:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+32:28612:x1830963592404864:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 403us (1670us total) trans 8589942482 rc 0/0 00000100:00100000:3.0:1746143699.368997:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8362 00000100:00100000:2.0:1746143699.369726:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592403968:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29445us (29855us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143699.369735:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3705 00002000:00100000:2.0:1746143699.369743:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff88008f3c8000 x1830963592403968/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.369752:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8000 with x1830963592403968 ext(0->1048575) 00002000:00010000:2.0:1746143699.369757:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c8000 00000100:00100000:0.0:1746143699.373129:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592404096:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30449us (33201us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143699.373176:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3706 00002000:00100000:0.0:1746143699.373189:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880090765880 x1830963592404096/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.373201:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765880 with x1830963592404096 ext(1048576->2097151) 00002000:00010000:0.0:1746143699.373207:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090765880 00000100:00100000:1.0:1746143699.378681:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592404480:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35482us (38733us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143699.378693:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3707 00002000:00100000:1.0:1746143699.378706:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880090767800 x1830963592404480/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.378714:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767800 with x1830963592404480 ext(1048576->2097151) 00002000:00010000:1.0:1746143699.378721:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767800 00000100:00100000:0.0:1746143699.408249:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.409353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.409699:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.409847:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592405120 00000100:00100000:1.0:1746143699.409858:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592405120 00000100:00100000:0.0:1746143699.409907:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:1.0:1746143699.409911:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880090766680 x1830963592405120/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.409921:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766680 with x1830963592405120 ext(2097152->3145727) 00002000:00010000:1.0:1746143699.409927:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090766680 00000100:00100000:1.0:1746143699.409945:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592405376 00000100:00100000:1.0:1746143699.409947:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592405376 00000100:00100000:0.0:1746143699.409951:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592405760 00000100:00100000:0.0:1746143699.409953:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592405760 00002000:00100000:1.0:1746143699.409957:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88012f186300 x1830963592405376/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.409963:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f186300 with x1830963592405376 ext(3145728->4194303) 00002000:00010000:1.0:1746143699.409965:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f186300 00002000:00100000:0.0:1746143699.409968:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88012f185c00 x1830963592405760/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.409974:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185c00 with x1830963592405760 ext(3145728->4194303) 00002000:00010000:0.0:1746143699.409978:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185c00 00000100:00100000:1.0:1746143699.409981:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592405632 00000100:00100000:1.0:1746143699.409982:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592405632 00000100:00100000:0.0:1746143699.409991:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3709 00002000:00100000:1.0:1746143699.409992:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012f185180 x1830963592405632/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.409998:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185180 with x1830963592405632 ext(2097152->3145727) 00000100:00100000:0.0:1746143699.409999:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592405120:12345-192.168.202.48@tcp:3:cat.0 00002000:00010000:1.0:1746143699.410000:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185180 00000100:00100000:1.0:1746143699.410009:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3710 00000100:00100000:1.0:1746143699.410013:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592405376:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143699.410061:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3711 00000100:00100000:2.0:1746143699.410089:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3712 00000100:00100000:2.0:1746143699.410097:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963592405632:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143699.415894:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1963:x1830963592405760:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143699.423134:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592405120:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13121us (14883us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143699.423163:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3709 00002000:00100000:1.0:1746143699.423177:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880090766680 x1830963592405120/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.423187:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766680 with x1830963592405120 ext(2097152->3145727) 00002000:00010000:1.0:1746143699.423193:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090766680 00000100:00100000:0.0:1746143699.429057:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.430093:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592406144 00000100:00100000:1.0:1746143699.430104:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592406144 00000100:00100000:1.0:1746143699.430190:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8363 00000100:00100000:1.0:1746143699.430198:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+270:28615:x1830963592406144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143699.430224:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.430242:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5549e00/0xe984082ccd726898 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2083 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.430354:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd72689f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430366:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd72689f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430376:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd72689f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430387:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd7268a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430393:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd7268a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430397:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd7268a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430493:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176000/0xe984082ccd7268ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430501:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176000/0xe984082ccd7268ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430506:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176000/0xe984082ccd7268ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143699.430513:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143699.430591:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd72689f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430597:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd72689f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430602:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd72689f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430607:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5548200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143699.430610:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd72689f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430615:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd72689f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430624:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143699.430628:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143699.430632:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd72689f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430637:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548200/0xe984082ccd72689f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430662:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd7268a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430667:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd7268a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430671:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd7268a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430675:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c177e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143699.430677:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd7268a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430680:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd7268a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430685:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009343f600) 00010000:00010000:1.0:1746143699.430687:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143699.430688:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd7268a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430692:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177e00/0xe984082ccd7268a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.430723:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5549e00/0xe984082ccd726898 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2083 expref: 273 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.431782:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176000/0xe984082ccd7268ad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2083 expref: 272 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.431789:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143699.431799:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143699.431801:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c176000, rc 0) 00000100:00100000:3.0:1746143699.431868:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963592405632:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21770us (21959us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143699.431878:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3712 00002000:00100000:3.0:1746143699.431888:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012f185180 x1830963592405632/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.431896:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185180 with x1830963592405632 ext(2097152->3145727) 00002000:00010000:3.0:1746143699.431901:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185180 00000100:00100000:1.0:1746143699.432193:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+272:28615:x1830963592406144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1994us (3145us total) trans 8589942483 rc 0/0 00000100:00100000:1.0:1746143699.432200:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8363 00000100:00100000:0.0:1746143699.441580:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.444732:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592405760:12345-192.168.202.48@tcp:3:cat.0 Request processed in 34657us (35025us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143699.444742:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3711 00002000:00100000:0.0:1746143699.444751:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88012f185c00 x1830963592405760/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.444760:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185c00 with x1830963592405760 ext(3145728->4194303) 00002000:00010000:0.0:1746143699.444766:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185c00 00000100:00100000:0.0:1746143699.445046:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.445065:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592406528 00000100:00100000:0.0:1746143699.445071:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592406528 00000100:00100000:0.0:1746143699.445114:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3418 00000100:00100000:0.0:1746143699.445120:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+272:28615:x1830963592406528:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1746143699.445289:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+273:28615:x1830963592406528:12345-192.168.202.48@tcp:35:cat.0 Request processed in 168us (242us total) trans 8589942484 rc 0/0 00000100:00100000:0.0:1746143699.445294:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3418 00000100:00100000:1.0:1746143699.445414:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1963:x1830963592405376:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35398us (36062us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143699.445421:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3710 00002000:00100000:1.0:1746143699.445425:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88012f186300 x1830963592405376/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.445432:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f186300 with x1830963592405376 ext(3145728->4194303) 00002000:00010000:1.0:1746143699.445436:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f186300 00000100:00100000:2.0:1746143699.449403:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592406272 00000100:00100000:2.0:1746143699.449414:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592406272 00000100:00100000:3.0:1746143699.449521:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9938 00000100:00100000:3.0:1746143699.449528:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+12:28612:x1830963592406272:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143699.449545:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143699.449559:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a208a expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.449585:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5a00/0xe984082ccd726867 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a206e expref: 13 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143699.449593:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.449594:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.449597:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2183168->2654207] (req 2183168->2654207) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 13 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.449621:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5a00/0xe984082ccd726867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a206e expref: 13 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143699.449631:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5a00/0xe984082ccd726867 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a206e expref: 13 pid: 6929 timeout: 878 lvb_type: 1 00000100:00100000:3.0:1746143699.449642:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593791488:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143699.449731:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.450375:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.450417:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.450476:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592406656 00000100:00100000:1.0:1746143699.450480:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592406656 00000100:00100000:1.0:1746143699.450512:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 574 00000100:00100000:1.0:1746143699.450517:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+273:1965:x1830963592406656:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143699.450525:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143699.450541:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c176000/0xe984082ccd7268ad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2083 expref: 273 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.450560:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143699.450564:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143699.450587:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+272:1965:x1830963592406656:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 70us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.450593:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 574 00000100:00100000:2.0:1746143699.450789:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592406784 00000100:00100000:2.0:1746143699.450801:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592406784 00000100:00100000:2.0:1746143699.450829:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9939 00000100:00100000:2.0:1746143699.450834:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28604:x1830963592406784:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143699.450842:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.450851:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2091 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.450866:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726875 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2075 expref: 20 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.450872:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.450873:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.450876:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3710976->4194303] (req 3710976->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 21 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.450895:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726875 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2075 expref: 20 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.450902:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726875 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2075 expref: 20 pid: 21542 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746143699.450910:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593791616:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143699.450944:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.452942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.454636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.454655:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.454667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.455088:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592407040 00000100:00100000:1.0:1746143699.455094:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592407040 00000100:00100000:1.0:1746143699.455125:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592406912 00000100:00100000:1.0:1746143699.455127:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592406912 00000100:00100000:1.0:1746143699.455136:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592407296 00000100:00100000:1.0:1746143699.455152:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592407296 00000100:00100000:2.0:1746143699.455238:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963593791488:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143699.455261:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2183168->2654207] (req 2183168->2654207) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 13 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.455275:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034ac00, rc 0) 00000100:00100000:2.0:1746143699.455308:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28612:x1830963592406272:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5780us (13736us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.455315:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9938 00000100:00100000:2.0:1746143699.455338:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592407552 00000100:00100000:2.0:1746143699.455340:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592407552 00000100:00100000:1.0:1746143699.455646:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9940 00000100:00100000:1.0:1746143699.455653:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592407040:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143699.455664:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.455676:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c2d800/0xe984082ccd7268c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a209f expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.455692:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.455693:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.455700:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c2d800/0xe984082ccd7268c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a209f expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.455712:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c2d800/0xe984082ccd7268c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a209f expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.455718:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c2d800, rc 0) 00000100:00100000:1.0:1746143699.455734:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592407040:12345-192.168.202.48@tcp:101:cat.0 Request processed in 82us (2798us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.455739:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9940 00000100:00100000:1.0:1746143699.455750:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9941 00000100:00100000:1.0:1746143699.455754:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592406912:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143699.455761:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.455768:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c2c200/0xe984082ccd7268d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2098 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.455777:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.455779:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.455782:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c2c200/0xe984082ccd7268d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2098 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.455802:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c2c200/0xe984082ccd7268d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2098 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.455809:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c2c200, rc 0) 00000100:00100000:1.0:1746143699.455823:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592406912:12345-192.168.202.48@tcp:101:cat.0 Request processed in 68us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.455827:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9941 00000100:00100000:1.0:1746143699.455836:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9942 00000100:00100000:1.0:1746143699.455840:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592407296:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143699.455845:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.455851:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c176a00/0xe984082ccd7268d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a20ad expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.455860:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.455862:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.455865:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c176a00/0xe984082ccd7268d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ad expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.455873:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c176a00/0xe984082ccd7268d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ad expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.455879:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c176a00, rc 0) 00000100:00100000:1.0:1746143699.455891:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592407296:12345-192.168.202.48@tcp:101:cat.0 Request processed in 51us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.455896:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9942 00000100:00100000:1.0:1746143699.455904:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9943 00000100:00100000:1.0:1746143699.455908:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592407552:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143699.455913:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.455919:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c176800/0xe984082ccd7268de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a20bb expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.455927:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.455933:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c176800/0xe984082ccd7268de lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20bb expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.455940:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c176800/0xe984082ccd7268de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20bb expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143699.455948:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c176800, rc 0) 00000100:00100000:1.0:1746143699.455959:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592407552:12345-192.168.202.48@tcp:101:cat.0 Request processed in 51us (1291us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143699.455966:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9943 00000100:00100000:2.0:1746143699.456073:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963593791616:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143699.456089:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3710976->4194303] (req 3710976->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.456097:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a29c800, rc 0) 00000100:00100000:2.0:1746143699.456111:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:28604:x1830963592406784:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5277us (5694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.456116:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9939 00000100:00100000:2.0:1746143699.456176:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.456187:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592407168 00000100:00100000:2.0:1746143699.456189:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592407168 00000100:00100000:2.0:1746143699.456203:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9944 00000100:00100000:2.0:1746143699.456207:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592407168:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143699.456213:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.456219:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff800/0xe984082ccd7268e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a20a6 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.456229:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.456230:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.456234:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff800/0xe984082ccd7268e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20a6 expref: 23 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.456243:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff800/0xe984082ccd7268e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20a6 expref: 23 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.456250:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21ff800, rc 0) 00000100:00100000:2.0:1746143699.456263:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592407168:12345-192.168.202.48@tcp:101:cat.0 Request processed in 55us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.456267:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9944 00000100:00100000:2.0:1746143699.456298:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.456308:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592407424 00000100:00100000:2.0:1746143699.456310:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592407424 00000100:00100000:2.0:1746143699.456322:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9945 00000100:00100000:2.0:1746143699.456326:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592407424:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143699.456332:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.456338:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a21fe600/0xe984082ccd7268ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a20b4 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.456346:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.456351:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a21fe600/0xe984082ccd7268ec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20b4 expref: 26 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.456357:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fe600/0xe984082ccd7268ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20b4 expref: 26 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.456369:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21fe600, rc 0) 00000100:00100000:2.0:1746143699.456381:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592407424:12345-192.168.202.48@tcp:101:cat.0 Request processed in 55us (84us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143699.456386:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9945 00000100:00100000:2.0:1746143699.456413:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.456421:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592407680 00000100:00100000:2.0:1746143699.456424:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592407680 00000100:00100000:2.0:1746143699.456436:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9946 00000100:00100000:2.0:1746143699.456440:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28608:x1830963592407680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143699.456446:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.456451:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd7268f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a20c2 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.456461:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.456464:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3710976->4194303] (req 3710976->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.456474:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143699.456477:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd7268f3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c2 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.456498:0:8496:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3710976->4194303] (req 3710976->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.456506:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd7268f3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c2 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.456513:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21fe200, rc 0) 00000100:00100000:2.0:1746143699.456526:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28608:x1830963592407680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 86us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.456530:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9946 00000100:00100000:2.0:1746143699.456634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.456650:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592407808 00000100:00100000:2.0:1746143699.456653:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592407808 00010000:00010000:2.0:1746143699.456665:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726875 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2075 expref: 22 pid: 21542 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746143699.456687:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5159 00000100:00100000:2.0:1746143699.456691:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1962:x1830963592407808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143699.456698:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143699.456715:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726875 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2075 expref: 22 pid: 21542 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746143699.456727:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726875 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2075 expref: 22 pid: 21542 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746143699.456738:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726875 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2075 expref: 22 pid: 21542 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746143699.456746:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.456747:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.456750:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.456756:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.456772:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.456780:0:9890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 22 pid: 8496 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746143699.456789:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593791872:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143699.456833:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143699.458206:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.458255:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592407936 00000100:00100000:2.0:1746143699.458259:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592407936 00010000:00010000:2.0:1746143699.458275:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5a00/0xe984082ccd726867 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a206e expref: 13 pid: 6929 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746143699.458297:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5160 00000100:00100000:2.0:1746143699.458302:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592407936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143699.458310:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143699.458323:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5a00/0xe984082ccd726867 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a206e expref: 13 pid: 6929 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746143699.458331:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5a00/0xe984082ccd726867 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a206e expref: 13 pid: 6929 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746143699.458344:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5a00/0xe984082ccd726867 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a206e expref: 13 pid: 6929 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746143699.458354:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.458356:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.458360:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 12 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.458366:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 12 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.458387:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 12 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143699.458395:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593792000:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143699.458440:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.458951:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963593791872:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143699.458964:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143699.459253:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963592407808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2560us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.459261:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5159 00000100:00100000:0.0:1746143699.459524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.459779:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592408192 00000100:00100000:1.0:1746143699.459783:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592408192 00002000:00100000:1.0:1746143699.459820:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3710976->3715071) req@ffff8800a63a3800 x1830963592408192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.459828:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a3800 with x1830963592408192 ext(3710976->3715071) 00010000:00010000:1.0:1746143699.459834:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 23 pid: 8496 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.459845:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 23 pid: 8496 timeout: 878 lvb_type: 0 00002000:00010000:1.0:1746143699.459851:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a63a3800 00000100:00100000:1.0:1746143699.459862:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 911 00000100:00100000:1.0:1746143699.459868:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592408192:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143699.459997:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592408192:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 128us (472us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143699.460002:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 911 00002000:00100000:1.0:1746143699.460007:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3710976->3715071) req@ffff8800a63a3800 x1830963592408192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.460014:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a3800 with x1830963592408192 ext(3710976->3715071) 00010000:00010000:1.0:1746143699.460018:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 23 pid: 8496 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.460031:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 23 pid: 8496 timeout: 878 lvb_type: 0 00002000:00010000:1.0:1746143699.460036:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a63a3800 00000100:00100000:0.0:1746143699.468623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.468703:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592408448 00000100:00100000:2.0:1746143699.468711:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592408448 00002000:00100000:2.0:1746143699.468745:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3710976->4194303) req@ffff8800a63a0700 x1830963592408448/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143699.468834:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963593792000:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143699.468850:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.468884:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592407936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10581us (10679us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.468893:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5160 00002000:00100000:2.0:1746143699.468938:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a0700 with x1830963592408448 ext(3710976->4194303) 00010000:00010000:2.0:1746143699.468946:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 23 pid: 8496 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.468957:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 23 pid: 8496 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746143699.468963:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a63a0700 00000100:00100000:2.0:1746143699.468986:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 912 00000100:00100000:2.0:1746143699.468993:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592408448:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143699.470048:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.470083:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592408704 00000100:00100000:1.0:1746143699.470088:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592408704 00002000:00100000:1.0:1746143699.470107:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2183168->2187263) req@ffff8800a63a0a80 x1830963592408704/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.470114:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a0a80 with x1830963592408704 ext(2183168->2187263) 00002000:00010000:1.0:1746143699.470118:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a0a80 00000100:00100000:1.0:1746143699.470183:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3713 00000100:00100000:1.0:1746143699.470189:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592408704:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143699.470301:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592408704:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 112us (254us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143699.470307:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3713 00002000:00100000:1.0:1746143699.470312:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2183168->2187263) req@ffff8800a63a0a80 x1830963592408704/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.470318:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a0a80 with x1830963592408704 ext(2183168->2187263) 00002000:00010000:1.0:1746143699.470321:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a0a80 00000100:00100000:0.0:1746143699.471551:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.471634:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592408832 00000100:00100000:1.0:1746143699.471638:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592408832 00000100:00100000:1.0:1746143699.471704:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9947 00000100:00100000:1.0:1746143699.471711:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28604:x1830963592408832:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143699.471724:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.471737:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a20c9 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.471758:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 11 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.471765:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143699.471766:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143699.471769:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [4194304->4497407] (req 4194304->4497407) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.471807:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 11 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.471816:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 11 pid: 9527 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.471826:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593792128:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143699.472428:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.476770:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.477317:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592409088 00000100:00100000:3.0:1746143699.477325:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592409088 00002000:00100000:3.0:1746143699.477368:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880094305f80 x1830963592409088/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.477380:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305f80 with x1830963592409088 ext(0->1048575) 00002000:00010000:3.0:1746143699.477387:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305f80 00000100:00100000:3.0:1746143699.477419:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3714 00000100:00100000:3.0:1746143699.477425:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592409088:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143699.479809:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.479928:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592409344 00000100:00100000:1.0:1746143699.479934:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592409344 00002000:00100000:1.0:1746143699.479964:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880094304380 x1830963592409344/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.479978:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304380 with x1830963592409344 ext(1048576->2097151) 00002000:00010000:1.0:1746143699.479983:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304380 00000100:00100000:1.0:1746143699.479999:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3715 00000100:00100000:1.0:1746143699.480009:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592409344:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143699.484268:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593792128:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143699.484295:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [4194304->4497407] (req 4194304->4497407) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.484313:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c176000, rc 0) 00000100:00100000:3.0:1746143699.484345:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28604:x1830963592408832:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 12634us (12797us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.484353:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9947 00000100:00100000:3.0:1746143699.484525:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.484570:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.484585:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592409600 00000100:00100000:3.0:1746143699.484590:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592409600 00002000:00100000:3.0:1746143699.484619:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880094c0e680 x1830963592409600/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.484627:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0e680 with x1830963592409600 ext(1048576->2097151) 00002000:00010000:3.0:1746143699.484631:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0e680 00000100:00100000:3.0:1746143699.484643:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592409856 00000100:00100000:3.0:1746143699.484645:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592409856 00002000:00100000:3.0:1746143699.484656:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094c0fb80 x1830963592409856/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.484663:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0fb80 with x1830963592409856 ext(1048576->2097151) 00002000:00010000:3.0:1746143699.484665:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0fb80 00000100:00100000:3.0:1746143699.484674:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3716 00000100:00100000:3.0:1746143699.484680:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592409600:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143699.485034:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.485050:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592410112 00000100:00100000:0.0:1746143699.485052:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592410112 00002000:00100000:0.0:1746143699.485066:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2650112->2654207) req@ffff880094304000 x1830963592410112/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.485072:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304000 with x1830963592410112 ext(2650112->2654207) 00010000:00010000:0.0:1746143699.485076:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 12 pid: 9527 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.485085:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 12 pid: 9527 timeout: 878 lvb_type: 0 00002000:00010000:0.0:1746143699.485091:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304000 00000100:00100000:0.0:1746143699.485108:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 913 00000100:00100000:0.0:1746143699.485113:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592410112:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143699.485204:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592410112:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 91us (170us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143699.485209:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 913 00002000:00100000:0.0:1746143699.485213:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2650112->2654207) req@ffff880094304000 x1830963592410112/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.485218:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304000 with x1830963592410112 ext(2650112->2654207) 00010000:00010000:0.0:1746143699.485222:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 12 pid: 9527 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.485229:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 12 pid: 9527 timeout: 878 lvb_type: 0 00002000:00010000:0.0:1746143699.485233:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304000 00000100:00100000:0.0:1746143699.485243:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3717 00000100:00100000:0.0:1746143699.485246:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592409856:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143699.496227:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592408448:12345-192.168.202.48@tcp:4:cat.0 Request processed in 27223us (27605us total) trans 21474839775 rc 0/0 00000100:00100000:2.0:1746143699.496237:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 912 00002000:00100000:2.0:1746143699.496250:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34c:0x0] (3710976->4194303) req@ffff8800a63a0700 x1830963592408448/t21474839775(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/448 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.496260:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a0700 with x1830963592408448 ext(3710976->4194303) 00010000:00010000:2.0:1746143699.496269:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 29 pid: 8496 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.496281:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 29 pid: 8496 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746143699.496291:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a63a0700 00000100:00100000:3.0:1746143699.497716:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592409088:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20285us (20947us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143699.497724:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3714 00002000:00100000:3.0:1746143699.497731:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880094305f80 x1830963592409088/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.497739:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305f80 with x1830963592409088 ext(0->1048575) 00002000:00010000:3.0:1746143699.497742:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305f80 00000100:00100000:0.0:1746143699.499997:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.500073:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592410368 00000100:00100000:3.0:1746143699.500081:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592410368 00002000:00100000:3.0:1746143699.500113:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2183168->2654207) req@ffff880094305500 x1830963592410368/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.500122:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305500 with x1830963592410368 ext(2183168->2654207) 00010000:00010000:3.0:1746143699.500130:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 12 pid: 9527 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.500163:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 12 pid: 9527 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746143699.500169:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094305500 00000100:00100000:3.0:1746143699.500770:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 914 00000100:00100000:3.0:1746143699.500777:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1964:x1830963592410368:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143699.504011:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592409600:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19323us (19478us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143699.504020:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3716 00002000:00100000:3.0:1746143699.504029:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880094c0e680 x1830963592409600/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.504038:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0e680 with x1830963592409600 ext(1048576->2097151) 00002000:00010000:3.0:1746143699.504043:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0e680 00000100:00100000:0.0:1746143699.507638:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.508477:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592410496 00000100:00100000:3.0:1746143699.508484:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592410496 00010000:00010000:3.0:1746143699.508515:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 27 pid: 8496 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746143699.508538:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5161 00000100:00100000:3.0:1746143699.508544:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592410496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143699.508553:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143699.508568:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143698 -> 1746143699 00002000:00010000:3.0:1746143699.508571:0:7150:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143698 -> 1746143699 00010000:00010000:3.0:1746143699.508575:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 27 pid: 8496 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.508583:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 27 pid: 8496 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.508600:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a29c800/0xe984082ccd7268c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2091 expref: 27 pid: 8496 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.508738:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.508740:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.508746:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd7268f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c2 expref: 20 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.508753:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd7268f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c2 expref: 20 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.508781:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd7268f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c2 expref: 20 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143699.508803:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593792256:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143699.509834:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143699.513531:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592409856:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28273us (28950us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143699.513542:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3717 00002000:00100000:1.0:1746143699.513554:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880094c0fb80 x1830963592409856/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.513563:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0fb80 with x1830963592409856 ext(1048576->2097151) 00002000:00010000:1.0:1746143699.513567:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0fb80 00000100:00100000:0.0:1746143699.515466:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592409344:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35455us (35669us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143699.515474:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3715 00002000:00100000:0.0:1746143699.515481:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880094304380 x1830963592409344/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.515489:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304380 with x1830963592409344 ext(1048576->2097151) 00002000:00010000:0.0:1746143699.515492:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304380 00000100:00100000:3.0:1746143699.519827:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592410368:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 19042us (19828us total) trans 17179872508 rc 0/0 00000100:00100000:3.0:1746143699.519838:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 914 00002000:00100000:3.0:1746143699.519848:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (2183168->2654207) req@ffff880094305500 x1830963592410368/t17179872508(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/448 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.519857:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305500 with x1830963592410368 ext(2183168->2654207) 00010000:00010000:3.0:1746143699.519866:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 14 pid: 9527 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.519881:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 14 pid: 9527 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746143699.519887:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094305500 00000100:00100000:0.0:1746143699.524957:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.525005:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.525020:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592410752 00000100:00100000:2.0:1746143699.525027:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592410752 00002000:00100000:2.0:1746143699.525067:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880094307100 x1830963592410752/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.525074:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307100 with x1830963592410752 ext(3145728->4194303) 00002000:00010000:2.0:1746143699.525080:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094307100 00000100:00100000:2.0:1746143699.525105:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3718 00000100:00100000:2.0:1746143699.525112:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963592410752:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143699.525176:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592410880 00000100:00100000:1.0:1746143699.525180:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592410880 00010000:00010000:1.0:1746143699.525196:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 14 pid: 9527 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.525216:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5162 00000100:00100000:1.0:1746143699.525221:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1964:x1830963592410880:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143699.525228:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143699.525245:0:9890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143698 -> 1746143699 00002000:00010000:1.0:1746143699.525247:0:9890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143698 -> 1746143699 00010000:00010000:1.0:1746143699.525251:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 14 pid: 9527 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.525261:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 14 pid: 9527 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.525276:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a034ac00/0xe984082ccd7268bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2654207) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a208a expref: 14 pid: 9527 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.525300:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.525302:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.525308:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.525315:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143699.525411:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963593792256:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143699.525425:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.525460:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963592410496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 16916us (17828us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.525466:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5161 00010000:00010000:1.0:1746143699.525542:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143699.525554:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593792384:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143699.527004:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143699.527902:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593792384:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143699.527921:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143699.527947:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1964:x1830963592410880:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2724us (2940us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.527954:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5162 00000100:00100000:2.0:1746143699.531053:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.531097:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592411136 00000100:00100000:0.0:1746143699.531105:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592411136 00002000:00100000:0.0:1746143699.531161:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (4493312->4497407) req@ffff88009c3fb100 x1830963592411136/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.531170:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb100 with x1830963592411136 ext(4493312->4497407) 00002000:00010000:0.0:1746143699.531175:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb100 00000100:00100000:1.0:1746143699.531201:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3719 00000100:00100000:1.0:1746143699.531210:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592411136:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143699.531475:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592411136:12345-192.168.202.48@tcp:3:cat.0 Request processed in 265us (525us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143699.531481:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3719 00002000:00100000:1.0:1746143699.531486:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (4493312->4497407) req@ffff88009c3fb100 x1830963592411136/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.531493:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb100 with x1830963592411136 ext(4493312->4497407) 00002000:00010000:1.0:1746143699.531495:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb100 00000100:00100000:0.0:1746143699.534046:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.534165:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592411392 00000100:00100000:1.0:1746143699.534172:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592411392 00002000:00100000:1.0:1746143699.534204:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094307b80 x1830963592411392/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.534212:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307b80 with x1830963592411392 ext(2097152->3145727) 00002000:00010000:1.0:1746143699.534217:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307b80 00000100:00100000:1.0:1746143699.534557:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3720 00000100:00100000:1.0:1746143699.534565:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592411392:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143699.536909:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.537627:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592411648 00000100:00100000:3.0:1746143699.537635:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592411648 00000100:00100000:3.0:1746143699.537682:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3419 00000100:00100000:3.0:1746143699.537689:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+272:28604:x1830963592411648:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143699.538358:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+273:28604:x1830963592411648:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 668us (1453us total) trans 8589942485 rc 0/0 00000100:00100000:3.0:1746143699.538365:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3419 00000100:00100000:3.0:1746143699.539263:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963592410752:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 14150us (14311us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143699.539272:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3718 00002000:00100000:3.0:1746143699.539281:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff880094307100 x1830963592410752/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.539289:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307100 with x1830963592410752 ext(3145728->4194303) 00002000:00010000:3.0:1746143699.539294:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094307100 00000100:00100000:1.0:1746143699.548246:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592411392:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13673us (14198us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143699.548256:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3720 00002000:00100000:1.0:1746143699.548264:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880094307b80 x1830963592411392/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.548271:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307b80 with x1830963592411392 ext(2097152->3145727) 00002000:00010000:1.0:1746143699.548276:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307b80 00000100:00100000:0.0:1746143699.550334:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.550423:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592411776 00000100:00100000:3.0:1746143699.550430:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592411776 00000100:00100000:3.0:1746143699.550478:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9948 00000100:00100000:3.0:1746143699.550484:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592411776:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143699.550498:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143699.550511:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d59ec00/0xe984082ccd726901 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a20d0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143699.550552:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593792512:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143699.550643:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.556629:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.557169:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592411904 00000100:00100000:2.0:1746143699.557178:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592411904 00000100:00100000:2.0:1746143699.557229:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9949 00000100:00100000:2.0:1746143699.557236:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28615:x1830963592411904:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143699.557253:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.557268:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57f4a00/0xe984082ccd726908 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a20d7 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.557288:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.557290:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.557297:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57f4a00/0xe984082ccd726908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20d7 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.557309:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57f4a00/0xe984082ccd726908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20d7 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.557323:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f4a00, rc 0) 00000100:00100000:2.0:1746143699.557361:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28615:x1830963592411904:12345-192.168.202.48@tcp:101:cat.0 Request processed in 125us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.557367:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9949 00002000:00010000:3.0:1746143699.557754:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime: 1746143697 -> 1746143699 00000100:00100000:3.0:1746143699.557771:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593792512:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143699.557803:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d59ec00/0xe984082ccd726901 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20d0 expref: 14 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143699.557816:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d59ec00/0xe984082ccd726901 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20d0 expref: 14 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143699.557831:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d59ec00, rc 0) 00000100:00100000:3.0:1746143699.557851:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1963:x1830963592411776:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7367us (7523us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143699.557855:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9948 00000100:00100000:0.0:1746143699.567413:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.567451:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.567475:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.567491:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592412032 00000100:00100000:3.0:1746143699.567499:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592412032 00000100:00100000:0.0:1746143699.567511:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.567532:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592412288 00000100:00100000:2.0:1746143699.567536:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592412288 00000100:00100000:3.0:1746143699.567538:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9950 00000100:00100000:3.0:1746143699.567544:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+13:28608:x1830963592412032:12345-192.168.202.48@tcp:101:cat.0 00002000:00100000:2.0:1746143699.567564:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012e1e3800 x1830963592412288/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.567571:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e3800 with x1830963592412288 ext(2097152->3145727) 00002000:00010000:2.0:1746143699.567575:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e1e3800 00000100:00100000:2.0:1746143699.567587:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592412544 00000100:00100000:1.0:1746143699.567588:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592412800 00000100:00100000:2.0:1746143699.567589:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592412544 00000100:00100000:1.0:1746143699.567591:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592412800 00002000:00100000:2.0:1746143699.567597:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88012e1e0000 x1830963592412544/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.567603:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0000 with x1830963592412544 ext(3145728->4194303) 00002000:00100000:1.0:1746143699.567604:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88012e1e1500 x1830963592412800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746143699.567605:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e1e0000 00002000:00100000:1.0:1746143699.567610:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e1500 with x1830963592412800 ext(3145728->4194303) 00002000:00010000:1.0:1746143699.567612:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e1500 00000100:00100000:2.0:1746143699.567614:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3721 00000100:00100000:2.0:1746143699.567618:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963592412288:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143699.567623:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3722 00000100:00100000:1.0:1746143699.567626:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963592412544:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143699.567665:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3723 00000100:00100000:2.0:1746143699.567669:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963592412800:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:3.0:1746143699.568756:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143699.568772:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a20de expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.568806:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.568814:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143699.568816:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143699.568819:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 14 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.568841:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.568855:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 27 pid: 25369 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746143699.568865:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593792640:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143699.568910:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143699.583412:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593792640:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143699.583439:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 14 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.583454:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d59fa00, rc 0) 00000100:00100000:3.0:1746143699.583575:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28608:x1830963592412032:12345-192.168.202.48@tcp:101:cat.0 Request processed in 16029us (16166us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.583582:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9950 00000100:00100000:1.0:1746143699.586130:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592412288:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18505us (18672us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143699.586164:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3721 00002000:00100000:1.0:1746143699.586176:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012e1e3800 x1830963592412288/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.586185:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e3800 with x1830963592412288 ext(2097152->3145727) 00002000:00010000:1.0:1746143699.586190:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e1e3800 00000100:00100000:2.0:1746143699.586615:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963592412800:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18943us (19101us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143699.586624:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3723 00002000:00100000:2.0:1746143699.586631:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88012e1e1500 x1830963592412800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.586639:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e1500 with x1830963592412800 ext(3145728->4194303) 00010000:00010000:2.0:1746143699.586649:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 26 pid: 25369 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.586663:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 26 pid: 25369 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746143699.586668:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e1e1500 00000100:00100000:0.0:1746143699.590983:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.591367:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592412928 00000100:00100000:2.0:1746143699.591375:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592412928 00002000:00100000:2.0:1746143699.591417:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4497407) req@ffff88012e1e3100 x1830963592412928/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.591426:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e3100 with x1830963592412928 ext(4194304->4497407) 00010000:00010000:2.0:1746143699.591434:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 26 pid: 25369 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.591446:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 26 pid: 25369 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746143699.591452:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e1e3100 00000100:00100000:2.0:1746143699.591475:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 915 00000100:00100000:2.0:1746143699.591485:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592412928:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143699.592613:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592412544:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24982us (25134us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143699.592622:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3722 00002000:00100000:1.0:1746143699.592629:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88012e1e0000 x1830963592412544/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.592636:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0000 with x1830963592412544 ext(3145728->4194303) 00002000:00010000:1.0:1746143699.592639:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e1e0000 00000100:00100000:0.0:1746143699.592697:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.592758:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592413056 00000100:00100000:3.0:1746143699.592762:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592413056 00000100:00100000:3.0:1746143699.592804:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9951 00000100:00100000:3.0:1746143699.592810:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28615:x1830963592413056:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143699.592819:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143699.592831:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d59ee00/0xe984082ccd726916 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a20e5 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.592847:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143699.592849:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143699.592853:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d59ee00/0xe984082ccd726916 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20e5 expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.592867:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d59ee00/0xe984082ccd726916 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20e5 expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.592875:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d59ee00, rc 0) 00000100:00100000:3.0:1746143699.592903:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:28615:x1830963592413056:12345-192.168.202.48@tcp:101:cat.0 Request processed in 88us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.592908:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9951 00000100:00100000:2.0:1746143699.597595:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592412928:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6106us (6611us total) trans 17179872509 rc 0/0 00000100:00100000:2.0:1746143699.597608:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 915 00002000:00100000:2.0:1746143699.597618:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4497407) req@ffff88012e1e3100 x1830963592412928/t17179872509(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/448 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.597626:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e3100 with x1830963592412928 ext(4194304->4497407) 00010000:00010000:2.0:1746143699.597635:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 29 pid: 25369 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.597648:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 29 pid: 25369 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746143699.597654:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e1e3100 00010000:00010000:1.0:1746143699.603421:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143699.606294:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.606343:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592413184 00000100:00100000:2.0:1746143699.606351:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592413184 00010000:00010000:2.0:1746143699.606383:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 29 pid: 25369 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746143699.606407:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5163 00000100:00100000:2.0:1746143699.606415:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592413184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143699.606427:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143699.606445:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 29 pid: 25369 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.606457:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 29 pid: 25369 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.606479:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c176000/0xe984082ccd7268fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4497407) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c9 expref: 29 pid: 25369 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.606496:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.606498:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.606508:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 13 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.606516:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 13 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.606523:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.606524:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.606527:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d59ee00/0xe984082ccd726916 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20e5 expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.606533:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d59ee00/0xe984082ccd726916 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20e5 expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.606559:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d59ee00/0xe984082ccd726916 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20e5 expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143699.606569:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593792768:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143699.606882:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 13 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143699.606894:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593792896:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143699.606912:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143699.613108:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593792768:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143699.616438:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963593792896:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143699.616460:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143699.616506:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592413184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10090us (10218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.616516:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5163 00000100:00100000:0.0:1746143699.619507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.619823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.620454:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592413568 00000100:00100000:2.0:1746143699.620462:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592413568 00002000:00100000:2.0:1746143699.620498:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88012e1e0a80 x1830963592413568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.620507:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0a80 with x1830963592413568 ext(3145728->4194303) 00002000:00010000:2.0:1746143699.620512:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e0a80 00000100:00100000:2.0:1746143699.620532:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592413696 00000100:00100000:2.0:1746143699.620535:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592413696 00002000:00100000:2.0:1746143699.620546:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88012e1e2d80 x1830963592413696/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.620552:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e2d80 with x1830963592413696 ext(4194304->4898815) 00002000:00010000:2.0:1746143699.620554:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e2d80 00000100:00100000:2.0:1746143699.620910:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3724 00000100:00100000:2.0:1746143699.620918:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592413568:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143699.622286:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3725 00000100:00100000:0.0:1746143699.622294:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592413696:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143699.635796:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592413568:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14861us (16279us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143699.635808:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3724 00002000:00100000:2.0:1746143699.635819:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88012e1e0a80 x1830963592413568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.635828:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e0a80 with x1830963592413568 ext(3145728->4194303) 00002000:00010000:2.0:1746143699.635832:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e0a80 00000100:00100000:2.0:1746143699.636706:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592413696:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14412us (16882us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143699.636713:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3725 00002000:00100000:2.0:1746143699.636718:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88012e1e2d80 x1830963592413696/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.636725:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e2d80 with x1830963592413696 ext(4194304->4898815) 00002000:00010000:2.0:1746143699.636728:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e2d80 00000100:00100000:0.0:1746143699.650262:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.650358:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592413952 00000100:00100000:2.0:1746143699.650366:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592413952 00002000:00100000:2.0:1746143699.650405:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88012e1e1c00 x1830963592413952/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.650414:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e1c00 with x1830963592413952 ext(4194304->4898815) 00002000:00010000:2.0:1746143699.650418:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e1c00 00000100:00100000:2.0:1746143699.650435:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3726 00000100:00100000:2.0:1746143699.650441:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592413952:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143699.657806:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592413952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7348us (7535us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143699.657816:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3726 00002000:00100000:2.0:1746143699.657827:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88012e1e1c00 x1830963592413952/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.657836:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e1e1c00 with x1830963592413952 ext(4194304->4898815) 00002000:00010000:2.0:1746143699.657842:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e1e1c00 00000100:00100000:0.0:1746143699.751449:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.751523:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592414080 00000100:00100000:1.0:1746143699.751532:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592414080 00000100:00100000:1.0:1746143699.751583:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9952 00000100:00100000:1.0:1746143699.751590:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+21:28621:x1830963592414080:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143699.751606:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.751621:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a20ec expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.751648:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd7268f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c2 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.751656:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57f4a00/0xe984082ccd726908 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20d7 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.751662:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.751663:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.751666:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2957312->3145727] (req 2957312->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.751690:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57f4a00/0xe984082ccd726908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20d7 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.751700:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57f4a00/0xe984082ccd726908 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20d7 expref: 24 pid: 8495 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.751710:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593793024:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.751823:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd7268f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c2 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.751831:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd7268f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c2 expref: 22 pid: 8496 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.751838:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593793152:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143699.751857:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143699.758123:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593793024:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143699.758703:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.758823:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593793152:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.758851:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2957312->3145727] (req 2957312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.758865:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e90600, rc 0) 00000100:00100000:1.0:1746143699.758915:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28621:x1830963592414080:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7324us (7472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.758922:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9952 00000100:00100000:0.0:1746143699.760958:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.761027:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592414208 00000100:00100000:3.0:1746143699.761034:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592414208 00010000:00010000:3.0:1746143699.761062:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57f4a00/0xe984082ccd726908 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20d7 expref: 25 pid: 8495 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746143699.761070:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592414336 00000100:00100000:2.0:1746143699.761074:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592414336 00000100:00100000:3.0:1746143699.761086:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5164 00010000:00010000:2.0:1746143699.761090:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd7268f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c2 expref: 22 pid: 8496 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746143699.761092:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592414208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143699.761104:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143699.761109:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5165 00000100:00100000:2.0:1746143699.761115:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592414336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143699.761122:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143699.761123:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57f4a00/0xe984082ccd726908 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20d7 expref: 25 pid: 8495 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.761131:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd7268f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c2 expref: 22 pid: 8496 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.761133:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57f4a00/0xe984082ccd726908 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20d7 expref: 25 pid: 8495 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.761164:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd7268f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c2 expref: 22 pid: 8496 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.761186:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57f4a00/0xe984082ccd726908 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20d7 expref: 25 pid: 8495 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.761364:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd7268f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20c2 expref: 22 pid: 8496 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.761537:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.761541:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.761548:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.761556:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.761565:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143699.761584:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143699.761594:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593793280:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143699.761607:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1965:x1830963592414336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 491us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.761613:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5165 00000100:00100000:3.0:1746143699.761647:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.766099:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.766206:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593793280:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143699.766224:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.766258:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592414208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5166us (7557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.766267:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5164 00000100:00100000:2.0:1746143699.766350:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592414592 00000100:00100000:2.0:1746143699.766356:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592414592 00002000:00100000:2.0:1746143699.766387:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2957312->2961407) req@ffff88013691a680 x1830963592414592/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.766395:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691a680 with x1830963592414592 ext(2957312->2961407) 00002000:00010000:2.0:1746143699.766399:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013691a680 00000100:00100000:2.0:1746143699.766426:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3727 00000100:00100000:2.0:1746143699.766432:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963592414592:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143699.767817:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1962:x1830963592414592:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 1381us (1722us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143699.768366:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3727 00002000:00100000:2.0:1746143699.768375:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (2957312->2961407) req@ffff88013691a680 x1830963592414592/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.768383:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691a680 with x1830963592414592 ext(2957312->2961407) 00002000:00010000:2.0:1746143699.768387:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013691a680 00000100:00100000:0.0:1746143699.775884:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.776781:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592414976 00000100:00100000:1.0:1746143699.776797:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592414976 00000100:00100000:1.0:1746143699.776840:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9953 00000100:00100000:1.0:1746143699.776846:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28621:x1830963592414976:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143699.776861:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.776875:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a20fa expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.776896:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 15 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.776904:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d59ee00/0xe984082ccd726916 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20e5 expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.776909:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.776910:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.776913:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3170303] (req 3145728->3170303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.776934:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d59ee00/0xe984082ccd726916 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20e5 expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.776942:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d59ee00/0xe984082ccd726916 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20e5 expref: 27 pid: 25369 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.776951:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593793408:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.777018:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 15 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.777025:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 15 pid: 25369 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.777032:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593793536:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143699.777048:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.777259:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.778416:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593793408:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143699.778425:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963593793536:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143699.778446:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->3170303] (req 3145728->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.778456:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e90a00, rc 0) 00000100:00100000:2.0:1746143699.779096:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28621:x1830963592414976:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2246us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.779103:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9953 00000100:00100000:1.0:1746143699.779302:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592414848 00000100:00100000:1.0:1746143699.779307:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592414848 00000100:00100000:1.0:1746143699.779337:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8364 00000100:00100000:1.0:1746143699.779343:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+273:28626:x1830963592414848:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143699.779358:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.779370:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90c00/0xe984082ccd72692b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a20f3 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.779460:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd726932 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779470:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd726932 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779479:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd726932 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779489:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91600/0xe984082ccd726939 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779495:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91600/0xe984082ccd726939 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779499:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91600/0xe984082ccd726939 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779589:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90400/0xe984082ccd726940 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779597:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90400/0xe984082ccd726940 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779602:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90400/0xe984082ccd726940 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143699.779610:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143699.779680:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd726932 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779685:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd726932 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779690:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd726932 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779697:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e91400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143699.779700:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd726932 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779705:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd726932 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779713:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143699.779716:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143699.779718:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd726932 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779722:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd726932 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779749:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91600/0xe984082ccd726939 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779753:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91600/0xe984082ccd726939 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779756:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91600/0xe984082ccd726939 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779760:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e91600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143699.779761:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91600/0xe984082ccd726939 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779765:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91600/0xe984082ccd726939 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779771:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009343fc00) 00010000:00010000:1.0:1746143699.779773:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143699.779775:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91600/0xe984082ccd726939 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779778:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91600/0xe984082ccd726939 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.779816:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90c00/0xe984082ccd72692b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20f3 expref: 276 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.779826:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90400/0xe984082ccd726940 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20f3 expref: 275 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.779830:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143699.779832:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143699.779834:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e90400, rc 0) 00000100:00100000:1.0:1746143699.779870:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+275:28626:x1830963592414848:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 527us (2611us total) trans 8589942486 rc 0/0 00000100:00100000:1.0:1746143699.779876:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8364 00000100:00100000:0.0:1746143699.782507:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.782555:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.783166:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592415104 00000100:00100000:3.0:1746143699.783173:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592415104 00000100:00100000:3.0:1746143699.783213:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592415232 00000100:00100000:3.0:1746143699.783215:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592415232 00010000:00010000:3.0:1746143699.783226:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d59ee00/0xe984082ccd726916 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20e5 expref: 28 pid: 25369 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746143699.783857:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5166 00000100:00100000:3.0:1746143699.783866:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592415232:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143699.783878:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143699.783899:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d59ee00/0xe984082ccd726916 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20e5 expref: 28 pid: 25369 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.783909:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d59ee00/0xe984082ccd726916 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20e5 expref: 28 pid: 25369 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.783926:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d59ee00/0xe984082ccd726916 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20e5 expref: 28 pid: 25369 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.783943:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.783989:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592415232:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 123us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.783995:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5166 00000100:00100000:3.0:1746143699.784019:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 575 00000100:00100000:3.0:1746143699.784023:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+275:1964:x1830963592415104:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143699.784030:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143699.784042:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90400/0xe984082ccd726940 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20f3 expref: 275 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.784051:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143699.784055:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.784068:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+274:1964:x1830963592415104:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 45us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.784072:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 575 00000100:00100000:0.0:1746143699.784981:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.785036:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592415488 00000100:00100000:1.0:1746143699.785041:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592415488 00000100:00100000:1.0:1746143699.785753:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8365 00000100:00100000:1.0:1746143699.785760:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+274:28630:x1830963592415488:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143699.785779:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.785802:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91000/0xe984082ccd72694e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2101 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.785900:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91800/0xe984082ccd726955 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.785911:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91800/0xe984082ccd726955 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.785919:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91800/0xe984082ccd726955 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.785930:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd72695c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.785935:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd72695c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.785939:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd72695c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143699.785988:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.786020:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.786033:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.786049:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.786150:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592416000 00000100:00100000:3.0:1746143699.786154:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592416000 00002000:00100000:3.0:1746143699.786178:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009ff6d880 x1830963592416000/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.786186:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d880 with x1830963592416000 ext(3145728->4194303) 00010000:00010000:3.0:1746143699.786192:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 15 pid: 25369 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.786202:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 15 pid: 25369 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746143699.786208:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6d880 00000100:00100000:3.0:1746143699.786224:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592415872 00000100:00100000:3.0:1746143699.786226:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592415872 00002000:00100000:3.0:1746143699.786237:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009ff6f100 x1830963592415872/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.786243:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f100 with x1830963592415872 ext(2097152->3145727) 00010000:00010000:3.0:1746143699.786247:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 16 pid: 25369 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.786254:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 16 pid: 25369 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746143699.786259:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6f100 00000100:00100000:3.0:1746143699.786266:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592416384 00000100:00100000:3.0:1746143699.786268:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592416384 00002000:00100000:3.0:1746143699.786278:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3334144->4194303) req@ffff8800a0878a80 x1830963592416384/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.786284:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0878a80 with x1830963592416384 ext(3334144->4194303) 00002000:00010000:3.0:1746143699.786287:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0878a80 00000100:00100000:3.0:1746143699.786575:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592416256 00000100:00100000:3.0:1746143699.786578:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592416256 00002000:00100000:3.0:1746143699.786591:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3334143) req@ffff8800a0879f80 x1830963592416256/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 504/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143699.786593:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 916 00002000:00100000:3.0:1746143699.786597:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879f80 with x1830963592416256 ext(2097152->3334143) 00002000:00010000:3.0:1746143699.786600:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0879f80 00000100:00100000:2.0:1746143699.786603:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592416000:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143699.786612:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 917 00000100:00100000:3.0:1746143699.786618:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592415872:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143699.786626:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3728 00000100:00100000:0.0:1746143699.786632:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592416384:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143699.786650:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3729 00000100:00100000:3.0:1746143699.786654:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592416256:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143699.787471:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90000/0xe984082ccd726963 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787482:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90000/0xe984082ccd726963 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787489:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90000/0xe984082ccd726963 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143699.787497:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143699.787572:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91800/0xe984082ccd726955 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787578:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91800/0xe984082ccd726955 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787583:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91800/0xe984082ccd726955 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787587:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e91800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143699.787590:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91800/0xe984082ccd726955 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787596:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91800/0xe984082ccd726955 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787606:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143699.787608:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143699.787611:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91800/0xe984082ccd726955 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787614:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91800/0xe984082ccd726955 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787623:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd72695c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787627:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd72695c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787630:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd72695c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787633:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131e91400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143699.787635:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd72695c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787639:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd72695c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787643:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009343f600) 00010000:00010000:1.0:1746143699.787644:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143699.787646:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd72695c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787650:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91400/0xe984082ccd72695c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.787685:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e91000/0xe984082ccd72694e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2101 expref: 277 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.787694:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90000/0xe984082ccd726963 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2101 expref: 276 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.787704:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143699.787706:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143699.787708:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e90000, rc 0) 00000100:00100000:1.0:1746143699.787728:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+276:28630:x1830963592415488:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1969us (2749us total) trans 8589942487 rc 0/0 00000100:00100000:1.0:1746143699.787734:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8365 00000100:00100000:3.0:1746143699.788176:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.788966:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592416640 00000100:00100000:2.0:1746143699.788972:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592416640 00000100:00100000:2.0:1746143699.789012:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9954 00000100:00100000:2.0:1746143699.789019:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:28626:x1830963592416640:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143699.789031:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.789043:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2108 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.789063:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.789069:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143699.789071:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143699.789074:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3633152->3792895] (req 3633152->3792895) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.789095:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.789103:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 24 pid: 8497 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746143699.789112:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593793664:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143699.789288:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.798908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.798939:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.798991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.799447:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592416896 00000100:00100000:3.0:1746143699.799455:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592416896 00000100:00100000:3.0:1746143699.799490:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3420 00000100:00100000:3.0:1746143699.799497:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a8f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+276:28630:x1830963592416896:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143699.799622:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1965:x1830963592416000:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13020us (13633us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143699.799633:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 916 00002000:00100000:2.0:1746143699.799641:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009ff6d880 x1830963592416000/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.799649:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d880 with x1830963592416000 ext(3145728->4194303) 00000100:00100000:3.0:1746143699.799654:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a8f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+277:28630:x1830963592416896:12345-192.168.202.48@tcp:35:cat.0 Request processed in 157us (754us total) trans 8589942488 rc 0/0 00010000:00010000:2.0:1746143699.799656:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 17 pid: 25369 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746143699.799660:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3420 00010000:00010000:2.0:1746143699.799666:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 17 pid: 25369 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746143699.799672:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6d880 00000100:00100000:2.0:1746143699.799687:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592417152 00000100:00100000:2.0:1746143699.799690:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592417152 00002000:00100000:2.0:1746143699.799707:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2957312->3145727) req@ffff8800a0878000 x1830963592417152/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143699.799711:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592417024 00002000:00100000:2.0:1746143699.799712:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0878000 with x1830963592417152 ext(2957312->3145727) 00000100:00100000:3.0:1746143699.799714:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592417024 00010000:00010000:2.0:1746143699.799717:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 25 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.799723:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 25 pid: 8497 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746143699.799728:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0878000 00000100:00100000:3.0:1746143699.799734:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 576 00000100:00100000:3.0:1746143699.799738:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+277:1965:x1830963592417024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143699.799740:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 918 00000100:00100000:2.0:1746143699.799744:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592417152:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:3.0:1746143699.799746:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143699.799764:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131e90000/0xe984082ccd726963 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2101 expref: 277 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.799775:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143699.799778:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.799806:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+276:1965:x1830963592417024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 67us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.799811:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 576 00000100:00100000:3.0:1746143699.799871:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593793664:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143699.799891:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3633152->3792895] (req 3633152->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.799904:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5c000, rc 0) 00000100:00100000:3.0:1746143699.799921:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:28626:x1830963592416640:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 10903us (11746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.799927:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9954 00000100:00100000:3.0:1746143699.804672:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592416256:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18009us (18613us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143699.804681:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3729 00002000:00100000:3.0:1746143699.804692:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3334143) req@ffff8800a0879f80 x1830963592416256/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 504/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.804700:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879f80 with x1830963592416256 ext(2097152->3334143) 00010000:00010000:3.0:1746143699.804709:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 25 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.804721:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 25 pid: 8497 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746143699.804728:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0879f80 00000100:00100000:2.0:1746143699.808867:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.809021:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.809186:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592417280 00000100:00100000:0.0:1746143699.809194:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592417280 00000100:00100000:3.0:1746143699.811649:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1965:x1830963592417152:12345-192.168.202.48@tcp:4:cat.0 Request processed in 11897us (12650us total) trans 21474839776 rc 0/0 00000100:00100000:3.0:1746143699.811659:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 918 00002000:00100000:3.0:1746143699.811670:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2957312->3145727) req@ffff8800a0878000 x1830963592417152/t21474839776(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/448 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.811679:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0878000 with x1830963592417152 ext(2957312->3145727) 00010000:00010000:3.0:1746143699.811688:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 25 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.811699:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 25 pid: 8497 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746143699.811706:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0878000 00000100:00100000:0.0:1746143699.812446:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592417408 00000100:00100000:0.0:1746143699.812452:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592417408 00000100:00100000:2.0:1746143699.812587:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9955 00000100:00100000:2.0:1746143699.812600:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9956 00000100:00100000:2.0:1746143699.812607:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592417408:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143699.812620:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.812634:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6469e00/0xe984082ccd726978 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2116 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143699.812673:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593793792:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143699.812728:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143699.812742:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592417280:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143699.812750:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.812760:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c94d800/0xe984082ccd72697f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a210f expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.812770:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.812777:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c94d800/0xe984082ccd72697f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a210f expref: 28 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.812785:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c94d800/0xe984082ccd72697f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a210f expref: 28 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.812811:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94d800, rc 0) 00000100:00100000:2.0:1746143699.812834:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592417280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 240us (3975us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143699.812843:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9955 00000100:00100000:0.0:1746143699.813216:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592416384:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26584us (27180us total) trans 0 rc 860160/860160 00000100:00100000:0.0:1746143699.813222:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3728 00002000:00100000:0.0:1746143699.813229:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3334144->4194303) req@ffff8800a0878a80 x1830963592416384/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 860160/860160 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.813237:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0878a80 with x1830963592416384 ext(3334144->4194303) 00010000:00010000:0.0:1746143699.813241:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 23 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.813254:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 23 pid: 8497 timeout: 878 lvb_type: 0 00002000:00010000:0.0:1746143699.813259:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0878a80 00000100:00100000:2.0:1746143699.813274:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963592415872:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26654us (27252us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143699.813280:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 917 00002000:00100000:2.0:1746143699.813285:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009ff6f100 x1830963592415872/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.813292:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f100 with x1830963592415872 ext(2097152->3145727) 00010000:00010000:2.0:1746143699.813297:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 15 pid: 25369 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.813305:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 15 pid: 25369 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746143699.813310:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6f100 00002000:00010000:2.0:1746143699.818202:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime: 1746143698 -> 1746143699 00000100:00100000:2.0:1746143699.818226:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593793792:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143699.818253:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6469e00/0xe984082ccd726978 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2116 expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.818265:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6469e00/0xe984082ccd726978 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2116 expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.818274:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6469e00, rc 0) 00000100:00100000:2.0:1746143699.818321:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592417408:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5715us (9299us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143699.818329:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9956 00000100:00100000:0.0:1746143699.824415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.824462:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592417536 00000100:00100000:3.0:1746143699.824470:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592417536 00010000:00010000:3.0:1746143699.824500:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 23 pid: 8497 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746143699.824535:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5167 00000100:00100000:3.0:1746143699.824541:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592417536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143699.824912:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143699.824933:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 23 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.824949:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 23 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.824968:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e90600/0xe984082ccd72691d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ec expref: 23 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.824996:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.824997:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.825004:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.825011:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.825039:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143699.825051:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593793920:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143699.825868:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.827605:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.827649:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592417920 00000100:00100000:2.0:1746143699.827657:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592417920 00000100:00100000:2.0:1746143699.827703:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9957 00000100:00100000:2.0:1746143699.827709:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592417920:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143699.827724:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.827740:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6469e00/0xe984082ccd726986 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a212b expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143699.827781:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593794048:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143699.827864:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143699.830616:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.832743:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.832974:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593793920:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143699.832990:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143699.833034:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592417664 00000100:00100000:0.0:1746143699.833034:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592417792 00000100:00100000:1.0:1746143699.833039:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592417664 00000100:00100000:0.0:1746143699.833039:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592417792 00000100:00100000:3.0:1746143699.833072:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592417536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8530us (8662us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.833075:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9958 00000100:00100000:3.0:1746143699.833080:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5167 00000100:00100000:1.0:1746143699.833081:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28627:x1830963592417664:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143699.833095:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.833108:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e91a00/0xe984082ccd72698d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a211d expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.833130:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.833136:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143699.833152:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143699.833155:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e91a00/0xe984082ccd72698d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a211d expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.833178:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.833186:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 26 pid: 8497 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.833195:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593794176:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143699.833685:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9959 00000100:00100000:0.0:1746143699.833694:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592417792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143699.833702:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143699.833710:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f5bda00/0xe984082ccd726994 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2124 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.833720:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.833727:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f5bda00/0xe984082ccd726994 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2124 expref: 28 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143699.833734:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f5bda00/0xe984082ccd726994 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2124 expref: 28 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143699.833745:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bda00, rc 0) 00000100:00100000:0.0:1746143699.833769:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592417792:12345-192.168.202.48@tcp:101:cat.0 Request processed in 79us (3161us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143699.833774:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9959 00000100:00100000:2.0:1746143699.833963:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.834021:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.834039:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592418304 00000100:00100000:2.0:1746143699.834042:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592418304 00002000:00100000:2.0:1746143699.834065:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3633152->3637247) req@ffff88009c3f9880 x1830963592418304/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.834073:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830963592418304 ext(3633152->3637247) 00010000:00010000:2.0:1746143699.834078:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 7/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 27 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.834086:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 7/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 27 pid: 8497 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746143699.834092:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592418048 00002000:00010000:2.0:1746143699.834095:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c3f9880 00000100:00100000:3.0:1746143699.834096:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592418048 00010000:00010000:3.0:1746143699.834109:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 15 pid: 25369 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746143699.834468:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 919 00000100:00100000:2.0:1746143699.834475:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592418304:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143699.834545:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5168 00000100:00100000:3.0:1746143699.834551:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1962:x1830963592418048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143699.834558:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143699.834572:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 15 pid: 25369 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.834580:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 15 pid: 25369 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746143699.834591:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592418304:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 117us (569us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1746143699.834593:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d59fa00/0xe984082ccd72690f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20de expref: 15 pid: 25369 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746143699.834596:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 919 00002000:00100000:2.0:1746143699.834600:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3633152->3637247) req@ffff88009c3f9880 x1830963592418304/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746143699.834605:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.834607:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:2.0:1746143699.834607:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830963592418304 ext(3633152->3637247) 00010000:00010000:3.0:1746143699.834611:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.834611:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 7/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 27 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.834618:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.834619:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 7/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 27 pid: 8497 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746143699.834624:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c3f9880 00010000:00010000:3.0:1746143699.834637:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143699.834645:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593794304:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143699.834919:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143699.835227:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.835676:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593794048:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143699.835696:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6469e00/0xe984082ccd726986 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a212b expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143699.835705:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6469e00/0xe984082ccd726986 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a212b expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143699.835712:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6469e00, rc 0) 00000100:00100000:0.0:1746143699.835730:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592417920:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8021us (8131us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143699.835736:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9957 00000100:00100000:0.0:1746143699.841207:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.841269:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592418560 00000100:00100000:2.0:1746143699.841278:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592418560 00002000:00100000:2.0:1746143699.841313:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3788800->3792895) req@ffff8800a087b100 x1830963592418560/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.841322:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b100 with x1830963592418560 ext(3788800->3792895) 00010000:00010000:2.0:1746143699.841330:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 25 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.841347:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 25 pid: 8497 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746143699.841353:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a087b100 00000100:00100000:2.0:1746143699.841383:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 920 00000100:00100000:2.0:1746143699.841390:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592418560:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143699.841769:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592418560:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 378us (568us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143699.841775:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 920 00002000:00100000:2.0:1746143699.841780:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3788800->3792895) req@ffff8800a087b100 x1830963592418560/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.841786:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b100 with x1830963592418560 ext(3788800->3792895) 00010000:00010000:2.0:1746143699.841801:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 25 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.841810:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 25 pid: 8497 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746143699.841815:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a087b100 00000100:00100000:1.0:1746143699.843243:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963593794176:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.843264:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e91a00/0xe984082ccd72698d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a211d expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.843276:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91a00, rc 0) 00000100:00100000:1.0:1746143699.844415:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28627:x1830963592417664:12345-192.168.202.48@tcp:101:cat.0 Request processed in 11328us (11671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.844423:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9958 00000100:00100000:0.0:1746143699.846088:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.846165:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592418816 00000100:00100000:2.0:1746143699.846170:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592418816 00002000:00100000:2.0:1746143699.846204:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3166208->3170303) req@ffff8800a0878700 x1830963592418816/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.846213:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0878700 with x1830963592418816 ext(3166208->3170303) 00002000:00010000:2.0:1746143699.846218:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0878700 00000100:00100000:2.0:1746143699.846233:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3730 00000100:00100000:2.0:1746143699.846239:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592418816:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143699.846402:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592418816:12345-192.168.202.48@tcp:3:cat.0 Request processed in 162us (318us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143699.846407:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3730 00002000:00100000:2.0:1746143699.846412:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3166208->3170303) req@ffff8800a0878700 x1830963592418816/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/4536 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.846419:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0878700 with x1830963592418816 ext(3166208->3170303) 00002000:00010000:2.0:1746143699.846422:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0878700 00000100:00100000:3.0:1746143699.846515:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593794304:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143699.846529:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.846550:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1962:x1830963592418048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 11999us (12588us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.846559:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5168 00000100:00100000:1.0:1746143699.846716:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.846732:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.846735:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592418944 00000100:00100000:0.0:1746143699.846738:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592418944 00000100:00100000:0.0:1746143699.846748:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592419200 00000100:00100000:0.0:1746143699.846750:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592419200 00000100:00100000:1.0:1746143699.846756:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:0.0:1746143699.846766:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3633152->3792895) req@ffff88012b79c380 x1830963592419200/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143699.846773:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c380 with x1830963592419200 ext(3633152->3792895) 00010000:00010000:0.0:1746143699.846784:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 25 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746143699.846806:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 25 pid: 8497 timeout: 878 lvb_type: 0 00002000:00010000:0.0:1746143699.846813:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b79c380 00000100:00100000:0.0:1746143699.846836:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 921 00000100:00100000:0.0:1746143699.846841:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592419200:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143699.848453:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9960 00000100:00100000:1.0:1746143699.848459:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:28630:x1830963592418944:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143699.848468:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.848480:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e91c00/0xe984082ccd72699b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2132 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.848503:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.848510:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143699.848511:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143699.848514:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e91c00/0xe984082ccd72699b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2132 expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.848535:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.848542:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 13 pid: 8497 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.848551:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593794432:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143699.848622:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143699.848743:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592419456 00000100:00100000:2.0:1746143699.848748:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592419456 00000100:00100000:2.0:1746143699.848772:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3421 00000100:00100000:2.0:1746143699.848777:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+276:28626:x1830963592419456:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143699.848934:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+277:28626:x1830963592419456:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 156us (2176us total) trans 8589942489 rc 0/0 00000100:00100000:2.0:1746143699.848940:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3421 00000100:00100000:1.0:1746143699.855175:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592419200:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8325us (8433us total) trans 21474839777 rc 0/0 00000100:00100000:1.0:1746143699.855185:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 921 00002000:00100000:1.0:1746143699.855886:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3633152->3792895) req@ffff88012b79c380 x1830963592419200/t21474839777(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/448 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.855894:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c380 with x1830963592419200 ext(3633152->3792895) 00010000:00010000:1.0:1746143699.855903:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 27 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.855917:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 27 pid: 8497 timeout: 878 lvb_type: 0 00002000:00010000:1.0:1746143699.855922:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b79c380 00000100:00100000:1.0:1746143699.855970:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593794432:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.855989:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e91c00/0xe984082ccd72699b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2132 expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.856000:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91c00, rc 0) 00000100:00100000:1.0:1746143699.857033:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:28630:x1830963592418944:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8571us (10314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.857041:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9960 00000100:00100000:0.0:1746143699.858887:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.859014:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592419584 00000100:00100000:1.0:1746143699.859021:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592419584 00002000:00100000:1.0:1746143699.859057:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3170303) req@ffff8800a0878e00 x1830963592419584/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.859065:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0878e00 with x1830963592419584 ext(3145728->3170303) 00010000:00010000:1.0:1746143699.859071:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 14 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.859080:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 14 pid: 8497 timeout: 878 lvb_type: 0 00002000:00010000:1.0:1746143699.859087:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0878e00 00000100:00100000:1.0:1746143699.859118:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 922 00000100:00100000:1.0:1746143699.859125:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592419584:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143699.860654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.861182:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592419584:12345-192.168.202.48@tcp:4:cat.0 Request processed in 2056us (2297us total) trans 17179872510 rc 0/0 00000100:00100000:1.0:1746143699.861191:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 922 00002000:00100000:1.0:1746143699.861199:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->3170303) req@ffff8800a0878e00 x1830963592419584/t17179872510(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/448 e 0 to 0 dl 1746143710 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.861207:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0878e00 with x1830963592419584 ext(3145728->3170303) 00010000:00010000:1.0:1746143699.861213:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 16 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746143699.861223:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 16 pid: 8497 timeout: 878 lvb_type: 0 00002000:00010000:1.0:1746143699.861229:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0878e00 00000100:00100000:3.0:1746143699.861658:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592419712 00000100:00100000:3.0:1746143699.861663:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592419712 00010000:00010000:3.0:1746143699.861685:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 27 pid: 8497 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746143699.861703:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5169 00000100:00100000:3.0:1746143699.861709:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592419712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143699.861718:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143699.861734:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 27 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.861741:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 27 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.861757:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c000/0xe984082ccd726971 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3633152->3792895) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2108 expref: 27 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746143699.861785:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.861796:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143699.861801:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e91a00/0xe984082ccd72698d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a211d expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.861811:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e91a00/0xe984082ccd72698d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a211d expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143699.861837:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131e91a00/0xe984082ccd72698d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a211d expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143699.861847:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593794560:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143699.861904:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143699.863364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.863922:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592419840 00000100:00100000:2.0:1746143699.863928:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592419840 00010000:00010000:2.0:1746143699.863952:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 16 pid: 8497 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746143699.863985:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5170 00000100:00100000:2.0:1746143699.863991:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592419840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143699.864000:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143699.864016:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 16 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.864024:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 16 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.864039:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726924 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20fa expref: 16 pid: 8497 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.864960:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.864962:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.864969:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e91c00/0xe984082ccd72699b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2132 expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.864977:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e91c00/0xe984082ccd72699b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2132 expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.865004:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131e91c00/0xe984082ccd72699b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2132 expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143699.865013:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3faa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593794688:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143699.865075:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143699.866164:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593794560:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143699.866176:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143699.866200:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592419712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4491us (5550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143699.866208:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5169 00000100:00100000:0.0:1746143699.869349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.869573:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3faa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963593794688:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143699.869590:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143699.869626:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1964:x1830963592419840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5634us (6263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.869635:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5170 00000100:00100000:1.0:1746143699.869764:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592420096 00000100:00100000:1.0:1746143699.869771:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592420096 00002000:00100000:1.0:1746143699.869813:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a0879500 x1830963592420096/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.869822:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879500 with x1830963592420096 ext(2097152->3145727) 00002000:00010000:1.0:1746143699.869826:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0879500 00000100:00100000:1.0:1746143699.869840:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3731 00000100:00100000:1.0:1746143699.869847:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592420096:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143699.874565:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.874642:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592420352 00000100:00100000:3.0:1746143699.874649:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592420352 00002000:00100000:3.0:1746143699.874686:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a087ad80 x1830963592420352/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.874695:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087ad80 with x1830963592420352 ext(2097152->3145727) 00002000:00010000:3.0:1746143699.874700:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a087ad80 00000100:00100000:3.0:1746143699.874719:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3732 00000100:00100000:3.0:1746143699.874726:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592420352:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143699.885603:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592420096:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15746us (16250us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143699.885619:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3731 00002000:00100000:1.0:1746143699.885631:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a0879500 x1830963592420096/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.885639:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879500 with x1830963592420096 ext(2097152->3145727) 00002000:00010000:1.0:1746143699.885644:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0879500 00000100:00100000:3.0:1746143699.886849:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592420352:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12118us (12288us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143699.886968:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3732 00002000:00100000:3.0:1746143699.886975:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff8800a087ad80 x1830963592420352/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.886983:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087ad80 with x1830963592420352 ext(2097152->3145727) 00002000:00010000:3.0:1746143699.886987:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a087ad80 00000100:00100000:0.0:1746143699.894124:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.894374:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.894478:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592420480 00000100:00100000:1.0:1746143699.894485:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592420480 00000100:00100000:1.0:1746143699.894527:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592420608 00000100:00100000:1.0:1746143699.894529:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592420608 00000100:00100000:1.0:1746143699.894888:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9961 00000100:00100000:1.0:1746143699.894896:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:28630:x1830963592420480:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143699.894911:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.894924:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae47600/0xe984082ccd7269a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2139 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.894943:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.894945:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143699.894950:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae47600/0xe984082ccd7269a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2139 expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.894963:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae47600/0xe984082ccd7269a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2139 expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.894971:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae47600, rc 0) 00000100:00100000:2.0:1746143699.895417:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9962 00000100:00100000:2.0:1746143699.895427:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+15:28627:x1830963592420608:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143699.895437:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.895448:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bdc5a00/0xe984082ccd7269a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2140 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.895463:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.895464:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.895468:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdc5a00/0xe984082ccd7269a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2140 expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.895479:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bdc5a00/0xe984082ccd7269a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2140 expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.895486:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bdc5a00, rc 0) 00000100:00100000:2.0:1746143699.895544:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28627:x1830963592420608:12345-192.168.202.48@tcp:101:cat.0 Request processed in 119us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.895550:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9962 00000100:00100000:1.0:1746143699.895576:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:28630:x1830963592420480:12345-192.168.202.48@tcp:101:cat.0 Request processed in 680us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.895585:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9961 00000100:00100000:2.0:1746143699.904494:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.904540:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.904586:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592420992 00000100:00100000:3.0:1746143699.904595:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592420992 00002000:00100000:3.0:1746143699.904635:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009c3faa00 x1830963592420992/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.904644:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830963592420992 ext(3145728->4194303) 00002000:00010000:3.0:1746143699.904648:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3faa00 00000100:00100000:3.0:1746143699.904676:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592421120 00000100:00100000:3.0:1746143699.904679:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592421120 00002000:00100000:3.0:1746143699.904691:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009c3fad80 x1830963592421120/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.904698:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830963592421120 ext(3145728->4194303) 00002000:00010000:3.0:1746143699.904701:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:3.0:1746143699.904720:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3733 00000100:00100000:3.0:1746143699.904727:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963592420992:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143699.904746:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3734 00000100:00100000:1.0:1746143699.904755:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963592421120:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143699.912894:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.912934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.912973:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.912990:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592421504 00000100:00100000:2.0:1746143699.913001:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592421504 00000100:00100000:3.0:1746143699.913027:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592421632 00000100:00100000:3.0:1746143699.913030:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592421632 00002000:00100000:2.0:1746143699.913041:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a087b480 x1830963592421504/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.913045:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a087b800 x1830963592421632/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.913050:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b480 with x1830963592421504 ext(3145728->4194303) 00002000:00100000:3.0:1746143699.913052:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b800 with x1830963592421632 ext(2097152->3145727) 00002000:00010000:3.0:1746143699.913055:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087b800 00002000:00010000:2.0:1746143699.913055:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a087b480 00000100:00100000:3.0:1746143699.913086:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592421760 00000100:00100000:3.0:1746143699.913088:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592421760 00002000:00100000:3.0:1746143699.913099:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800a0878380 x1830963592421760/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143699.913101:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3735 00002000:00100000:3.0:1746143699.913105:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0878380 with x1830963592421760 ext(3145728->4194303) 00002000:00010000:3.0:1746143699.913107:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0878380 00000100:00100000:2.0:1746143699.913107:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592421632:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143699.913123:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3736 00000100:00100000:3.0:1746143699.913126:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592421504:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143699.913156:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3737 00000100:00100000:1.0:1746143699.913163:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592421760:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143699.916389:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1963:x1830963592420992:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11653us (11895us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143699.916400:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3733 00002000:00100000:3.0:1746143699.916408:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009c3faa00 x1830963592420992/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.916416:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830963592420992 ext(3145728->4194303) 00002000:00010000:3.0:1746143699.916421:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3faa00 00000100:00100000:1.0:1746143699.921467:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963592421120:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16705us (16918us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143699.921477:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3734 00002000:00100000:1.0:1746143699.921487:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009c3fad80 x1830963592421120/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.921495:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830963592421120 ext(3145728->4194303) 00002000:00010000:1.0:1746143699.921500:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:1.0:1746143699.927382:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592421760:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14212us (14401us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143699.927391:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3737 00002000:00100000:1.0:1746143699.927400:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff8800a0878380 x1830963592421760/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143699.927408:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0878380 with x1830963592421760 ext(3145728->4194303) 00002000:00010000:1.0:1746143699.927413:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0878380 00000100:00100000:3.0:1746143699.935660:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592421504:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22524us (22769us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143699.935670:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3736 00002000:00100000:3.0:1746143699.935679:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff8800a087b480 x1830963592421504/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.935688:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b480 with x1830963592421504 ext(3145728->4194303) 00002000:00010000:3.0:1746143699.935693:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a087b480 00000100:00100000:2.0:1746143699.936190:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592421632:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23082us (23254us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143699.936196:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3735 00002000:00100000:2.0:1746143699.936201:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff8800a087b800 x1830963592421632/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.936208:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b800 with x1830963592421632 ext(2097152->3145727) 00002000:00010000:2.0:1746143699.936212:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087b800 00000100:00100000:0.0:1746143699.938098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.938757:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592422144 00000100:00100000:2.0:1746143699.938765:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592422144 00002000:00100000:2.0:1746143699.938812:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a0879180 x1830963592422144/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.938821:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879180 with x1830963592422144 ext(4194304->4898815) 00002000:00010000:2.0:1746143699.938825:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0879180 00000100:00100000:2.0:1746143699.938856:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3738 00000100:00100000:2.0:1746143699.938863:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592422144:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143699.945360:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143699.945723:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592422400 00000100:00100000:3.0:1746143699.945730:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592422400 00002000:00100000:3.0:1746143699.945764:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a0879880 x1830963592422400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/0 e 0 to 0 dl 1746143710 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143699.945773:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879880 with x1830963592422400 ext(4194304->4898815) 00002000:00010000:3.0:1746143699.945777:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0879880 00000100:00100000:2.0:1746143699.946199:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592422144:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7333us (8102us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143699.946207:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3738 00002000:00100000:2.0:1746143699.946213:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a0879180 x1830963592422144/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.946220:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879180 with x1830963592422144 ext(4194304->4898815) 00002000:00010000:2.0:1746143699.946223:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0879180 00000100:00100000:2.0:1746143699.946241:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3739 00000100:00100000:2.0:1746143699.946249:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592422400:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143699.959685:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592422400:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13423us (14317us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746143699.959699:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3739 00002000:00100000:2.0:1746143699.959711:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff8800a0879880 x1830963592422400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:95/0 lens 488/440 e 0 to 0 dl 1746143710 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143699.959721:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879880 with x1830963592422400 ext(4194304->4898815) 00002000:00010000:2.0:1746143699.959727:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0879880 00000100:00100000:0.0:1746143699.982609:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143699.982819:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592422528 00000100:00100000:1.0:1746143699.982830:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592422528 00000100:00100000:1.0:1746143699.982899:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8366 00000100:00100000:1.0:1746143699.982906:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+24:28635:x1830963592422528:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143699.982927:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143699.982943:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47800/0xe984082ccd7269b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2147 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.982993:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47a00/0xe984082ccd7269b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.983002:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47a00/0xe984082ccd7269b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.983011:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47a00/0xe984082ccd7269b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.983022:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47c00/0xe984082ccd7269be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.983027:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47c00/0xe984082ccd7269be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.983032:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47c00/0xe984082ccd7269be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.983123:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.983133:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72688a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a207c expref: 31 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.983177:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.983205:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72688a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a207c expref: 31 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.983219:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72688a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a207c expref: 31 pid: 14764 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746143699.983230:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593794816:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143699.983319:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143699.988213:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593794816:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143699.988246:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143699.988557:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.988867:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592422784 00000100:00100000:2.0:1746143699.988874:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592422784 00000100:00100000:2.0:1746143699.988931:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3422 00000100:00100000:2.0:1746143699.988939:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+32:15421:x1830963592422784:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143699.989374:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+33:15421:x1830963592422784:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 433us (817us total) trans 8589942490 rc 0/0 00000100:00100000:2.0:1746143699.989381:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3422 00000100:00100000:0.0:1746143699.990853:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.990945:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592422912 00000100:00100000:2.0:1746143699.990950:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592422912 00010000:00010000:2.0:1746143699.990975:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72688a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a207c expref: 33 pid: 14764 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746143699.991054:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5171 00000100:00100000:2.0:1746143699.991061:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+33:1964:x1830963592422912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143699.991072:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143699.991078:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72688a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a207c expref: 33 pid: 14764 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.991089:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72688a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a207c expref: 33 pid: 14764 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.991113:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bfa800/0xe984082ccd72688a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a207c expref: 33 pid: 14764 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746143699.991267:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143699.991273:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143699.991283:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143699.991290:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143699.991318:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143699.992388:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992397:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143699.992440:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:1.0:1746143699.992445:0:20509:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143699.992461:0:20509:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992470:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992479:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47a00/0xe984082ccd7269b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992485:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47a00/0xe984082ccd7269b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992490:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47a00/0xe984082ccd7269b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992496:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ae47a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143699.992500:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47a00/0xe984082ccd7269b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992506:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47a00/0xe984082ccd7269b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992516:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:1.0:1746143699.992519:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143699.992522:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47a00/0xe984082ccd7269b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992527:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47a00/0xe984082ccd7269b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992553:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47c00/0xe984082ccd7269be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992559:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47c00/0xe984082ccd7269be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992563:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47c00/0xe984082ccd7269be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992567:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ae47c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143699.992570:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47c00/0xe984082ccd7269be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992574:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47c00/0xe984082ccd7269be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992581:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009343fc00) 00010000:00010000:1.0:1746143699.992583:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143699.992585:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47c00/0xe984082ccd7269be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992589:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47c00/0xe984082ccd7269be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143699.992623:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47800/0xe984082ccd7269b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2147 expref: 26 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.992634:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2147 expref: 25 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143699.992640:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143699.992642:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143699.992644:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae47e00, rc 0) 00000100:00100000:2.0:1746143699.992764:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1964:x1830963592422912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1701us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.992772:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5171 00000100:00100000:1.0:1746143699.994192:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+25:28635:x1830963592422528:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 11278us (11587us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143699.994201:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8366 00000100:00100000:0.0:1746143699.998688:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.998726:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.998756:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.998898:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143699.998922:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592423040 00000100:00100000:0.0:1746143699.998930:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592423040 00000100:00100000:0.0:1746143699.998970:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592423168 00000100:00100000:0.0:1746143699.998972:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592423168 00000100:00100000:0.0:1746143699.998983:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592423424 00000100:00100000:0.0:1746143699.998984:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592423424 00000100:00100000:0.0:1746143699.998992:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592423680 00000100:00100000:0.0:1746143699.998993:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592423680 00000100:00100000:0.0:1746143699.999006:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9963 00000100:00100000:0.0:1746143699.999013:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592423040:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143699.999033:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143699.999050:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801302a8c00/0xe984082ccd7269cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a214e expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143699.999073:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143699.999075:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143699.999084:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9964 00010000:00010000:0.0:1746143699.999084:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801302a8c00/0xe984082ccd7269cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a214e expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143699.999093:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592423168:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143699.999101:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.999112:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc600/0xe984082ccd7269d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2155 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.999126:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.999128:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.999134:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc600/0xe984082ccd7269d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2155 expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.999172:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc600/0xe984082ccd7269d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2155 expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.999182:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61cc600, rc 0) 00000100:00100000:2.0:1746143699.999229:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592423168:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 138us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.999236:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9964 00000100:00100000:2.0:1746143699.999253:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9965 00000100:00100000:2.0:1746143699.999258:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592423424:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143699.999264:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.999271:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a61cde00/0xe984082ccd7269da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2163 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.999280:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.999282:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.999287:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61cde00/0xe984082ccd7269da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2163 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.999298:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a61cde00/0xe984082ccd7269da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2163 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.999304:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61cde00, rc 0) 00000100:00100000:2.0:1746143699.999318:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592423424:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 60us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.999326:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9965 00000100:00100000:2.0:1746143699.999335:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9966 00000100:00100000:2.0:1746143699.999339:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1964:x1830963592423680:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143699.999344:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.999351:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc800/0xe984082ccd7269e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2171 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.999360:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.999361:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.999365:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc800/0xe984082ccd7269e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2171 expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.999372:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc800/0xe984082ccd7269e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2171 expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.999378:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61cc800, rc 0) 00000100:00100000:2.0:1746143699.999391:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592423680:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 52us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.999395:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9966 00000100:00100000:2.0:1746143699.999425:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143699.999440:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592423296 00000100:00100000:2.0:1746143699.999444:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592423296 00000100:00100000:2.0:1746143699.999460:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9967 00000100:00100000:2.0:1746143699.999464:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592423296:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143699.999470:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143699.999477:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5200/0xe984082ccd7269e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a215c expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143699.999488:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.999489:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143699.999494:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5200/0xe984082ccd7269e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a215c expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.999502:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5200/0xe984082ccd7269e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a215c expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143699.999502:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801302a8c00/0xe984082ccd7269cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a214e expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143699.999508:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f5200, rc 0) 00010000:00010000:0.0:1746143699.999511:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801302a8c00, rc 0) 00000100:00100000:2.0:1746143699.999521:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592423296:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 57us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143699.999526:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9967 00000100:00100000:0.0:1746143699.999530:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592423040:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 517us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143699.999535:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9963 00000100:00100000:1.0:1746143700.000817:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143700.000929:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592423552 00000100:00100000:0.0:1746143700.000935:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592423552 00000100:00100000:0.0:1746143700.000974:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9968 00000100:00100000:0.0:1746143700.000981:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592423552:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143700.000992:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143700.001002:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801302a8800/0xe984082ccd7269ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a216a expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143700.001017:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143700.001019:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143700.001025:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801302a8800/0xe984082ccd7269ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a216a expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143700.001036:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801302a8800/0xe984082ccd7269ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a216a expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143700.001045:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801302a8800, rc 0) 00000100:00100000:0.0:1746143700.001082:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592423552:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 101us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143700.001087:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9968 00000100:00080000:3.0:1746143700.001256:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143700.005777:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.006723:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592423936 00000100:00100000:1.0:1746143700.006734:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592423936 00000100:00100000:1.0:1746143700.006814:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8367 00000100:00100000:1.0:1746143700.006823:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+25:28635:x1830963592423936:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143700.006845:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143700.006863:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47000/0xe984082ccd7269f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2178 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.006957:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46e00/0xe984082ccd7269fd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143700.006976:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2147 expref: 26 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.006982:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46e00/0xe984082ccd7269fd lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143700.007012:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2147 expref: 26 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.007023:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2147 expref: 26 pid: 20509 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746143700.007033:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593794944:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143700.007122:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03600 going to sleep for 11 seconds 00000100:00080000:3.0:1746143700.007182:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143700.008466:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593794944:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143700.008488:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46e00/0xe984082ccd7269fd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143700.008885:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143700.009323:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592424064 00000100:00100000:2.0:1746143700.009329:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592424064 00010000:00010000:2.0:1746143700.009356:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2147 expref: 27 pid: 20509 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746143700.009663:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5172 00000100:00100000:2.0:1746143700.009671:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+27:1964:x1830963592424064:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143700.009683:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143700.009688:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2147 expref: 27 pid: 20509 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746143700.009698:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2147 expref: 27 pid: 20509 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746143700.009719:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47e00/0xe984082ccd7269c5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2147 expref: 27 pid: 20509 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746143700.009835:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143700.009840:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46e00/0xe984082ccd7269fd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143700.009849:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46e00/0xe984082ccd7269fd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143700.009855:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46e00/0xe984082ccd7269fd lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143700.009882:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143700.009947:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46e00/0xe984082ccd7269fd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143700.009955:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46e00/0xe984082ccd7269fd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143700.009973:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143700.010111:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae47000/0xe984082ccd7269f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2178 expref: 28 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143700.011449:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+27:1964:x1830963592424064:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1773us (2559us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143700.011458:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5172 00010000:00010000:1.0:1746143700.011756:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46e00/0xe984082ccd7269fd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2178 expref: 26 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.011767:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143700.011770:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143700.011772:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae46e00, rc 0) 00000100:00100000:1.0:1746143700.012205:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+26:28635:x1830963592423936:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 5383us (6438us total) trans 8589942491 rc 0/0 00000100:00100000:1.0:1746143700.012213:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8367 00000100:00100000:0.0:1746143700.014685:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.015017:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592424320 00000100:00100000:1.0:1746143700.015027:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592424320 00000100:00100000:1.0:1746143700.015113:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8368 00000100:00100000:1.0:1746143700.015121:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+26:28635:x1830963592424320:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143700.015175:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143700.015179:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143700.015208:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46e00/0xe984082ccd7269fd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2178 expref: 26 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.015868:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143700.015874:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143700.015888:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a0b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a217f expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.015983:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46a00/0xe984082ccd726a12 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143700.015996:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46a00/0xe984082ccd726a12 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143700.016005:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46a00/0xe984082ccd726a12 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143700.016016:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143700.016161:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a0b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a217f expref: 28 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.016175:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46a00/0xe984082ccd726a12 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a217f expref: 27 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.016182:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143700.016184:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143700.016186:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae46a00, rc 0) 00000100:00100000:1.0:1746143700.016250:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+27:28635:x1830963592424320:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 1129us (1575us total) trans 8589942492 rc 0/0 00000100:00100000:1.0:1746143700.016258:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8368 00000100:00100000:0.0:1746143700.018050:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.018174:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592424448 00000100:00100000:1.0:1746143700.018182:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592424448 00000100:00100000:1.0:1746143700.018227:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8369 00000100:00100000:1.0:1746143700.018234:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+27:28635:x1830963592424448:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143700.018254:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143700.018268:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46800/0xe984082ccd726a20 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2186 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.018313:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46800/0xe984082ccd726a20 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2186 expref: 28 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.018324:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46800/0xe984082ccd726a20 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2186 expref: 28 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.018344:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143700.018347:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143700.018349:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae46800, rc 0) 00000100:00100000:1.0:1746143700.018389:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+28:28635:x1830963592424448:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 155us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143700.018395:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8369 00000100:00100000:0.0:1746143700.020865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143700.021022:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592424576 00000100:00100000:2.0:1746143700.021030:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592424576 00000100:00100000:2.0:1746143700.021492:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9969 00000100:00100000:2.0:1746143700.021502:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592424576:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143700.021549:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.021568:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72687c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2052 expref: 15 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.021575:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801302a8c00/0xe984082ccd7269cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a214e expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.021583:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c2c200/0xe984082ccd7268d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2098 expref: 27 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.021590:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143700.021592:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143700.021595:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.021628:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c2c200/0xe984082ccd7268d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2098 expref: 27 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.021642:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c2c200/0xe984082ccd7268d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2098 expref: 27 pid: 15784 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746143700.021656:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593795072:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143700.021816:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.021840:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592424704 00000100:00100000:1.0:1746143700.021845:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592424704 00000100:00100000:1.0:1746143700.021873:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9970 00000100:00100000:1.0:1746143700.021879:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592424704:12345-192.168.202.48@tcp:1:mirror_io.0 00000100:00100000:0.0:1746143700.021890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143700.021899:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143700.021905:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592424960 00000100:00100000:0.0:1746143700.021907:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592424960 00010000:00010000:1.0:1746143700.021910:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2c00/0xe984082ccd726859 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2059 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143700.021916:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc600/0xe984082ccd7269d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2155 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143700.021922:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c2d800/0xe984082ccd7268c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a209f expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143700.021928:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143700.021929:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143700.021929:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9971 00010000:00010000:1.0:1746143700.021931:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143700.021935:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592424960:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143700.021948:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.021952:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c2d800/0xe984082ccd7268c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a209f expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143700.021957:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930c4600/0xe984082ccd72686e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2067 expref: 15 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143700.021959:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c2d800/0xe984082ccd7268c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a209f expref: 26 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.021964:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a61cde00/0xe984082ccd7269da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2163 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143700.021968:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593795200:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143700.021971:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c176a00/0xe984082ccd7268d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ad expref: 27 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143700.021976:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143700.021977:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143700.021979:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143700.021992:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c176a00/0xe984082ccd7268d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ad expref: 27 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143700.021999:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c176a00/0xe984082ccd7268d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ad expref: 27 pid: 15784 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.022006:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593795328:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143700.022011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.022022:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592425216 00000100:00100000:1.0:1746143700.022024:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592425216 00000100:00100000:0.0:1746143700.022040:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.022041:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9972 00000100:00100000:1.0:1746143700.022045:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592425216:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143700.022061:0:8497:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143700.022061:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143700.022071:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e91a00/0xe984082ccd72698d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a211d expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.022078:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc800/0xe984082ccd7269e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2171 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143700.022084:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae47600/0xe984082ccd7269a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2139 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.022095:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143700.022097:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143700.022099:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.022114:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae47600/0xe984082ccd7269a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2139 expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.022122:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ae47600/0xe984082ccd7269a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2139 expref: 26 pid: 25369 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746143700.022130:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593795456:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143700.022638:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592424832 00000100:00100000:2.0:1746143700.022643:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592424832 00000100:00100000:2.0:1746143700.022658:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592425088 00000100:00100000:2.0:1746143700.022660:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592425088 00000100:00100000:2.0:1746143700.022678:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9973 00000100:00100000:2.0:1746143700.022683:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592424832:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143700.022701:0:8495:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.022712:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd726860 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2060 expref: 22 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.022723:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5200/0xe984082ccd7269e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a215c expref: 11 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.022730:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff800/0xe984082ccd7268e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20a6 expref: 26 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.022735:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143700.022737:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143700.022739:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.022755:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff800/0xe984082ccd7268e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20a6 expref: 26 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.022763:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff800/0xe984082ccd7268e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20a6 expref: 26 pid: 8496 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746143700.022771:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593795584:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143700.022834:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc600/0xe984082ccd7269d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2155 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143700.022843:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc600/0xe984082ccd7269d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2155 expref: 11 pid: 8495 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.022851:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095099180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593795712:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143700.023070:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5200/0xe984082ccd7269e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a215c expref: 11 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.023079:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5200/0xe984082ccd7269e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a215c expref: 11 pid: 4582 timeout: 879 lvb_type: 1 00000100:00100000:3.0:1746143700.023084:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9974 00000100:00100000:2.0:1746143700.023087:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593795840:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143700.023095:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592425088:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143700.023114:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.023119:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd726860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2060 expref: 22 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143700.023125:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e91c00/0xe984082ccd72699b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2132 expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.023127:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd726860 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2060 expref: 22 pid: 4581 timeout: 879 lvb_type: 1 00010000:00010000:3.0:1746143700.023132:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801302a8800/0xe984082ccd7269ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a216a expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143700.023135:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593795968:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143700.023155:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bdc5a00/0xe984082ccd7269a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2140 expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.023161:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143700.023162:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143700.023165:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 6/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143700.023173:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00010000:00010000:3.0:1746143700.023181:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bdc5a00/0xe984082ccd7269a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2140 expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.023193:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bdc5a00/0xe984082ccd7269a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2140 expref: 15 pid: 8495 timeout: 879 lvb_type: 0 00000100:00100000:3.0:1746143700.023201:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593796096:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143700.023201:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801302a8c00/0xe984082ccd7269cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a214e expref: 11 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.023208:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801302a8c00/0xe984082ccd7269cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a214e expref: 11 pid: 15784 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746143700.023216:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593796224:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143700.023242:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801302a8800/0xe984082ccd7269ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a216a expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.023246:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72687c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2052 expref: 15 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143700.023249:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801302a8800/0xe984082ccd7269ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a216a expref: 11 pid: 25369 timeout: 879 lvb_type: 1 00010000:00010000:2.0:1746143700.023253:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72687c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2052 expref: 15 pid: 15784 timeout: 879 lvb_type: 1 00000100:00100000:3.0:1746143700.023256:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593796352:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143700.023261:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593796480:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143700.023275:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e91c00/0xe984082ccd72699b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2132 expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143700.023278:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143700.023282:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e91c00/0xe984082ccd72699b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2132 expref: 27 pid: 25369 timeout: 879 lvb_type: 0 00000100:00100000:3.0:1746143700.023288:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593796608:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143700.023300:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42300 going to sleep for 11 seconds 00000100:00080000:3.0:1746143700.023311:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746143700.024097:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a61cde00/0xe984082ccd7269da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2163 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143700.024106:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a61cde00/0xe984082ccd7269da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2163 expref: 11 pid: 8495 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.024115:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095098a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593796736:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143700.024185:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930c4600/0xe984082ccd72686e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2067 expref: 15 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143700.024193:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930c4600/0xe984082ccd72686e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2067 expref: 15 pid: 4581 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.024200:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095098700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593796864:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143700.024216:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143700.024328:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593795328:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143700.024576:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593795072:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143700.024640:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc800/0xe984082ccd7269e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2171 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143700.024650:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc800/0xe984082ccd7269e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2171 expref: 11 pid: 8495 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746143700.024657:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593796992:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143700.024689:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e91a00/0xe984082ccd72698d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a211d expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.024696:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e91a00/0xe984082ccd72698d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a211d expref: 22 pid: 25369 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746143700.024704:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593797120:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143700.024718:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143700.024729:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593795456:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143700.025602:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2c00/0xe984082ccd726859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2059 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143700.025613:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2c00/0xe984082ccd726859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2059 expref: 22 pid: 8495 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.025621:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593797248:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143700.025890:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143700.025905:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593795200:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143700.032556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143700.032575:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143700.032591:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143700.032604:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143700.032615:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143700.032642:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592425472 00000100:00100000:0.0:1746143700.032650:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592425472 00010000:00010000:0.0:1746143700.032694:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c2d800/0xe984082ccd7268c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a209f expref: 27 pid: 15784 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.032717:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592426112 00000100:00100000:0.0:1746143700.032719:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592426112 00010000:00010000:0.0:1746143700.032729:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801302a8c00/0xe984082ccd7269cc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a214e expref: 12 pid: 15784 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.032736:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592425984 00000100:00100000:0.0:1746143700.032738:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592425984 00010000:00010000:0.0:1746143700.032745:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff800/0xe984082ccd7268e5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20a6 expref: 28 pid: 8496 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.032751:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592425344 00000100:00100000:0.0:1746143700.032752:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592425344 00010000:00010000:0.0:1746143700.032762:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c176a00/0xe984082ccd7268d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ad expref: 28 pid: 15784 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.032769:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592425728 00000100:00100000:0.0:1746143700.032770:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592425728 00010000:00010000:0.0:1746143700.032779:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc600/0xe984082ccd7269d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2155 expref: 12 pid: 8495 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.032800:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5173 00000100:00100000:0.0:1746143700.032809:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963592425472:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143700.032823:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143700.032846:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c2d800/0xe984082ccd7268c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a209f expref: 28 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.032856:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c2d800/0xe984082ccd7268c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a209f expref: 28 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.032878:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c2d800/0xe984082ccd7268c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a209f expref: 28 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.032897:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143700.032936:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963592425472:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 127us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143700.032941:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5173 00000100:00100000:0.0:1746143700.032956:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5174 00000100:00100000:0.0:1746143700.032960:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592426112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143700.032967:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143700.032979:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801302a8c00/0xe984082ccd7269cc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a214e expref: 12 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.032987:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801302a8c00/0xe984082ccd7269cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a214e expref: 12 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.032998:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143700.033008:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1963:x1830963592426112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143700.033013:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5174 00000100:00100000:0.0:1746143700.033020:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5175 00000100:00100000:0.0:1746143700.033024:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592425984:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143700.033028:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143700.033036:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff800/0xe984082ccd7268e5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20a6 expref: 26 pid: 8496 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033043:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff800/0xe984082ccd7268e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20a6 expref: 26 pid: 8496 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033052:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143700.033061:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963592425984:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 36us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143700.033065:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5175 00000100:00100000:0.0:1746143700.033098:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5176 00000100:00100000:0.0:1746143700.033102:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592425344:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143700.033106:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143700.033114:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c176a00/0xe984082ccd7268d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ad expref: 28 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033121:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c176a00/0xe984082ccd7268d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ad expref: 28 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033131:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c176a00/0xe984082ccd7268d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20ad expref: 28 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033174:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143700.033188:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592425344:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 85us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143700.033193:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5176 00000100:00100000:0.0:1746143700.033202:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5177 00000100:00100000:0.0:1746143700.033206:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592425728:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143700.033210:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143700.033217:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc600/0xe984082ccd7269d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2155 expref: 12 pid: 8495 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033225:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc600/0xe984082ccd7269d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2155 expref: 12 pid: 8495 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033234:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143700.033244:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592425728:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 38us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143700.033248:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5177 00000100:00100000:0.0:1746143700.033294:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143700.033306:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592426240 00000100:00100000:0.0:1746143700.033309:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592426240 00010000:00010000:0.0:1746143700.033320:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd726860 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2060 expref: 23 pid: 4581 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.033332:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5178 00000100:00100000:0.0:1746143700.033335:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592426240:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143700.033341:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143700.033347:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd726860 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2060 expref: 23 pid: 4581 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033354:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd726860 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2060 expref: 23 pid: 4581 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033364:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143700.033375:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592426240:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 40us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143700.033380:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5178 00000100:00100000:0.0:1746143700.033421:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143700.033431:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592425600 00000100:00100000:0.0:1746143700.033433:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592425600 00010000:00010000:0.0:1746143700.033442:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c2c200/0xe984082ccd7268d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2098 expref: 27 pid: 15784 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.033453:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5179 00000100:00100000:0.0:1746143700.033456:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592425600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143700.033462:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143700.033468:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c2c200/0xe984082ccd7268d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2098 expref: 27 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033476:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c2c200/0xe984082ccd7268d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2098 expref: 27 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033485:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c2c200/0xe984082ccd7268d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2098 expref: 27 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033494:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143700.033506:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963592425600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143700.033512:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5179 00000100:00100000:0.0:1746143700.033543:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143700.033552:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592425856 00000100:00100000:0.0:1746143700.033555:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592425856 00010000:00010000:0.0:1746143700.033563:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5200/0xe984082ccd7269e8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a215c expref: 12 pid: 4582 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.033575:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5180 00000100:00100000:0.0:1746143700.033579:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592425856:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143700.033584:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143700.033591:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5200/0xe984082ccd7269e8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a215c expref: 12 pid: 4582 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033599:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5200/0xe984082ccd7269e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a215c expref: 12 pid: 4582 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.033609:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143700.033611:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143700.033617:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143700.033625:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143700.033647:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143700.033658:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592425856:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 78us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143700.033663:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5180 00000100:00100000:0.0:1746143700.033760:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095098a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593796736:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143700.033808:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095098700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593796864:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143700.033828:0:15784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143700.034215:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593796096:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143700.034223:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593796352:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143700.034231:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963593796608:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143700.034245:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746143700.034261:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746143700.034264:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746143700.034299:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801302a8c00/0xe984082ccd7269cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a214e expref: 11 pid: 15784 timeout: 879 lvb_type: 1 00000100:00100000:3.0:1746143700.034313:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593796224:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143700.034326:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963593796480:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143700.034343:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143700.034553:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593796992:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143700.034562:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963593797120:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143700.034583:0:8497:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.034607:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc600/0xe984082ccd7269d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2155 expref: 11 pid: 8495 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746143700.034619:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095099180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593795712:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143700.034701:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a21ff800/0xe984082ccd7268e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a20a6 expref: 25 pid: 8496 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746143700.034719:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593795584:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143700.034729:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5200/0xe984082ccd7269e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a215c expref: 10 pid: 4582 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746143700.034737:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593795840:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143700.034746:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd726860 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2060 expref: 22 pid: 4581 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746143700.034754:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593795968:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143700.034767:0:8495:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.034773:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.034780:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.034812:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.034820:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.034832:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.034838:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57f5600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143700.034842:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.034849:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.034861:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.034867:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5600/0xe984082ccd726a43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143700.034922:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592424832:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 12238us (12881us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143700.034929:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9973 00000100:00100000:0.0:1746143700.040378:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143700.040413:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143700.042351:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143700.042471:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143700.042486:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592426624 00000100:00100000:2.0:1746143700.042496:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592426624 00010000:00010000:2.0:1746143700.042545:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72687c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2052 expref: 16 pid: 15784 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746143700.042570:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592426752 00000100:00100000:2.0:1746143700.042572:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592426752 00010000:00010000:2.0:1746143700.042583:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61cde00/0xe984082ccd7269da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2163 expref: 11 pid: 8495 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746143700.042598:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592427136 00000100:00100000:2.0:1746143700.042600:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592427136 00010000:00010000:2.0:1746143700.042606:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930c4600/0xe984082ccd72686e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2067 expref: 17 pid: 4581 timeout: 879 lvb_type: 1 00000100:00100000:2.0:1746143700.042617:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5181 00000100:00100000:2.0:1746143700.042623:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592426624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143700.042636:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143700.042657:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72687c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2052 expref: 17 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:2.0:1746143700.042667:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72687c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2052 expref: 17 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:2.0:1746143700.042693:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72687c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2052 expref: 17 pid: 15784 timeout: 879 lvb_type: 1 00010000:00010000:2.0:1746143700.042707:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143700.042709:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143700.042713:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.042721:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.042747:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143700.042796:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1962:x1830963592426624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 164us (2420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143700.042802:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5181 00000100:00100000:2.0:1746143700.042816:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5182 00000100:00100000:2.0:1746143700.042820:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1962:x1830963592426752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143700.042826:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143700.042834:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a61cde00/0xe984082ccd7269da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2163 expref: 11 pid: 8495 timeout: 879 lvb_type: 1 00010000:00010000:2.0:1746143700.042842:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a61cde00/0xe984082ccd7269da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2163 expref: 11 pid: 8495 timeout: 879 lvb_type: 1 00010000:00010000:2.0:1746143700.042851:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a61cde00/0xe984082ccd7269da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2163 expref: 11 pid: 8495 timeout: 879 lvb_type: 1 00010000:00010000:2.0:1746143700.042863:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143700.042874:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1962:x1830963592426752:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 53us (2461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143700.042894:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5183 00000100:00100000:3.0:1746143700.042900:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1963:x1830963592427136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143700.042907:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143700.042914:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930c4600/0xe984082ccd72686e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2067 expref: 15 pid: 4581 timeout: 879 lvb_type: 1 00010000:00010000:3.0:1746143700.042922:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930c4600/0xe984082ccd72686e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2067 expref: 15 pid: 4581 timeout: 879 lvb_type: 1 00010000:00010000:3.0:1746143700.042931:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930c4600/0xe984082ccd72686e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2067 expref: 15 pid: 4581 timeout: 879 lvb_type: 1 00000100:00100000:1.0:1746143700.042934:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009509ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963593797248:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143700.042943:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143700.042945:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143700.042947:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.042953:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.042964:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143700.042967:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143700.042976:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1963:x1830963592427136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 77us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143700.042980:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5183 00000100:00080000:3.0:1746143700.042992:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746143700.042999:0:15784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.043004:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.043007:0:15784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.043011:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.043027:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.043027:0:15784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.043033:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.043033:0:15784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.043040:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.043044:0:15784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.043050:0:15784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801302a8a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143700.043051:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57f4e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143700.043054:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.043054:0:15784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.043061:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.043061:0:15784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.043068:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.043071:0:15784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.043073:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4e00/0xe984082ccd726a27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.043076:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801302a8a00/0xe984082ccd726a35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143700.043107:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592424576:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 21608us (22252us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143700.043113:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9969 00000100:00100000:1.0:1746143700.043129:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592424960:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 21193us (21237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143700.043135:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9971 00000100:00100000:2.0:1746143700.043169:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5182 00000100:00100000:2.0:1746143700.043296:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592426368 00000100:00100000:2.0:1746143700.043299:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592426368 00010000:00010000:2.0:1746143700.043309:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bdc5a00/0xe984082ccd7269a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2140 expref: 14 pid: 8495 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746143700.043326:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5184 00000100:00100000:2.0:1746143700.043329:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+14:1965:x1830963592426368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143700.043334:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143700.043342:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bdc5a00/0xe984082ccd7269a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2140 expref: 14 pid: 8495 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746143700.043349:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bdc5a00/0xe984082ccd7269a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2140 expref: 14 pid: 8495 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746143700.043357:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bdc5a00/0xe984082ccd7269a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2140 expref: 14 pid: 8495 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746143700.043364:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143700.043376:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592426368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 46us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143700.043380:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5184 00000100:00100000:1.0:1746143700.045813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.045844:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.045864:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143700.045874:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592426880 00000100:00100000:1.0:1746143700.045876:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143700.045882:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592426880 00010000:00010000:3.0:1746143700.045917:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e91c00/0xe984082ccd72699b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2132 expref: 26 pid: 25369 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746143700.046589:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143700.047410:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592426496 00000100:00100000:3.0:1746143700.047417:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592426496 00000100:00100000:1.0:1746143700.047422:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592427008 00000100:00100000:1.0:1746143700.047426:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592427008 00010000:00010000:3.0:1746143700.047438:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801302a8800/0xe984082ccd7269ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a216a expref: 8 pid: 25369 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746143700.047446:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc800/0xe984082ccd7269e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2171 expref: 9 pid: 8495 timeout: 879 lvb_type: 1 00000100:00100000:3.0:1746143700.047451:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592427264 00000100:00100000:3.0:1746143700.047455:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592427264 00000100:00100000:1.0:1746143700.047460:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592427392 00000100:00100000:1.0:1746143700.047462:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592427392 00010000:00010000:3.0:1746143700.047463:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2c00/0xe984082ccd726859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2059 expref: 22 pid: 8495 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746143700.047472:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e91a00/0xe984082ccd72698d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a211d expref: 23 pid: 25369 timeout: 879 lvb_type: 0 00000100:00100000:3.0:1746143700.047475:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5185 00000100:00100000:3.0:1746143700.047480:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592426880:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143700.047482:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5186 00000100:00100000:1.0:1746143700.047487:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592426496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143700.047494:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143700.047494:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143700.047514:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e91c00/0xe984082ccd72699b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2132 expref: 26 pid: 25369 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746143700.047514:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801302a8800/0xe984082ccd7269ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a216a expref: 8 pid: 25369 timeout: 879 lvb_type: 1 00010000:00010000:1.0:1746143700.047524:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801302a8800/0xe984082ccd7269ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a216a expref: 8 pid: 25369 timeout: 879 lvb_type: 1 00010000:00010000:3.0:1746143700.047532:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e91c00/0xe984082ccd72699b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2132 expref: 26 pid: 25369 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746143700.048066:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5187 00000100:00100000:0.0:1746143700.048075:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592427008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143700.048085:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143700.048100:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc800/0xe984082ccd7269e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2171 expref: 9 pid: 8495 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.048108:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc800/0xe984082ccd7269e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2171 expref: 9 pid: 8495 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.048127:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc800/0xe984082ccd7269e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2171 expref: 9 pid: 8495 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.048160:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143700.048338:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801302a8800/0xe984082ccd7269ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a216a expref: 8 pid: 25369 timeout: 879 lvb_type: 1 00010000:00010000:3.0:1746143700.048345:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e91c00/0xe984082ccd72699b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2132 expref: 26 pid: 25369 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746143700.048350:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143700.048352:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143700.048356:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048364:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.048377:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143700.048392:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143700.048396:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592426880:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 915us (2593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143700.048402:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5185 00000100:00100000:1.0:1746143700.048409:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963592426496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 921us (2563us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143700.048415:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5186 00000100:00100000:3.0:1746143700.048431:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5188 00000100:00100000:0.0:1746143700.048434:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1965:x1830963592427008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 361us (2568us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143700.048436:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963592427264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143700.048440:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5187 00010000:00010000:3.0:1746143700.048442:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143700.048452:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2c00/0xe984082ccd726859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2059 expref: 23 pid: 8495 timeout: 879 lvb_type: 1 00000100:00100000:0.0:1746143700.048453:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5189 00000100:00100000:0.0:1746143700.048459:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963592427392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143700.048465:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143700.048466:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2c00/0xe984082ccd726859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2059 expref: 23 pid: 8495 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.048472:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e91a00/0xe984082ccd72698d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a211d expref: 23 pid: 25369 timeout: 879 lvb_type: 0 00010000:00010000:3.0:1746143700.048477:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2c00/0xe984082ccd726859 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2059 expref: 23 pid: 8495 timeout: 879 lvb_type: 1 00010000:00010000:0.0:1746143700.048479:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e91a00/0xe984082ccd72698d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a211d expref: 23 pid: 25369 timeout: 879 lvb_type: 0 00010000:00010000:3.0:1746143700.048486:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143700.048488:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143700.048489:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e91a00/0xe984082ccd72698d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a211d expref: 22 pid: 25369 timeout: 879 lvb_type: 0 00010000:00010000:3.0:1746143700.048490:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143700.048496:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143700.048497:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143700.048509:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+21:1963:x1830963592427392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (1921us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143700.048511:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143700.048513:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5189 00000100:00100000:3.0:1746143700.048525:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592427264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 90us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143700.048531:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5188 00010000:00010000:1.0:1746143700.048575:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048582:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048601:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048608:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048614:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048620:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ae46600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143700.048624:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048631:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048644:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048649:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae46600/0xe984082ccd726a2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143700.048688:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:1965:x1830963592424704:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 26810us (26873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143700.048694:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9970 00010000:00010000:1.0:1746143700.048713:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048718:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048730:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048734:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048740:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048744:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e5e000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143700.048746:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048752:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048759:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.048763:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5e000/0xe984082ccd726a4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143700.048805:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1965:x1830963592425088:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 25715us (26743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143700.048809:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9974 00000100:00100000:0.0:1746143700.050875:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143700.052169:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592427520 00000100:00100000:3.0:1746143700.052179:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592427520 00010000:00010000:3.0:1746143700.052214:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae47600/0xe984082ccd7269a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2139 expref: 25 pid: 25369 timeout: 879 lvb_type: 0 00000100:00100000:3.0:1746143700.052252:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5190 00000100:00100000:3.0:1746143700.052259:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963592427520:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143700.052271:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143700.052294:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ae47600/0xe984082ccd7269a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2139 expref: 25 pid: 25369 timeout: 879 lvb_type: 0 00010000:00010000:3.0:1746143700.052306:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ae47600/0xe984082ccd7269a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2139 expref: 25 pid: 25369 timeout: 879 lvb_type: 0 00010000:00010000:3.0:1746143700.052326:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae47600/0xe984082ccd7269a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2139 expref: 25 pid: 25369 timeout: 879 lvb_type: 0 00010000:00010000:3.0:1746143700.052340:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143700.052343:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143700.052347:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.052355:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143700.052384:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143700.052425:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963592427520:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 166us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143700.052432:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5190 00010000:00010000:1.0:1746143700.052685:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.052696:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.052717:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.052723:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.052729:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.052740:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ae46c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143700.052744:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.052750:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.052759:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.052763:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae46c00/0xe984082ccd726a3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143700.052814:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1965:x1830963592425216:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 30768us (30801us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143700.052821:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9972 00000100:00100000:0.0:1746143700.055333:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143700.055355:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592427776 00000100:00100000:2.0:1746143700.055366:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592427776 00000100:00100000:2.0:1746143700.055418:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8370 00000100:00100000:2.0:1746143700.055427:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+28:28635:x1830963592427776:12345-192.168.202.48@tcp:36:mirror_io.0 00010000:00010000:2.0:1746143700.055478:0:14764:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143700.055501:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46800/0xe984082ccd726a20 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2186 expref: 28 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055517:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143700.055523:0:14764:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143700.055551:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143700.055563:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a1d expref: 276 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055570:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 276 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055577:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd725e49 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a39 expref: 31 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055582:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726255 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c93 expref: 31 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055587:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5400/0xe984082ccd72642a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dce expref: 276 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055593:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd7264a1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e06 expref: 31 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055599:0:14764:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd726779 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff7 expref: 276 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055606:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 10/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:2.0:1746143700.055638:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd726779 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff7 expref: 276 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055655:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd726779 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff7 expref: 276 pid: 20509 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746143700.055669:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593797376:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143700.055763:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd7264a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e06 expref: 31 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055771:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd7264a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e06 expref: 31 pid: 16090 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746143700.055779:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593797504:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143700.055816:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5400/0xe984082ccd72642a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dce expref: 276 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055823:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5400/0xe984082ccd72642a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dce expref: 276 pid: 21713 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746143700.055830:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593797632:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143700.055853:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726255 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c93 expref: 31 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055861:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726255 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c93 expref: 31 pid: 21713 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746143700.055868:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593797760:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143700.055893:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd725e49 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a39 expref: 31 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055900:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd725e49 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a39 expref: 31 pid: 14764 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746143700.055907:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593797888:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143700.055927:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 276 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055934:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 276 pid: 21713 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746143700.055941:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593798016:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143700.055962:0:14764:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a1d expref: 276 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.055969:0:14764:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a1d expref: 276 pid: 16090 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746143700.055975:0:14764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593798144:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143700.055991:0:14764:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143700.059066:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593797376:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143700.060037:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593797632:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143700.060045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143700.060048:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593797760:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143700.060079:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143700.060092:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592428160 00000100:00100000:3.0:1746143700.060100:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592428160 00000100:00100000:1.0:1746143700.060101:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.060116:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.060133:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592428544 00000100:00100000:1.0:1746143700.060137:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592428544 00000100:00100000:0.0:1746143700.060153:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592428800 00000100:00100000:0.0:1746143700.060158:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592428800 00000100:00100000:3.0:1746143700.060159:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592428416 00000100:00100000:3.0:1746143700.060161:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592428416 00000100:00100000:3.0:1746143700.060177:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3423 00010000:00010000:1.0:1746143700.060178:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 278 pid: 21713 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746143700.060178:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd7264a1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e06 expref: 33 pid: 16090 timeout: 879 lvb_type: 0 00000100:00100000:3.0:1746143700.060184:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+278:15421:x1830963592428160:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143700.060198:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5191 00000100:00100000:1.0:1746143700.060204:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5192 00000100:00100000:0.0:1746143700.060204:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+33:1962:x1830963592428800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143700.060210:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+278:1962:x1830963592428544:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143700.060217:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143700.060218:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143700.060222:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd7264a1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e06 expref: 33 pid: 16090 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746143700.060223:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 278 pid: 21713 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746143700.060232:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd7264a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e06 expref: 33 pid: 16090 timeout: 879 lvb_type: 0 00000100:00100000:2.0:1746143700.060365:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593797888:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143700.060379:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593798016:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143700.060387:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593798144:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143700.060394:0:14764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14764:1830963593797504:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143700.060398:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 278 pid: 21713 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746143700.060420:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2a00/0xe984082ccd725e3b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a2b expref: 278 pid: 21713 timeout: 879 lvb_type: 0 00010000:00010000:2.0:1746143700.060428:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143700.060439:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143700.060443:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143700.060452:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143700.060488:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+277:1962:x1830963592428544:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 278us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143700.060494:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5192 00000100:00100000:1.0:1746143700.060580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.060593:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592428672 00000100:00100000:1.0:1746143700.060596:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592428672 00010000:00010000:1.0:1746143700.060605:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a1d expref: 277 pid: 16090 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746143700.060616:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5193 00000100:00100000:1.0:1746143700.060620:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+277:1962:x1830963592428672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143700.060668:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143700.060673:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a1d expref: 278 pid: 16090 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746143700.060680:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a1d expref: 278 pid: 16090 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746143700.060690:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fdfc00/0xe984082ccd725e2d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a1d expref: 278 pid: 16090 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746143700.060698:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143700.060701:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143700.060706:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143700.060714:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+277:15421:x1830963592428160:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 529us (679us total) trans 8589942493 rc 0/0 00000100:00100000:3.0:1746143700.060720:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3423 00000100:00100000:1.0:1746143700.060720:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+277:1962:x1830963592428672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143700.060725:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5193 00000100:00100000:3.0:1746143700.060732:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3424 00000100:00100000:3.0:1746143700.060737:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+33:7696:x1830963592428416:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143700.060817:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+34:7696:x1830963592428416:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 79us (737us total) trans 8589942494 rc 0/0 00000100:00100000:3.0:1746143700.060823:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3424 00000100:00080000:3.0:1746143700.060843:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746143700.061374:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd7264a1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1e06 expref: 33 pid: 16090 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746143700.061384:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143700.061388:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143700.061393:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143700.062282:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1962:x1830963592428800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2075us (2161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143700.062291:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5191 00000100:00100000:3.0:1746143700.066036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143700.066235:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143700.066271:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143700.066480:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592427904 00000100:00100000:0.0:1746143700.066489:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592427904 00010000:00010000:0.0:1746143700.066525:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd726779 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff7 expref: 276 pid: 20509 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746143700.066557:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592428928 00000100:00100000:0.0:1746143700.066559:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592428928 00010000:00010000:0.0:1746143700.066571:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd725e49 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a39 expref: 32 pid: 14764 timeout: 879 lvb_type: 0 00000100:00100000:0.0:1746143700.066587:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5194 00000100:00100000:0.0:1746143700.066595:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+276:1964:x1830963592427904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143700.066608:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143700.066613:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd726779 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff7 expref: 276 pid: 20509 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746143700.066627:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd726779 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff7 expref: 276 pid: 20509 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746143700.066649:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c177600/0xe984082ccd726779 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1ff7 expref: 276 pid: 20509 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746143700.066664:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143700.066668:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143700.066676:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143700.066719:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+275:1964:x1830963592427904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 124us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143700.066725:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5194 00000100:00100000:0.0:1746143700.066740:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5195 00000100:00100000:0.0:1746143700.066745:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+32:1963:x1830963592428928:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143700.066751:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143700.066755:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd725e49 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a39 expref: 32 pid: 14764 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746143700.066767:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd725e49 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a39 expref: 32 pid: 14764 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746143700.066778:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd725e49 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1a39 expref: 32 pid: 14764 timeout: 879 lvb_type: 0 00010000:00010000:0.0:1746143700.066800:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143700.066803:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143700.066807:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143700.066824:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1963:x1830963592428928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 77us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143700.066829:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5195 00000100:00100000:1.0:1746143700.066867:0:14758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592429056 00000100:00100000:1.0:1746143700.066872:0:14758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592429056 00000100:00100000:3.0:1746143700.066897:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.066899:0:14758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 175 00000100:00100000:1.0:1746143700.066905:0:14758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c23f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1965:x1830963592429056:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1746143700.066911:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592429184 00000100:00100000:3.0:1746143700.066914:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592429184 00010000:00010000:3.0:1746143700.066927:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5400/0xe984082ccd72642a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dce expref: 275 pid: 21713 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746143700.066939:0:14758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c23f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1965:x1830963592429056:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 34us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143700.066940:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5196 00000100:00100000:3.0:1746143700.066945:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+275:1963:x1830963592429184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143700.066945:0:14758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 175 00010000:00010000:3.0:1746143700.066951:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143700.066954:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5400/0xe984082ccd72642a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dce expref: 275 pid: 21713 timeout: 879 lvb_type: 0 00010000:00010000:3.0:1746143700.066961:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5400/0xe984082ccd72642a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dce expref: 275 pid: 21713 timeout: 879 lvb_type: 0 00010000:00010000:3.0:1746143700.066972:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5400/0xe984082ccd72642a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1dce expref: 275 pid: 21713 timeout: 879 lvb_type: 0 00010000:00010000:3.0:1746143700.066994:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143700.066997:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143700.067002:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143700.067016:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+274:1963:x1830963592429184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 71us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143700.067021:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5196 00000100:00100000:0.0:1746143700.069691:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143700.070444:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592429312 00000100:00100000:3.0:1746143700.070453:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592429312 00010000:00010000:3.0:1746143700.070488:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726255 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c93 expref: 31 pid: 21713 timeout: 879 lvb_type: 0 00000100:00100000:3.0:1746143700.070518:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5197 00000100:00100000:3.0:1746143700.070526:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+31:1963:x1830963592429312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143700.070541:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143700.070547:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726255 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c93 expref: 31 pid: 21713 timeout: 879 lvb_type: 0 00010000:00010000:3.0:1746143700.070557:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726255 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c93 expref: 31 pid: 21713 timeout: 879 lvb_type: 0 00010000:00010000:3.0:1746143700.070577:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a800/0xe984082ccd726255 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a1c93 expref: 31 pid: 21713 timeout: 879 lvb_type: 0 00010000:00010000:3.0:1746143700.070594:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143700.070599:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143700.070608:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143700.070614:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143700.070634:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143700.070675:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+30:1963:x1830963592429312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 150us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143700.070681:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5197 00010000:00010000:0.0:1746143700.071821:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143700.071832:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000040:00080000:0.0:1746143700.072502:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2312, 88 off194400 00000004:00080000:0.0:1746143700.072511:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779082370433ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143700.072555:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2258, 88 off189472 00000004:00080000:0.0:1746143700.072560:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779082420267ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143700.072579:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2259, 88 off189560 00000004:00080000:0.0:1746143700.072582:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779082442436ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143700.072589:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2313, 88 off194488 00000004:00080000:0.0:1746143700.072592:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779082452109ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143700.072611:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2314, 88 off194576 00000004:00080000:0.0:1746143700.072614:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779082474774ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143700.072720:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2260, 88 off189648 00000004:00080000:0.0:1746143700.072726:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779082586259ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143700.074024:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2261, 88 off189736 00000004:00080000:0.0:1746143700.074030:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779083890417ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143700.074319:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2262, 88 off189824 00000004:00080000:0.0:1746143700.074324:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779084183969ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143700.074335:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2315, 88 off194664 00000004:00080000:0.0:1746143700.074338:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779084198152ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143700.074360:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2263, 88 off189912 00000004:00080000:0.0:1746143700.074363:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779084223537ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143700.074370:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2316, 88 off194752 00000004:00080000:0.0:1746143700.074373:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779084233225ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143700.074379:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2264, 88 off190000 00000004:00080000:0.0:1746143700.074382:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779084242069ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143700.074388:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2317, 88 off194840 00000004:00080000:0.0:1746143700.074390:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779084250825ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143700.074399:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2318, 88 off194928 00000004:00080000:0.0:1746143700.074402:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779084262098ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143700.074410:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2319, 88 off195016 00000004:00080000:0.0:1746143700.074414:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779084274775ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143700.074422:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2320, 88 off195104 00000004:00080000:0.0:1746143700.074425:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779084285404ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143700.074433:0:14764:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2265, 88 off190088 00000004:00080000:0.0:1746143700.074436:0:14764:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779084296195ns, next at 718087967394ns, rc = 0 00000004:00010000:0.0:1746143700.113112:0:14764:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a5c22d80 reply state ffff880090e79800 transno 8589942495 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000001:00080000:2.0:1746143700.113120:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942495 is committed 00000100:00100000:0.0:1746143700.113128:0:14764:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:2.0:1746143700.113129:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1610 committed 00000004:00080000:2.0:1746143700.113261:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1665 committed 00000100:00100000:0.0:1746143700.113378:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593798272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143700.113435:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143700.113480:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593798784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143700.113495:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143700.113505:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143700.113509:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593798400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143700.113522:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143700.113532:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593798912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143700.113553:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1746143700.113561:0:14764:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746143700.113572:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593798656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143700.113575:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+28:28635:x1830963592427776:12345-192.168.202.48@tcp:36:mirror_io.0 Request processed in 58147us (58251us total) trans 8589942495 rc 0/0 00000100:00100000:1.0:1746143700.113584:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8370 00000100:00100000:0.0:1746143700.113588:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143700.113598:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593799168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143700.113610:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143700.113618:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593798272 00000100:00100000:0.0:1746143700.113618:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143700.113621:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593798528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143700.113626:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593798272 00000100:00100000:0.0:1746143700.113634:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143700.113643:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593799040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143700.113653:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143700.113660:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593798784 00000100:00100000:1.0:1746143700.113662:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593798784 00000100:00100000:1.0:1746143700.113673:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593798400 00000100:00100000:1.0:1746143700.113674:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593798400 00000100:00100000:1.0:1746143700.113684:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593798912 00000100:00100000:1.0:1746143700.113685:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593798912 00000100:00100000:1.0:1746143700.113693:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593798656 00000100:00100000:1.0:1746143700.113695:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593798656 00000100:00100000:1.0:1746143700.113700:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593799168 00000100:00100000:1.0:1746143700.113702:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593799168 00000100:00100000:1.0:1746143700.113707:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593798528 00000100:00100000:1.0:1746143700.113708:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593798528 00000100:00100000:1.0:1746143700.113713:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593799040 00000100:00100000:1.0:1746143700.113714:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593799040 00000100:00100000:1.0:1746143700.113723:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9975 00000100:00100000:1.0:1746143700.113729:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593798272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143700.113776:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9976 00000100:00100000:0.0:1746143700.113782:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593798784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143700.113931:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1830963593798272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (496us total) trans 21474839778 rc 0/0 00002000:00010000:0.0:1746143700.113934:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00000100:00100000:1.0:1746143700.113937:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9975 00002000:00010000:0.0:1746143700.113937:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:0.0:1746143700.113939:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143700.113941:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:0.0:1746143700.113943:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:1.0:1746143700.113947:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9977 00000100:00100000:1.0:1746143700.113951:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593798400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143700.113959:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593798784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 179us (463us total) trans 21474839779 rc 0/0 00000100:00100000:0.0:1746143700.113964:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9976 00000100:00100000:0.0:1746143700.113972:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9978 00000100:00100000:0.0:1746143700.113976:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593798912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143700.114031:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1830963593798400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (507us total) trans 21474839780 rc 0/0 00000100:00100000:1.0:1746143700.114036:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9977 00000100:00100000:0.0:1746143700.114043:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593798912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (490us total) trans 21474839781 rc 0/0 00000100:00100000:1.0:1746143700.114045:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9979 00000100:00100000:0.0:1746143700.114048:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9978 00000100:00100000:1.0:1746143700.114049:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593798656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143700.114055:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9980 00000100:00100000:0.0:1746143700.114058:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963593799168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143700.114110:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9981 00000100:00100000:1.0:1746143700.114114:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963593798528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143700.114128:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963593799168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (516us total) trans 21474839782 rc 0/0 00000100:00100000:0.0:1746143700.114133:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9980 00000100:00100000:0.0:1746143700.114159:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9982 00000100:00100000:0.0:1746143700.114163:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593799040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143700.114218:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3293:x1830963593798528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (582us total) trans 21474839784 rc 0/0 00000100:00100000:1.0:1746143700.114223:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9981 00000100:00100000:0.0:1746143700.114234:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963593799040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (579us total) trans 21474839785 rc 0/0 00000100:00100000:0.0:1746143700.114238:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9982 00000004:00080000:0.0:1746143700.114265:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0d500/2, rc 0, transno 21474839784 00000100:00100000:0.0:1746143700.114270:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593798528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143700.114277:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f9f80/2, rc 0, transno 21474839785 00000100:00100000:0.0:1746143700.114280:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593799040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143700.114287:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f8000/2, rc 0, transno 21474839782 00000004:00080000:2.0:1746143700.114288:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1664 committed 00000100:00100000:0.0:1746143700.114289:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593799168:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143700.114290:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1663 committed 00000004:00080000:2.0:1746143700.114293:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1662 committed 00000004:00080000:2.0:1746143700.114294:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1609 committed 00000004:00080000:2.0:1746143700.114296:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1661 committed 00000004:00080000:2.0:1746143700.114297:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1608 committed 00000004:00080000:2.0:1746143700.114299:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1660 committed 00000004:00080000:2.0:1746143700.114300:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1607 committed 00000004:00080000:0.0:1746143700.114300:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0c380/2, rc 0, transno 21474839780 00000004:00080000:2.0:1746143700.114302:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1606 committed 00000100:00100000:0.0:1746143700.114302:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593798400:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143700.114304:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1605 committed 00000004:00080000:2.0:1746143700.114305:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1659 committed 00000004:00080000:2.0:1746143700.114307:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1658 committed 00000004:00080000:0.0:1746143700.114307:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0ed80/2, rc 0, transno 21474839781 00000004:00080000:2.0:1746143700.114308:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1604 committed 00000004:00080000:2.0:1746143700.114309:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1603 committed 00000100:00100000:0.0:1746143700.114309:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593798912:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143700.114313:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1657 committed 00000004:00080000:0.0:1746143700.114314:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0c000/2, rc 0, transno 21474839779 00000100:00100000:0.0:1746143700.114316:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593798784:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1746143700.114320:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942484 is committed 00000004:00080000:0.0:1746143700.114320:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0c700/2, rc 0, transno 21474839778 00000100:00100000:0.0:1746143700.114323:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593798272:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1746143700.114339:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942447 is committed 00002000:00010000:0.0:1746143700.114349:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143700.114351:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143700.114352:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143700.114354:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143700.114356:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000001:00080000:2.0:1746143700.114358:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942487 is committed 00000001:00080000:2.0:1746143700.114373:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942472 is committed 00000100:00100000:0.0:1746143700.114375:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593798656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 326us (786us total) trans 21474839783 rc 0/0 00000100:00100000:0.0:1746143700.114380:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9979 00000001:00080000:2.0:1746143700.114398:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942490 is committed 00000001:00080000:2.0:1746143700.114404:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942489 is committed 00000001:00080000:2.0:1746143700.114449:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942494 is committed 00000001:00080000:2.0:1746143700.114454:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942493 is committed 00010000:00010000:3.0:1746143700.114657:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143700.114666:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143700.114672:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143700.114678:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cde0800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143700.114682:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143700.114689:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143700.114706:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143700.114709:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143700.114713:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:3.0:1746143700.114717:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0800/0xe984082ccd726a51 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00000100:00080000:3.0:1746143700.114740:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143700.114889:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593799552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143700.114915:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143700.114938:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593800064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143700.114950:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143700.114960:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143700.114964:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593799680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143700.114976:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143700.114985:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593800192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143700.114996:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143700.115010:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593799552 00000100:00100000:2.0:1746143700.115013:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593799552 00000100:00100000:2.0:1746143700.115034:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593800064 00000100:00100000:2.0:1746143700.115036:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593800064 00000100:00100000:2.0:1746143700.115043:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593799680 00000100:00100000:2.0:1746143700.115044:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593799680 00000100:00100000:2.0:1746143700.115051:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593800192 00000100:00100000:2.0:1746143700.115052:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593800192 00000100:00100000:2.0:1746143700.115062:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9983 00000100:00100000:2.0:1746143700.115066:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3292:x1830963593799552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143700.115217:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3292:x1830963593799552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 150us (301us total) trans 17179872511 rc 0/0 00000100:00100000:2.0:1746143700.115222:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9983 00000100:00100000:2.0:1746143700.115233:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9984 00000100:00100000:2.0:1746143700.115238:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3292:x1830963593800064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143700.115335:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3292:x1830963593800064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (382us total) trans 17179872512 rc 0/0 00000100:00100000:2.0:1746143700.115340:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9984 00000100:00100000:2.0:1746143700.115349:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9985 00000100:00100000:2.0:1746143700.115353:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3292:x1830963593799680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143700.115417:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143700.115419:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746143700.115421:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143700.115423:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746143700.115424:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143700.115439:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3292:x1830963593799680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (462us total) trans 17179872513 rc 0/0 00000100:00100000:2.0:1746143700.115444:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9985 00000100:00100000:2.0:1746143700.115452:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9986 00000100:00100000:2.0:1746143700.115457:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3292:x1830963593800192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143700.115534:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3292:x1830963593800192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (536us total) trans 17179872514 rc 0/0 00000100:00100000:2.0:1746143700.115539:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9986 00000004:00080000:2.0:1746143700.115578:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6d500/2, rc 0, transno 17179872513 00000100:00100000:2.0:1746143700.115585:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593799680:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143700.115592:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136919c00/2, rc 0, transno 17179872514 00000100:00100000:2.0:1746143700.115595:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593800192:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143700.115601:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f8380/2, rc 0, transno 17179872511 00000100:00100000:2.0:1746143700.115604:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593799552:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143700.115611:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013691b480/2, rc 0, transno 17179872512 00000100:00100000:2.0:1746143700.115613:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593800064:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143700.118960:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0df80/2, rc 0, transno 21474839783 00000100:00100000:1.0:1746143700.118973:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593798656:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1746143700.119086:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143700.120236:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593799424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143700.120814:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143700.121023:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.121052:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592429440 00000100:00100000:1.0:1746143700.121059:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592429440 00000100:00100000:1.0:1746143700.121110:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8371 00000100:00100000:1.0:1746143700.121121:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+7:28635:x1830963592429440:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143700.121162:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143700.121181:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde1e00/0xe984082ccd726a58 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a218d expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.121239:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde1e00/0xe984082ccd726a58 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a218d expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.121252:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde1e00/0xe984082ccd726a58 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a218d expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.121270:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143700.121273:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143700.121276:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cde1e00, rc 0) 00000100:00100000:1.0:1746143700.121550:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28635:x1830963592429440:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 429us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143700.121557:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8371 00000100:00100000:3.0:1746143700.121828:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593799424 00000100:00100000:3.0:1746143700.121832:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593799424 00000100:00100000:1.0:1746143700.122560:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593799296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143700.122968:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9987 00000100:00100000:2.0:1746143700.122978:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3295:x1830963593799424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143700.123228:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3295:x1830963593799424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 252us (2415us total) trans 17179872515 rc 0/0 00000100:00100000:2.0:1746143700.123234:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9987 00000100:00100000:1.0:1746143700.123297:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143700.123324:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593799296 00000100:00100000:2.0:1746143700.123329:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593799296 00000100:00100000:2.0:1746143700.123346:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9988 00000100:00100000:2.0:1746143700.123350:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3294:x1830963593799296:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143700.123400:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3fa300/2, rc 0, transno 17179872515 00000100:00100000:0.0:1746143700.123405:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593799424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143700.123418:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593799936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143700.123442:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143700.123454:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3294:x1830963593799296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (157us total) trans 17179872516 rc 0/0 00000100:00100000:2.0:1746143700.123459:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9988 00000100:00100000:2.0:1746143700.123469:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593799936 00000100:00100000:2.0:1746143700.123471:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593799936 00000100:00100000:2.0:1746143700.123483:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9989 00000100:00100000:2.0:1746143700.123487:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3295:x1830963593799936:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143700.123541:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3fa680/2, rc 0, transno 17179872516 00000100:00100000:1.0:1746143700.123545:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593799296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143700.123550:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593799808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143700.123567:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143700.123577:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963593799936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (134us total) trans 17179872517 rc 0/0 00000100:00100000:1.0:1746143700.123579:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593800320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143700.123582:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9989 00000100:00100000:2.0:1746143700.123590:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593799808 00000100:00100000:1.0:1746143700.123592:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143700.123593:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593799808 00000100:00100000:2.0:1746143700.123603:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593800320 00000100:00100000:2.0:1746143700.123605:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593800320 00000100:00100000:1.0:1746143700.123610:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9990 00000100:00100000:1.0:1746143700.123615:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593799808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143700.123617:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9991 00000100:00100000:2.0:1746143700.123621:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593800320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143700.123705:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3294:x1830963593800320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (110us total) trans 17179872518 rc 0/0 00000100:00100000:2.0:1746143700.123709:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9991 00000100:00100000:1.0:1746143700.123714:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3294:x1830963593799808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (146us total) trans 17179872519 rc 0/0 00000100:00100000:1.0:1746143700.123719:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9990 00000004:00080000:2.0:1746143700.123728:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013691b800/2, rc 0, transno 17179872517 00000100:00100000:2.0:1746143700.123731:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593799936:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143700.123741:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136919500/2, rc 0, transno 17179872519 00000100:00100000:1.0:1746143700.123744:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593799808:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143700.123749:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0ad180/2, rc 0, transno 17179872518 00000100:00100000:1.0:1746143700.123751:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593800320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143700.125971:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.126336:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592429568 00000100:00100000:1.0:1746143700.126343:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592429568 00000100:00100000:1.0:1746143700.126627:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8372 00000100:00100000:1.0:1746143700.126636:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28635:x1830963592429568:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143700.126656:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143700.126674:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0200/0xe984082ccd726a5f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2194 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.126759:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd726a66 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143700.126771:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd726a66 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143700.126782:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd726a66 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:1.0:1746143700.126827:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:1.0:1746143700.126830:0:14764:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143700.126844:0:14764:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd726a66 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:1.0:1746143700.126865:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0200/0xe984082ccd726a5f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2194 expref: 10 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.126896:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd726a66 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2194 expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.126904:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143700.126907:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143700.126910:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cde0600, rc 0) 00000100:00100000:1.0:1746143700.126956:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28635:x1830963592429568:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 322us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143700.126963:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8372 00000100:00100000:3.0:1746143700.130573:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143700.130614:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143700.130635:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143700.130651:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143700.130664:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143700.130744:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143700.130873:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592429824 00000100:00100000:1.0:1746143700.130883:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592429824 00000100:00100000:1.0:1746143700.130923:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592430080 00000100:00100000:1.0:1746143700.130926:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592430080 00000100:00100000:1.0:1746143700.130940:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592430336 00000100:00100000:1.0:1746143700.130942:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592430336 00000100:00100000:1.0:1746143700.130951:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592429696 00000100:00100000:1.0:1746143700.130953:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592429696 00000100:00100000:1.0:1746143700.130963:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592429952 00000100:00100000:1.0:1746143700.130965:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592429952 00000100:00100000:1.0:1746143700.130975:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592430208 00000100:00100000:1.0:1746143700.130977:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592430208 00000100:00100000:1.0:1746143700.130989:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9992 00000100:00100000:1.0:1746143700.130996:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592429824:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143700.131016:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143700.131035:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e91c00/0xe984082ccd726a6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21a2 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143700.131062:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34a:0x0] initial LVB size: 2097152, mtime: 0x681409d1, atime: 0x681409cf, ctime: 0x681409d1, blocks: 0x821 00010000:00010000:1.0:1746143700.131081:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143700.131083:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143700.131092:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e91c00/0xe984082ccd726a6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21a2 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143700.131108:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e91c00/0xe984082ccd726a6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21a2 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143700.131119:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91c00, rc 0) 00000100:00100000:1.0:1746143700.131180:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592429824:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 183us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143700.131187:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9992 00000100:00100000:1.0:1746143700.131201:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9993 00000100:00100000:1.0:1746143700.131206:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592430080:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143700.131214:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143700.131225:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726a74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21b0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143700.131240:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9994 00002000:00010000:1.0:1746143700.131241:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409d2, atime: 0x681409d2, ctime: 0x681409d2, blocks: 0x81f 00010000:00010000:1.0:1746143700.131250:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143700.131252:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143700.131256:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726a74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21b0 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143700.131262:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592430336:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143700.131265:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726a74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21b0 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.131269:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143700.131271:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e90a00, rc 0) 00000100:00100000:1.0:1746143700.131289:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592430080:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 82us (674us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143700.131290:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd726a7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21be expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143700.131293:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9993 00000100:00100000:1.0:1746143700.131303:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9995 00002000:00010000:2.0:1746143700.131304:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409d3, atime: 0x681409d3, ctime: 0x681409d3, blocks: 0x1029 00000100:00100000:1.0:1746143700.131307:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592429696:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143700.131312:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143700.131324:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e90200/0xe984082ccd726a82 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a219b expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143700.131326:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143700.131328:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143700.131332:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd726a7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21be expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746143700.131335:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409cf, atime: 0x681409cf, ctime: 0x681409cf, blocks: 0x807 00010000:00010000:1.0:1746143700.131342:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143700.131343:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143700.131347:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e90200/0xe984082ccd726a82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a219b expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.131353:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd726a7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21be expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143700.131354:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e90200/0xe984082ccd726a82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a219b expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.131360:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21fe200, rc 0) 00010000:00010000:1.0:1746143700.131360:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e90200, rc 0) 00000100:00100000:1.0:1746143700.131374:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592429696:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 67us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143700.131379:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9995 00000100:00100000:2.0:1746143700.131384:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592430336:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 138us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143700.131389:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9994 00000100:00100000:1.0:1746143700.131392:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9996 00000100:00100000:1.0:1746143700.131396:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592429952:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143700.131401:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143700.131409:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726a89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21a9 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143700.131412:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9997 00000100:00100000:2.0:1746143700.131417:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1964:x1830963592430208:12345-192.168.202.48@tcp:101:mirror_io.0 00002000:00010000:1.0:1746143700.131419:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34b:0x0] initial LVB size: 2097152, mtime: 0x681409d2, atime: 0x681409d2, ctime: 0x681409d2, blocks: 0x821 00010000:00010000:2.0:1746143700.131422:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143700.131426:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143700.131427:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143700.131430:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd726a90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21b7 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143700.131431:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726a89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21a9 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143700.131438:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726a89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21a9 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143700.131445:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91e00, rc 0) 00002000:00010000:2.0:1746143700.131452:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 4897312, mtime: 0x681409d3, atime: 0x681409d3, ctime: 0x681409d3, blocks: 0x15a5 00000100:00100000:1.0:1746143700.131461:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592429952:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 64us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143700.131466:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9996 00010000:00010000:2.0:1746143700.131473:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143700.131474:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143700.131478:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd726a90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21b7 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.131487:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd726a90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21b7 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143700.131493:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5c000, rc 0) 00000100:00100000:2.0:1746143700.131519:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592430208:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 101us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143700.131524:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9997 00010000:00010000:3.0:1746143700.605955:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143701.143716:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143701.143816:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592430592 00000100:00100000:2.0:1746143701.143828:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592430592 00000100:00100000:2.0:1746143701.143911:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3740 00000100:00100000:2.0:1746143701.143921:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592430592:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143701.143964:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8801368a7800/0xe984082ccd726a97 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.143980:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143701.143981:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143701.143987:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a7800/0xe984082ccd726a97 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.144001:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a7800/0xe984082ccd726a97 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143701.146904:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.146941:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.146956:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.146964:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592431104 00000100:00100000:1.0:1746143701.146974:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592431104 00000100:00100000:0.0:1746143701.146985:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.147005:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592430976 00000100:00100000:0.0:1746143701.147008:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592430976 00000100:00100000:1.0:1746143701.147024:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592431360 00000100:00100000:1.0:1746143701.147026:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592431360 00000100:00100000:0.0:1746143701.147036:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592431488 00000100:00100000:0.0:1746143701.147038:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592431488 00000100:00100000:1.0:1746143701.147048:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3741 00000100:00100000:1.0:1746143701.147063:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1964:x1830963592431104:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143701.147098:0:26144:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e7c200/0xe984082ccd726a9e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.147114:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.147116:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.147120:0:26144:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e7c200/0xe984082ccd726a9e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.147133:0:26144:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8e7c200/0xe984082ccd726a9e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143701.148717:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3742 00000100:00100000:0.0:1746143701.148729:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963592430976:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143701.148763:0:21518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093bfa800/0xe984082ccd726aa5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.148786:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143701.148788:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143701.148792:0:21518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bfa800/0xe984082ccd726aa5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.148803:0:21518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bfa800/0xe984082ccd726aa5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143701.149086:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3743 00000100:00100000:1.0:1746143701.149093:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592431360:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143701.149112:0:25543:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d598600/0xe984082ccd726aac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.149120:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.149121:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.149124:0:25543:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d598600/0xe984082ccd726aac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.149154:0:25543:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d598600/0xe984082ccd726aac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143701.149733:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3744 00000100:00100000:3.0:1746143701.149741:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1964:x1830963592431488:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143701.149759:0:8502:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2400/0xe984082ccd726ab3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.149766:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143701.149767:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143701.149770:0:8502:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2400/0xe984082ccd726ab3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.149787:0:8502:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2400/0xe984082ccd726ab3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143701.150558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143701.150580:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592431872 00000100:00100000:2.0:1746143701.150587:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592431872 00000100:00100000:2.0:1746143701.150627:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3745 00000100:00100000:2.0:1746143701.150633:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+12:1965:x1830963592431872:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143701.150649:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094c2d800/0xe984082ccd726aba lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.150658:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143701.150659:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143701.150662:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2d800/0xe984082ccd726aba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.150670:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c2d800/0xe984082ccd726aba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143701.153407:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.153489:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.153512:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592432256 00000100:00100000:0.0:1746143701.153520:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592432256 00000100:00100000:1.0:1746143701.157069:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592432384 00000100:00100000:1.0:1746143701.157080:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592432384 00000100:00100000:1.0:1746143701.157152:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3746 00000100:00100000:1.0:1746143701.157161:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1964:x1830963592432384:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143701.157200:0:31339:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cde0800/0xe984082ccd726ac1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.157215:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.157217:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.157222:0:31339:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cde0800/0xe984082ccd726ac1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.157236:0:31339:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cde0800/0xe984082ccd726ac1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143701.158394:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3747 00000100:00100000:0.0:1746143701.158404:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1964:x1830963592432256:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143701.158428:0:8500:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a581d000/0xe984082ccd726ac8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.158438:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143701.158440:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143701.158444:0:8500:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a581d000/0xe984082ccd726ac8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.158453:0:8500:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a581d000/0xe984082ccd726ac8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.185396:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8801368a7800/0xe984082ccd726a97 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.185422:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a7800/0xe984082ccd726a97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.185430:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801368a7800/0xe984082ccd726a97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.185447:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801368a7800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143701.185450:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801368a7800/0xe984082ccd726a97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.185457:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801368a7800/0xe984082ccd726a97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.185472:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801368a7800/0xe984082ccd726a97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.185477:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a7800/0xe984082ccd726a97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143701.185555:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1965:x1830963592430592:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 41632us (41848us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143701.185563:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3740 00010000:00010000:1.0:1746143701.195449:0:26144:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a8e7c200/0xe984082ccd726a9e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.195464:0:26144:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8e7c200/0xe984082ccd726a9e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.195471:0:26144:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a8e7c200/0xe984082ccd726a9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.195481:0:26144:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8e7c200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143701.195484:0:26144:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8e7c200/0xe984082ccd726a9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.195491:0:26144:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a8e7c200/0xe984082ccd726a9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.195507:0:26144:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a8e7c200/0xe984082ccd726a9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.195512:0:26144:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8e7c200/0xe984082ccd726a9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143701.196526:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963592431104:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 49464us (49628us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143701.196536:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3741 00010000:00010000:2.0:1746143701.200847:0:21518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093bfa800/0xe984082ccd726aa5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.200861:0:21518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093bfa800/0xe984082ccd726aa5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.200868:0:21518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093bfa800/0xe984082ccd726aa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.200873:0:21518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bfa800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143701.200876:0:21518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bfa800/0xe984082ccd726aa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.200882:0:21518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bfa800/0xe984082ccd726aa5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.200896:0:21518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093bfa800/0xe984082ccd726aa5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.200901:0:21518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bfa800/0xe984082ccd726aa5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143701.200975:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1964:x1830963592430976:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 52246us (54029us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143701.200983:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3742 00010000:00010000:3.0:1746143701.201248:0:8502:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2400/0xe984082ccd726ab3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.201257:0:8502:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2400/0xe984082ccd726ab3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.201263:0:8502:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2400/0xe984082ccd726ab3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.201268:0:8502:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a95e2400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143701.201270:0:8502:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2400/0xe984082ccd726ab3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.201275:0:8502:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2400/0xe984082ccd726ab3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.201285:0:8502:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2400/0xe984082ccd726ab3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.201290:0:8502:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a95e2400/0xe984082ccd726ab3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143701.201357:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+15:1964:x1830963592431488:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 51615us (54369us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143701.201363:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3744 00010000:00010000:1.0:1746143701.212916:0:25543:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d598600/0xe984082ccd726aac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.212931:0:25543:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d598600/0xe984082ccd726aac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.212938:0:25543:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d598600/0xe984082ccd726aac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.212943:0:25543:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d598600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143701.212947:0:25543:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d598600/0xe984082ccd726aac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.212953:0:25543:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d598600/0xe984082ccd726aac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.212967:0:25543:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d598600/0xe984082ccd726aac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.212972:0:25543:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d598600/0xe984082ccd726aac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143701.213058:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+13:1964:x1830963592431360:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 63962us (66096us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143701.213066:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3743 00010000:00010000:0.0:1746143701.214511:0:31338:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094c2d800/0xe984082ccd726aba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.214522:0:31338:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2d800/0xe984082ccd726aba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.214528:0:31338:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094c2d800/0xe984082ccd726aba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.214533:0:31338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c2d800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143701.214536:0:31338:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c2d800/0xe984082ccd726aba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.214542:0:31338:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c2d800/0xe984082ccd726aba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.214554:0:31338:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094c2d800/0xe984082ccd726aba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.214559:0:31338:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c2d800/0xe984082ccd726aba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143701.214823:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+11:1965:x1830963592431872:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 64186us (64263us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143701.214831:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3745 00010000:00010000:1.0:1746143701.219101:0:31339:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cde0800/0xe984082ccd726ac1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.219115:0:31339:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cde0800/0xe984082ccd726ac1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.219122:0:31339:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cde0800/0xe984082ccd726ac1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.219127:0:31339:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cde0800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143701.219131:0:31339:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cde0800/0xe984082ccd726ac1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.219176:0:31339:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cde0800/0xe984082ccd726ac1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.219191:0:31339:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cde0800/0xe984082ccd726ac1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.219196:0:31339:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cde0800/0xe984082ccd726ac1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143701.219582:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592432384:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 62418us (66088us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143701.219592:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3746 00010000:00010000:2.0:1746143701.222411:0:8500:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a581d000/0xe984082ccd726ac8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.222424:0:8500:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a581d000/0xe984082ccd726ac8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.222431:0:8500:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a581d000/0xe984082ccd726ac8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.222437:0:8500:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a581d000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143701.222440:0:8500:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a581d000/0xe984082ccd726ac8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.222445:0:8500:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a581d000/0xe984082ccd726ac8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.222459:0:8500:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a581d000/0xe984082ccd726ac8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.222465:0:8500:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a581d000/0xe984082ccd726ac8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143701.222548:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1964:x1830963592432256:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 64143us (69147us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143701.222556:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3747 00000100:00100000:0.0:1746143701.226941:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143701.227023:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592432512 00000100:00100000:2.0:1746143701.227031:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592432512 00000100:00100000:2.0:1746143701.227338:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 577 00000100:00100000:2.0:1746143701.227345:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28635:x1830963592432512:12345-192.168.202.48@tcp:103:mirror_io.0 00010000:00010000:2.0:1746143701.227357:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143701.227377:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae46a00/0xe984082ccd726a12 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a217f expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.227402:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143701.227405:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143701.227448:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28635:x1830963592432512:12345-192.168.202.48@tcp:103:mirror_io.0 Request processed in 103us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143701.227453:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 577 00000100:00100000:0.0:1746143701.233057:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143701.233156:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592432768 00000100:00100000:2.0:1746143701.233164:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592432768 00000100:00100000:2.0:1746143701.233760:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3425 00000100:00100000:2.0:1746143701.233769:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:28635:x1830963592432768:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143701.234031:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28635:x1830963592432768:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 262us (980us total) trans 8589942496 rc 0/0 00000100:00100000:2.0:1746143701.234037:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3425 00000100:00100000:0.0:1746143701.235599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.236872:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592433024 00000100:00100000:3.0:1746143701.236881:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592433024 00000100:00100000:3.0:1746143701.236972:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3426 00000100:00100000:3.0:1746143701.236980:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a8d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:28635:x1830963592433024:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143701.237367:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a8d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:28635:x1830963592433024:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 387us (1770us total) trans 8589942497 rc 0/0 00000100:00100000:3.0:1746143701.237377:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3426 00000100:00100000:0.0:1746143701.260682:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.260738:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143701.260932:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592433280 00000100:00100000:2.0:1746143701.260942:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592433280 00000100:00100000:2.0:1746143701.260994:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592433536 00000100:00100000:2.0:1746143701.260996:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592433536 00000100:00100000:2.0:1746143701.261017:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8373 00000100:00100000:2.0:1746143701.261028:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:28649:x1830963592433280:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143701.261053:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143701.261073:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7800/0xe984082ccd726acf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21c5 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.261218:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd726ad6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261232:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd726ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261243:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd726ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261259:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd726add lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261265:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd726add lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261270:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd726add lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261375:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd726ae4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261382:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd726ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261388:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd726ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:2.0:1746143701.261396:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143701.261478:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd726ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261484:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd726ad6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261491:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd726ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261496:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801368a7400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143701.261499:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd726ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261505:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd726ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261514:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143701.261517:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143701.261521:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd726ad6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261526:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7400/0xe984082ccd726ad6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261546:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd726add lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261550:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd726add lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261554:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd726add lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261559:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbc6a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143701.261561:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd726add lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261565:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd726add lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261571:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009365d300) 00010000:00010000:2.0:1746143701.261572:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143701.261575:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd726add lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.261579:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd726add lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143701.261770:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8374 00000100:00100000:0.0:1746143701.261788:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+6:28646:x1830963592433536:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143701.261799:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143701.261807:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b5de00/0xe984082ccd726af2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21cc expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.261847:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5000/0xe984082ccd726af9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.261854:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5000/0xe984082ccd726af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.261861:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5000/0xe984082ccd726af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.261868:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd726b00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.261875:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd726b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.261880:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd726b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.261922:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4600/0xe984082ccd726b07 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.261928:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4600/0xe984082ccd726b07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.261933:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4600/0xe984082ccd726b07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143701.261939:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:0.0:1746143701.261985:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5000/0xe984082ccd726af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.261990:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5000/0xe984082ccd726af9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.261995:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5000/0xe984082ccd726af9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.261999:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57f5000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143701.262001:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5000/0xe984082ccd726af9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.262005:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5000/0xe984082ccd726af9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.262012:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:0.0:1746143701.262014:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143701.262016:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5000/0xe984082ccd726af9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.262021:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5000/0xe984082ccd726af9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.262035:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd726b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.262039:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd726b00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.262044:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd726b00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.262048:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57f5800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143701.262051:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd726b00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.262055:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd726b00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.262059:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ba5a500) 00010000:00010000:0.0:1746143701.262061:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143701.262063:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd726b00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.262067:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5800/0xe984082ccd726b00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.262092:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b5de00/0xe984082ccd726af2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21cc expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.262107:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4600/0xe984082ccd726b07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21cc expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.262113:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143701.262115:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143701.262117:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f4600, rc 0) 00000100:00100000:0.0:1746143701.262182:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28646:x1830963592433536:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 404us (1443us total) trans 8589942499 rc 0/0 00000100:00100000:0.0:1746143701.262188:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8374 00010000:00010000:2.0:1746143701.263476:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a7800/0xe984082ccd726acf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21c5 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.263492:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd726ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21c5 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.263500:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143701.263503:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143701.263505:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368c6e00, rc 0) 00000100:00100000:2.0:1746143701.264160:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28649:x1830963592433280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3132us (3485us total) trans 8589942498 rc 0/0 00000100:00100000:2.0:1746143701.264168:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8373 00000100:00100000:0.0:1746143701.265833:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143701.265918:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592433664 00000100:00100000:2.0:1746143701.265927:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592433664 00000100:00100000:2.0:1746143701.268981:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9998 00000100:00100000:2.0:1746143701.269003:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963592433664:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143701.269025:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143701.269048:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21d3 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.269075:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143701.269076:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143701.269086:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21d3 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143701.269101:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21d3 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143701.269111:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e93b600, rc 0) 00000100:00100000:2.0:1746143701.269898:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963592433664:12345-192.168.202.48@tcp:101:cat.0 Request processed in 903us (4069us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143701.269905:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9998 00000100:00100000:1.0:1746143701.270451:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.270500:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.273968:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592433920 00000100:00100000:3.0:1746143701.273984:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592433920 00000100:00100000:3.0:1746143701.274006:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592434176 00000100:00100000:3.0:1746143701.274008:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592434176 00000100:00100000:3.0:1746143701.274069:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8375 00000100:00100000:3.0:1746143701.274077:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28650:x1830963592434176:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143701.274102:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143701.274120:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd400/0xe984082ccd726b1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21e1 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.274222:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd600/0xe984082ccd726b23 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143701.274235:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd600/0xe984082ccd726b23 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143701.274246:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd600/0xe984082ccd726b23 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143701.274256:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:3.0:1746143701.274363:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd400/0xe984082ccd726b1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e1 expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.274401:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd600/0xe984082ccd726b23 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e1 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.274408:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143701.274411:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143701.274414:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9dd600, rc 0) 00000100:00100000:1.0:1746143701.274637:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8376 00000100:00100000:1.0:1746143701.274643:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28645:x1830963592433920:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143701.274653:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.274659:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0e00/0xe984082ccd726b31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21da expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.274694:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143701.274703:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd726a66 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2194 expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.274709:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd726ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21c5 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.274716:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4600/0xe984082ccd726b07 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21cc expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.274722:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143701.274752:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4600/0xe984082ccd726b07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21cc expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.274764:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4600/0xe984082ccd726b07 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21cc expref: 10 pid: 21713 timeout: 880 lvb_type: 0 00000100:00100000:1.0:1746143701.274785:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593800448:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143701.274851:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd726ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21c5 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.274858:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd726ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21c5 expref: 243 pid: 20509 timeout: 880 lvb_type: 0 00000100:00100000:1.0:1746143701.274866:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593800576:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143701.274891:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd726a66 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2194 expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.274899:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd726a66 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2194 expref: 9 pid: 14764 timeout: 880 lvb_type: 0 00000100:00100000:1.0:1746143701.274906:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593800704:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143701.274923:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f03300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143701.275436:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28650:x1830963592434176:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1357us (4931us total) trans 8589942500 rc 0/0 00000100:00100000:3.0:1746143701.275443:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8375 00000100:00100000:1.0:1746143701.275682:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.275882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.275909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.275942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.275957:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.275974:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592434304 00000100:00100000:1.0:1746143701.275979:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592434304 00000100:00100000:1.0:1746143701.276003:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592434432 00000100:00100000:1.0:1746143701.276004:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592434432 00000100:00100000:1.0:1746143701.276013:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592434560 00000100:00100000:1.0:1746143701.276015:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592434560 00000100:00100000:1.0:1746143701.276026:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592434688 00000100:00100000:1.0:1746143701.276027:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592434688 00000100:00100000:1.0:1746143701.276036:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592434816 00000100:00100000:1.0:1746143701.276038:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592434816 00000100:00100000:1.0:1746143701.276049:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9999 00000100:00100000:1.0:1746143701.276055:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963592434304:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143701.276065:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.276076:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f5bdc00/0xe984082ccd726b3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21e8 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.276092:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.276094:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.276103:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5bdc00/0xe984082ccd726b3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e8 expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.276115:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f5bdc00/0xe984082ccd726b3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e8 expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.276130:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bdc00, rc 0) 00000100:00100000:1.0:1746143701.276169:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592434304:12345-192.168.202.48@tcp:101:cat.0 Request processed in 114us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.276174:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9999 00000100:00100000:1.0:1746143701.276298:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10000 00000100:00100000:1.0:1746143701.276302:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963592434432:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143701.276307:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.276313:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f5bc200/0xe984082ccd726b46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21ef expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.276321:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.276323:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.276326:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5bc200/0xe984082ccd726b46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21ef expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.276334:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f5bc200/0xe984082ccd726b46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21ef expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.276340:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bc200, rc 0) 00000100:00100000:1.0:1746143701.276351:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592434432:12345-192.168.202.48@tcp:101:cat.0 Request processed in 49us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.276355:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10000 00000100:00100000:1.0:1746143701.276361:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10001 00000100:00100000:1.0:1746143701.276365:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592434560:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143701.276373:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.276380:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f5bca00/0xe984082ccd726b4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21f6 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.276388:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.276389:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.276392:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f5bca00/0xe984082ccd726b4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21f6 expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.276400:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f5bca00/0xe984082ccd726b4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21f6 expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.276405:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bca00, rc 0) 00000100:00100000:1.0:1746143701.276414:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592434560:12345-192.168.202.48@tcp:101:cat.0 Request processed in 49us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.276417:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10001 00000100:00100000:1.0:1746143701.276423:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10002 00000100:00100000:1.0:1746143701.276426:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592434688:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143701.276430:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.276434:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc600/0xe984082ccd726b54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a21fd expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.276440:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.276442:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.276445:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc600/0xe984082ccd726b54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21fd expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.276451:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc600/0xe984082ccd726b54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21fd expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.276457:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bc600, rc 0) 00000100:00100000:1.0:1746143701.276465:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592434688:12345-192.168.202.48@tcp:101:cat.0 Request processed in 39us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.276469:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10002 00000100:00100000:1.0:1746143701.276475:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10003 00000100:00100000:1.0:1746143701.276478:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963592434816:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143701.276482:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.276486:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f5bd200/0xe984082ccd726b5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2204 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.276492:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.276493:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.276496:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5bd200/0xe984082ccd726b5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2204 expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.276502:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f5bd200/0xe984082ccd726b5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2204 expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.276507:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bd200, rc 0) 00000100:00100000:1.0:1746143701.276516:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592434816:12345-192.168.202.48@tcp:101:cat.0 Request processed in 38us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.276520:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10003 00000100:00100000:1.0:1746143701.276569:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.276725:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592435072 00000100:00100000:3.0:1746143701.276729:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592435072 00000100:00100000:3.0:1746143701.276754:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8377 00000100:00100000:3.0:1746143701.276759:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28646:x1830963592435072:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143701.276767:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143701.276769:0:14762:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143701.276785:0:14762:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4600/0xe984082ccd726b07 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21cc expref: 10 pid: 21713 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746143701.276800:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143701.276804:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143701.276810:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143701.276814:0:14762:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143701.276819:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd800/0xe984082ccd726b62 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a220b expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.276847:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143701.276854:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde1e00/0xe984082ccd726a58 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a218d expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.276860:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd600/0xe984082ccd726b23 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e1 expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.276866:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143701.276883:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd600/0xe984082ccd726b23 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e1 expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.276889:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd600/0xe984082ccd726b23 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e1 expref: 11 pid: 14762 timeout: 880 lvb_type: 0 00000100:00100000:3.0:1746143701.276898:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963593800832:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143701.277247:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde1e00/0xe984082ccd726a58 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a218d expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.277255:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde1e00/0xe984082ccd726a58 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a218d expref: 9 pid: 14764 timeout: 880 lvb_type: 0 00000100:00100000:3.0:1746143701.277262:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963593800960:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143701.277391:0:20509:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from blocking AST (req@ffff88012b79df80 x1830963593800448) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4600/0xe984082ccd726b07 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21cc expref: 11 pid: 21713 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746143701.277402:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4600/0xe984082ccd726b07 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21cc expref: 11 pid: 21713 timeout: 880 lvb_type: 0 00000100:00100000:0.0:1746143701.277415:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593800448:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143701.277484:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593800576:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143701.277518:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963593800704:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143701.277539:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143701.277542:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143701.277547:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143701.277552:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143701.277556:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143701.277563:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:3.0:1746143701.277699:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143701.277924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.277941:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.278454:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.278470:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592435456 00000100:00100000:0.0:1746143701.278474:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592435456 00000100:00100000:0.0:1746143701.278497:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8378 00000100:00100000:0.0:1746143701.278503:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+11:28650:x1830963592435456:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143701.278516:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143701.278526:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4a00/0xe984082ccd726b70 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2212 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.278585:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.278594:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143701.278599:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143701.278603:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.278614:0:21713:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143701.278626:0:21713:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143701.278631:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:2.0:1746143701.278739:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592435200 00000100:00100000:2.0:1746143701.278743:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592435200 00010000:00010000:2.0:1746143701.278760:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd726ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21c5 expref: 244 pid: 20509 timeout: 880 lvb_type: 0 00000100:00100000:2.0:1746143701.278784:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592435328 00000100:00100000:2.0:1746143701.278786:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592435328 00010000:00010000:2.0:1746143701.278795:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd726a66 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2194 expref: 10 pid: 14764 timeout: 880 lvb_type: 0 00000100:00100000:2.0:1746143701.278807:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5198 00000100:00100000:2.0:1746143701.278811:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:1965:x1830963592435200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143701.278819:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143701.278822:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd726ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21c5 expref: 244 pid: 20509 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746143701.278830:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd726ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21c5 expref: 244 pid: 20509 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746143701.278842:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd726ae4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21c5 expref: 244 pid: 20509 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746143701.278853:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143701.278856:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.278861:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143701.278865:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.278869:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143701.278875:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143701.278879:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143701.278904:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1965:x1830963592435200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 92us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143701.278909:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5198 00000100:00100000:2.0:1746143701.278921:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5199 00000100:00100000:2.0:1746143701.278925:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+10:1965:x1830963592435328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143701.278930:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143701.278933:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd726a66 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2194 expref: 10 pid: 14764 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746143701.278940:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd726a66 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2194 expref: 10 pid: 14764 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746143701.278949:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0600/0xe984082ccd726a66 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2194 expref: 10 pid: 14764 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746143701.278955:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143701.278958:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.278964:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.278969:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143701.278977:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143701.278982:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143701.278986:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143701.278990:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143701.278999:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143701.279011:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592435328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 85us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143701.279015:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5199 00000100:00100000:3.0:1746143701.279220:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963593800832:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143701.279293:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143701.279304:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143701.279319:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:1.0:1746143701.279433:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0e00/0xe984082ccd726b31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21da expref: 244 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.279466:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21da expref: 243 pid: 20509 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746143701.279473:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21da expref: 243 pid: 20509 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746143701.279478:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cde0a00, rc 0) 00000100:00100000:1.0:1746143701.279500:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28645:x1830963592433920:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4857us (9052us total) trans 8589942501 rc 0/0 00000100:00100000:1.0:1746143701.279513:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8376 00000100:00100000:3.0:1746143701.280410:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.280432:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.280463:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143701.280505:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592435584 00000100:00100000:2.0:1746143701.280510:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592435584 00010000:00010000:2.0:1746143701.280527:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd600/0xe984082ccd726b23 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e1 expref: 13 pid: 14762 timeout: 880 lvb_type: 0 00000100:00100000:2.0:1746143701.280541:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592435712 00000100:00100000:2.0:1746143701.280543:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592435712 00010000:00010000:2.0:1746143701.280549:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde1e00/0xe984082ccd726a58 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a218d expref: 9 pid: 14764 timeout: 880 lvb_type: 0 00000100:00100000:2.0:1746143701.280559:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5200 00000100:00100000:2.0:1746143701.280564:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+13:1965:x1830963592435584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143701.280573:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143701.280578:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd600/0xe984082ccd726b23 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e1 expref: 13 pid: 14762 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746143701.280586:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd600/0xe984082ccd726b23 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e1 expref: 13 pid: 14762 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746143701.280599:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd600/0xe984082ccd726b23 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e1 expref: 13 pid: 14762 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746143701.280619:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143701.280622:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143701.280628:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143701.280633:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143701.280637:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143701.280641:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143701.280659:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+12:1965:x1830963592435584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 95us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143701.280663:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5200 00000100:00100000:2.0:1746143701.280671:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5201 00000100:00100000:2.0:1746143701.280675:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592435712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143701.280679:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143701.280681:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde1e00/0xe984082ccd726a58 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a218d expref: 9 pid: 14764 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746143701.280692:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde1e00/0xe984082ccd726a58 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a218d expref: 9 pid: 14764 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746143701.280700:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143701.280702:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143701.280706:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143701.280713:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143701.280719:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143701.280723:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143701.280728:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143701.280736:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143701.280746:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1965:x1830963592435712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 71us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143701.280751:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5201 00010000:00010000:0.0:1746143701.280887:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde1e00/0xe984082ccd726a58 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a218d expref: 8 pid: 14764 timeout: 880 lvb_type: 0 00000100:00100000:0.0:1746143701.280897:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963593800960:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143701.280913:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143701.280919:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143701.280923:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00000040:00080000:0.0:1746143701.281478:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2321, 88 off195192 00000004:00080000:0.0:1746143701.281485:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780291345117ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143701.281533:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2266, 88 off190176 00000004:00080000:0.0:1746143701.281538:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780291398092ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143701.281548:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2267, 88 off190264 00000004:00080000:0.0:1746143701.281550:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780291410660ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143701.281556:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2322, 88 off195280 00000004:00080000:0.0:1746143701.281558:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780291418680ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143701.281564:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2323, 88 off195368 00000004:00080000:0.0:1746143701.281566:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780291426602ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143701.281572:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2268, 88 off190352 00000004:00080000:0.0:1746143701.281574:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780291434410ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143701.281579:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2269, 88 off190440 00000004:00080000:0.0:1746143701.281581:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780291441792ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143701.281587:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2270, 88 off190528 00000004:00080000:0.0:1746143701.281589:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780291448937ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143701.281594:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2324, 88 off195456 00000004:00080000:0.0:1746143701.281595:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780291455773ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143701.281601:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2271, 88 off190616 00000004:00080000:0.0:1746143701.281603:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780291463158ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143701.281683:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2325, 88 off195544 00000004:00080000:0.0:1746143701.281686:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780291546277ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143701.281695:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2272, 88 off190704 00000004:00080000:0.0:1746143701.281697:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780291557153ns, next at 718087967394ns, rc = 0 00000040:00080000:0.0:1746143701.281702:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2326, 88 off195632 00000004:00080000:0.0:1746143701.281705:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780291564980ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143701.281710:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2327, 88 off195720 00000004:00080000:0.0:1746143701.281712:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780291572292ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143701.281717:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2328, 88 off195808 00000004:00080000:0.0:1746143701.281719:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780291579610ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143701.281725:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2329, 88 off195896 00000004:00080000:0.0:1746143701.281727:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780291587535ns, next at 758183694006ns, rc = 0 00000040:00080000:0.0:1746143701.281734:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2273, 88 off190792 00000004:00080000:0.0:1746143701.281736:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780291596730ns, next at 718087967394ns, rc = 0 00000100:00100000:0.0:1746143701.282320:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.282345:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592435968 00000100:00100000:0.0:1746143701.282350:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592435968 00010000:00010000:0.0:1746143701.282373:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21da expref: 243 pid: 20509 timeout: 880 lvb_type: 0 00000100:00100000:0.0:1746143701.282391:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5202 00000100:00100000:0.0:1746143701.282395:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1963:x1830963592435968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143701.282405:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143701.282408:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21da expref: 243 pid: 20509 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746143701.282417:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21da expref: 243 pid: 20509 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746143701.282433:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde0a00/0xe984082ccd726b38 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21da expref: 243 pid: 20509 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746143701.282443:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143701.282447:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.282452:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.282455:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143701.282459:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143701.282478:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:1963:x1830963592435968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 82us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143701.282486:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5202 00000100:00100000:1.0:1746143701.282631:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592435840 00000100:00100000:1.0:1746143701.282635:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592435840 00000100:00100000:1.0:1746143701.282656:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8379 00000100:00100000:1.0:1746143701.282660:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28649:x1830963592435840:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143701.282674:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.282684:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc000/0xe984082ccd726b85 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2219 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.282719:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc000/0xe984082ccd726b85 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2219 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.282734:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc000/0xe984082ccd726b85 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2219 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.282743:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143701.282746:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143701.282748:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc000/0xe984082ccd726b85 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2219 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.282753:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f5bc000, rc 0) 00000100:00100000:1.0:1746143701.282784:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28649:x1830963592435840:12345-192.168.202.48@tcp:101:cat.0 Request processed in 113us (2310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.282789:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8379 00010000:00010000:2.0:1746143701.309349:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a220b expref: 13 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.309365:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143701.309369:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746143701.309373:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143701.309383:0:14762:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143701.309389:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143701.309396:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc000/0xe984082ccd726b85 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2219 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.309404:0:14762:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc000/0xe984082ccd726b85 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2219 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.309410:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc000/0xe984082ccd726b85 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2219 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746143701.309423:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942502 is committed 00000004:00080000:3.0:1746143701.309434:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1618 committed 00000004:00080000:3.0:1746143701.309442:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1674 committed 00010000:00010000:2.0:1746143701.309454:0:14762:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc000/0xe984082ccd726b85 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2219 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143701.309469:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963593801088:192.168.202.48@tcp:105: 00000004:00080000:3.0:1746143701.309544:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1673 committed 00000004:00080000:3.0:1746143701.309546:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1672 committed 00000004:00080000:3.0:1746143701.309548:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1671 committed 00000004:00080000:3.0:1746143701.309549:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1617 committed 00000004:00080000:3.0:1746143701.309551:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1670 committed 00000004:00080000:3.0:1746143701.309552:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1616 committed 00000004:00080000:3.0:1746143701.309553:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1669 committed 00000004:00080000:3.0:1746143701.309554:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1615 committed 00000004:00080000:3.0:1746143701.309556:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1614 committed 00000004:00080000:3.0:1746143701.309557:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1613 committed 00000004:00080000:3.0:1746143701.309559:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1668 committed 00000004:00080000:3.0:1746143701.309560:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1667 committed 00000004:00080000:3.0:1746143701.309561:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1612 committed 00000004:00080000:3.0:1746143701.309563:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1611 committed 00000004:00080000:3.0:1746143701.309564:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1666 committed 00000100:00100000:2.0:1746143701.309571:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b9c0 going to sleep for 11 seconds 00000001:00080000:3.0:1746143701.309579:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942501 is committed 00000001:00080000:3.0:1746143701.309851:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942496 is committed 00000001:00080000:3.0:1746143701.309859:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942497 is committed 00000100:00100000:0.0:1746143701.310198:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143701.310214:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593801216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143701.310267:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143701.310270:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593801728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143701.310291:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593801600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143701.310313:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593801216 00000100:00100000:0.0:1746143701.310318:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593801216 00000100:00100000:0.0:1746143701.310350:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10004 00000100:00100000:0.0:1746143701.310355:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593801216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143701.310494:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143701.310536:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593801344:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143701.310556:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143701.310569:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593801856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143701.310585:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143701.310596:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143701.310600:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593801472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143701.310612:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143701.310621:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593801984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143701.310632:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143701.310650:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593801728 00000100:00100000:2.0:1746143701.310655:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593801728 00000100:00100000:2.0:1746143701.310679:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593801344 00000100:00100000:2.0:1746143701.310680:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593801344 00000100:00100000:2.0:1746143701.310689:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593801856 00000100:00100000:2.0:1746143701.310690:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593801856 00000100:00100000:2.0:1746143701.310699:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593801472 00000100:00100000:2.0:1746143701.310701:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593801472 00000100:00100000:2.0:1746143701.310709:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593801984 00000100:00100000:2.0:1746143701.310711:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593801984 00000100:00100000:2.0:1746143701.310719:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10005 00000100:00100000:2.0:1746143701.310725:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3295:x1830963593801728:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143701.310755:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143701.310763:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143701.310809:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:3.0:1746143701.310813:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143701.310826:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143701.310855:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f4a00/0xe984082ccd726b70 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2212 expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.310874:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2212 expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.310881:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143701.310883:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746143701.310886:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f5e00, rc 0) 00000100:00100000:3.0:1746143701.310918:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28650:x1830963592435456:12345-192.168.202.48@tcp:101:cat.0 Request processed in 32415us (32464us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143701.310925:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8378 00002000:00010000:2.0:1746143701.311538:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb size from disk: 1896448 -> 1896448 00002000:00010000:2.0:1746143701.311541:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb mtime from disk: 1746143642 -> 1746143642 00002000:00010000:2.0:1746143701.311544:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143701.311546:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb ctime from disk: 1746143642 -> 1746143642 00002000:00010000:2.0:1746143701.311548:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34d:0x0] updating lvb blocks from disk: 1687 -> 1687 00000100:00100000:1.0:1746143701.311551:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10006 00000100:00100000:1.0:1746143701.311559:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963593801344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143701.311582:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963593801728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 856us (1089us total) trans 21474839787 rc 0/0 00000100:00100000:2.0:1746143701.311589:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10005 00000100:00100000:2.0:1746143701.311605:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10007 00000100:00100000:2.0:1746143701.311610:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963593801856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143701.311673:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143701.311676:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143698 -> 1746143698 00002000:00010000:1.0:1746143701.311678:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143698 -> 1746143698 00002000:00010000:1.0:1746143701.311679:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143698 -> 1746143698 00002000:00010000:1.0:1746143701.311681:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746143701.311702:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963593801856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (1116us total) trans 21474839789 rc 0/0 00000100:00100000:2.0:1746143701.311708:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10007 00000100:00100000:1.0:1746143701.311714:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963593801344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (1157us total) trans 21474839788 rc 0/0 00000100:00100000:1.0:1746143701.311720:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10006 00002000:00010000:0.0:1746143701.311770:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143701.311772:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143697 -> 1746143697 00000100:00100000:2.0:1746143701.311781:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10008 00002000:00010000:0.0:1746143701.311782:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143701.311784:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143697 -> 1746143697 00002000:00010000:0.0:1746143701.311786:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143701.311787:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10009 00000100:00100000:2.0:1746143701.311788:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963593801472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143701.311793:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963593801984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143701.311810:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3294:x1830963593801216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1455us (1543us total) trans 21474839786 rc 0/0 00000100:00100000:0.0:1746143701.311816:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10004 00000100:00100000:0.0:1746143701.311834:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746143701.311878:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c9180/2, rc 0, transno 21474839788 00000100:00100000:2.0:1746143701.311883:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593801344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143701.312202:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593802112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143701.312206:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963593801984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 413us (1571us total) trans 21474839790 rc 0/0 00000100:00100000:1.0:1746143701.312211:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10009 00000100:00100000:1.0:1746143701.312220:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593801600 00000100:00100000:1.0:1746143701.312223:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593801600 00000100:00100000:0.0:1746143701.312224:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143701.312237:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593802112 00000100:00100000:1.0:1746143701.312238:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593802112 00000100:00100000:1.0:1746143701.312246:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10010 00000004:00080000:0.0:1746143701.312247:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3cb480/2, rc 0, transno 21474839786 00000100:00100000:1.0:1746143701.312249:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963593801600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143701.312252:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593801216:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143701.312305:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143701.312307:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:1.0:1746143701.312308:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:1.0:1746143701.312310:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:1.0:1746143701.312311:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143701.312327:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593801600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (493us total) trans 21474839791 rc 0/0 00000100:00100000:1.0:1746143701.312331:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10010 00000100:00100000:1.0:1746143701.312340:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10011 00000100:00100000:1.0:1746143701.312343:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963593802112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143701.312429:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963593802112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (204us total) trans 21474839792 rc 0/0 00000100:00100000:1.0:1746143701.312433:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10011 00000100:00100000:0.0:1746143701.312482:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593802496:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143701.312497:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143701.312499:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143699 -> 1746143699 00002000:00010000:1.0:1746143701.312501:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143699 -> 1746143699 00002000:00010000:1.0:1746143701.312502:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143699 -> 1746143699 00002000:00010000:1.0:1746143701.312504:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746143701.312525:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963593801472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 738us (1911us total) trans 21474839793 rc 0/0 00000100:00100000:0.0:1746143701.312529:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143701.312530:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10008 00000100:00100000:1.0:1746143701.312541:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593802496 00000100:00100000:1.0:1746143701.312544:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593802496 00000100:00100000:0.0:1746143701.312545:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593803008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143701.312557:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10012 00000100:00100000:1.0:1746143701.312561:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963593802496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143701.312561:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143701.312572:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143701.312576:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593802368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143701.312589:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143701.312598:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593802880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143701.312610:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143701.312626:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593803008 00000100:00100000:0.0:1746143701.312629:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593803008 00002000:00010000:1.0:1746143701.312642:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00000100:00100000:0.0:1746143701.312643:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593802368 00002000:00010000:1.0:1746143701.312644:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143699 -> 1746143699 00000100:00100000:0.0:1746143701.312645:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593802368 00002000:00010000:1.0:1746143701.312646:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143699 -> 1746143699 00002000:00010000:1.0:1746143701.312647:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143699 -> 1746143699 00002000:00010000:1.0:1746143701.312648:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5541 -> 5541 00000100:00100000:0.0:1746143701.312651:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593802880 00000100:00100000:1.0:1746143701.312670:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3293:x1830963593802496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (167us total) trans 17179872520 rc 0/0 00000100:00100000:1.0:1746143701.312675:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10012 00000100:00100000:1.0:1746143701.312684:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10013 00000100:00100000:1.0:1746143701.312688:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3293:x1830963593803008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143701.312763:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3293:x1830963593803008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (201us total) trans 17179872521 rc 0/0 00000100:00100000:1.0:1746143701.312768:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10013 00000100:00100000:1.0:1746143701.312789:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10014 00000100:00100000:1.0:1746143701.312794:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3293:x1830963593802368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143701.312815:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593802880 00000100:00100000:0.0:1746143701.312830:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10015 00000100:00100000:0.0:1746143701.312834:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3293:x1830963593802880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143701.312857:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143701.312859:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143698 -> 1746143698 00002000:00010000:1.0:1746143701.312861:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143698 -> 1746143698 00002000:00010000:1.0:1746143701.312863:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143698 -> 1746143698 00002000:00010000:1.0:1746143701.312864:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746143701.312883:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3293:x1830963593802368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (292us total) trans 17179872522 rc 0/0 00000100:00100000:1.0:1746143701.312887:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10014 00000100:00100000:0.0:1746143701.312919:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3293:x1830963593802880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (307us total) trans 17179872523 rc 0/0 00000100:00100000:0.0:1746143701.312925:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10015 00000004:00080000:0.0:1746143701.312949:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f03b80/2, rc 0, transno 17179872522 00000100:00100000:0.0:1746143701.312956:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593802368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143701.312962:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c11180/2, rc 0, transno 17179872523 00000100:00100000:0.0:1746143701.312967:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593802880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143701.312972:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f03100/2, rc 0, transno 17179872520 00000100:00100000:0.0:1746143701.312975:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593802496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143701.312980:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c12d80/2, rc 0, transno 17179872521 00000100:00100000:0.0:1746143701.312982:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593803008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143701.312995:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593802624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143701.313010:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143701.313020:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593803136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143701.313022:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593802624 00000100:00100000:1.0:1746143701.313025:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593802624 00000100:00100000:0.0:1746143701.313032:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143701.313045:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593803136 00000100:00100000:1.0:1746143701.313047:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593803136 00000004:00080000:0.0:1746143701.313057:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c8700/2, rc 0, transno 21474839791 00000100:00100000:0.0:1746143701.313060:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593801600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143701.313062:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10016 00000100:00100000:1.0:1746143701.313066:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3294:x1830963593802624:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143701.313098:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3ca300/2, rc 0, transno 21474839789 00000100:00100000:2.0:1746143701.313103:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593801856:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143701.313115:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3cb800/2, rc 0, transno 21474839793 00000100:00100000:2.0:1746143701.313118:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593801472:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143701.313127:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e1f80/2, rc 0, transno 21474839790 00002000:00010000:1.0:1746143701.313129:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1746143701.313131:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593801984:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143701.313132:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746143701.313133:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143701.313134:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746143701.313136:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x350:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143701.313168:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10017 00000100:00100000:1.0:1746143701.313173:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963593802624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (161us total) trans 17179872524 rc 0/0 00000100:00100000:2.0:1746143701.313177:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963593803136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143701.313179:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10016 00000100:00100000:2.0:1746143701.313299:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963593803136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (264us total) trans 17179872525 rc 0/0 00000100:00100000:2.0:1746143701.313305:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10017 00000100:00100000:2.0:1746143701.313334:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593802240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143701.313360:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143701.313584:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e0e00/2, rc 0, transno 21474839792 00000100:00100000:0.0:1746143701.313587:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593802112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143701.313598:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f01880/2, rc 0, transno 17179872524 00000100:00100000:0.0:1746143701.313601:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593802624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143701.313673:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000004:00080000:0.0:1746143701.313695:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c10700/2, rc 0, transno 17179872525 00000100:00100000:0.0:1746143701.313699:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593803136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143701.313998:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593802240 00000100:00100000:0.0:1746143701.314002:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593802240 00000100:00100000:2.0:1746143701.314008:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593802752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143701.314022:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10018 00000100:00100000:0.0:1746143701.314026:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963593802240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143701.314029:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143701.314043:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593803264:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143701.314059:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746143701.314109:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143701.314112:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143701.314114:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143701.314115:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143695 -> 1746143695 00002000:00010000:0.0:1746143701.314117:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:3.0:1746143701.314130:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593802752 00000100:00100000:3.0:1746143701.314136:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593802752 00000100:00100000:0.0:1746143701.314151:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963593802240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (777us total) trans 17179872526 rc 0/0 00000100:00100000:0.0:1746143701.314157:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10018 00000100:00100000:0.0:1746143701.314165:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593803264 00000100:00100000:0.0:1746143701.314168:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593803264 00000100:00100000:3.0:1746143701.314179:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10019 00000100:00100000:0.0:1746143701.314183:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10020 00000100:00100000:3.0:1746143701.314185:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963593802752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143701.314188:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963593803264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143701.314265:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3295:x1830963593803264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (205us total) trans 17179872527 rc 0/0 00000100:00100000:0.0:1746143701.314269:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10020 00000100:00100000:1.0:1746143701.314343:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.314375:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000004:00080000:2.0:1746143701.314400:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c8380/2, rc 0, transno 21474839787 00000100:00100000:2.0:1746143701.314405:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593801728:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143701.314425:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f01f80/2, rc 0, transno 17179872526 00000100:00100000:2.0:1746143701.314428:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593802240:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143701.314434:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f02d80/2, rc 0, transno 17179872528 00000100:00100000:2.0:1746143701.314437:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593802752:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143701.314444:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd4380/2, rc 0, transno 17179872527 00000100:00100000:2.0:1746143701.314446:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593803264:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143701.314474:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963593801088:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143701.314500:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963593802752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (267us total) trans 17179872528 rc 0/0 00000100:00100000:3.0:1746143701.314506:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10019 00010000:00010000:2.0:1746143701.314510:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dd800/0xe984082ccd726b62 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a220b expref: 9 pid: 14762 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746143701.314529:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592436096 00000100:00100000:0.0:1746143701.314533:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592436096 00000100:00100000:3.0:1746143701.314537:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592436224 00010000:00010000:2.0:1746143701.314538:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a220b expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143701.314540:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592436224 00000100:00100000:3.0:1746143701.314560:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3427 00000100:00100000:3.0:1746143701.314565:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:28649:x1830963592436224:12345-192.168.202.48@tcp:49:cat.0 00010000:00010000:2.0:1746143701.314566:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9dda00, rc 0) 00000100:00100000:2.0:1746143701.314601:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28646:x1830963592435072:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 37842us (38032us total) trans 8589942502 rc 0/0 00000100:00100000:2.0:1746143701.314607:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8377 00000100:00100000:2.0:1746143701.314619:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592436352 00000100:00100000:2.0:1746143701.314622:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592436352 00000100:00100000:3.0:1746143701.314623:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:28649:x1830963592436224:12345-192.168.202.48@tcp:49:cat.0 Request processed in 57us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143701.314628:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3427 00000100:00100000:2.0:1746143701.314664:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8380 00000100:00100000:2.0:1746143701.314671:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28650:x1830963592436096:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143701.314673:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8381 00000100:00100000:1.0:1746143701.314680:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:28645:x1830963592436352:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143701.314681:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.314690:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143701.314693:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801302a8c00/0xe984082ccd726b8c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2220 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.314703:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b600/0xe984082ccd726b93 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2227 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.314722:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801302a8c00/0xe984082ccd726b8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2220 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.314734:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801302a8c00/0xe984082ccd726b8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2220 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.314742:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b600/0xe984082ccd726b93 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2227 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.314753:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143701.314756:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143701.314759:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801302a8c00, rc 0) 00000100:00100000:2.0:1746143701.314786:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28650:x1830963592436096:12345-192.168.202.48@tcp:101:cat.0 Request processed in 104us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143701.314792:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8380 00010000:00010000:1.0:1746143701.314875:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b600/0xe984082ccd726b93 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2227 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.314892:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143701.314894:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143701.314897:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336b600, rc 0) 00000100:00100000:1.0:1746143701.314921:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28645:x1830963592436352:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 242us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.314926:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8381 00000100:00100000:0.0:1746143701.321427:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.322071:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.322327:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.322440:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.322454:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592436480 00000100:00100000:3.0:1746143701.322465:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592436480 00000100:00100000:3.0:1746143701.322506:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592436608 00000100:00100000:3.0:1746143701.322508:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592436608 00000100:00100000:3.0:1746143701.322524:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592436864 00000100:00100000:3.0:1746143701.322526:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592436864 00000100:00100000:3.0:1746143701.322540:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10021 00000100:00100000:3.0:1746143701.322547:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+14:28646:x1830963592436480:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143701.322567:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143701.322586:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a222e expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.322614:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131e90200/0xe984082ccd726a82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a219b expref: 8 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143701.322623:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21d3 expref: 27 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143701.322629:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143701.322630:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143701.322633:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [487424->700415] (req 487424->700415) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.322665:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21d3 expref: 27 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143701.322677:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21d3 expref: 27 pid: 25369 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746143701.322690:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593803392:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143701.322786:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10022 00010000:00010000:3.0:1746143701.322790:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131e90200/0xe984082ccd726a82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a219b expref: 8 pid: 8496 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143701.322803:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:28645:x1830963592436608:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143701.322804:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131e90200/0xe984082ccd726a82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a219b expref: 8 pid: 8496 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746143701.322816:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593803520:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143701.322821:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143701.322835:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00010000:00010000:1.0:1746143701.322838:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2235 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143701.322857:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10023 00000100:00100000:3.0:1746143701.322863:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592436864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143701.322868:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd726a7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21be expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143701.322870:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143701.322875:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9dde00/0xe984082ccd726ba8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a223c expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.322876:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f5bd200/0xe984082ccd726b5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2204 expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.322881:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.322883:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.322885:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3776512->3977215] (req 3776512->3977215) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.322886:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143701.322895:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9dde00/0xe984082ccd726ba8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a223c expref: 16 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143701.322905:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9dde00/0xe984082ccd726ba8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a223c expref: 16 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.322915:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f5bd200/0xe984082ccd726b5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2204 expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.322925:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f5bd200/0xe984082ccd726b5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2204 expref: 28 pid: 4582 timeout: 880 lvb_type: 1 00000100:00100000:1.0:1746143701.322935:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593803648:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143701.322993:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd726a7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21be expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.323001:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd726a7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21be expref: 8 pid: 4582 timeout: 880 lvb_type: 1 00000100:00100000:1.0:1746143701.323009:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009509ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593803776:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143701.323025:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52b5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143701.323059:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592437120 00000100:00100000:0.0:1746143701.323063:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592437120 00000100:00100000:0.0:1746143701.323085:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10024 00000100:00100000:0.0:1746143701.323089:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1964:x1830963592437120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143701.323096:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143701.323097:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143701.323105:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd726baf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2243 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143701.323116:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143701.323118:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592437248 00010000:00010000:0.0:1746143701.323118:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143701.323123:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592437248 00010000:00010000:0.0:1746143701.323125:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd726baf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2243 expref: 21 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143701.323159:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd726baf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2243 expref: 22 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143701.323172:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5ea00, rc 0) 00000100:00100000:1.0:1746143701.323180:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10025 00000100:00100000:1.0:1746143701.323187:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592437248:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143701.323197:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592437120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 107us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143701.323203:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10024 00010000:00010000:1.0:1746143701.323388:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.323398:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a61cde00/0xe984082ccd726bb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a224a expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.323410:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.323412:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.323418:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a61cde00/0xe984082ccd726bb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a224a expref: 22 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.323429:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a61cde00/0xe984082ccd726bb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a224a expref: 22 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.323438:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61cde00, rc 0) 00000100:00100000:1.0:1746143701.323742:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592437248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 554us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.323748:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10025 00010000:00010000:3.0:1746143701.324724:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9dde00, rc 0) 00000100:00100000:3.0:1746143701.324762:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+15:1965:x1830963592436864:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1896us (2432us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143701.324768:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10023 00000100:00100000:0.0:1746143701.325090:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.325129:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.325173:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.325190:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143701.325228:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592436736 00000100:00100000:2.0:1746143701.325236:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592436736 00000100:00100000:2.0:1746143701.325271:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592436992 00000100:00100000:2.0:1746143701.325273:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592436992 00000100:00100000:2.0:1746143701.325289:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 578 00000100:00100000:2.0:1746143701.325294:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:1963:x1830963592436736:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143701.325305:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143701.325321:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b600/0xe984082ccd726b93 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2227 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.325338:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143701.325342:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143701.325382:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:1963:x1830963592436736:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143701.325391:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 578 00000100:00100000:2.0:1746143701.325404:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 579 00000100:00100000:2.0:1746143701.325409:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963592436992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143701.325414:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143701.325423:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801302a8c00/0xe984082ccd726b8c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2220 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.325432:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143701.325434:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143701.325445:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592437376 00000100:00100000:2.0:1746143701.325447:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1963:x1830963592436992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 39us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143701.325450:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592437376 00000100:00100000:2.0:1746143701.325451:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 579 00000100:00100000:3.0:1746143701.325471:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592437504 00000100:00100000:3.0:1746143701.325474:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592437504 00000100:00100000:3.0:1746143701.325487:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10026 00000100:00100000:3.0:1746143701.325494:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1964:x1830963592437376:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143701.325494:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10027 00000100:00100000:2.0:1746143701.325500:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+16:1965:x1830963592437504:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143701.325508:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143701.325510:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143701.325519:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801302a8600/0xe984082ccd726bbd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2258 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143701.325520:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9dc600/0xe984082ccd726bc4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2251 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143701.325532:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143701.325533:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143701.325534:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143701.325536:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143701.325539:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801302a8600/0xe984082ccd726bbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2258 expref: 18 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143701.325542:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9dc600/0xe984082ccd726bc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2251 expref: 18 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143701.325549:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801302a8600/0xe984082ccd726bbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2258 expref: 18 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143701.325553:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9dc600/0xe984082ccd726bc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2251 expref: 18 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143701.325562:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9dc600, rc 0) 00010000:00010000:2.0:1746143701.325562:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801302a8600, rc 0) 00000100:00100000:2.0:1746143701.325578:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592437504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 79us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143701.325583:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10027 00000100:00100000:3.0:1746143701.325586:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592437376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 92us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143701.325592:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10026 00000100:00100000:0.0:1746143701.325639:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.325823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.325828:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592437632 00000100:00100000:1.0:1746143701.325833:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592437632 00000100:00100000:0.0:1746143701.325851:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.325854:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10028 00000100:00100000:1.0:1746143701.325859:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592437632:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143701.325866:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.325874:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc600/0xe984082ccd726bcb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a225f expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143701.325876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143701.325883:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.325889:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc600/0xe984082ccd726bcb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a225f expref: 23 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.325896:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a61cc600/0xe984082ccd726bcb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a225f expref: 23 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143701.325897:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592438016 00000100:00100000:0.0:1746143701.325899:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592438016 00010000:00010000:1.0:1746143701.325906:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61cc600, rc 0) 00002000:00100000:0.0:1746143701.325926:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880093503b80 x1830963592438016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143701.325927:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1964:x1830963592437632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 68us (288us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143701.325932:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10028 00002000:00100000:0.0:1746143701.325934:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503b80 with x1830963592438016 ext(0->1048575) 00010000:00010000:0.0:1746143701.325939:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21d3 expref: 28 pid: 25369 timeout: 880 lvb_type: 1 00000100:00100000:1.0:1746143701.325947:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592438272 00010000:00010000:0.0:1746143701.325948:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21d3 expref: 28 pid: 25369 timeout: 880 lvb_type: 1 00000100:00100000:1.0:1746143701.325950:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592438272 00002000:00010000:0.0:1746143701.325953:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093503b80 00000100:00100000:0.0:1746143701.325965:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592438400 00002000:00100000:1.0:1746143701.325966:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88009b853480 x1830963592438272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143701.325967:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592438400 00002000:00100000:1.0:1746143701.325974:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b853480 with x1830963592438272 ext(1048576->2097151) 00002000:00010000:1.0:1746143701.325977:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b853480 00002000:00100000:0.0:1746143701.325978:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009b850700 x1830963592438400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143701.325983:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850700 with x1830963592438400 ext(1048576->2097151) 00002000:00010000:0.0:1746143701.325986:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b850700 00000100:00100000:1.0:1746143701.325987:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 923 00000100:00100000:1.0:1746143701.325992:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592438016:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143701.325997:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3748 00000100:00100000:0.0:1746143701.326002:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592438272:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.326338:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3749 00000100:00100000:3.0:1746143701.326346:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592438400:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143701.328852:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.329604:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.329620:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.329646:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.329665:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592438784 00000100:00100000:1.0:1746143701.329671:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592438784 00010000:00010000:1.0:1746143701.329695:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e90200/0xe984082ccd726a82 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a219b expref: 9 pid: 8496 timeout: 880 lvb_type: 1 00000100:00100000:1.0:1746143701.329716:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592438912 00000100:00100000:1.0:1746143701.329718:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592438912 00010000:00010000:1.0:1746143701.329728:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd726a7b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21be expref: 9 pid: 4582 timeout: 880 lvb_type: 1 00000100:00100000:1.0:1746143701.329739:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592439040 00000100:00100000:1.0:1746143701.329741:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592439040 00010000:00010000:1.0:1746143701.329749:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5bd200/0xe984082ccd726b5b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2204 expref: 32 pid: 4582 timeout: 880 lvb_type: 1 00000100:00100000:1.0:1746143701.329767:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5203 00000100:00100000:1.0:1746143701.329785:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592438784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143701.329796:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143701.329813:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e90200/0xe984082ccd726a82 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a219b expref: 9 pid: 8496 timeout: 880 lvb_type: 1 00010000:00010000:1.0:1746143701.329823:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e90200/0xe984082ccd726a82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a219b expref: 9 pid: 8496 timeout: 880 lvb_type: 1 00010000:00010000:1.0:1746143701.329843:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143701.329866:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592438784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 92us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.329871:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5203 00000100:00100000:1.0:1746143701.329886:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5204 00000100:00100000:1.0:1746143701.329890:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009509a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592438912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143701.329891:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593803392:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143701.329897:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143701.329908:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e90200/0xe984082ccd726a82 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a219b expref: 8 pid: 8496 timeout: 880 lvb_type: 1 00010000:00010000:1.0:1746143701.329909:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd726a7b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21be expref: 9 pid: 4582 timeout: 880 lvb_type: 1 00010000:00010000:1.0:1746143701.329916:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd726a7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21be expref: 9 pid: 4582 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746143701.329922:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593803520:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143701.329926:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143701.329940:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009509a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+9:1963:x1830963592438912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.329945:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5204 00010000:00010000:3.0:1746143701.329948:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [487424->700415] (req 487424->700415) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143701.329954:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5205 00000100:00100000:1.0:1746143701.329958:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963592439040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143701.329961:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9dcc00, rc 0) 00010000:00010000:1.0:1746143701.329963:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143701.329970:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f5bd200/0xe984082ccd726b5b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2204 expref: 32 pid: 4582 timeout: 880 lvb_type: 1 00010000:00010000:1.0:1746143701.329978:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f5bd200/0xe984082ccd726b5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2204 expref: 32 pid: 4582 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746143701.329986:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28646:x1830963592436480:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7439us (8570us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143701.329988:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.329989:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143701.329994:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10021 00010000:00010000:1.0:1746143701.329995:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 32 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.330002:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 32 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.330027:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 32 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143701.330038:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593803904:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143701.330082:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe840 going to sleep for 11 seconds 00010000:00010000:1.0:1746143701.330118:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f5bd200/0xe984082ccd726b5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2204 expref: 32 pid: 4582 timeout: 880 lvb_type: 1 00000100:00100000:1.0:1746143701.330132:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009509bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593803648:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143701.330160:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fe200/0xe984082ccd726a7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21be expref: 8 pid: 4582 timeout: 880 lvb_type: 1 00000100:00100000:1.0:1746143701.330167:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009509ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593803776:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143701.330187:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 31 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.330195:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336a600, rc 0) 00000100:00100000:1.0:1746143701.330213:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:28645:x1830963592436608:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7418us (8144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.330220:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10022 00000100:00100000:2.0:1746143701.330505:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592438656 00000100:00100000:2.0:1746143701.330509:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592438656 00002000:00100000:2.0:1746143701.330535:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880095098700 x1830963592438656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143701.330543:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098700 with x1830963592438656 ext(1048576->2097151) 00002000:00010000:2.0:1746143701.330547:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095098700 00000100:00100000:2.0:1746143701.330561:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3750 00000100:00100000:2.0:1746143701.330566:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592438656:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143701.332925:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.333019:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592439168 00000100:00100000:1.0:1746143701.333029:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592439168 00000100:00100000:1.0:1746143701.333078:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10029 00000100:00100000:1.0:1746143701.333085:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+16:28650:x1830963592439168:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143701.333098:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.333189:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd726bd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2266 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.333211:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.333216:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [487424->700415] (req 487424->700415) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.333225:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143701.333228:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd726bd2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2266 expref: 17 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.333253:0:15784:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [487424->700415] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.333263:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd726bd2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2266 expref: 17 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.333271:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336a200, rc 0) 00000100:00100000:1.0:1746143701.333302:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+17:28650:x1830963592439168:12345-192.168.202.48@tcp:101:cat.0 Request processed in 218us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.333307:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10029 00000100:00100000:0.0:1746143701.337245:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593803904:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143701.337268:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143701.337320:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592439040:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7359us (7671us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143701.337330:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5205 00000100:00100000:0.0:1746143701.338452:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.338648:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592439424 00000100:00100000:3.0:1746143701.338656:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592439424 00002000:00100000:3.0:1746143701.338694:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3776512->3780607) req@ffff88009b852d80 x1830963592439424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.338703:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b852d80 with x1830963592439424 ext(3776512->3780607) 00002000:00010000:3.0:1746143701.338708:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b852d80 00000100:00100000:3.0:1746143701.339436:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3751 00000100:00100000:3.0:1746143701.339444:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592439424:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.339596:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963592439424:12345-192.168.202.48@tcp:3:cat.0 Request processed in 152us (1151us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143701.339602:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3751 00002000:00100000:3.0:1746143701.339607:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3776512->3780607) req@ffff88009b852d80 x1830963592439424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/4536 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.339614:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b852d80 with x1830963592439424 ext(3776512->3780607) 00002000:00010000:3.0:1746143701.339617:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b852d80 00000100:00100000:0.0:1746143701.344341:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592438016:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18335us (18505us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143701.344355:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 923 00002000:00100000:0.0:1746143701.344367:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880093503b80 x1830963592438016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143701.344377:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503b80 with x1830963592438016 ext(0->1048575) 00010000:00010000:0.0:1746143701.344388:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21d3 expref: 30 pid: 25369 timeout: 880 lvb_type: 1 00010000:00010000:0.0:1746143701.344404:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21d3 expref: 30 pid: 25369 timeout: 880 lvb_type: 1 00002000:00010000:0.0:1746143701.344417:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093503b80 00000100:00100000:3.0:1746143701.349576:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592438400:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23222us (23689us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143701.349590:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3749 00002000:00100000:3.0:1746143701.349601:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff88009b850700 x1830963592438400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.349610:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850700 with x1830963592438400 ext(1048576->2097151) 00002000:00010000:3.0:1746143701.349616:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b850700 00000100:00100000:2.0:1746143701.359923:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592438656:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29344us (31064us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143701.359936:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3750 00002000:00100000:2.0:1746143701.359950:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880095098700 x1830963592438656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143701.359959:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095098700 with x1830963592438656 ext(1048576->2097151) 00002000:00010000:2.0:1746143701.359966:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095098700 00000100:00100000:0.0:1746143701.361202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.361259:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592439552 00000100:00100000:1.0:1746143701.361270:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592439552 00010000:00010000:1.0:1746143701.361307:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21d3 expref: 28 pid: 25369 timeout: 880 lvb_type: 1 00000100:00100000:1.0:1746143701.361357:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5206 00000100:00100000:1.0:1746143701.361365:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963592439552:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143701.361377:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143701.361396:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21d3 expref: 28 pid: 25369 timeout: 880 lvb_type: 1 00010000:00010000:1.0:1746143701.361412:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21d3 expref: 28 pid: 25369 timeout: 880 lvb_type: 1 00010000:00010000:1.0:1746143701.361430:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e93b600/0xe984082ccd726b15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21d3 expref: 28 pid: 25369 timeout: 880 lvb_type: 1 00010000:00010000:1.0:1746143701.362551:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.362552:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.362561:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.362569:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.362601:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.362612:0:7151:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 16 pid: 6929 timeout: 880 lvb_type: 0 00000100:00100000:1.0:1746143701.362623:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593804160:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143701.363360:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143701.363808:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592438272:12345-192.168.202.48@tcp:3:cat.0 Request processed in 37798us (37949us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143701.363820:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3748 00002000:00100000:0.0:1746143701.363832:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff88009b853480 x1830963592438272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143701.363842:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b853480 with x1830963592438272 ext(1048576->2097151) 00002000:00010000:0.0:1746143701.363847:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b853480 00000100:00100000:0.0:1746143701.366120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143701.366211:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592439808 00000100:00100000:2.0:1746143701.366218:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592439808 00002000:00100000:2.0:1746143701.366256:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3973120->3977215) req@ffff880093806d80 x1830963592439808/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143701.366270:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806d80 with x1830963592439808 ext(3973120->3977215) 00000100:00100000:1.0:1746143701.366337:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593804160:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143701.366351:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143701.366388:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592439552:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5025us (5193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.366397:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5206 00002000:00010000:2.0:1746143701.366444:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093806d80 00000100:00100000:2.0:1746143701.366461:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3752 00000100:00100000:2.0:1746143701.366468:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592439808:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143701.366580:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963592439808:12345-192.168.202.48@tcp:3:cat.0 Request processed in 113us (468us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143701.366584:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3752 00002000:00100000:2.0:1746143701.366588:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3973120->3977215) req@ffff880093806d80 x1830963592439808/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/4536 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143701.366594:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806d80 with x1830963592439808 ext(3973120->3977215) 00002000:00010000:2.0:1746143701.366597:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093806d80 00000100:00100000:0.0:1746143701.366699:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.366761:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592440064 00000100:00100000:3.0:1746143701.366770:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592440064 00002000:00100000:3.0:1746143701.366812:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (487424->491519) req@ffff880093804e00 x1830963592440064/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.366821:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804e00 with x1830963592440064 ext(487424->491519) 00010000:00010000:3.0:1746143701.366829:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 17 pid: 6929 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746143701.366843:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 17 pid: 6929 timeout: 880 lvb_type: 0 00002000:00010000:3.0:1746143701.366849:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093804e00 00000100:00100000:3.0:1746143701.366868:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 924 00000100:00100000:3.0:1746143701.366873:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592440064:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.367013:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1964:x1830963592440064:12345-192.168.202.48@tcp:3:cat.0 Request processed in 140us (315us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143701.367019:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 924 00002000:00100000:3.0:1746143701.367023:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (487424->491519) req@ffff880093804e00 x1830963592440064/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/4536 e 0 to 0 dl 1746143712 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.367035:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804e00 with x1830963592440064 ext(487424->491519) 00010000:00010000:3.0:1746143701.367039:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 17 pid: 6929 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746143701.367047:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 17 pid: 6929 timeout: 880 lvb_type: 0 00002000:00010000:3.0:1746143701.367052:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093804e00 00000100:00100000:0.0:1746143701.379336:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.379423:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592440320 00000100:00100000:3.0:1746143701.379437:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592440320 00002000:00100000:3.0:1746143701.379489:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880093806a00 x1830963592440320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.379500:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806a00 with x1830963592440320 ext(2097152->3145727) 00002000:00010000:3.0:1746143701.379506:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093806a00 00000100:00100000:3.0:1746143701.379543:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3753 00000100:00100000:3.0:1746143701.379551:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592440320:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143701.379832:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143701.379993:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592440576 00000100:00100000:2.0:1746143701.380001:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592440576 00000100:00100000:2.0:1746143701.380048:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3428 00000100:00100000:2.0:1746143701.380054:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:28645:x1830963592440576:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143701.380359:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28645:x1830963592440576:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 305us (527us total) trans 8589942503 rc 0/0 00000100:00100000:2.0:1746143701.380366:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3428 00000100:00100000:2.0:1746143701.383016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143701.383047:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143701.383083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.383172:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592440832 00000100:00100000:3.0:1746143701.383184:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592440832 00002000:00100000:3.0:1746143701.383232:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f3c9880 x1830963592440832/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.383242:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c9880 with x1830963592440832 ext(3145728->4194303) 00002000:00010000:3.0:1746143701.383248:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c9880 00000100:00100000:3.0:1746143701.383265:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592441088 00000100:00100000:3.0:1746143701.383268:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592441088 00002000:00100000:3.0:1746143701.383282:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012f185f80 x1830963592441088/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.383290:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185f80 with x1830963592441088 ext(2097152->3145727) 00002000:00010000:3.0:1746143701.383293:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185f80 00000100:00100000:3.0:1746143701.383303:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592441344 00000100:00100000:3.0:1746143701.383305:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592441344 00002000:00100000:3.0:1746143701.383315:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3776511) req@ffff88012f187800 x1830963592441344/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.383322:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187800 with x1830963592441344 ext(3145728->3776511) 00002000:00010000:3.0:1746143701.383324:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f187800 00000100:00100000:3.0:1746143701.383336:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3754 00000100:00100000:3.0:1746143701.383343:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592440832:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143701.383906:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3755 00000100:00100000:0.0:1746143701.383918:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592441088:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.385204:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3756 00000100:00100000:3.0:1746143701.385214:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592441344:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.394687:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592440320:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15129us (15350us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143701.394700:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3753 00002000:00100000:3.0:1746143701.394709:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff880093806a00 x1830963592440320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.394718:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806a00 with x1830963592440320 ext(2097152->3145727) 00002000:00010000:3.0:1746143701.394723:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093806a00 00000100:00100000:0.0:1746143701.402611:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.402831:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592441600 00000100:00100000:3.0:1746143701.402839:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592441600 00002000:00100000:3.0:1746143701.402875:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (696320->700415) req@ffff880093804380 x1830963592441600/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.402891:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804380 with x1830963592441600 ext(696320->700415) 00010000:00010000:3.0:1746143701.402899:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 17 pid: 6929 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746143701.402911:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 17 pid: 6929 timeout: 880 lvb_type: 0 00002000:00010000:3.0:1746143701.402918:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093804380 00000100:00100000:3.0:1746143701.404326:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 925 00000100:00100000:3.0:1746143701.404335:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592441600:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.404508:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1963:x1830963592441600:12345-192.168.202.48@tcp:3:cat.0 Request processed in 173us (1902us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143701.404514:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 925 00002000:00100000:3.0:1746143701.404520:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34c:0x0] (696320->700415) req@ffff880093804380 x1830963592441600/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/4536 e 0 to 0 dl 1746143712 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.404527:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804380 with x1830963592441600 ext(696320->700415) 00010000:00010000:3.0:1746143701.404533:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 17 pid: 6929 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746143701.404544:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 17 pid: 6929 timeout: 880 lvb_type: 0 00002000:00010000:3.0:1746143701.404550:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093804380 00000100:00100000:0.0:1746143701.407289:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.407366:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592441856 00000100:00100000:3.0:1746143701.407377:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592441856 00002000:00100000:3.0:1746143701.407409:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3977216->4194303) req@ffff880093805c00 x1830963592441856/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.407417:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805c00 with x1830963592441856 ext(3977216->4194303) 00002000:00010000:3.0:1746143701.407421:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093805c00 00000100:00100000:2.0:1746143701.408739:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963592441088:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24818us (25685us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143701.408751:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3755 00002000:00100000:2.0:1746143701.408759:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88012f185f80 x1830963592441088/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143701.408767:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185f80 with x1830963592441088 ext(2097152->3145727) 00002000:00010000:2.0:1746143701.408770:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185f80 00000100:00100000:2.0:1746143701.408807:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3757 00000100:00100000:2.0:1746143701.408819:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592441856:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.410297:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592440832:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26951us (27284us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143701.410303:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3754 00002000:00100000:3.0:1746143701.410310:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88008f3c9880 x1830963592440832/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.410318:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c9880 with x1830963592440832 ext(3145728->4194303) 00002000:00010000:3.0:1746143701.410321:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c9880 00000100:00100000:3.0:1746143701.414276:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592441344:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29050us (31178us total) trans 0 rc 630784/630784 00000100:00100000:3.0:1746143701.414289:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3756 00002000:00100000:3.0:1746143701.414303:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->3776511) req@ffff88012f187800 x1830963592441344/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 630784/630784 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.414312:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187800 with x1830963592441344 ext(3145728->3776511) 00002000:00010000:3.0:1746143701.414318:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f187800 00000100:00100000:0.0:1746143701.414565:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.414683:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.414734:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592442368 00000100:00100000:3.0:1746143701.414741:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592442368 00002000:00100000:3.0:1746143701.414781:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34c:0x0] (487424->700415) req@ffff880093807100 x1830963592442368/t0(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.414788:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807100 with x1830963592442368 ext(487424->700415) 00010000:00010000:3.0:1746143701.414795:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 17 pid: 6929 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746143701.414808:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 17 pid: 6929 timeout: 880 lvb_type: 0 00002000:00010000:3.0:1746143701.414814:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093807100 00000100:00100000:3.0:1746143701.414830:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 926 00000100:00100000:3.0:1746143701.414836:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+17:1962:x1830963592442368:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143701.415189:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592442240 00000100:00100000:1.0:1746143701.415200:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592442240 00000100:00100000:1.0:1746143701.415263:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3429 00000100:00100000:1.0:1746143701.415271:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+8:28646:x1830963592442240:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143701.416335:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28646:x1830963592442240:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 1061us (1770us total) trans 8589942504 rc 0/0 00000100:00100000:1.0:1746143701.416343:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3429 00000100:00100000:3.0:1746143701.418312:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592441856:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9487us (11021us total) trans 0 rc 217088/217088 00000100:00100000:3.0:1746143701.418324:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3757 00002000:00100000:3.0:1746143701.418336:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x34c:0x0] (3977216->4194303) req@ffff880093805c00 x1830963592441856/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 217088/217088 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.418346:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805c00 with x1830963592441856 ext(3977216->4194303) 00002000:00010000:3.0:1746143701.418352:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093805c00 00000100:00100000:3.0:1746143701.423027:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.425026:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592442496 00000100:00100000:1.0:1746143701.425040:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592442496 00000100:00100000:1.0:1746143701.425108:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10030 00000100:00100000:1.0:1746143701.425119:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592442496:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143701.425158:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.425178:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5c00/0xe984082ccd726bd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a226d expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143701.425244:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593804288:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143701.425342:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe0c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746143701.427113:0:15784:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime: 1746143695 -> 1746143701 00002000:00010000:1.0:1746143701.427120:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime: 1746143695 -> 1746143701 00002000:00010000:1.0:1746143701.427122:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime: 1746143695 -> 1746143701 00000100:00100000:1.0:1746143701.427167:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593804288:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143701.427875:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592442368:12345-192.168.202.48@tcp:4:cat.0 Request processed in 13034us (13186us total) trans 17179872529 rc 0/0 00000100:00100000:2.0:1746143701.427888:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 926 00002000:00100000:2.0:1746143701.427899:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34c:0x0] (487424->700415) req@ffff880093807100 x1830963592442368/t17179872529(0) o4->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/448 e 0 to 0 dl 1746143712 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143701.427908:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807100 with x1830963592442368 ext(487424->700415) 00010000:00010000:2.0:1746143701.427917:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 19 pid: 6929 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746143701.427932:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 19 pid: 6929 timeout: 880 lvb_type: 0 00002000:00010000:2.0:1746143701.427938:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093807100 00010000:00010000:1.0:1746143701.428128:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5c00/0xe984082ccd726bd9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a226d expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.428160:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57f5c00/0xe984082ccd726bd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a226d expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.428183:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f5c00, rc 0) 00000100:00100000:1.0:1746143701.428209:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592442496:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3093us (5193us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143701.428216:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10030 00000100:00100000:0.0:1746143701.430726:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.430990:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592442624 00000100:00100000:1.0:1746143701.430999:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592442624 00010000:00010000:1.0:1746143701.431028:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 19 pid: 6929 timeout: 880 lvb_type: 0 00000100:00100000:1.0:1746143701.431064:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5207 00000100:00100000:1.0:1746143701.431070:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592442624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143701.431081:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143701.431101:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 19 pid: 6929 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746143701.431111:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 19 pid: 6929 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746143701.431129:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9dcc00/0xe984082ccd726b9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->700415) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a222e expref: 19 pid: 6929 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746143701.431179:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.431182:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.431188:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd726bd2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2266 expref: 18 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.431195:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd726bd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2266 expref: 18 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.431223:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd726bd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2266 expref: 18 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143701.431234:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593804416:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143701.431782:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143701.438576:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593804416:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143701.438604:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143701.438655:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592442624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7583us (7935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.438668:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5207 00000100:00100000:0.0:1746143701.438883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.438991:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592443008 00000100:00100000:3.0:1746143701.438998:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592443008 00002000:00100000:3.0:1746143701.439039:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880093804a80 x1830963592443008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.439049:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804a80 with x1830963592443008 ext(4194304->4898815) 00002000:00010000:3.0:1746143701.439053:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093804a80 00000100:00100000:3.0:1746143701.439070:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3758 00000100:00100000:3.0:1746143701.439077:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592443008:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143701.442028:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.442483:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.442511:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.442534:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143701.442596:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592443520 00000100:00100000:2.0:1746143701.442605:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592443520 00002000:00100000:2.0:1746143701.442644:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880093805500 x1830963592443520/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143701.442659:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805500 with x1830963592443520 ext(1048576->2097151) 00002000:00010000:2.0:1746143701.442664:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093805500 00000100:00100000:2.0:1746143701.442683:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592443392 00000100:00100000:2.0:1746143701.442685:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592443392 00002000:00100000:2.0:1746143701.442693:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093806680 x1830963592443392/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143701.442699:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806680 with x1830963592443392 ext(1048576->2097151) 00002000:00010000:2.0:1746143701.442702:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093806680 00000100:00100000:2.0:1746143701.442713:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592443776 00000100:00100000:2.0:1746143701.442715:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592443776 00002000:00100000:2.0:1746143701.442723:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880093807800 x1830963592443776/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143701.442729:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807800 with x1830963592443776 ext(0->1048575) 00002000:00010000:2.0:1746143701.442732:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093807800 00000100:00100000:2.0:1746143701.442740:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3759 00000100:00100000:2.0:1746143701.442747:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1965:x1830963592443520:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.442771:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592443904 00000100:00100000:3.0:1746143701.442788:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592443904 00002000:00100000:3.0:1746143701.442806:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880093804700 x1830963592443904/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.442814:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804700 with x1830963592443904 ext(1048576->2097151) 00002000:00010000:3.0:1746143701.442817:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093804700 00000100:00100000:3.0:1746143701.442838:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3760 00000100:00100000:3.0:1746143701.442843:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592443392:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143701.443092:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3761 00000100:00100000:2.0:1746143701.443097:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592443776:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.443193:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3762 00000100:00100000:3.0:1746143701.443199:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1965:x1830963592443904:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.451615:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963592443008:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12525us (12719us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143701.451628:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3758 00002000:00100000:3.0:1746143701.451640:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff880093804a80 x1830963592443008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.451650:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804a80 with x1830963592443008 ext(4194304->4898815) 00002000:00010000:3.0:1746143701.451656:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093804a80 00000100:00100000:3.0:1746143701.456551:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1965:x1830963592443776:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13441us (14027us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143701.456562:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3761 00002000:00100000:3.0:1746143701.456573:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x34c:0x0] (0->1048575) req@ffff880093807800 x1830963592443776/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.456583:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807800 with x1830963592443776 ext(0->1048575) 00002000:00010000:3.0:1746143701.456588:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093807800 00000100:00100000:0.0:1746143701.457469:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.457528:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592444160 00000100:00100000:1.0:1746143701.457538:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592444160 00000100:00100000:1.0:1746143701.457588:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10031 00000100:00100000:1.0:1746143701.457597:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592444160:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143701.457614:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.457630:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4400/0xe984082ccd726be0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2274 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.457654:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.457656:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.457665:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4400/0xe984082ccd726be0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2274 expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.457680:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4400/0xe984082ccd726be0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2274 expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143701.457691:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f4400, rc 0) 00000100:00100000:1.0:1746143701.457718:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963592444160:12345-192.168.202.48@tcp:101:cat.0 Request processed in 124us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.457724:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10031 00000100:00100000:3.0:1746143701.461678:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963592443392:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18823us (19184us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143701.461690:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3760 00002000:00100000:3.0:1746143701.461702:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34a:0x0] (1048576->2097151) req@ffff880093806680 x1830963592443392/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.461710:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806680 with x1830963592443392 ext(1048576->2097151) 00002000:00010000:3.0:1746143701.461716:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093806680 00000100:00100000:2.0:1746143701.466084:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+22:1965:x1830963592443520:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23323us (24057us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143701.466096:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3759 00002000:00100000:2.0:1746143701.466109:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x34b:0x0] (1048576->2097151) req@ffff880093805500 x1830963592443520/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143701.466123:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805500 with x1830963592443520 ext(1048576->2097151) 00002000:00010000:2.0:1746143701.466129:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093805500 00000100:00100000:3.0:1746143701.471350:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592443904:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28138us (28801us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143701.471362:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3762 00002000:00100000:3.0:1746143701.471375:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34e:0x0] (1048576->2097151) req@ffff880093804700 x1830963592443904/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.471385:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804700 with x1830963592443904 ext(1048576->2097151) 00002000:00010000:3.0:1746143701.471391:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093804700 00000100:00100000:0.0:1746143701.473515:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.473609:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592444416 00000100:00100000:1.0:1746143701.473618:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592444416 00000100:00100000:1.0:1746143701.473675:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3430 00000100:00100000:1.0:1746143701.473683:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28649:x1830963592444416:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143701.474467:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28649:x1830963592444416:12345-192.168.202.48@tcp:35:cat.0 Request processed in 783us (958us total) trans 8589942505 rc 0/0 00000100:00100000:1.0:1746143701.474474:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3430 00000100:00100000:0.0:1746143701.486132:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.486263:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592444672 00000100:00100000:3.0:1746143701.486272:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592444672 00002000:00100000:3.0:1746143701.486319:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009bef6d80 x1830963592444672/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.486329:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef6d80 with x1830963592444672 ext(2097152->3145727) 00002000:00010000:3.0:1746143701.486334:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef6d80 00000100:00100000:3.0:1746143701.486365:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3763 00000100:00100000:3.0:1746143701.486373:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592444672:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.498399:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1963:x1830963592444672:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12013us (12265us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143701.498416:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3763 00002000:00100000:3.0:1746143701.498428:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (2097152->3145727) req@ffff88009bef6d80 x1830963592444672/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.498438:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef6d80 with x1830963592444672 ext(2097152->3145727) 00002000:00010000:3.0:1746143701.498445:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef6d80 00000100:00100000:0.0:1746143701.501723:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.503908:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592444800 00000100:00100000:1.0:1746143701.503920:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592444800 00000100:00100000:1.0:1746143701.503971:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10032 00000100:00100000:1.0:1746143701.503979:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+22:28650:x1830963592444800:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143701.503998:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143701.504017:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5800/0xe984082ccd726be7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a227b expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.504047:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.504060:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143701.504062:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143701.504065:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5800/0xe984082ccd726be7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a227b expref: 23 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.504095:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.504107:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 26 pid: 15784 timeout: 880 lvb_type: 0 00000100:00100000:1.0:1746143701.504119:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593804544:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143701.504227:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143701.506445:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963593804544:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143701.506475:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5800/0xe984082ccd726be7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a227b expref: 23 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.506591:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57f5800, rc 0) 00000100:00100000:1.0:1746143701.507087:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:28650:x1830963592444800:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3105us (5370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.507095:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10032 00000100:00100000:0.0:1746143701.507414:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.507660:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592444928 00000100:00100000:3.0:1746143701.507667:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592444928 00002000:00100000:3.0:1746143701.507707:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3776512->3977215) req@ffff88009bef4a80 x1830963592444928/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.507716:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef4a80 with x1830963592444928 ext(3776512->3977215) 00010000:00010000:3.0:1746143701.507724:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 27 pid: 15784 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746143701.507736:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 27 pid: 15784 timeout: 880 lvb_type: 0 00002000:00010000:3.0:1746143701.507742:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bef4a80 00000100:00100000:3.0:1746143701.507770:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 927 00000100:00100000:3.0:1746143701.507786:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963592444928:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143701.510969:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963592444928:12345-192.168.202.48@tcp:4:cat.0 Request processed in 3172us (3544us total) trans 21474839794 rc 0/0 00000100:00100000:3.0:1746143701.510981:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 927 00002000:00100000:3.0:1746143701.510995:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3776512->3977215) req@ffff88009bef4a80 x1830963592444928/t21474839794(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:97/0 lens 488/448 e 0 to 0 dl 1746143712 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.511011:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef4a80 with x1830963592444928 ext(3776512->3977215) 00010000:00010000:3.0:1746143701.511022:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 29 pid: 15784 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746143701.511036:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 29 pid: 15784 timeout: 880 lvb_type: 0 00002000:00010000:3.0:1746143701.511042:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bef4a80 00000100:00100000:0.0:1746143701.517325:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.518622:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592445056 00000100:00100000:1.0:1746143701.518633:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592445056 00010000:00010000:1.0:1746143701.518678:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 29 pid: 15784 timeout: 880 lvb_type: 0 00000100:00100000:1.0:1746143701.519285:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5208 00000100:00100000:1.0:1746143701.519295:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963592445056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143701.519311:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143701.519333:0:7151:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143699 -> 1746143701 00002000:00010000:1.0:1746143701.519336:0:7151:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143699 -> 1746143701 00002000:00010000:1.0:1746143701.519338:0:7151:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143699 -> 1746143701 00010000:00010000:1.0:1746143701.519344:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 29 pid: 15784 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746143701.519358:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 29 pid: 15784 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746143701.519383:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd726ba1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3776512->3977215) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2235 expref: 29 pid: 15784 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746143701.519439:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.519441:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143701.519449:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5800/0xe984082ccd726be7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a227b expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.519458:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5800/0xe984082ccd726be7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a227b expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143701.519495:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5800/0xe984082ccd726be7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a227b expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143701.519513:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593804672:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143701.520026:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143701.522429:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593804672:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143701.522451:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143701.522494:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963592445056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3200us (5178us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143701.522503:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5208 00000100:00100000:0.0:1746143701.529593:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.529633:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143701.529674:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.529759:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592445312 00000100:00100000:3.0:1746143701.529769:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592445312 00002000:00100000:3.0:1746143701.529828:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009bef6a00 x1830963592445312/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.529838:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef6a00 with x1830963592445312 ext(2097152->3145727) 00002000:00010000:3.0:1746143701.529843:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bef6a00 00000100:00100000:3.0:1746143701.529860:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592445568 00000100:00100000:3.0:1746143701.529862:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592445568 00002000:00100000:3.0:1746143701.529871:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009bef5500 x1830963592445568/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.529877:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef5500 with x1830963592445568 ext(3145728->4194303) 00002000:00010000:3.0:1746143701.529879:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bef5500 00000100:00100000:3.0:1746143701.529887:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592445824 00000100:00100000:3.0:1746143701.529888:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592445824 00002000:00100000:3.0:1746143701.529898:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009bef6300 x1830963592445824/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.529904:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef6300 with x1830963592445824 ext(3145728->4194303) 00002000:00010000:3.0:1746143701.529907:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef6300 00000100:00100000:3.0:1746143701.529934:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3764 00000100:00100000:3.0:1746143701.529942:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+24:1964:x1830963592445312:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.531192:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3765 00000100:00100000:3.0:1746143701.531199:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963592445568:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143701.531691:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3766 00000100:00100000:2.0:1746143701.531700:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592445824:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.547880:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1964:x1830963592445312:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17927us (18286us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143701.547894:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3764 00002000:00100000:3.0:1746143701.547907:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x34c:0x0] (2097152->3145727) req@ffff88009bef6a00 x1830963592445312/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.547919:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef6a00 with x1830963592445312 ext(2097152->3145727) 00002000:00010000:3.0:1746143701.547925:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bef6a00 00000100:00100000:2.0:1746143701.553743:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1964:x1830963592445824:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22031us (24054us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143701.553755:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3766 00002000:00100000:2.0:1746143701.553768:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x34f:0x0] (3145728->4194303) req@ffff88009bef6300 x1830963592445824/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143701.553788:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef6300 with x1830963592445824 ext(3145728->4194303) 00002000:00010000:2.0:1746143701.553794:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef6300 00000100:00100000:3.0:1746143701.563072:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1964:x1830963592445568:12345-192.168.202.48@tcp:3:cat.0 Request processed in 31860us (33425us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143701.563087:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3765 00002000:00100000:3.0:1746143701.563099:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x34c:0x0] (3145728->4194303) req@ffff88009bef5500 x1830963592445568/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.563108:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef5500 with x1830963592445568 ext(3145728->4194303) 00002000:00010000:3.0:1746143701.563116:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bef5500 00000100:00100000:0.0:1746143701.573974:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143701.574050:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592446080 00000100:00100000:3.0:1746143701.574060:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592446080 00002000:00100000:3.0:1746143701.574113:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009bef4380 x1830963592446080/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/0 e 0 to 0 dl 1746143712 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.574127:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef4380 with x1830963592446080 ext(4194304->4898815) 00002000:00010000:3.0:1746143701.574132:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef4380 00000100:00100000:3.0:1746143701.574197:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3767 00000100:00100000:3.0:1746143701.574205:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592446080:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143701.582167:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1965:x1830963592446080:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7934us (8176us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746143701.582180:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3767 00002000:00100000:3.0:1746143701.582193:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x34f:0x0] (4194304->4898815) req@ffff88009bef4380 x1830963592446080/t0(0) o3->e4de552a-071d-43ca-bd1a-29b75634db8b@192.168.202.48@tcp:97/0 lens 488/440 e 0 to 0 dl 1746143712 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143701.582202:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bef4380 with x1830963592446080 ext(4194304->4898815) 00002000:00010000:3.0:1746143701.582209:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bef4380 00000100:00100000:0.0:1746143701.596356:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143701.600877:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592446336 00000100:00100000:1.0:1746143701.600893:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592446336 00000100:00100000:1.0:1746143701.600976:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3431 00000100:00100000:1.0:1746143701.600984:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+9:28650:x1830963592446336:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143701.601269:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+10:28650:x1830963592446336:12345-192.168.202.48@tcp:35:cat.0 Request processed in 286us (4925us total) trans 8589942506 rc 0/0 00000100:00100000:1.0:1746143701.601276:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3431 00010000:00010000:2.0:1746143701.607673:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143702.274571:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143702.276910:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592446592 00000100:00100000:1.0:1746143702.276925:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592446592 00000100:00100000:1.0:1746143702.277009:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10033 00000100:00100000:1.0:1746143702.277020:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+23:1963:x1830963592446592:12345-192.168.202.48@tcp:16:kworker.0 00000100:00080000:3.0:1746143702.277793:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143702.279355:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.279382:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.279404:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.279416:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.279437:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592446464 00000100:00100000:0.0:1746143702.279444:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592446464 00000100:00100000:0.0:1746143702.279485:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592446848 00000100:00100000:0.0:1746143702.279487:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592446848 00000100:00100000:0.0:1746143702.279497:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592446720 00000100:00100000:0.0:1746143702.279498:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592446720 00000100:00100000:0.0:1746143702.279508:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592447104 00000100:00100000:0.0:1746143702.279510:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592447104 00000100:00100000:0.0:1746143702.279522:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10034 00000100:00100000:0.0:1746143702.279529:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592446464:12345-192.168.202.48@tcp:16:kworker.0 00000100:00100000:0.0:1746143702.279592:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10035 00000100:00100000:0.0:1746143702.279597:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1963:x1830963592446848:12345-192.168.202.48@tcp:16:kworker.0 00000100:00100000:0.0:1746143702.279620:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10036 00000100:00100000:0.0:1746143702.279624:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1962:x1830963592446720:12345-192.168.202.48@tcp:16:kworker.0 00000100:00100000:0.0:1746143702.279674:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.279689:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592446976 00000100:00100000:0.0:1746143702.279692:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592446976 00000100:00100000:0.0:1746143702.279710:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10037 00000100:00100000:0.0:1746143702.279714:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+25:1963:x1830963592447104:12345-192.168.202.48@tcp:16:kworker.0 00000100:00100000:0.0:1746143702.279738:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10038 00000100:00100000:0.0:1746143702.279742:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1962:x1830963592446976:12345-192.168.202.48@tcp:16:kworker.0 00000100:00080000:3.0:1746143702.279862:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1746143702.358449:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839786 is committed 00000001:00080000:2.0:1746143702.358469:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839771 is committed 00000001:00080000:2.0:1746143702.358476:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839766 is committed 00000001:00080000:2.0:1746143702.358663:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839793 is committed 00000001:00080000:2.0:1746143702.358688:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839777 is committed 00000001:00080000:2.0:1746143702.358694:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839772 is committed 00000001:00080000:2.0:1746143702.358726:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839794 is committed 00000001:00080000:2.0:1746143702.358732:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839776 is committed 00000100:00100000:0.0:1746143702.358805:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4de552a-071d-43ca-bd1a-29b75634db8b+11:1962:x1830963592446720:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 79174us (79394us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143702.358815:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10036 00000100:00100000:1.0:1746143702.358899:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1963:x1830963592447104:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 79183us (79481us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143702.358905:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10037 00000100:00100000:1.0:1746143702.358938:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1963:x1830963592446592:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 81922us (84379us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143702.358946:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10033 00000100:00100000:1.0:1746143702.370642:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4de552a-071d-43ca-bd1a-29b75634db8b+20:1963:x1830963592446848:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 91039us (91252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143702.370652:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10035 00000100:00100000:1.0:1746143702.370695:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+19:1962:x1830963592446976:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 90951us (91020us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143702.370700:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10038 00000100:00100000:2.0:1746143702.370929:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+18:1962:x1830963592446464:12345-192.168.202.48@tcp:16:kworker.0 Request processed in 91399us (91582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143702.370936:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10034 00000001:00080000:3.0:1746143702.371154:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872527 is committed 00000001:00080000:3.0:1746143702.371184:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872510 is committed 00000001:00080000:3.0:1746143702.371219:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872509 is committed 00000001:00080000:3.0:1746143702.371232:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872529 is committed 00000001:00080000:3.0:1746143702.371242:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872528 is committed 00000100:00100000:0.0:1746143702.388340:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.388375:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.388387:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592447616 00000100:00100000:2.0:1746143702.388395:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592447616 00000100:00100000:0.0:1746143702.388400:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.388428:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10039 00000100:00100000:2.0:1746143702.388434:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+8:1961:x1830963592447616:12345-192.168.202.48@tcp:9:umount.0 00000100:00100000:0.0:1746143702.388437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.388454:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592447872 00000100:00100000:0.0:1746143702.388457:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592447872 00000020:00000080:2.0:1746143702.388458:0:12618:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe984082ccd71ddb0 00000020:00010000:2.0:1746143702.388464:0:12618:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012e88e800: total 0 00000100:00080000:2.0:1746143702.388468:0:12618:0:(import.c:66:import_set_state_nolock()) ffff88012e88a000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1746143702.388487:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592447744 00000100:00100000:0.0:1746143702.388489:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592447744 00000001:00000004:2.0:1746143702.388490:0:12618:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179872529 00000100:00100000:0.0:1746143702.388498:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592448000 00000100:00100000:0.0:1746143702.388499:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592448000 00000100:00100000:0.0:1746143702.388511:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 580 00000100:00100000:0.0:1746143702.388516:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:15f57a9f-bfb8-4cdc-bf57-fb307e561160+17:1964:x1830963592447872:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143702.388525:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143702.388550:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800930c5a00/0xe984082ccd71dd94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209cfe0 expref: 17 pid: 14758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.388563:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143702.388594:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:15f57a9f-bfb8-4cdc-bf57-fb307e561160+16:1964:x1830963592447872:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143702.388600:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 580 00000100:00100000:0.0:1746143702.388611:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 581 00000100:00100000:0.0:1746143702.388616:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1964:x1830963592447744:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143702.388621:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143702.388627:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800930c5800/0xe984082ccd71dd8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209cfb6 expref: 15 pid: 14758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.388634:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143702.388643:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:15f57a9f-bfb8-4cdc-bf57-fb307e561160+14:1964:x1830963592447744:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 28us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143702.388648:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 581 00000100:00100000:0.0:1746143702.388655:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 582 00000100:00100000:0.0:1746143702.388659:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:15f57a9f-bfb8-4cdc-bf57-fb307e561160+13:1964:x1830963592448000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143702.388663:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143702.388669:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a95e3000/0xe984082ccd71dd9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209cfe7 expref: 13 pid: 14761 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143702.388670:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e4de552a-071d-43ca-bd1a-29b75634db8b+6:1961:x1830963592447616:12345-192.168.202.48@tcp:9:umount.0 Request processed in 236us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143702.388676:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10039 00010000:00010000:0.0:1746143702.388676:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143702.388685:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:15f57a9f-bfb8-4cdc-bf57-fb307e561160+12:1964:x1830963592448000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 26us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143702.388690:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 582 00000020:00010000:3.0:1746143702.388909:0:7152:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012e88e800: total 0 00010000:00010000:3.0:1746143702.388935:0:7152:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012e88e800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1746143702.388968:0:7152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9dc600/0xe984082ccd726bc4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2251 expref: 5 pid: 8497 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746143702.388982:0:7152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5541 -> 5543 00010000:00010000:3.0:1746143702.388989:0:7152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801302a8600/0xe984082ccd726bbd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2258 expref: 4 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143702.389002:0:7152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd726bd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2266 expref: 3 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.389011:0:7152:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012e88e800, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746143702.389018:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143702.389019:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143702.389021:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143702.407403:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143702.407505:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592448640 00000100:00100000:1.0:1746143702.407513:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592448640 00000100:00100000:1.0:1746143702.407566:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10040 00000100:00100000:1.0:1746143702.407573:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+9:1961:x1830963592448640:12345-192.168.202.48@tcp:9:umount.0 00000020:00000080:1.0:1746143702.407599:0:25369:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe984082ccd71dda9 00000020:00010000:1.0:1746143702.407607:0:25369:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009ca46800: total 0 00000100:00080000:1.0:1746143702.407610:0:25369:0:(import.c:66:import_set_state_nolock()) ffff88009ca47800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746143702.407647:0:25369:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474839794 00000100:00100000:1.0:1746143702.407891:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e4de552a-071d-43ca-bd1a-29b75634db8b+7:1961:x1830963592448640:12345-192.168.202.48@tcp:9:umount.0 Request processed in 317us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143702.407897:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10040 00000020:00010000:0.0:1746143702.408002:0:7153:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009ca46800: total 0 00010000:00010000:0.0:1746143702.408031:0:7153:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009ca46800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1746143702.408075:0:7153:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c177800/0xe984082ccd71dec8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209d0b9 expref: 6 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.408099:0:7153:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5ea00/0xe984082ccd726baf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2243 expref: 5 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143702.408113:0:7153:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5800/0xe984082ccd726be7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a227b expref: 4 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.408131:0:7153:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a61cde00/0xe984082ccd726bb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a224a expref: 3 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143702.408162:0:7153:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009ca46800, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1746143702.408171:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143702.408173:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143702.408174:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143702.416506:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143702.416604:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592449024 00000100:00100000:1.0:1746143702.416614:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592449024 00000100:00080000:3.0:1746143702.416807:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143702.416830:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8382 00000100:00100000:1.0:1746143702.416839:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+10:1961:x1830963592449024:12345-192.168.202.48@tcp:39:umount.0 00000020:00000080:1.0:1746143702.416878:0:20509:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe984082ccd71dda2 00000020:00010000:1.0:1746143702.416894:0:20509:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009ca40000: total 0 00000100:00080000:1.0:1746143702.416898:0:20509:0:(import.c:66:import_set_state_nolock()) ffff88009ca41000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746143702.416925:0:20509:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589942506 00000020:00010000:3.0:1746143702.416952:0:9889:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009ca40000: total 0 00010000:00010000:3.0:1746143702.416992:0:9889:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009ca40000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1746143702.417023:0:9889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143702.417026:0:9889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746143702.417033:0:9889:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726b77 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2212 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.417103:0:9889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143702.417105:0:9889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746143702.417109:0:9889:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9dda00/0xe984082ccd726b69 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a220b expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.417133:0:9889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143702.417134:0:9889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746143702.417137:0:9889:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb5a00/0xe984082ccd71de66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209d08f expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.417171:0:9889:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009ca40000, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746143702.417181:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143702.417184:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143702.417185:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143702.417343:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e4de552a-071d-43ca-bd1a-29b75634db8b+5:1961:x1830963592449024:12345-192.168.202.48@tcp:39:umount.0 Request processed in 505us (844us total) trans 8589942507 rc 0/0 00000100:00100000:1.0:1746143702.417350:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8382 00010000:00010000:2.0:1746143702.609354:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143702.855888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.855921:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.855952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.855993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.856025:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592449536 00000100:00100000:0.0:1746143702.856035:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592449536 00000100:00100000:3.0:1746143702.856041:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592449664 00000100:00100000:3.0:1746143702.856051:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592449664 00000100:00100000:0.0:1746143702.856095:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10041 00000100:00100000:0.0:1746143702.856104:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1961:x1830963592449536:12345-192.168.202.48@tcp:9:umount.0 00000100:00100000:3.0:1746143702.856105:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592449920 00000100:00100000:3.0:1746143702.856107:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592449920 00000100:00100000:3.0:1746143702.856121:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592449792 00000100:00100000:3.0:1746143702.856123:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592449792 00000020:00000080:0.0:1746143702.856172:0:25369:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe984082ccd71ddd3 00000020:00010000:0.0:1746143702.856180:0:25369:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009ca42000: total 0 00000100:00080000:0.0:1746143702.856185:0:25369:0:(import.c:66:import_set_state_nolock()) ffff88009ca43800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1746143702.856187:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 583 00000100:00100000:3.0:1746143702.856195:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f57a9f-bfb8-4cdc-bf57-fb307e561160+14:1964:x1830963592449664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143702.856208:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00000004:0.0:1746143702.856221:0:25369:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179872529 00010000:00010000:3.0:1746143702.856222:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800b4daf600/0xe984082ccd71ddb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209d011 expref: 14 pid: 14761 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.856240:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143702.856284:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f57a9f-bfb8-4cdc-bf57-fb307e561160+13:1964:x1830963592449664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 90us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143702.856289:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 583 00000100:00100000:3.0:1746143702.856312:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 584 00000100:00100000:3.0:1746143702.856317:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f57a9f-bfb8-4cdc-bf57-fb307e561160+12:1964:x1830963592449920:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143702.856322:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143702.856329:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880093369000/0xe984082ccd71ddc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209d042 expref: 12 pid: 14758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.856337:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143702.856350:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f57a9f-bfb8-4cdc-bf57-fb307e561160+11:1964:x1830963592449920:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 33us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143702.856355:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 584 00000100:00100000:3.0:1746143702.856366:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 585 00000100:00100000:3.0:1746143702.856372:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f57a9f-bfb8-4cdc-bf57-fb307e561160+10:1964:x1830963592449792:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143702.856376:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1961:x1830963592449536:12345-192.168.202.48@tcp:9:umount.0 Request processed in 273us (381us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143702.856378:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143702.856382:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10041 00010000:00010000:3.0:1746143702.856385:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880093369c00/0xe984082ccd71ddbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209d03b expref: 10 pid: 14758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.856391:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00010000:0.0:1746143702.856403:0:7152:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009ca42000: total 0 00010000:00010000:0.0:1746143702.856405:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746143702.856406:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f57a9f-bfb8-4cdc-bf57-fb307e561160+9:1964:x1830963592449792:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 33us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143702.856411:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 585 00010000:00010000:0.0:1746143702.856420:0:7152:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009ca42000, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1746143702.856467:0:7152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e90a00/0xe984082ccd726a74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21b0 expref: 5 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143702.856494:0:7152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd71e1df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209d25d expref: 4 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.856518:0:7152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd726a90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21b7 expref: 3 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143702.856525:0:7152:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009ca42000, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1746143702.856533:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143702.856535:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143702.856537:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1746143702.856660:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143702.860444:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.860528:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592450432 00000100:00100000:2.0:1746143702.860537:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592450432 00000100:00100000:2.0:1746143702.860596:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10042 00000100:00100000:2.0:1746143702.860604:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+8:1961:x1830963592450432:12345-192.168.202.48@tcp:9:umount.0 00000020:00000080:2.0:1746143702.860635:0:12618:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe984082ccd71ddda 00000020:00010000:2.0:1746143702.860642:0:12618:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012e888000: total 0 00000100:00080000:2.0:1746143702.860646:0:12618:0:(import.c:66:import_set_state_nolock()) ffff88012e88d800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1746143702.860683:0:7153:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012e888000: total 0 00000001:00000004:2.0:1746143702.860691:0:12618:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474839794 00010000:00010000:1.0:1746143702.860722:0:7153:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012e888000, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1746143702.860782:0:7153:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e91c00/0xe984082ccd726a6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21a2 expref: 7 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143702.860823:0:7153:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f79c000/0xe984082ccd71e1d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209d256 expref: 5 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.860848:0:7153:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e91e00/0xe984082ccd726a89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21a9 expref: 4 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143702.860856:0:7153:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012e888000, canceled 3 locks, left on hash table 0. 00000100:00100000:2.0:1746143702.860863:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+3:1961:x1830963592450432:12345-192.168.202.48@tcp:9:umount.0 Request processed in 260us (430us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143702.860866:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746143702.860867:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746143702.860869:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143702.860870:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10042 00000100:00080000:0.0:1746143702.861098:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143702.864680:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143702.865043:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592450688 00000100:00100000:1.0:1746143702.865052:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592450688 00000100:00080000:0.0:1746143702.865591:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143702.865726:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8383 00000100:00100000:3.0:1746143702.865738:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+6:1961:x1830963592450688:12345-192.168.202.48@tcp:39:umount.0 00000020:00000080:3.0:1746143702.865784:0:21713:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe984082ccd71ddcc 00000020:00010000:3.0:1746143702.865792:0:21713:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012e88f800: total 0 00000100:00080000:3.0:1746143702.865796:0:21713:0:(import.c:66:import_set_state_nolock()) ffff88012e88f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746143702.865835:0:21713:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589942507 00000020:00010000:2.0:1746143702.866091:0:9889:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012e88f800: total 0 00010000:00010000:2.0:1746143702.866127:0:9889:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012e88f800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1746143702.866167:0:9889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:2.0:1746143702.866169:0:9889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746143702.866175:0:9889:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa600/0xe984082ccd71dde8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae461209d06c expref: 5 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.866197:0:9889:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012e88f800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1746143702.866204:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746143702.866205:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746143702.866206:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746143702.866752:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a68cf9ee-f2d6-4364-bc3a-13a57a653c3e+3:1961:x1830963592450688:12345-192.168.202.48@tcp:39:umount.0 Request processed in 1016us (2079us total) trans 8589942508 rc 0/0 00000100:00100000:3.0:1746143702.866769:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8383 00000100:00100000:0.0:1746143702.885541:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143702.885682:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592450816 00000100:00100000:3.0:1746143702.885693:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592450816 00000100:00100000:3.0:1746143702.886343:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8384 00000100:00100000:3.0:1746143702.886352:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28696:x1830963592450816:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143702.886375:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143702.886393:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bce00/0xe984082ccd726bee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2282 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746143702.886617:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746143702.886654:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc800/0xe984082ccd726bf5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.886668:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc800/0xe984082ccd726bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.886678:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc800/0xe984082ccd726bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.886689:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd726bfc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.886693:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd726bfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.886698:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd726bfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.887830:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c03 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.887838:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.887845:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:3.0:1746143702.887875:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:3.0:1746143702.887879:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143702.887893:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.887901:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c03 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.887908:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc800/0xe984082ccd726bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.887917:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc800/0xe984082ccd726bf5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.887923:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc800/0xe984082ccd726bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.887928:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bc800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143702.887931:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc800/0xe984082ccd726bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.887937:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc800/0xe984082ccd726bf5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.887948:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ba5a700) 00010000:00010000:3.0:1746143702.887951:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143702.887954:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc800/0xe984082ccd726bf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.887959:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc800/0xe984082ccd726bf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.888010:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd726bfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.888015:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd726bfc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.888019:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd726bfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.888023:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bc600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143702.888025:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd726bfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.888033:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd726bfc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.888039:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093484d00) 00010000:00010000:3.0:1746143702.888041:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143702.888043:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd726bfc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.888047:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd726bfc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.888082:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bce00/0xe984082ccd726bee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2282 expref: 245 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.888093:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c03 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2282 expref: 244 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.888097:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143702.888099:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143702.888101:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02bca00, rc 0) 00000100:00100000:3.0:1746143702.888182:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28696:x1830963592450816:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1831us (2651us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143702.888189:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8384 00000100:00100000:0.0:1746143702.892078:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.892160:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592450944 00000100:00100000:2.0:1746143702.892168:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592450944 00000100:00100000:2.0:1746143702.892230:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10043 00000100:00100000:2.0:1746143702.892237:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963592450944:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143702.892253:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143702.892267:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b458200/0xe984082ccd726c0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2289 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143702.892289:0:12618:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409d5, atime: 0x681409d5, ctime: 0x681409d5, blocks: 0x1029 00010000:00010000:2.0:1746143702.892305:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.892307:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.892314:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b458200/0xe984082ccd726c0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2289 expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.892327:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b458200/0xe984082ccd726c0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2289 expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.892337:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b458200, rc 0) 00000100:00080000:0.0:1746143702.892361:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143702.892376:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963592450944:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 139us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143702.892382:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10043 00000100:00100000:0.0:1746143702.900226:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143702.901062:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592451200 00000100:00100000:3.0:1746143702.901073:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592451200 00000100:00100000:3.0:1746143702.901130:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8385 00000100:00100000:3.0:1746143702.901155:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28696:x1830963592451200:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143702.901176:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143702.901196:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd726c11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2290 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.901290:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.901303:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c03 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2282 expref: 245 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.901310:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143702.901339:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c03 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2282 expref: 245 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.901350:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c03 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2282 expref: 245 pid: 21713 timeout: 881 lvb_type: 0 00000100:00100000:3.0:1746143702.901362:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593804800:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143702.901468:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143702.903116:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143702.903254:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593804800:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143702.903275:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:1.0:1746143702.903337:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592451328 00000100:00100000:1.0:1746143702.903343:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592451328 00010000:00010000:1.0:1746143702.903374:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c03 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2282 expref: 246 pid: 21713 timeout: 881 lvb_type: 0 00000100:00100000:1.0:1746143702.903410:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5209 00000100:00100000:1.0:1746143702.903417:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:1965:x1830963592451328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143702.903429:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143702.903435:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c03 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2282 expref: 246 pid: 21713 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746143702.903445:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c03 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2282 expref: 246 pid: 21713 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746143702.903464:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c03 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2282 expref: 246 pid: 21713 timeout: 881 lvb_type: 0 00010000:00010000:1.0:1746143702.903491:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143702.903495:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143702.903503:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143702.903509:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143702.903533:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143702.903568:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:1965:x1830963592451328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 151us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143702.903574:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5209 00010000:00010000:2.0:1746143702.903899:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143702.903906:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143702.903923:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143702.904806:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd726c11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2290 expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.904845:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2290 expref: 245 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.904855:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143702.904857:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143702.904860:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02bdc00, rc 0) 00000100:00100000:2.0:1746143702.904897:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28696:x1830963592451200:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3759us (4696us total) trans 8589942509 rc 0/0 00000100:00100000:2.0:1746143702.904904:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8385 00000100:00100000:0.0:1746143702.908565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.908663:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592451456 00000100:00100000:2.0:1746143702.908672:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592451456 00000100:00100000:2.0:1746143702.908752:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8386 00000100:00100000:2.0:1746143702.908771:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28696:x1830963592451456:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143702.908796:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143702.908815:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b459000/0xe984082ccd726c26 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2297 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.908895:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458000/0xe984082ccd726c2d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143702.908910:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2290 expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.908916:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458000/0xe984082ccd726c2d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143702.908949:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2290 expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.908960:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2290 expref: 246 pid: 21713 timeout: 881 lvb_type: 0 00000100:00100000:2.0:1746143702.908973:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593804928:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143702.909688:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143702.912267:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963593804928:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143702.912293:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458000/0xe984082ccd726c2d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:2.0:1746143702.912421:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.913504:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592451584 00000100:00100000:0.0:1746143702.913513:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592451584 00010000:00010000:0.0:1746143702.913552:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2290 expref: 247 pid: 21713 timeout: 881 lvb_type: 0 00000100:00100000:0.0:1746143702.914124:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5210 00000100:00100000:0.0:1746143702.914134:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:1965:x1830963592451584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143702.914162:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143702.914169:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2290 expref: 247 pid: 21713 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746143702.914180:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2290 expref: 247 pid: 21713 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746143702.914202:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd726c18 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2290 expref: 247 pid: 21713 timeout: 881 lvb_type: 0 00010000:00010000:0.0:1746143702.914245:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143702.914250:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458000/0xe984082ccd726c2d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143702.914260:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458000/0xe984082ccd726c2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143702.914267:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458000/0xe984082ccd726c2d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143702.914287:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143702.914336:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:1965:x1830963592451584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 203us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143702.914342:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5210 00010000:00010000:0.0:1746143702.914452:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458000/0xe984082ccd726c2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143702.914458:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458000/0xe984082ccd726c2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143702.914502:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:0.0:1746143702.914506:0:21713:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143702.914523:0:21713:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458000/0xe984082ccd726c2d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143702.914554:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b459000/0xe984082ccd726c26 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2297 expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.914568:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458000/0xe984082ccd726c2d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2297 expref: 245 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.914574:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:0.0:1746143702.914576:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143702.914578:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b458000, rc 0) 00000100:00100000:0.0:1746143702.915290:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28696:x1830963592451456:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 6528us (6734us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143702.915299:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8386 00000100:00100000:0.0:1746143702.917295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.917433:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592451840 00000100:00100000:2.0:1746143702.917441:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592451840 00000100:00100000:2.0:1746143702.917489:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8387 00000100:00100000:2.0:1746143702.917498:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28696:x1830963592451840:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143702.917518:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143702.917537:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5549200/0xe984082ccd726c34 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a229e expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.917625:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b89fc00/0xe984082ccd726c3b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143702.917640:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b89fc00/0xe984082ccd726c3b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143702.917654:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b89fc00/0xe984082ccd726c3b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:2.0:1746143702.917664:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00010000:00010000:2.0:1746143702.917789:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5549200/0xe984082ccd726c34 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a229e expref: 248 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.917823:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b89fc00/0xe984082ccd726c3b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a229e expref: 247 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.917831:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143702.917834:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143702.917836:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b89fc00, rc 0) 00000100:00100000:2.0:1746143702.917886:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:28696:x1830963592451840:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 388us (600us total) trans 8589942510 rc 0/0 00000100:00100000:2.0:1746143702.917892:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8387 00000100:00100000:0.0:1746143702.919584:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.919619:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.919852:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.919868:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.919881:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.919942:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.919966:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592451968 00000100:00100000:0.0:1746143702.919973:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592451968 00000100:00100000:0.0:1746143702.920884:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592452224 00000100:00100000:0.0:1746143702.920889:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592452224 00000100:00100000:1.0:1746143702.921047:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592452480 00000100:00100000:1.0:1746143702.921052:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592452480 00000100:00100000:1.0:1746143702.921071:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592452096 00000100:00100000:1.0:1746143702.921073:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592452096 00000100:00100000:1.0:1746143702.921083:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592452352 00000100:00100000:1.0:1746143702.921085:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592452352 00000100:00100000:1.0:1746143702.921262:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592452608 00000100:00100000:1.0:1746143702.921265:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592452608 00000100:00100000:0.0:1746143702.921302:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10044 00000100:00100000:0.0:1746143702.921313:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592451968:12345-192.168.202.48@tcp:1:lfs.0 00000100:00100000:2.0:1746143702.921347:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10045 00000100:00100000:2.0:1746143702.921355:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592452224:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143702.921359:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.921375:0:12618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.921376:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4400/0xe984082ccd726be0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2274 expref: 22 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143702.921383:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.921385:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f5bc200/0xe984082ccd726b46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21ef expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143702.921385:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143702.921388:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.921389:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.921391:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.921393:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.921416:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f5bc200/0xe984082ccd726b46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21ef expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143702.921416:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4400/0xe984082ccd726be0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2274 expref: 22 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.921428:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f5bc200/0xe984082ccd726b46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21ef expref: 19 pid: 4582 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746143702.921428:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4400/0xe984082ccd726be0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2274 expref: 22 pid: 15784 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746143702.921439:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593805056:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143702.921439:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593805184:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143702.921508:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10046 00000100:00100000:0.0:1746143702.921511:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143702.921513:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592452480:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143702.921529:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143702.921530:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10047 00000100:00100000:0.0:1746143702.921534:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592452096:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143702.921538:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc600/0xe984082ccd726b54 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21fd expref: 22 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.921543:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.921544:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.921546:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.921547:0:8495:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.921555:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f5bdc00/0xe984082ccd726b3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e8 expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.921559:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc600/0xe984082ccd726b54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21fd expref: 22 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143702.921560:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143702.921561:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143702.921563:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.921566:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc600/0xe984082ccd726b54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21fd expref: 22 pid: 4582 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746143702.921575:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f5bdc00/0xe984082ccd726b3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e8 expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143702.921580:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593805312:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143702.921581:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f5bdc00/0xe984082ccd726b3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e8 expref: 19 pid: 4582 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746143702.921587:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593805440:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143702.921598:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143702.921603:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143702.921613:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10048 00000100:00100000:2.0:1746143702.921617:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592452352:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143702.921632:0:6929:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.921640:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f5bca00/0xe984082ccd726b4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21f6 expref: 22 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.921645:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.921647:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.921649:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.921661:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f5bca00/0xe984082ccd726b4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21f6 expref: 22 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.921667:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f5bca00/0xe984082ccd726b4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21f6 expref: 22 pid: 4582 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746143702.921673:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593805568:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143702.921692:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143702.921701:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00080000:0.0:1746143702.921717:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143702.921932:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10049 00000100:00100000:3.0:1746143702.921942:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592452608:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143702.921958:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.921968:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b458200/0xe984082ccd726c0a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2289 expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143702.921974:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143702.921975:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143702.921977:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.921991:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b458200/0xe984082ccd726c0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2289 expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143702.922002:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b458200/0xe984082ccd726c0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2289 expref: 19 pid: 12618 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746143702.922009:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593805696:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143702.922044:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143702.924859:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963593805440:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143702.924860:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963593805312:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143702.924884:0:4582:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.924884:0:8495:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143702.924978:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963593805184:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143702.924991:0:15784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143702.925175:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963593805056:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143702.925189:0:12618:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143702.926390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143702.926648:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143702.926693:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963593805696:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143702.926709:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143702.926721:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143702.926743:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592452736 00000100:00100000:3.0:1746143702.926750:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592452736 00000100:00100000:2.0:1746143702.926769:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593805568:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143702.926784:0:6929:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.926789:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4400/0xe984082ccd726be0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2274 expref: 23 pid: 15784 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746143702.926824:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592452992 00000100:00100000:3.0:1746143702.926827:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592452992 00010000:00010000:3.0:1746143702.926837:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b458200/0xe984082ccd726c0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2289 expref: 20 pid: 12618 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746143702.926842:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592452864 00000100:00100000:2.0:1746143702.926845:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592452864 00000100:00100000:3.0:1746143702.926851:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5211 00010000:00010000:2.0:1746143702.926854:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5bc200/0xe984082ccd726b46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21ef expref: 21 pid: 4582 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746143702.926858:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963592452736:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143702.926868:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5212 00010000:00010000:3.0:1746143702.926870:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143702.926872:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963592452992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143702.926879:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143702.926894:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4400/0xe984082ccd726be0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2274 expref: 23 pid: 15784 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746143702.926894:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b458200/0xe984082ccd726c0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2289 expref: 21 pid: 12618 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746143702.926903:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4400/0xe984082ccd726be0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2274 expref: 23 pid: 15784 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746143702.926903:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b458200/0xe984082ccd726c0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2289 expref: 21 pid: 12618 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746143702.926923:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57f4400/0xe984082ccd726be0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2274 expref: 23 pid: 15784 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746143702.926923:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b458200/0xe984082ccd726c0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2289 expref: 21 pid: 12618 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746143702.926935:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143702.926936:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143702.926937:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.926937:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143702.926942:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.926942:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.926949:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.926949:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.926964:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143702.927175:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5213 00000100:00100000:0.0:1746143702.927181:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963592452864:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143702.927189:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143702.927200:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f5bc200/0xe984082ccd726b46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21ef expref: 20 pid: 4582 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746143702.927209:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f5bc200/0xe984082ccd726b46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21ef expref: 20 pid: 4582 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746143702.927219:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f5bc200/0xe984082ccd726b46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21ef expref: 20 pid: 4582 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746143702.927227:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143702.927229:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143702.927232:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.927237:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.927250:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143702.927722:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143702.927724:0:15784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.927733:0:15784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.927757:0:15784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.927771:0:15784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.927778:0:15784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.927783:0:15784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bd2d200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143702.927789:0:15784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.927795:0:15784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.927805:0:15784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.927815:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd2d200/0xe984082ccd726c49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143702.927919:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963592452864:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 736us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143702.927922:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963592452992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1048us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143702.927926:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5213 00000100:00100000:2.0:1746143702.927930:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5212 00010000:00010000:0.0:1746143702.927951:0:12618:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.927959:0:12618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143702.927965:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963592452736:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1106us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143702.927971:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5211 00010000:00010000:0.0:1746143702.927975:0:12618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.927981:0:12618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.927988:0:12618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.927993:0:12618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b89fa00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143702.927996:0:12618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.928002:0:12618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.928007:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.928013:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.928015:0:12618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.928021:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b89fa00/0xe984082ccd726c50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.928026:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.928031:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.928036:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.928041:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bca00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143702.928043:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143702.928053:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963592452224:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 6699us (8434us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143702.928054:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143702.928060:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10045 00010000:00010000:2.0:1746143702.928062:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.928068:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd726c6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143702.928430:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592451968:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 7118us (8852us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143702.928436:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10044 00000100:00100000:0.0:1746143702.928566:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143702.928615:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592453120 00000100:00100000:3.0:1746143702.928620:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592453120 00010000:00010000:3.0:1746143702.928637:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f5bca00/0xe984082ccd726b4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21f6 expref: 21 pid: 4582 timeout: 881 lvb_type: 1 00000100:00100000:3.0:1746143702.928656:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5214 00000100:00100000:3.0:1746143702.928662:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592453120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143702.928671:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143702.928675:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143702.928683:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f5bca00/0xe984082ccd726b4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21f6 expref: 21 pid: 4582 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746143702.928685:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592453376 00000100:00100000:0.0:1746143702.928688:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592453376 00010000:00010000:3.0:1746143702.928692:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f5bca00/0xe984082ccd726b4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21f6 expref: 22 pid: 4582 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746143702.928701:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc600/0xe984082ccd726b54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21fd expref: 22 pid: 4582 timeout: 881 lvb_type: 1 00010000:00010000:3.0:1746143702.928703:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f5bca00/0xe984082ccd726b4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21f6 expref: 22 pid: 4582 timeout: 881 lvb_type: 1 00000100:00100000:0.0:1746143702.928720:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5215 00000100:00100000:0.0:1746143702.928725:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963592453376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143702.928732:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143702.928742:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc600/0xe984082ccd726b54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21fd expref: 21 pid: 4582 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746143702.928749:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc600/0xe984082ccd726b54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21fd expref: 21 pid: 4582 timeout: 881 lvb_type: 1 00010000:00010000:0.0:1746143702.928774:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f5bc600/0xe984082ccd726b54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21fd expref: 21 pid: 4582 timeout: 881 lvb_type: 1 00000100:00100000:2.0:1746143702.928775:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963592452608:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 6835us (8831us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143702.928781:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10049 00010000:00010000:3.0:1746143702.930472:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143702.930477:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143702.930482:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.930493:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.930548:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143702.930550:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143702.930554:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.930561:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.930584:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143702.930619:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963592453376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1889us (1941us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143702.930627:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5215 00000100:00100000:0.0:1746143702.930693:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143702.930744:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143702.930827:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592453248 00000100:00100000:1.0:1746143702.930833:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592453248 00010000:00010000:1.0:1746143702.930855:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f5bdc00/0xe984082ccd726b3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e8 expref: 16 pid: 4582 timeout: 881 lvb_type: 1 00000100:00100000:1.0:1746143702.930875:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5216 00000100:00100000:1.0:1746143702.930880:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963592453248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143702.930887:0:6929:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.930890:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143702.930896:0:6929:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.930906:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f5bdc00/0xe984082ccd726b3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e8 expref: 16 pid: 4582 timeout: 881 lvb_type: 1 00010000:00010000:1.0:1746143702.930915:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f5bdc00/0xe984082ccd726b3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e8 expref: 16 pid: 4582 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746143702.930920:0:6929:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.930926:0:6929:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.930929:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f5bdc00/0xe984082ccd726b3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a21e8 expref: 16 pid: 4582 timeout: 881 lvb_type: 1 00010000:00010000:2.0:1746143702.930931:0:6929:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.930936:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143702.930937:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143702.930941:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.930942:0:6929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c25f000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143702.930945:0:6929:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.930946:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.930951:0:6929:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.930957:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143702.930960:0:6929:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.930964:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c25f000/0xe984082ccd726c65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143702.930973:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1965:x1830963592453248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 93us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143702.930977:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5216 00010000:00010000:3.0:1746143702.931011:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.931018:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.931033:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.931038:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.931044:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.931049:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c177800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143702.931051:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.931056:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.931061:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.931062:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143702.931066:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c177800/0xe984082ccd726c57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.931067:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.931080:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.931084:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.931095:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.931099:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b458c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143702.931101:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.931106:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.931113:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143702.931118:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b458c00/0xe984082ccd726c5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143702.931609:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592452352:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 9988us (11723us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143702.931615:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10048 00000100:00100000:3.0:1746143702.931713:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592452480:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 10198us (11859us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143702.931721:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10046 00000100:00100000:0.0:1746143702.931723:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+14:1964:x1830963592452096:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 10187us (11853us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143702.931730:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10047 00000100:00100000:3.0:1746143702.931749:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963592453120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3088us (3184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143702.931755:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5214 00000100:00100000:0.0:1746143702.934281:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.934454:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592453632 00000100:00100000:2.0:1746143702.934463:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592453632 00000100:00100000:2.0:1746143702.934519:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8388 00000100:00100000:2.0:1746143702.934527:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:28696:x1830963592453632:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:2.0:1746143702.934586:0:21713:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746143702.934615:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b458000/0xe984082ccd726c2d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2297 expref: 247 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.934635:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f5bc000/0xe984082ccd726b85 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2219 expref: 246 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.934651:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143702.934655:0:21713:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143702.934856:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25e600/0xe984082ccd726c73 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143702.934869:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25e600/0xe984082ccd726c73 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143702.934878:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25e600/0xe984082ccd726c73 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000040:00080000:2.0:1746143702.936351:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2330, 88 off195984 00000004:00080000:2.0:1746143702.936362:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781946222050ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143702.936418:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2274, 88 off190880 00000004:00080000:2.0:1746143702.936428:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781946288646ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143702.936456:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2275, 88 off190968 00000004:00080000:2.0:1746143702.936460:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781946319967ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143702.936467:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2331, 88 off196072 00000004:00080000:2.0:1746143702.936470:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781946330111ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143702.936476:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2332, 88 off196160 00000004:00080000:2.0:1746143702.936479:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781946339337ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143702.936485:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2276, 88 off191056 00000004:00080000:2.0:1746143702.936488:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781946348682ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143702.936494:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2277, 88 off191144 00000004:00080000:2.0:1746143702.936497:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781946357299ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143702.936502:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2278, 88 off191232 00000004:00080000:2.0:1746143702.936505:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781946365017ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143702.936510:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2333, 88 off196248 00000004:00080000:2.0:1746143702.936513:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781946373136ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143702.936518:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2279, 88 off191320 00000004:00080000:2.0:1746143702.936520:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781946380356ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143702.936525:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2334, 88 off196336 00000004:00080000:2.0:1746143702.936527:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781946387564ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143702.936533:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2280, 88 off191408 00000004:00080000:2.0:1746143702.936535:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781946395531ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143702.936541:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2335, 88 off196424 00000004:00080000:2.0:1746143702.936543:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781946402976ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143702.936549:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2336, 88 off196512 00000004:00080000:2.0:1746143702.936551:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781946411139ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143702.936581:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2338, 88 off196696 00000004:00080000:2.0:1746143702.936584:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781946444780ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143702.936592:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2339, 88 off196784 00000004:00080000:2.0:1746143702.936595:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 781946455009ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143702.936601:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2281, 88 off191496 00000004:00080000:2.0:1746143702.936604:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 781946463981ns, next at 718087967394ns, rc = 0 00000004:00010000:2.0:1746143702.972592:0:21713:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009cdc3800 reply state ffff88008eec1800 transno 8589942511 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25e600/0xe984082ccd726c73 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:2.0:1746143702.972607:0:21713:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143702.972729:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:28696:x1830963592453632:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 38196us (38452us total) trans 8589942511 rc 0/0 00000100:00100000:2.0:1746143702.972737:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8388 00000001:00100000:3.0:1746143702.974016:0:14831:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e4de552a-071d-43ca-bd1a-29b75634db8b 00000001:00080000:3.0:1746143702.974036:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942507 is committed 00000001:00080000:3.0:1746143702.974046:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942505 is committed 00000020:00000080:3.0:1746143702.974051:0:14831:0:(genops.c:904:class_export_put()) final put ffff88009ca40000/e4de552a-071d-43ca-bd1a-29b75634db8b 00010000:00010000:1.0:1746143702.975057:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25e600/0xe984082ccd726c73 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143702.975069:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25e600/0xe984082ccd726c73 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143702.975077:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25e600/0xe984082ccd726c73 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143702.975083:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c25e600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143702.975087:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25e600/0xe984082ccd726c73 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143702.975095:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25e600/0xe984082ccd726c73 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143702.975112:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143702.975114:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143702.975118:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25e600/0xe984082ccd726c73 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143702.975123:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25e600/0xe984082ccd726c73 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00000020:00000080:0.0:1746143702.976332:0:19617:0:(genops.c:863:class_export_destroy()) destroying export ffff88009ca40000/e4de552a-071d-43ca-bd1a-29b75634db8b for lustre-MDT0000 00000020:00000080:0.0:1746143702.976400:0:19617:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88009ca41000 for lustre-MDT0000 00000100:00100000:1.0:1746143702.976647:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.976699:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592453760 00000100:00100000:2.0:1746143702.976708:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592453760 00000100:00100000:2.0:1746143702.976750:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8389 00000100:00100000:2.0:1746143702.976768:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:28696:x1830963592453760:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143702.976793:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143702.976814:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd726c7a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a22a5 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.976881:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd726c7a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22a5 expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.976894:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd726c7a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22a5 expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143702.976913:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143702.976916:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143702.976919:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0800, rc 0) 00000100:00100000:2.0:1746143702.976980:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:28696:x1830963592453760:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 221us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143702.976986:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8389 00000001:00080000:3.0:1746143702.979606:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942511 is committed 00000004:00080000:3.0:1746143702.979616:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1626 committed 00000004:00080000:3.0:1746143702.980363:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1683 committed 00000004:00080000:3.0:1746143702.980372:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1682 committed 00000004:00080000:3.0:1746143702.980374:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1681 committed 00000004:00080000:3.0:1746143702.980375:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1680 committed 00000004:00080000:3.0:1746143702.980377:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1625 committed 00000004:00080000:3.0:1746143702.980379:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1679 committed 00000004:00080000:3.0:1746143702.980380:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1624 committed 00000004:00080000:3.0:1746143702.980382:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1678 committed 00000004:00080000:3.0:1746143702.980383:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1623 committed 00000004:00080000:3.0:1746143702.980385:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1622 committed 00000004:00080000:3.0:1746143702.980386:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1621 committed 00000004:00080000:3.0:1746143702.980387:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1677 committed 00000004:00080000:3.0:1746143702.980389:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1676 committed 00000004:00080000:3.0:1746143702.980390:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1620 committed 00000004:00080000:3.0:1746143702.980392:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1619 committed 00000004:00080000:3.0:1746143702.980395:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1675 committed 00000001:00100000:3.0:1746143702.980419:0:14831:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a68cf9ee-f2d6-4364-bc3a-13a57a653c3e 00000001:00080000:3.0:1746143702.980425:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942508 is committed 00000020:00000080:3.0:1746143702.980428:0:14831:0:(genops.c:904:class_export_put()) final put ffff88012e88f800/a68cf9ee-f2d6-4364-bc3a-13a57a653c3e 00000100:00100000:2.0:1746143702.980704:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593805824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143702.980756:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143702.980960:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593805952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143702.980985:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143702.981001:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593806080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143702.981017:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143702.981039:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593805824 00000100:00100000:0.0:1746143702.981045:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593805824 00000100:00100000:0.0:1746143702.981088:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593805952 00000100:00100000:0.0:1746143702.981090:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593805952 00000100:00100000:0.0:1746143702.981100:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593806080 00000100:00100000:0.0:1746143702.981102:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593806080 00000100:00100000:0.0:1746143702.981114:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10050 00000100:00100000:0.0:1746143702.981121:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3292:x1830963593805824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143702.981631:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10051 00000100:00100000:3.0:1746143702.981638:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3293:x1830963593805952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143702.981704:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143702.981829:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10052 00000100:00100000:1.0:1746143702.981835:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3294:x1830963593806080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143702.981847:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592453888 00000100:00100000:1.0:1746143702.981850:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592453888 00000100:00100000:1.0:1746143702.981869:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8390 00000100:00100000:1.0:1746143702.981873:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28696:x1830963592453888:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143702.981882:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143702.981899:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63dec00/0xe984082ccd726c81 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a22ac expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.981962:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63dfc00/0xe984082ccd726c88 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143702.981974:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63dfc00/0xe984082ccd726c88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143702.981984:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63dfc00/0xe984082ccd726c88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143702.982002:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d6:0x0]: returning size 9091616 00000004:00200000:1.0:1746143702.982005:0:20509:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143702.982018:0:20509:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63dfc00/0xe984082ccd726c88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143702.982035:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63dec00/0xe984082ccd726c81 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22ac expref: 244 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.982052:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63dfc00/0xe984082ccd726c88 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22ac expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143702.982059:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143702.982061:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143702.982064:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63dfc00, rc 0) 00000100:00100000:1.0:1746143702.982103:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28696:x1830963592453888:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 228us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143702.982108:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8390 00000100:00100000:2.0:1746143702.982767:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593806336:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143702.982797:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143702.982818:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593806848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143702.982834:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143702.982844:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593807360:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143702.982856:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143702.982868:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143702.982872:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593806976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143702.982888:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143702.982898:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593807488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143702.982910:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143702.982929:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593806208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143702.982948:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143702.982956:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593806720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143702.982970:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143702.982977:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593807232:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143702.982989:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143702.982996:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593807744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143702.983008:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143702.983016:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746143702.983020:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593807104:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143702.983034:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143702.983041:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593807616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143702.983053:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143702.983106:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593806336 00000100:00100000:3.0:1746143702.983110:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593806336 00000100:00100000:3.0:1746143702.983125:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593806848 00000100:00100000:3.0:1746143702.983127:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593806848 00000100:00100000:3.0:1746143702.983152:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593807360 00000100:00100000:3.0:1746143702.983154:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593807360 00000100:00100000:3.0:1746143702.983161:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593806976 00000100:00100000:3.0:1746143702.983162:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593806976 00000100:00100000:3.0:1746143702.983168:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593807488 00000100:00100000:3.0:1746143702.983170:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593807488 00000100:00100000:3.0:1746143702.983175:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593806208 00000100:00100000:3.0:1746143702.983176:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593806208 00000100:00100000:3.0:1746143702.983182:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593806720 00000100:00100000:3.0:1746143702.983184:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593806720 00000100:00100000:3.0:1746143702.983189:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593807232 00000100:00100000:3.0:1746143702.983191:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593807232 00000100:00100000:3.0:1746143702.983198:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593807744 00000100:00100000:3.0:1746143702.983199:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593807744 00000100:00100000:3.0:1746143702.983205:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593807104 00000100:00100000:3.0:1746143702.983206:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593807104 00000100:00100000:3.0:1746143702.983211:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593807616 00000100:00100000:3.0:1746143702.983212:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593807616 00000100:00100000:3.0:1746143702.983220:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10053 00000100:00100000:3.0:1746143702.983224:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3292:x1830963593806336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143702.983237:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10054 00000100:00100000:3.0:1746143702.983241:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3292:x1830963593806848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143702.984365:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10055 00000100:00100000:1.0:1746143702.984372:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963593807360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143702.984635:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963593806848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1392us (1799us total) trans 17179872530 rc 0/0 00000100:00100000:3.0:1746143702.984641:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10054 00000100:00100000:3.0:1746143702.984660:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10056 00000100:00100000:3.0:1746143702.984665:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963593806976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143702.984861:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3292:x1830963593805824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3738us (4103us total) trans 21474839795 rc 0/0 00000100:00100000:0.0:1746143702.984866:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10050 00000100:00100000:0.0:1746143702.984882:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10057 00000100:00100000:0.0:1746143702.984888:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963593807488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143702.984981:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3292:x1830963593807488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (2068us total) trans 17179872533 rc 0/0 00000100:00100000:0.0:1746143702.984986:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10057 00000100:00100000:0.0:1746143702.984997:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10058 00000100:00100000:0.0:1746143702.985001:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3295:x1830963593806208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143702.985089:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143702.985091:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143702.985094:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143702.985095:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:0.0:1746143702.985097:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143702.985120:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3295:x1830963593806208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 119us (2172us total) trans 21474839796 rc 0/0 00000100:00100000:0.0:1746143702.985128:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10058 00000100:00100000:0.0:1746143702.985157:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10059 00000100:00100000:0.0:1746143702.985162:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3295:x1830963593806720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143702.985247:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3295:x1830963593806720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (2276us total) trans 21474839797 rc 0/0 00000100:00100000:0.0:1746143702.985253:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10059 00000100:00100000:0.0:1746143702.985263:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10060 00000100:00100000:0.0:1746143702.985268:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593807232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143702.985345:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3295:x1830963593807232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (2354us total) trans 17179872534 rc 0/0 00000100:00100000:0.0:1746143702.985350:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10060 00000100:00100000:0.0:1746143702.985361:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10061 00000100:00100000:0.0:1746143702.985366:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593807744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143702.985437:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3295:x1830963593807744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (2428us total) trans 17179872535 rc 0/0 00000100:00100000:0.0:1746143702.985442:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10061 00000100:00100000:0.0:1746143702.985453:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10062 00000100:00100000:0.0:1746143702.985457:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593807104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143702.985541:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3295:x1830963593807104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (2505us total) trans 17179872536 rc 0/0 00000100:00100000:0.0:1746143702.985546:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10062 00000100:00100000:0.0:1746143702.985556:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10063 00000100:00100000:0.0:1746143702.985560:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593807616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143702.985644:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3295:x1830963593807616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (2589us total) trans 17179872537 rc 0/0 00000100:00100000:0.0:1746143702.985649:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10063 00000100:00080000:0.0:1746143702.985667:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143702.985671:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143702.985704:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593806592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143702.985731:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143702.985772:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593806592 00000100:00100000:0.0:1746143702.985778:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593806592 00000100:00100000:0.0:1746143702.985798:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10064 00000100:00100000:0.0:1746143702.985802:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3294:x1830963593806592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143702.985882:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963593806592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (150us total) trans 21474839798 rc 0/0 00000100:00100000:0.0:1746143702.985886:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10064 00000100:00100000:0.0:1746143702.985917:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839793 gen 2 00000004:00080000:0.0:1746143702.985922:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0c700, transno 21474839778 00000004:00080000:0.0:1746143702.985929:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0c000, transno 21474839779 00000004:00080000:0.0:1746143702.985932:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0c380, transno 21474839780 00000004:00080000:0.0:1746143702.985934:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0ed80, transno 21474839781 00000004:00080000:0.0:1746143702.985936:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f8000, transno 21474839782 00000004:00080000:0.0:1746143702.985939:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0df80, transno 21474839783 00000004:00080000:0.0:1746143702.985941:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0d500, transno 21474839784 00000004:00080000:0.0:1746143702.985943:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f9f80, transno 21474839785 00000004:00080000:0.0:1746143702.985945:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3cb480, transno 21474839786 00000004:00080000:0.0:1746143702.985948:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c8380, transno 21474839787 00000004:00080000:0.0:1746143702.985951:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c9180, transno 21474839788 00000004:00080000:0.0:1746143702.985953:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3ca300, transno 21474839789 00000004:00080000:0.0:1746143702.985957:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e1f80, transno 21474839790 00000004:00080000:0.0:1746143702.985959:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c8700, transno 21474839791 00000004:00080000:0.0:1746143702.985962:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e1e0e00, transno 21474839792 00000004:00080000:0.0:1746143702.985964:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3cb800, transno 21474839793 00000100:00100000:0.0:1746143702.985970:0:3294:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880093f02680 x1830963593806592/t21474839798(21474839798) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143718 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746143702.985980:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f02680/2, rc 0, transno 21474839798 00000100:00100000:0.0:1746143702.985984:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593806592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143702.986215:0:14800:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 7 in flight, 16 done 00000100:00100000:1.0:1746143702.986342:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963593807360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1970us (3484us total) trans 17179872531 rc 0/0 00000100:00100000:1.0:1746143702.986348:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10055 00000100:00100000:1.0:1746143702.986379:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593806464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143702.986402:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143702.986478:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963593806976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1812us (3589us total) trans 17179872532 rc 0/0 00000100:00100000:3.0:1746143702.986484:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10056 00000100:00100000:3.0:1746143702.986495:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593806464 00000100:00100000:3.0:1746143702.986498:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593806464 00000100:00100000:3.0:1746143702.986524:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10065 00000100:00100000:3.0:1746143702.986529:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963593806464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143702.986621:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593806464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (218us total) trans 21474839799 rc 0/0 00000100:00100000:3.0:1746143702.986625:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10065 00000100:00100000:3.0:1746143702.986723:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593805952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5086us (5737us total) trans 21474839800 rc 0/0 00000100:00100000:3.0:1746143702.986728:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10051 00000100:00100000:1.0:1746143702.986885:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963593806080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5051us (5867us total) trans 21474839801 rc 0/0 00000100:00100000:1.0:1746143702.986890:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10052 00000004:00080000:1.0:1746143702.986910:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd6300/2, rc 0, transno 21474839800 00000100:00100000:1.0:1746143702.986914:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593805952:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143702.986919:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f00000/2, rc 0, transno 21474839799 00000100:00100000:1.0:1746143702.986922:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593806464:0@lo:2:osp-syn-0-0.0 00000020:00000080:2.0:1746143702.986991:0:30469:0:(genops.c:863:class_export_destroy()) destroying export ffff88012e88f800/a68cf9ee-f2d6-4364-bc3a-13a57a653c3e for lustre-MDT0000 00000020:00000080:2.0:1746143702.987039:0:30469:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88012e88f000 for lustre-MDT0000 00000100:00100000:2.0:1746143702.987075:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872528 gen 2 00000004:00080000:2.0:1746143702.987079:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3f8380, transno 17179872511 00000004:00080000:2.0:1746143702.987085:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013691b480, transno 17179872512 00000004:00080000:2.0:1746143702.987087:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6d500, transno 17179872513 00000004:00080000:2.0:1746143702.987090:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136919c00, transno 17179872514 00000004:00080000:2.0:1746143702.987092:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3fa300, transno 17179872515 00000004:00080000:2.0:1746143702.987094:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c3fa680, transno 17179872516 00000004:00080000:2.0:1746143702.987098:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013691b800, transno 17179872517 00000004:00080000:2.0:1746143702.987100:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ad180, transno 17179872518 00000004:00080000:2.0:1746143702.987102:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136919500, transno 17179872519 00000004:00080000:2.0:1746143702.987105:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f03100, transno 17179872520 00000004:00080000:2.0:1746143702.987107:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c12d80, transno 17179872521 00000004:00080000:2.0:1746143702.987110:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f03b80, transno 17179872522 00000004:00080000:2.0:1746143702.987112:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c11180, transno 17179872523 00000004:00080000:2.0:1746143702.987115:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f01880, transno 17179872524 00000004:00080000:2.0:1746143702.987117:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c10700, transno 17179872525 00000004:00080000:2.0:1746143702.987120:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f01f80, transno 17179872526 00000004:00080000:2.0:1746143702.987122:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd4380, transno 17179872527 00000004:00080000:2.0:1746143702.987125:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f02d80, transno 17179872528 00000100:00100000:2.0:1746143702.987130:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880093501880 x1830963593807104/t17179872536(17179872536) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143718 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746143702.987153:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093501880/2, rc 0, transno 17179872536 00000100:00100000:2.0:1746143702.987157:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593807104:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143702.987171:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093503100/2, rc 0, transno 17179872537 00000100:00100000:2.0:1746143702.987174:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593807616:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143702.987182:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd5c00/2, rc 0, transno 21474839796 00000100:00100000:2.0:1746143702.987185:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593806208:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143702.987192:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f00380/2, rc 0, transno 21474839797 00000100:00100000:2.0:1746143702.987195:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593806720:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143702.987202:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093503800/2, rc 0, transno 17179872534 00000100:00100000:2.0:1746143702.987204:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593807232:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143702.987211:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093500000/2, rc 0, transno 17179872535 00000100:00100000:2.0:1746143702.987214:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593807744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143702.987262:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.987281:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.987294:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.987306:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.987318:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.987392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143702.987408:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592454016 00000100:00100000:2.0:1746143702.987411:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592454016 00000100:00100000:2.0:1746143702.987427:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592454144 00000100:00100000:2.0:1746143702.987429:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592454144 00000100:00100000:2.0:1746143702.987441:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592454400 00000100:00100000:2.0:1746143702.987442:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592454400 00000100:00100000:2.0:1746143702.987450:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592454272 00000100:00100000:2.0:1746143702.987452:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592454272 00000100:00100000:2.0:1746143702.987458:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592454528 00000100:00100000:2.0:1746143702.987459:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592454528 00000100:00100000:2.0:1746143702.987465:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592454656 00000100:00100000:2.0:1746143702.987466:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592454656 00000100:00100000:2.0:1746143702.987473:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10066 00000100:00100000:2.0:1746143702.987477:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592454016:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143702.987486:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143702.987501:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fffb600/0xe984082ccd726c8f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a22b3 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143702.987518:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34c:0x0] initial LVB size: 1048576, mtime: 0x681409d5, atime: 0x681409cf, ctime: 0x681409d5, blocks: 0x805 00010000:00010000:2.0:1746143702.987533:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.987535:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.987544:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fffb600/0xe984082ccd726c8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22b3 expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.987561:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fffb600/0xe984082ccd726c8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22b3 expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.987570:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fffb600, rc 0) 00000100:00100000:2.0:1746143702.987601:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592454016:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 124us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143702.987606:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10066 00000100:00100000:2.0:1746143702.987616:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10067 00000100:00100000:2.0:1746143702.987621:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963592454144:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143702.987627:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143702.987636:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fffb400/0xe984082ccd726c96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a22ba expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143702.987648:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34a:0x0] initial LVB size: 2097152, mtime: 0x681409d1, atime: 0x681409cf, ctime: 0x681409d1, blocks: 0x81f 00010000:00010000:2.0:1746143702.987656:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.987657:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.987661:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fffb400/0xe984082ccd726c96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22ba expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.987671:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fffb400/0xe984082ccd726c96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22ba expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.987678:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fffb400, rc 0) 00000100:00100000:2.0:1746143702.987691:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963592454144:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 70us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143702.987700:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10067 00000100:00100000:2.0:1746143702.987710:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10068 00000100:00100000:2.0:1746143702.987714:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592454400:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143702.987719:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143702.987725:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fffb200/0xe984082ccd726c9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a22c8 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143702.987734:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34e:0x0] initial LVB size: 2097152, mtime: 0x681409d2, atime: 0x681409d2, ctime: 0x681409d2, blocks: 0x81f 00010000:00010000:2.0:1746143702.987739:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.987741:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.987744:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fffb200/0xe984082ccd726c9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c8 expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.987752:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fffb200/0xe984082ccd726c9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c8 expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.987768:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fffb200, rc 0) 00000100:00100000:2.0:1746143702.987782:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592454400:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 68us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143702.987787:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10068 00000100:00100000:2.0:1746143702.987795:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10069 00000100:00100000:2.0:1746143702.987799:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963592454272:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143702.987804:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143702.987810:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fffbe00/0xe984082ccd726ca4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a22c1 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143702.987823:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34b:0x0] initial LVB size: 2097152, mtime: 0x681409d2, atime: 0x681409d2, ctime: 0x681409d2, blocks: 0x821 00010000:00010000:2.0:1746143702.987830:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.987831:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.987835:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fffbe00/0xe984082ccd726ca4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c1 expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.987843:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fffbe00/0xe984082ccd726ca4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c1 expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.987849:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fffbe00, rc 0) 00000100:00100000:2.0:1746143702.987862:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963592454272:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 63us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143702.987867:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10069 00000100:00100000:2.0:1746143702.987875:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10070 00000100:00100000:2.0:1746143702.987879:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592454528:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143702.987885:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143702.987892:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fffbc00/0xe984082ccd726cab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a22cf expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143702.987901:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x34f:0x0] initial LVB size: 4897312, mtime: 0x681409d3, atime: 0x681409d3, ctime: 0x681409d3, blocks: 0x15a7 00010000:00010000:2.0:1746143702.987908:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.987909:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.987913:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fffbc00/0xe984082ccd726cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22cf expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.987926:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fffbc00/0xe984082ccd726cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22cf expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.987932:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fffbc00, rc 0) 00000100:00100000:2.0:1746143702.987948:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592454528:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 68us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143702.987952:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10070 00000100:00100000:2.0:1746143702.987961:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10071 00000100:00100000:2.0:1746143702.987965:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963592454656:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143702.987970:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143702.987977:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd726cb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a22d6 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143702.987986:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x34c:0x0] initial LVB size: 4194304, mtime: 0x681409d5, atime: 0x681409d5, ctime: 0x681409d5, blocks: 0x1029 00010000:00010000:2.0:1746143702.987992:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.987993:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143702.987997:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd726cb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22d6 expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.988004:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd726cb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22d6 expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143702.988010:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fffba00, rc 0) 00000100:00100000:2.0:1746143702.988023:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963592454656:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 57us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143702.988031:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10071 00000004:00080000:2.0:1746143702.988065:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949f2300/2, rc 0, transno 17179872532 00000100:00100000:2.0:1746143702.988069:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593806976:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143702.988078:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093500e00/2, rc 0, transno 17179872533 00000100:00100000:2.0:1746143702.988081:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593807488:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143702.988088:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949f1880/2, rc 0, transno 17179872530 00000100:00100000:2.0:1746143702.988091:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593806848:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143702.988098:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093500a80/2, rc 0, transno 17179872531 00000100:00100000:2.0:1746143702.988100:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593807360:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143702.988109:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd4000/2, rc 0, transno 21474839795 00000100:00100000:2.0:1746143702.988111:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593805824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143702.988373:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 18 done 00000100:00100000:1.0:1746143702.988431:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746143702.988440:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593807872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143702.988467:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143702.988494:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593807872 00000100:00100000:1.0:1746143702.988497:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593807872 00000100:00100000:1.0:1746143702.988513:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10072 00000100:00100000:1.0:1746143702.988518:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963593807872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143702.988630:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963593807872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (161us total) trans 17179872538 rc 0/0 00000100:00100000:1.0:1746143702.988635:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10072 00000004:00080000:1.0:1746143702.988653:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093501500/2, rc 0, transno 17179872538 00000100:00100000:1.0:1746143702.988656:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593807872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143702.990070:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963593806336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6841us (7269us total) trans 21474839802 rc 0/0 00000100:00100000:3.0:1746143702.990079:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10053 00000004:00080000:2.0:1746143702.990189:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e1e1880/2, rc 0, transno 21474839802 00000100:00100000:2.0:1746143702.990194:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593806336:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143702.990360:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd6d80/2, rc 0, transno 21474839801 00000100:00100000:0.0:1746143702.990364:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963593806080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143703.002275:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143703.002372:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592454912 00000100:00100000:3.0:1746143703.002383:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592454912 00000100:00100000:3.0:1746143703.002538:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3768 00000100:00100000:3.0:1746143703.002547:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592454912:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143703.002589:0:21518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b872e00/0xe984082ccd726cb9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.002604:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.002606:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.002612:0:21518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b872e00/0xe984082ccd726cb9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.005855:0:21518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b872e00/0xe984082ccd726cb9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143703.007993:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143703.008101:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143703.008188:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592455168 00000100:00100000:2.0:1746143703.008198:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592455168 00000100:00100000:2.0:1746143703.008252:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592455424 00000100:00100000:2.0:1746143703.008254:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592455424 00000100:00100000:2.0:1746143703.008286:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3769 00000100:00100000:2.0:1746143703.008294:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963592455168:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143703.008330:0:25543:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fffae00/0xe984082ccd726cc0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.008344:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.008346:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.008352:0:25543:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fffae00/0xe984082ccd726cc0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.008371:0:25543:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fffae00/0xe984082ccd726cc0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143703.008632:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3770 00000100:00100000:1.0:1746143703.008640:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963592455424:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143703.008657:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d520a00/0xe984082ccd726cc7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.008665:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143703.008667:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143703.008670:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520a00/0xe984082ccd726cc7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.008679:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d520a00/0xe984082ccd726cc7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143703.010740:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143703.013529:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592455680 00000100:00100000:0.0:1746143703.013542:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592455680 00000100:00100000:0.0:1746143703.013627:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3771 00000100:00100000:0.0:1746143703.013635:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963592455680:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143703.013678:0:8500:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093327600/0xe984082ccd726cce lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.013696:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143703.013698:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143703.013703:0:8500:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093327600/0xe984082ccd726cce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.013717:0:8500:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093327600/0xe984082ccd726cce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143703.019772:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143703.021412:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143703.022314:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143703.023134:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592455936 00000100:00100000:2.0:1746143703.023161:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592455936 00000100:00100000:2.0:1746143703.023214:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592456192 00000100:00100000:2.0:1746143703.023217:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592456192 00000100:00100000:2.0:1746143703.023233:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592456448 00000100:00100000:2.0:1746143703.023235:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592456448 00000100:00100000:2.0:1746143703.023253:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3772 00000100:00100000:2.0:1746143703.023261:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963592455936:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143703.023300:0:25544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fffa600/0xe984082ccd726cd5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143703.023301:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3773 00000100:00100000:1.0:1746143703.023309:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592456192:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143703.023315:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.023317:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.023322:0:25544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fffa600/0xe984082ccd726cd5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.023331:0:31339:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd726cdc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.023335:0:25544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fffa600/0xe984082ccd726cd5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.023339:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143703.023340:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143703.023343:0:31339:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd726cdc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.023352:0:31339:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd726cdc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143703.023792:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3774 00000100:00100000:2.0:1746143703.023799:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963592456448:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143703.023815:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fffa400/0xe984082ccd726ce3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.023827:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.023829:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.023832:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fffa400/0xe984082ccd726ce3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.023840:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fffa400/0xe984082ccd726ce3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143703.031125:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143703.031637:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592456704 00000100:00100000:2.0:1746143703.031647:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592456704 00000100:00100000:2.0:1746143703.031722:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3775 00000100:00100000:2.0:1746143703.031730:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592456704:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143703.031780:0:8502:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726cea lrc: 3/1,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.031795:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.031796:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.031803:0:8502:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726cea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.031817:0:8502:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726cea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.042367:0:21518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b872e00/0xe984082ccd726cb9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.042386:0:21518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b872e00/0xe984082ccd726cb9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.042394:0:21518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b872e00/0xe984082ccd726cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.042401:0:21518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b872e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143703.042405:0:21518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b872e00/0xe984082ccd726cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.042413:0:21518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b872e00/0xe984082ccd726cb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.042435:0:21518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b872e00/0xe984082ccd726cb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.042446:0:21518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b872e00/0xe984082ccd726cb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143703.042540:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963592454912:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 39989us (40271us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143703.042551:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3768 00010000:00010000:2.0:1746143703.049424:0:25543:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fffae00/0xe984082ccd726cc0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.049444:0:25543:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fffae00/0xe984082ccd726cc0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.049458:0:25543:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fffae00/0xe984082ccd726cc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.049465:0:25543:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fffae00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143703.049469:0:25543:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fffae00/0xe984082ccd726cc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.049476:0:25543:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fffae00/0xe984082ccd726cc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.049497:0:25543:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fffae00/0xe984082ccd726cc0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.049502:0:25543:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fffae00/0xe984082ccd726cc0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143703.049619:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963592455168:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 41319us (41629us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143703.049629:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3769 00010000:00010000:0.0:1746143703.056976:0:8500:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093327600/0xe984082ccd726cce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.056992:0:8500:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093327600/0xe984082ccd726cce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.057000:0:8500:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093327600/0xe984082ccd726cce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.057007:0:8500:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093327600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143703.057011:0:8500:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093327600/0xe984082ccd726cce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.057018:0:8500:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093327600/0xe984082ccd726cce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.057038:0:8500:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093327600/0xe984082ccd726cce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.057043:0:8500:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093327600/0xe984082ccd726cce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143703.059901:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963592455680:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 46255us (49159us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143703.059914:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3771 00010000:00010000:0.0:1746143703.061466:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d520a00/0xe984082ccd726cc7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.061481:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520a00/0xe984082ccd726cc7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.061490:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d520a00/0xe984082ccd726cc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.061497:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d520a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143703.061501:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d520a00/0xe984082ccd726cc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.061509:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d520a00/0xe984082ccd726cc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.061528:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d520a00/0xe984082ccd726cc7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.061534:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d520a00/0xe984082ccd726cc7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143703.061613:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592455424:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 52969us (53507us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143703.061621:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3770 00010000:00010000:2.0:1746143703.070021:0:31339:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd726cdc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.070039:0:31339:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd726cdc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.070046:0:31339:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd726cdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.070054:0:31339:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d520000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143703.070059:0:31339:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd726cdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.070068:0:31339:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd726cdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.070086:0:31339:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd726cdc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.070092:0:31339:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d520000/0xe984082ccd726cdc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143703.070214:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592456192:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 46900us (48804us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143703.070224:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3773 00010000:00010000:1.0:1746143703.080354:0:25544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fffa600/0xe984082ccd726cd5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.080372:0:25544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fffa600/0xe984082ccd726cd5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.080381:0:25544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fffa600/0xe984082ccd726cd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.080387:0:25544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fffa600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143703.080390:0:25544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fffa600/0xe984082ccd726cd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.080398:0:25544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fffa600/0xe984082ccd726cd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.080418:0:25544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fffa600/0xe984082ccd726cd5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.080428:0:25544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fffa600/0xe984082ccd726cd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143703.080537:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592455936:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 57271us (60782us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143703.080547:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3772 00010000:00010000:2.0:1746143703.088255:0:31338:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fffa400/0xe984082ccd726ce3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.088272:0:31338:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fffa400/0xe984082ccd726ce3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.088576:0:31338:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fffa400/0xe984082ccd726ce3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.088585:0:31338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fffa400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143703.088594:0:31338:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fffa400/0xe984082ccd726ce3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.088603:0:31338:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fffa400/0xe984082ccd726ce3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.088623:0:31338:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fffa400/0xe984082ccd726ce3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.088630:0:31338:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fffa400/0xe984082ccd726ce3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143703.088740:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592456448:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 64935us (66423us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143703.088750:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3774 00010000:00010000:3.0:1746143703.093048:0:8502:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726cea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.093068:0:8502:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726cea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.093076:0:8502:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726cea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.093087:0:8502:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57f5e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143703.093091:0:8502:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726cea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.093101:0:8502:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726cea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.093125:0:8502:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726cea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.093132:0:8502:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57f5e00/0xe984082ccd726cea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143703.093597:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963592456704:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 61861us (62478us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143703.093610:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3775 00000100:00100000:0.0:1746143703.109514:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143703.109622:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592456960 00000100:00100000:1.0:1746143703.109632:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592456960 00000100:00100000:1.0:1746143703.109691:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8391 00000100:00100000:1.0:1746143703.109699:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28696:x1830963592456960:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:1.0:1746143703.109753:0:21713:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143703.109794:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63dfc00/0xe984082ccd726c88 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22ac expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.109817:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143703.109821:0:21713:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143703.109907:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd726cf1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143703.109918:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd726cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143703.109926:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd726cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00010000:1.0:1746143703.110134:0:21713:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009cdc1180 reply state ffff880131eb3000 transno 8589942512 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd726cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:1.0:1746143703.110175:0:21713:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746143703.110252:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:28696:x1830963592456960:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 553us (750us total) trans 8589942512 rc 0/0 00000100:00100000:1.0:1746143703.110258:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8391 00010000:00010000:3.0:1746143703.113338:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd726cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143703.113355:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd726cf1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143703.113361:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd726cf1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143703.113368:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d510200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143703.113372:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd726cf1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143703.113378:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd726cf1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143703.113395:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143703.113397:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143703.113401:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd726cf1 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143703.113405:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd726cf1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143703.113584:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143703.114495:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592457088 00000100:00100000:2.0:1746143703.114505:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592457088 00000100:00100000:2.0:1746143703.114551:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10073 00000100:00100000:2.0:1746143703.114558:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28696:x1830963592457088:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143703.114578:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143703.114595:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5e00/0xe984082ccd726cf8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a22dd expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.114623:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fffb600/0xe984082ccd726c8f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22b3 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143703.114631:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.114633:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.114637:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5e00/0xe984082ccd726cf8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22dd expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.114668:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fffb600/0xe984082ccd726c8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22b3 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143703.114680:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fffb600/0xe984082ccd726c8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22b3 expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746143703.114692:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593808000:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143703.114793:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143703.118277:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143703.118517:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593808000:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143703.118549:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5e00/0xe984082ccd726cf8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22dd expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.118567:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f5e00, rc 0) 00000100:00100000:2.0:1746143703.118610:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28696:x1830963592457088:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4051us (5031us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143703.118618:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10073 00000100:00100000:3.0:1746143703.118710:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592457216 00000100:00100000:3.0:1746143703.118717:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592457216 00010000:00010000:3.0:1746143703.118744:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fffb600/0xe984082ccd726c8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22b3 expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746143703.118790:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5217 00000100:00100000:3.0:1746143703.118797:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963592457216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143703.118809:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143703.118830:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fffb600/0xe984082ccd726c8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22b3 expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.118840:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fffb600/0xe984082ccd726c8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22b3 expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.118861:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fffb600/0xe984082ccd726c8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22b3 expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.118872:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.118874:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.118881:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5e00/0xe984082ccd726cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22dd expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.118888:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5e00/0xe984082ccd726cf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22dd expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.118918:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5e00/0xe984082ccd726cf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22dd expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143703.118931:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593808128:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143703.118993:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143703.120984:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143703.121448:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592457344 00000100:00100000:2.0:1746143703.121457:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592457344 00000100:00100000:2.0:1746143703.121498:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10074 00000100:00100000:2.0:1746143703.121506:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:28696:x1830963592457344:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143703.121526:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143703.121544:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4600/0xe984082ccd726cff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a22e4 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.121577:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fffb400/0xe984082ccd726c96 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22ba expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143703.121584:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.121586:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.121589:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4600/0xe984082ccd726cff lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22e4 expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.121613:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fffb400/0xe984082ccd726c96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22ba expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143703.121625:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fffb400/0xe984082ccd726c96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22ba expref: 18 pid: 25369 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746143703.121637:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593808256:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143703.121708:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143703.122065:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593808128:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143703.122083:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143703.122124:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963592457216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3326us (3857us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143703.122134:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5217 00000100:00100000:0.0:1746143703.124727:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143703.124831:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593808256:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143703.124838:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592457472 00000100:00100000:3.0:1746143703.124845:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592457472 00010000:00010000:2.0:1746143703.124863:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4600/0xe984082ccd726cff lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22e4 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.124873:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fffb400/0xe984082ccd726c96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22ba expref: 19 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:2.0:1746143703.124881:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f4600, rc 0) 00000100:00100000:3.0:1746143703.125136:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5218 00000100:00100000:3.0:1746143703.125199:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592457472:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143703.125212:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143703.125237:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fffb400/0xe984082ccd726c96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22ba expref: 19 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.125247:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fffb400/0xe984082ccd726c96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22ba expref: 19 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.125269:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fffb400/0xe984082ccd726c96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22ba expref: 19 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.125280:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.125282:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.125288:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4600/0xe984082ccd726cff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22e4 expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.125301:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4600/0xe984082ccd726cff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22e4 expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.125329:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4600/0xe984082ccd726cff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22e4 expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143703.125439:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593808384:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143703.125640:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:28696:x1830963592457344:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4133us (4662us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143703.125647:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10074 00000100:00100000:3.0:1746143703.125663:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143703.129212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143703.129310:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592457600 00000100:00100000:2.0:1746143703.129320:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592457600 00000100:00100000:2.0:1746143703.129368:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10075 00000100:00100000:2.0:1746143703.129375:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:28696:x1830963592457600:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143703.129395:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143703.129414:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5a00/0xe984082ccd726d06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a22eb expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.129443:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fffbe00/0xe984082ccd726ca4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c1 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143703.129451:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.129453:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.129456:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5a00/0xe984082ccd726d06 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22eb expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.129485:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fffbe00/0xe984082ccd726ca4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c1 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143703.129497:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fffbe00/0xe984082ccd726ca4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c1 expref: 19 pid: 25369 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746143703.129509:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593808512:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143703.129581:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143703.129797:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593808384:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143703.129813:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143703.129917:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592457472:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4719us (5198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143703.129926:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5218 00000100:00100000:0.0:1746143703.132596:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143703.132800:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592457728 00000100:00100000:3.0:1746143703.132809:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592457728 00010000:00010000:3.0:1746143703.132844:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fffbe00/0xe984082ccd726ca4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c1 expref: 19 pid: 25369 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746143703.132888:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5219 00000100:00100000:3.0:1746143703.132895:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963592457728:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143703.132908:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143703.132931:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fffbe00/0xe984082ccd726ca4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c1 expref: 19 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.132948:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fffbe00/0xe984082ccd726ca4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c1 expref: 19 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.132988:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.132990:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.132998:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5a00/0xe984082ccd726d06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22eb expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.133006:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5a00/0xe984082ccd726d06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22eb expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.133039:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5a00/0xe984082ccd726d06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22eb expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143703.133052:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593808640:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143703.133246:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fffbe00/0xe984082ccd726ca4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c1 expref: 19 pid: 25369 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746143703.133263:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593808512:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143703.133291:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5a00/0xe984082ccd726d06 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22eb expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.133300:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f5a00, rc 0) 00000100:00100000:0.0:1746143703.134417:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:28696:x1830963592457600:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5037us (5213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143703.134427:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10075 00000100:00100000:3.0:1746143703.135537:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143703.136780:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143703.136869:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593808640:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143703.136888:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143703.136931:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963592457728:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4035us (4343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143703.136942:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5219 00000100:00100000:1.0:1746143703.137316:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592457856 00000100:00100000:1.0:1746143703.137324:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592457856 00000100:00100000:1.0:1746143703.137355:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10076 00000100:00100000:1.0:1746143703.137362:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28696:x1830963592457856:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143703.137384:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143703.137402:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd726d0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a22f2 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.137430:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fffb200/0xe984082ccd726c9d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c8 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143703.137437:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143703.137439:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143703.137442:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd726d0d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22f2 expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143703.137472:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fffb200/0xe984082ccd726c9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c8 expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143703.137482:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fffb200/0xe984082ccd726c9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c8 expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00000100:00100000:1.0:1746143703.137493:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593808768:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143703.137557:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136801600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143703.140799:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143703.141059:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593808768:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143703.141092:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd726d0d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22f2 expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.141111:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d510600, rc 0) 00000100:00100000:2.0:1746143703.141180:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28696:x1830963592457856:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3818us (4406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143703.141189:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10076 00000100:00100000:3.0:1746143703.141977:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592457984 00000100:00100000:3.0:1746143703.141984:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592457984 00010000:00010000:3.0:1746143703.142012:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fffb200/0xe984082ccd726c9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c8 expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746143703.142048:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5220 00000100:00100000:3.0:1746143703.142055:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592457984:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143703.142069:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143703.142091:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fffb200/0xe984082ccd726c9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c8 expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.142102:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fffb200/0xe984082ccd726c9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c8 expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.142124:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fffb200/0xe984082ccd726c9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22c8 expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.142178:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.142180:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.142188:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd726d0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22f2 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.142195:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd726d0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22f2 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.142225:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd726d0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22f2 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143703.142236:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593808896:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143703.142305:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143703.144574:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593808896:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143703.144595:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143703.144637:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592457984:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2581us (3847us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143703.144648:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5220 00000100:00100000:0.0:1746143703.144877:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143703.145025:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592458112 00000100:00100000:3.0:1746143703.145031:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592458112 00000100:00100000:3.0:1746143703.145060:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10077 00000100:00100000:3.0:1746143703.145066:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:28696:x1830963592458112:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143703.145085:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143703.145101:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b873000/0xe984082ccd726d14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a22f9 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.145128:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fffbc00/0xe984082ccd726cab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22cf expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143703.145571:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.145573:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.145578:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b873000/0xe984082ccd726d14 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22f9 expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.145606:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fffbc00/0xe984082ccd726cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22cf expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143703.145619:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fffbc00/0xe984082ccd726cab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22cf expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746143703.145631:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593809024:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143703.146537:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143703.149703:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963593809024:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143703.149740:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b873000/0xe984082ccd726d14 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22f9 expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.149775:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b873000, rc 0) 00000100:00100000:0.0:1746143703.150430:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143703.150644:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:28696:x1830963592458112:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5575us (5766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143703.150654:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10077 00000100:00100000:3.0:1746143703.150710:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592458240 00000100:00100000:3.0:1746143703.150717:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592458240 00010000:00010000:3.0:1746143703.150744:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fffbc00/0xe984082ccd726cab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22cf expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746143703.150779:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5221 00000100:00100000:3.0:1746143703.150787:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592458240:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143703.150802:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143703.150830:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fffbc00/0xe984082ccd726cab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22cf expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.150842:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fffbc00/0xe984082ccd726cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22cf expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.150867:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fffbc00/0xe984082ccd726cab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22cf expref: 21 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.150889:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.150891:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.150898:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b873000/0xe984082ccd726d14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22f9 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.150906:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b873000/0xe984082ccd726d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22f9 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.150937:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b873000/0xe984082ccd726d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22f9 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143703.150949:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593809152:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143703.152258:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143703.155266:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143703.155589:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592458368 00000100:00100000:2.0:1746143703.155600:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592458368 00000100:00100000:3.0:1746143703.155727:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963593809152:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143703.155748:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143703.155805:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592458240:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5018us (5376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143703.155815:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5221 00000100:00100000:2.0:1746143703.156488:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10078 00000100:00100000:2.0:1746143703.156497:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:28696:x1830963592458368:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143703.156516:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143703.156534:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4c00/0xe984082ccd726d1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2300 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.156565:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd726cb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22d6 expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143703.156573:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.156575:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143703.156578:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4c00/0xe984082ccd726d1b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2300 expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.156609:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd726cb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22d6 expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143703.156620:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd726cb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22d6 expref: 18 pid: 25369 timeout: 882 lvb_type: 1 00000100:00100000:2.0:1746143703.156634:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593809280:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143703.156704:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143703.160370:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143703.160614:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963593809280:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143703.160648:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4c00/0xe984082ccd726d1b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2300 expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.160666:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f4c00, rc 0) 00000100:00100000:2.0:1746143703.160716:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:28696:x1830963592458368:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4221us (5459us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143703.160725:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10078 00000100:00100000:3.0:1746143703.160917:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592458496 00000100:00100000:3.0:1746143703.160924:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592458496 00010000:00010000:3.0:1746143703.160953:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd726cb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22d6 expref: 18 pid: 25369 timeout: 882 lvb_type: 1 00000100:00100000:3.0:1746143703.160977:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5222 00000100:00100000:3.0:1746143703.160984:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592458496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143703.160998:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143703.161022:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd726cb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22d6 expref: 18 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.161032:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd726cb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22d6 expref: 18 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.161056:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd726cb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22d6 expref: 18 pid: 25369 timeout: 882 lvb_type: 1 00010000:00010000:3.0:1746143703.161069:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.161070:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143703.161077:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4c00/0xe984082ccd726d1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2300 expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.161085:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4c00/0xe984082ccd726d1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2300 expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143703.161116:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f8f4c00/0xe984082ccd726d1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2300 expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143703.161135:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593809408:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143703.161206:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143703.163522:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963593809408:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143703.163542:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143703.163579:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963592458496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2594us (3218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143703.163589:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5222 00000100:00100000:0.0:1746143703.164442:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143703.164507:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143703.164520:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143703.164538:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592458624 00000100:00100000:0.0:1746143703.164544:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592458624 00000100:00100000:2.0:1746143703.164720:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143703.164816:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592458880 00000100:00100000:0.0:1746143703.164820:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592458880 00000100:00100000:0.0:1746143703.164836:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592459136 00000100:00100000:0.0:1746143703.164838:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592459136 00000100:00100000:0.0:1746143703.164847:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592458752 00000100:00100000:0.0:1746143703.164849:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592458752 00000100:00100000:0.0:1746143703.164861:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10079 00000100:00100000:0.0:1746143703.164867:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592458624:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:2.0:1746143703.165045:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10080 00000100:00100000:2.0:1746143703.165052:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963592458880:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:1.0:1746143703.165125:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10081 00000100:00100000:1.0:1746143703.165133:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963592459136:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:2.0:1746143703.165249:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143703.165253:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143698 -> 1746143701 00002000:00010000:2.0:1746143703.165255:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143698 -> 1746143701 00002000:00010000:2.0:1746143703.165257:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143698 -> 1746143702 00002000:00010000:1.0:1746143703.165257:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:2.0:1746143703.165260:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746143703.165260:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143699 -> 1746143701 00002000:00010000:1.0:1746143703.165262:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143699 -> 1746143701 00002000:00010000:1.0:1746143703.165264:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143699 -> 1746143702 00002000:00010000:1.0:1746143703.165266:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5543 -> 5543 00000100:00100000:3.0:1746143703.165378:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10082 00000100:00100000:3.0:1746143703.165385:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592458752:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143703.165456:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143703.165458:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143697 -> 1746143701 00002000:00010000:3.0:1746143703.165460:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143695 -> 1746143701 00002000:00010000:3.0:1746143703.165462:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143697 -> 1746143702 00002000:00010000:3.0:1746143703.165463:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:0.0:1746143703.165747:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143703.165750:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143701 -> 1746143701 00002000:00010000:0.0:1746143703.165753:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143695 -> 1746143701 00002000:00010000:0.0:1746143703.165754:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143701 -> 1746143702 00002000:00010000:0.0:1746143703.165766:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2053 -> 2053 00000100:00100000:2.0:1746143703.165979:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592458880:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 928us (1470us total) trans 21474839803 rc 0/0 00000100:00100000:2.0:1746143703.165985:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10080 00000100:00100000:1.0:1746143703.166009:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592459136:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 876us (1486us total) trans 17179872539 rc 0/0 00000100:00100000:1.0:1746143703.166015:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10081 00000100:00100000:2.0:1746143703.166023:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143703.166062:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592458752:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 678us (1343us total) trans 21474839804 rc 0/0 00000100:00100000:3.0:1746143703.166067:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10082 00000100:00100000:2.0:1746143703.166162:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143703.166190:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592458624:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 1323us (1751us total) trans 17179872540 rc 0/0 00000100:00100000:0.0:1746143703.166195:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10079 00000100:00100000:3.0:1746143703.166223:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592459008 00000100:00100000:3.0:1746143703.166227:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592459008 00000100:00100000:3.0:1746143703.166248:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10083 00000100:00100000:3.0:1746143703.166252:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963592459008:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143703.166315:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143703.166317:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143698 -> 1746143701 00002000:00010000:3.0:1746143703.166318:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143698 -> 1746143701 00002000:00010000:3.0:1746143703.166320:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143698 -> 1746143702 00002000:00010000:3.0:1746143703.166322:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746143703.166336:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963592459008:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 84us (312us total) trans 17179872541 rc 0/0 00000100:00100000:3.0:1746143703.166340:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10083 00000100:00100000:2.0:1746143703.166513:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592459264 00000100:00100000:2.0:1746143703.166516:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592459264 00000100:00100000:2.0:1746143703.166530:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 10084 00000100:00100000:2.0:1746143703.166534:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963592459264:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:2.0:1746143703.166599:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143703.166601:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143701 -> 1746143701 00002000:00010000:2.0:1746143703.166604:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143701 -> 1746143701 00002000:00010000:2.0:1746143703.166605:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143701 -> 1746143702 00002000:00010000:2.0:1746143703.166607:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746143703.166619:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963592459264:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 85us (458us total) trans 21474839805 rc 0/0 00000100:00100000:2.0:1746143703.166623:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 10084 00000100:00100000:0.0:1746143703.169711:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143703.169863:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592459520 00000100:00100000:2.0:1746143703.169872:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592459520 00000100:00100000:2.0:1746143703.169928:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3432 00000100:00100000:2.0:1746143703.169936:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a8f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28696:x1830963592459520:12345-192.168.202.48@tcp:35:lfs.0 00000004:00010000:2.0:1746143703.170000:0:14766:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x2d6:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b89fc00/0xe984082ccd726c3b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a229e expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.170049:0:14766:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14766 initiator: MDT0 00010000:00010000:2.0:1746143703.170061:0:14766:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd726c7a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22a5 expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.170068:0:14766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14766 initiator: MDT0 00010000:00010000:2.0:1746143703.170104:0:14766:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd726c7a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22a5 expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143703.170114:0:14766:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd726c7a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22a5 expref: 243 pid: 21713 timeout: 882 lvb_type: 0 00000100:00100000:2.0:1746143703.170222:0:14766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14766:1830963593809536:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143703.170925:0:14766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143703.173309:0:14766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14766:1830963593809536:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143703.173336:0:14766:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14766 initiator: MDT0 00000100:00100000:0.0:1746143703.173442:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143703.173535:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592459648 00000100:00100000:3.0:1746143703.173543:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592459648 00010000:00010000:3.0:1746143703.173574:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd726c7a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22a5 expref: 244 pid: 21713 timeout: 882 lvb_type: 0 00000100:00100000:3.0:1746143703.173605:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5223 00000100:00100000:3.0:1746143703.173611:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:1964:x1830963592459648:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143703.173624:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143703.173628:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd726c7a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22a5 expref: 244 pid: 21713 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746143703.173638:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd726c7a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22a5 expref: 244 pid: 21713 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746143703.173658:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd726c7a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a22a5 expref: 244 pid: 21713 timeout: 882 lvb_type: 0 00010000:00010000:3.0:1746143703.173682:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:3.0:1746143703.173686:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14766 initiator: MDT0 00010000:00010000:3.0:1746143703.173695:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14766 initiator: MDT0 00010000:00010000:3.0:1746143703.173701:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14766 initiator: MDT0 00010000:00010000:3.0:1746143703.173717:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143703.173771:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1964:x1830963592459648:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 159us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143703.173777:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5223 00010000:00010000:2.0:1746143703.174018:0:14766:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14766 initiator: MDT0 00010000:00010000:2.0:1746143703.174025:0:14766:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14766 initiator: MDT0 00000040:00080000:2.0:1746143703.174672:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2340, 88 off196872 00000004:00080000:2.0:1746143703.174681:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782184541209ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143703.174710:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2282, 88 off191584 00000004:00080000:2.0:1746143703.174714:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782184574146ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143703.174725:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2283, 88 off191672 00000004:00080000:2.0:1746143703.174728:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782184588678ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143703.174734:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2341, 88 off196960 00000004:00080000:2.0:1746143703.174736:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782184596691ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143703.174742:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2342, 88 off197048 00000004:00080000:2.0:1746143703.174745:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782184604956ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143703.174750:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2284, 88 off191760 00000004:00080000:2.0:1746143703.174752:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782184612743ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143703.174769:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2285, 88 off191848 00000004:00080000:2.0:1746143703.174771:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782184631631ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143703.174777:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2286, 88 off191936 00000004:00080000:2.0:1746143703.174779:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782184639841ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143703.174785:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2343, 88 off197136 00000004:00080000:2.0:1746143703.174789:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782184649043ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143703.174794:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2287, 88 off192024 00000004:00080000:2.0:1746143703.174797:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782184657863ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143703.174802:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2344, 88 off197224 00000004:00080000:2.0:1746143703.174805:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782184665301ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143703.174810:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2288, 88 off192112 00000004:00080000:2.0:1746143703.174812:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782184672616ns, next at 718087967394ns, rc = 0 00000040:00080000:2.0:1746143703.174818:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2345, 88 off197312 00000004:00080000:2.0:1746143703.174820:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782184680318ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143703.174825:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2346, 88 off197400 00000004:00080000:2.0:1746143703.174828:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782184688399ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143703.174833:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2347, 88 off197488 00000004:00080000:2.0:1746143703.174835:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782184695521ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143703.174840:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2348, 88 off197576 00000004:00080000:2.0:1746143703.174843:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782184703431ns, next at 758183694006ns, rc = 0 00000040:00080000:2.0:1746143703.174849:0:14766:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2289, 88 off192200 00000004:00080000:2.0:1746143703.174852:0:14766:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782184711981ns, next at 718087967394ns, rc = 0 00000004:00080000:3.0:1746143703.183986:0:14801:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 782193843514ns, next at 783193841429ns, rc = 0 00000100:00100000:3.0:1746143703.184005:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746143703.184024:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593809664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746143703.184089:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143703.184238:0:8499:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593809664 00000100:00100000:1.0:1746143703.184246:0:8499:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593809664 00000100:00100000:1.0:1746143703.184287:0:8499:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1746143703.184294:0:8499:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963593809664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746143703.184332:0:8499:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 206503936 pending 0 free 3852468224 avail 3850371072 00000100:00100000:1.0:1746143703.184368:0:8499:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963593809664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143703.184374:0:8499:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1746143703.184531:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593809664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746143703.198572:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1830963593810048:0@lo:400:kworker.0 00000100:00100000:0.0:1746143703.198590:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b20e2be-dc58-49ff-81b7-9c0574412294:3294:1830963593809792:0@lo:400:kworker.0 00000100:00100000:0.0:1746143703.198677:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143703.198678:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143703.198707:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593810176:0@lo:400:kworker.0 00000100:00100000:0.0:1746143703.198718:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830963593810304:0@lo:400:kworker.0 00000100:00100000:1.0:1746143703.198730:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143703.198744:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143703.198778:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746143703.198779:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593810048 00000100:00100000:0.0:1746143703.198783:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1830963593809920:0@lo:400:kworker.0 00000100:00100000:1.0:1746143703.198789:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593810048 00000100:00100000:0.0:1746143703.198802:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143703.198830:0:14761:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593809792 00000100:00100000:1.0:1746143703.198835:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593810304 00000100:00100000:0.0:1746143703.198835:0:14761:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593809792 00000100:00100000:1.0:1746143703.198837:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593810304 00000100:00100000:1.0:1746143703.198849:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593809920 00000100:00100000:1.0:1746143703.198851:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593809920 00000100:00100000:1.0:1746143703.198869:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1746143703.198869:0:14761:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1746143703.198876:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1830963593810048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143703.198876:0:14761:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c23d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3294:x1830963593809792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143703.198918:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1830963593810048:12345-0@lo:400:kworker.0 Request processed in 42us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143703.198922:0:14761:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c23d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3294:x1830963593809792:12345-0@lo:400:kworker.0 Request processed in 46us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143703.198924:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1746143703.198929:0:14761:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1746143703.198938:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1746143703.198942:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830963593810304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143703.198951:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593810176 00000100:00100000:0.0:1746143703.198954:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593810176 00000100:00100000:1.0:1746143703.198964:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830963593810304:12345-0@lo:400:kworker.0 Request processed in 21us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143703.198968:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1746143703.198969:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1746143703.198972:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963593810176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143703.198977:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1746143703.198981:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830963593809920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143703.199003:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963593810176:12345-0@lo:400:kworker.0 Request processed in 30us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143703.199006:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830963593809920:12345-0@lo:400:kworker.0 Request processed in 24us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143703.199008:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1746143703.199011:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1746143703.199022:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143703.199066:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593810176:0@lo:400:kworker.0 00000100:00100000:0.0:1746143703.199095:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1830963593810048:0@lo:400:kworker.0 00000100:00100000:0.0:1746143703.199127:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1830963593809920:0@lo:400:kworker.0 00000100:00100000:0.0:1746143703.199133:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b20e2be-dc58-49ff-81b7-9c0574412294:3294:1830963593809792:0@lo:400:kworker.0 00000100:00100000:0.0:1746143703.199160:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830963593810304:0@lo:400:kworker.0 00000004:00080000:3.0:1746143703.213386:0:14805:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 782223244007ns, next at 783223242777ns, rc = 0 00000100:00100000:0.0:1746143703.213464:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593810432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143703.213517:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143703.213816:0:8498:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593810432 00000100:00100000:3.0:1746143703.213822:0:8498:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593810432 00000100:00100000:3.0:1746143703.213852:0:8498:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1746143703.213858:0:8498:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593810432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746143703.213887:0:8498:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 216465408 pending 0 free 3849322496 avail 3847225344 00000100:00100000:3.0:1746143703.213932:0:8498:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963593810432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143703.213938:0:8498:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1746143703.213964:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593810432:0@lo:13:osp-pre-1-0.0 00000004:00010000:2.0:1746143703.216311:0:14766:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a5a8f450 reply state ffff88012e371000 transno 8589942513 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14766 initiator: MDT0 00000100:00100000:2.0:1746143703.216321:0:14766:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746143703.216328:0:14766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:2.0:1746143703.216331:0:14766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143703.216337:0:14766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b89fc00/0xe984082ccd726c3b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a229e expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746143703.216414:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942512 is committed 00000100:00100000:2.0:1746143703.216415:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a8f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:28696:x1830963592459520:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 46479us (46712us total) trans 8589942513 rc 0/0 00000100:00100000:2.0:1746143703.216423:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3432 00000001:00080000:3.0:1746143703.216427:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589942513 is committed 00000004:00080000:3.0:1746143703.216431:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1634 committed 00000004:00080000:3.0:1746143703.216438:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1692 committed 00000004:00080000:3.0:1746143703.216443:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1691 committed 00000004:00080000:3.0:1746143703.216444:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1690 committed 00000004:00080000:3.0:1746143703.216446:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1689 committed 00000004:00080000:3.0:1746143703.216447:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1633 committed 00000004:00080000:3.0:1746143703.216448:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1688 committed 00000004:00080000:3.0:1746143703.216450:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1632 committed 00000004:00080000:3.0:1746143703.216451:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1687 committed 00000004:00080000:3.0:1746143703.216453:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1631 committed 00000004:00080000:3.0:1746143703.216454:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1630 committed 00000004:00080000:3.0:1746143703.216456:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1629 committed 00000004:00080000:3.0:1746143703.216458:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1686 committed 00000004:00080000:3.0:1746143703.216459:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1685 committed 00000004:00080000:3.0:1746143703.216462:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1628 committed 00000004:00080000:3.0:1746143703.216463:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1627 committed 00000004:00080000:3.0:1746143703.216465:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1684 committed 00000100:00100000:2.0:1746143703.216531:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593810944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143703.216543:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593810560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143703.216559:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143703.216579:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593811456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143703.216581:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143703.216592:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143703.216597:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593811072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143703.216602:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746143703.216606:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593810816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143703.216610:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143703.216618:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143703.216624:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746143703.216628:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593810688:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143703.216628:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593811328:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143703.216639:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143703.216650:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593810944 00000100:00100000:3.0:1746143703.216653:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593810944 00000100:00100000:2.0:1746143703.216658:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593810560 00000100:00100000:2.0:1746143703.216661:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593810560 00000100:00100000:3.0:1746143703.216672:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593811456 00000100:00100000:3.0:1746143703.216674:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593811456 00000100:00100000:2.0:1746143703.216675:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593811072 00000100:00100000:2.0:1746143703.216677:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593811072 00000100:00100000:3.0:1746143703.216684:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593810816 00000100:00100000:3.0:1746143703.216685:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593810816 00000100:00100000:2.0:1746143703.216687:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593811328 00000100:00100000:2.0:1746143703.216689:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593811328 00000100:00100000:3.0:1746143703.216696:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10085 00000100:00100000:3.0:1746143703.216701:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3295:x1830963593810944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143703.216860:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143703.216863:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb mtime from disk: 1746143639 -> 1746143639 00002000:00010000:3.0:1746143703.216865:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb atime from disk: 1746143639 -> 1746143639 00002000:00010000:3.0:1746143703.216866:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb ctime from disk: 1746143639 -> 1746143639 00002000:00010000:3.0:1746143703.216868:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x349:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:1.0:1746143703.216893:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14766 initiator: MDT0 00000100:00100000:3.0:1746143703.216900:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3295:x1830963593810944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 198us (340us total) trans 21474839806 rc 0/0 00010000:00010000:1.0:1746143703.216900:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14766 initiator: MDT0 00010000:00010000:1.0:1746143703.216906:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14766 initiator: MDT0 00010000:00010000:1.0:1746143703.216914:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f8f4000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143703.216918:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14766 initiator: MDT0 00010000:00010000:1.0:1746143703.216924:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14766 initiator: MDT0 00010000:00010000:1.0:1746143703.216935:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff880094924800) 00010000:00010000:1.0:1746143703.216937:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143703.216939:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14766 initiator: MDT0 00010000:00010000:1.0:1746143703.216944:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd726d22 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14766 initiator: MDT0 00000100:00100000:0.0:1746143703.217044:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593811712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143703.217066:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143703.217076:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593812224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143703.217086:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143703.217093:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143703.217096:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593811584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143703.217107:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143703.217113:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593812096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143703.217123:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143703.217208:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593811712 00000100:00100000:0.0:1746143703.217214:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593811712 00000100:00100000:2.0:1746143703.217792:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593812224 00000100:00100000:2.0:1746143703.217795:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593812224 00000100:00100000:2.0:1746143703.217805:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593811584 00000100:00100000:2.0:1746143703.217807:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593811584 00000100:00100000:2.0:1746143703.217813:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593812096 00000100:00100000:2.0:1746143703.217814:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593812096 00000100:00100000:2.0:1746143703.217821:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10086 00000100:00100000:2.0:1746143703.217826:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963593810560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143703.217912:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143703.217915:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb mtime from disk: 1746143701 -> 1746143701 00002000:00010000:2.0:1746143703.217917:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb atime from disk: 1746143701 -> 1746143701 00002000:00010000:2.0:1746143703.217918:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb ctime from disk: 1746143702 -> 1746143702 00002000:00010000:2.0:1746143703.217920:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34a:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746143703.217943:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963593810560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (1362us total) trans 21474839807 rc 0/0 00000100:00100000:2.0:1746143703.217948:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10086 00000100:00100000:2.0:1746143703.217957:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10087 00000100:00100000:2.0:1746143703.217961:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3295:x1830963593811456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143703.218028:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963593811456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1435us total) trans 21474839808 rc 0/0 00000100:00100000:2.0:1746143703.218033:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10087 00000100:00100000:2.0:1746143703.218044:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10088 00000100:00100000:2.0:1746143703.218048:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963593811072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143703.218118:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963593811072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1506us total) trans 21474839809 rc 0/0 00000100:00100000:2.0:1746143703.218123:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10088 00000100:00100000:2.0:1746143703.218131:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10089 00000100:00100000:2.0:1746143703.218136:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3295:x1830963593810816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143703.218209:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143703.218212:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb mtime from disk: 1746143701 -> 1746143701 00002000:00010000:2.0:1746143703.218214:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb atime from disk: 1746143701 -> 1746143701 00002000:00010000:2.0:1746143703.218216:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb ctime from disk: 1746143702 -> 1746143702 00002000:00010000:2.0:1746143703.218217:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34c:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746143703.218234:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963593810816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (1615us total) trans 21474839810 rc 0/0 00000100:00100000:2.0:1746143703.218239:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10089 00000100:00100000:2.0:1746143703.218249:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10090 00000100:00100000:2.0:1746143703.218253:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3295:x1830963593811328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143703.218315:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963593811328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (1674us total) trans 21474839811 rc 0/0 00000100:00100000:2.0:1746143703.218320:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10090 00000100:00100000:2.0:1746143703.218328:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10091 00000100:00100000:2.0:1746143703.218331:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3293:x1830963593812224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143703.218420:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3293:x1830963593812224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (1332us total) trans 17179872542 rc 0/0 00000100:00100000:2.0:1746143703.218425:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10091 00000100:00100000:2.0:1746143703.218433:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10092 00000100:00100000:2.0:1746143703.218437:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3293:x1830963593811584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143703.218499:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143703.218501:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb mtime from disk: 1746143701 -> 1746143701 00002000:00010000:2.0:1746143703.218503:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb atime from disk: 1746143701 -> 1746143701 00002000:00010000:2.0:1746143703.218505:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb ctime from disk: 1746143702 -> 1746143702 00002000:00010000:2.0:1746143703.218507:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34c:0x0] updating lvb blocks from disk: 2053 -> 2053 00000100:00100000:2.0:1746143703.218522:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3293:x1830963593811584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (1414us total) trans 17179872543 rc 0/0 00000100:00100000:2.0:1746143703.218527:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10092 00000100:00100000:2.0:1746143703.218535:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10093 00000100:00100000:2.0:1746143703.218538:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3293:x1830963593812096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143703.218545:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10085 00000100:00100000:3.0:1746143703.218574:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143703.218593:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593811200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143703.218600:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3293:x1830963593812096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (1475us total) trans 17179872544 rc 0/0 00000100:00100000:2.0:1746143703.218605:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10093 00000100:00100000:3.0:1746143703.218612:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143703.218612:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593810688 00000100:00100000:2.0:1746143703.218614:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593810688 00000100:00100000:2.0:1746143703.218624:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593811200 00000100:00100000:2.0:1746143703.218626:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593811200 00000004:00080000:3.0:1746143703.218631:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1efb80/2, rc 0, transno 21474839807 00000100:00100000:2.0:1746143703.218633:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10094 00000100:00100000:3.0:1746143703.218635:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593810560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143703.218637:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963593810688:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143703.218641:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ef480/2, rc 0, transno 21474839809 00000100:00100000:3.0:1746143703.218644:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593811072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143703.218658:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10095 00000100:00100000:3.0:1746143703.218663:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963593811200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143703.218697:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143703.218699:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb mtime from disk: 1746143701 -> 1746143701 00002000:00010000:2.0:1746143703.218701:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb atime from disk: 1746143701 -> 1746143701 00002000:00010000:2.0:1746143703.218703:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb ctime from disk: 1746143702 -> 1746143702 00002000:00010000:2.0:1746143703.218705:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x34b:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746143703.218723:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963593810688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (148us total) trans 21474839812 rc 0/0 00000100:00100000:2.0:1746143703.218728:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10094 00000100:00100000:3.0:1746143703.218747:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963593811200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (133us total) trans 21474839813 rc 0/0 00000100:00100000:3.0:1746143703.218752:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10095 00000004:00080000:3.0:1746143703.218788:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ed180/2, rc 0, transno 21474839812 00000100:00100000:3.0:1746143703.218791:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593810688:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143703.218799:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1eea00/2, rc 0, transno 21474839813 00000100:00100000:3.0:1746143703.218802:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593811200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143703.218816:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593811968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143703.218835:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143703.218846:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593812480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143703.218858:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143703.218882:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ec380/2, rc 0, transno 21474839810 00000100:00100000:3.0:1746143703.218885:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593810816:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143703.218890:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1eca80/2, rc 0, transno 21474839811 00000100:00100000:3.0:1746143703.218893:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593811328:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143703.218900:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ece00/2, rc 0, transno 21474839808 00000100:00100000:3.0:1746143703.218903:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593811456:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143703.218909:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ed500/2, rc 0, transno 21474839806 00000100:00100000:3.0:1746143703.218911:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593810944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143703.218918:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746143703.218922:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593811840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143703.218936:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143703.218947:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593812352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143703.218959:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143703.218975:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593811968 00000100:00100000:3.0:1746143703.218978:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593811968 00000100:00100000:3.0:1746143703.218989:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593812480 00000100:00100000:3.0:1746143703.218990:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593812480 00000100:00100000:3.0:1746143703.218997:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593811840 00000100:00100000:3.0:1746143703.218998:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593811840 00000100:00100000:3.0:1746143703.219023:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593812352 00000100:00100000:3.0:1746143703.219025:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593812352 00000100:00100000:3.0:1746143703.219033:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10096 00000100:00100000:3.0:1746143703.219037:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963593811968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143703.219098:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10097 00000100:00100000:1.0:1746143703.219105:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963593812480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143703.219204:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963593812480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (344us total) trans 17179872545 rc 0/0 00000100:00100000:1.0:1746143703.219209:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10097 00000100:00100000:1.0:1746143703.219220:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10098 00000100:00100000:1.0:1746143703.219224:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963593811840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143703.219278:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963593811968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 239us (441us total) trans 17179872546 rc 0/0 00000100:00100000:3.0:1746143703.219284:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10096 00002000:00010000:1.0:1746143703.219284:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb size from disk: 4897312 -> 4897312 00002000:00010000:1.0:1746143703.219286:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb mtime from disk: 1746143701 -> 1746143701 00002000:00010000:1.0:1746143703.219288:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb atime from disk: 1746143701 -> 1746143701 00002000:00010000:1.0:1746143703.219290:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb ctime from disk: 1746143702 -> 1746143702 00002000:00010000:1.0:1746143703.219291:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34f:0x0] updating lvb blocks from disk: 5543 -> 5543 00000100:00100000:3.0:1746143703.219295:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10099 00000100:00100000:3.0:1746143703.219299:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963593812352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143703.219308:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963593811840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (371us total) trans 17179872547 rc 0/0 00000100:00100000:1.0:1746143703.219313:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10098 00000004:00080000:1.0:1746143703.219335:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd4380/2, rc 0, transno 17179872547 00000100:00100000:1.0:1746143703.219341:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593811840:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143703.219348:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f03100/2, rc 0, transno 17179872546 00000100:00100000:1.0:1746143703.219351:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593811968:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143703.219356:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f02d80/2, rc 0, transno 17179872545 00000100:00100000:1.0:1746143703.219359:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593812480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143703.219385:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963593812352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (423us total) trans 17179872548 rc 0/0 00000100:00100000:3.0:1746143703.219393:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10099 00000100:00100000:1.0:1746143703.219393:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593812608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143703.219409:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143703.219422:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593812608 00000100:00100000:3.0:1746143703.219425:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593812608 00000004:00080000:1.0:1746143703.219429:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f01f80/2, rc 0, transno 17179872548 00000100:00100000:1.0:1746143703.219432:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963593812352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143703.219436:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10100 00000100:00100000:3.0:1746143703.219440:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963593812608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143703.219519:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3292:x1830963593812608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (108us total) trans 17179872549 rc 0/0 00000100:00100000:3.0:1746143703.219524:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10100 00000100:00100000:3.0:1746143703.219534:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10101 00000100:00100000:3.0:1746143703.219539:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3293:x1830963593811712:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143703.219558:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c12d80/2, rc 0, transno 17179872543 00000100:00100000:0.0:1746143703.219563:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593811584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143703.219569:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f03b80/2, rc 0, transno 17179872544 00000100:00100000:0.0:1746143703.219572:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593812096:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143703.219578:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f01880/2, rc 0, transno 17179872542 00000100:00100000:0.0:1746143703.219580:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593812224:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143703.219618:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143703.219621:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb mtime from disk: 1746143701 -> 1746143701 00002000:00010000:3.0:1746143703.219622:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb atime from disk: 1746143701 -> 1746143701 00002000:00010000:3.0:1746143703.219624:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb ctime from disk: 1746143702 -> 1746143702 00002000:00010000:3.0:1746143703.219625:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x34e:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746143703.219649:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3293:x1830963593811712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (2583us total) trans 17179872550 rc 0/0 00000100:00100000:3.0:1746143703.219653:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10101 00000100:00100000:1.0:1746143703.219703:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000004:00080000:1.0:1746143703.219723:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b852a00/2, rc 0, transno 17179872549 00000100:00100000:1.0:1746143703.219726:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963593812608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143703.219782:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592459776 00000100:00100000:0.0:1746143703.219785:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592459776 00000100:00100000:0.0:1746143703.219817:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8392 00000100:00100000:0.0:1746143703.219822:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:28696:x1830963592459776:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143703.219835:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143703.219847:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2da00/0xe984082ccd726d29 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a2307 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.219886:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2da00/0xe984082ccd726d29 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2307 expref: 241 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.219898:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2da00/0xe984082ccd726d29 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2307 expref: 241 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143703.219911:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d6:0x0].0x0 (ffff88009ba5a200) 00010000:00010000:0.0:1746143703.219913:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143703.219915:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2da00, rc 0) 00000100:00100000:0.0:1746143703.219939:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:28696:x1830963592459776:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 117us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143703.219944:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8392 00000004:00080000:0.0:1746143703.219963:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd7800/2, rc 0, transno 17179872550 00000100:00100000:0.0:1746143703.219967:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963593811712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143703.223863:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143703.224048:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963592460032 00000100:00100000:2.0:1746143703.224055:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963592460032 00000100:00100000:2.0:1746143703.224099:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3433 00000100:00100000:2.0:1746143703.224105:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:28696:x1830963592460032:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1746143703.224711:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:28696:x1830963592460032:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 604us (854us total) trans 8589942514 rc 0/0 00000100:00100000:2.0:1746143703.224717:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3433 00010000:00010000:2.0:1746143703.611562:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746143704.071113:0:758:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: final resync failed 00010000:00010000:0.0:1746143704.617985:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 69240 lines, 69240 kept, 0 dropped, 0 bad.